A analysis undertaking performed by Columbia College professors on GPU servers positioned greater than 5,000 miles away in Paraguay has produced outcomes that HIVE Digital Applied sciences (Nasdaq: HIVE) is searching for as a proof of idea for future distributed AI infrastructure.
HIVE Digital, a publicly traded information middle and digital asset mining firm based in 2017 and traded on each the TSX and Nasdaq, introduced on June 22 that it has accomplished its first AI analysis collaboration with Columbia College's Division of Industrial Engineering and Operations Analysis.
The analysis was offered on the Neural Info Processing Techniques Convention (NeurIPS), one of many world's most influential machine studying conferences together with ICLR and ICML.
What the analysis truly discovered
Working from New York Metropolis, the Colombian staff remotely ran iterative AI coaching experiments on HIVE's A40 GPU cluster in Asunción, Paraguay.
The analysis targeted on pre-training neural networks, the elemental course of by which large-scale AI fashions be taught from information earlier than being fine-tuned for a selected job.
Headline discovery is necessary. After two months of particular code optimizations for HIVE's A40 {hardware}, Columbia researchers discovered they matched the efficiency of Nvidia's H100 GPU, a more moderen and significantly costlier era of chips that’s broadly thought of the gold customary for AI coaching workloads.
Comparisons have been made after normalizing the uncooked efficiency of every {hardware} platform.
The staff additionally ran customary benchmarks on the LLaMA mannequin as a part of their analysis, testing service throughput and latency on the 1.4 billion parameter language mannequin.
“For the use case of pre-training an LLM with as much as 1.4B parameters, the outcomes match the H100 outcomes after normalizing the uncooked efficiency of every {hardware},” mentioned Columbia researchers within the IEOR division.
“This analysis advances our understanding of contemporary neural community optimization, together with matrix-aware optimizers comparable to Muon and associated scale-invariant strategies.”
Trending on TheStreet Roundtable:
- Wall Avenue Analysts Predict 400% Rise in MicroStrategy Inventory
- Billionaire reveals Satoshi's shocking proposal on Bitcoin
- Mark Zuckerberg eyes new $1 billion market
Why Paraguay and what occurs subsequent?
The Asunción outcomes are presently serving as a efficiency baseline for a big infrastructure undertaking that HIVE is constructing in Iguazu, Paraguay. The corporate is constructing a 100-megawatt substation there, and civil works have already been accomplished.
The substation is scheduled to be energized in September 2026, and development of the brand new Tier-III information middle will start within the fall, with a goal service date of late 2027.
HIVE's wager on Paraguay is rooted within the nation's power profile. Low-cost and ample hydropower makes it a beautiful location for power-intensive computing workloads.
Frank Holmes, HIVE Government Director, mentioned: “Paraguay has energy, it has a strategic location, and now it proves it.”
“Excessive-performance computing doesn't should be restricted by geography. Our imaginative and prescient is to offer the fitting energy, information middle design, software program stack, and execution to allow Paraguay to take part straight within the world AI financial system by way of HIVE.”
HIVE’s broader story
When based in 2017, HIVE was one of many first publicly traded corporations to make use of inexperienced power to mine Bitcoin. We presently function Tier-I and Tier-III information facilities in Canada, Sweden, and Paraguay, serving each Bitcoin mining purchasers and excessive efficiency computing prospects.
The corporate has beforehand collaborated with Intel Company on customized mining {hardware}, making it one in every of Sweden's largest demand response contributors and serving to to steadiness the nationwide energy grid.
The collaboration with Columbia represents HIVE's clearest step but into AI infrastructure as a industrial enterprise line, shifting past crypto mining and into the broader marketplace for GPU computing.
”Innovation is in our DNA” mentioned Aydin Kilic, President and CEO of HIVE. ”We imagine that the way forward for AI in Paraguay is shiny. ”
Kilic added that good engineering supplies nice worth. He added that HIVE will proceed to take a position in the neighborhood whereas bringing developments in its expertise stack to information facilities around the globe.
