TRENDING: Grand Theft Auto 6 release date confirmed by Take-Two

Elon Musk's xAI to double Colossus AI supercomputer power to 200K NVIDIA Hopper AI GPUs

Elon Musk's xAI and its massive Colossus AI supercomputer is about to double its GPU power: from 100,000 NVIDIA Hopper AI GPUs to 200,000 Hopper AI GPUs.

Elon Musk's xAI to double Colossus AI supercomputer power to 200K NVIDIA Hopper AI GPUs
Comment IconFacebook IconX IconReddit Icon
Gaming Editor
Published
2 minutes read time
TL;DR: Elon Musk's xAI is upgrading its Colossus AI supercomputer from 100,000 to 200,000 NVIDIA Hopper AI GPUs. Colossus, the world's largest AI supercomputer, is used to train xAI's Grok LLMs, with chatbots available for X Premium subscribers.

Elon Musk's xAI startup is currently in the process of upgrading its Colossus AI supercomputer cluster from 100,000 NVIDIA Hopper AI GPUs, doubling it to an insane 200,000 NVIDIA Hopper AI GPUs.

Colossus is the world's largest AI supercomputer, and is using used to train xAI's Grok family of LLMs (large language models), with chatbots on offer for X Premium subscribers. Elon's massive xAI Colossus supercomputer cluster facility was recently toured (more on that in the links below) and took just 122 days to complete, something NVIDIA CEO Jensen Huang recently called Elon Musk "superhuman" because of it.

NVIDIA recently posted some content explaining its partnership with Elon and xAI, with the company explaining: "The supporting facility and state-of-the-art supercomputer was built by xAI and NVIDIA in just 122 days, instead of the typical timeframe for systems of this size that can take many months to years. It took 19 days from the time the first rack rolled onto the floor until training began".

"While training the extremely large Grok model, Colossus achieves unprecedented network performance. Across all three tiers of the network fabric, the system has experienced zero application latency degradation or packet loss due to flow collisions. It has maintained 95% data throughput enabled by Spectrum-X congestion control. This level of performance cannot be achieved at scale with standard Ethernet, which creates thousands of flow collisions while delivering only 60% data throughput".

Gilad Shainer, senior vice president of networking at NVIDIA explains: "AI is becoming mission-critical and requires increased performance, security, scalability and cost-efficiency. The NVIDIA Spectrum-X Ethernet networking platform is designed to provide innovators such as xAI with faster processing, analysis and execution of AI workloads, and in turn accelerates the development, deployment and time to market of AI solutions".

Elon Musk explained on X: "Colossus is the most powerful training system in the world. Nice work by xAI team, NVIDIA and our many partners/suppliers".

An xAI spokesperson added: "xAI has built the world's largest, most-powerful supercomputer. NVIDIA's Hopper GPUs and Spectrum-X allow us to push the boundaries of training AI models at a massive-scale, creating a super-accelerated and optimized AI factory based on the Ethernet standard".

Photo of the NVIDIA H100 Hopper PCIe 80GB
Best Deals: NVIDIA H100 Hopper PCIe 80GB
Country flag Today 7 days ago 30 days ago
Loading... Loading...
Buy
* Prices last scanned on 11/9/2024 at 11:57 pm CST - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission from any sales.
Newsletter Subscription

Join the daily TweakTown Newsletter for a special insider look into new content and what is happening behind the scenes.

Gaming Editor

Email IconX IconLinkedIn Icon

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Related Topics

Newsletter Subscription