Elon Musk's xAI plans 10x expansion of Colossus AI cluster, with over 1 million AI GPUs

Elon Musk's xAI startup pledges to expand its Colossus AI supercomputer power by 10x where it will use more than 1 million AI GPUs at once.

Elon Musk's xAI plans 10x expansion of Colossus AI cluster, with over 1 million AI GPUs
Comment IconFacebook IconX IconReddit Icon
Gaming Editor
Published
2 minutes & 45 seconds read time

As an Amazon Associate, we earn from qualifying purchases. TweakTown may also earn commissions from other affiliate partners at no extra cost to you.

TL;DR: Elon Musk's xAI startup plans to expand its Colossus AI supercomputer by tenfold, reaching over 1 million GPUs. The expansion involves increasing the facility size in Memphis, Tennessee, with support from NVIDIA, Dell, and Supermicro. The project is costly, with significant expenses for GPUs, infrastructure, and operations.

Elon Musk's xAI startup has promised to expand its Colossus AI supercomputer by 10x its computational power, with over 1 million GPUs in total... yes, 1,000,000+ AI GPUs.

xAI built Colossus in just 3 months earlier this year, with the world's largest AI supercomputer featuring over 100,000 x NVIDIA IA GPUs operating at once, training Grok for X, and more. The expansion project has already started, with the first step being increasing the size of the facility in Memphis, Tennessee.

NVIDIA, Dell, and Supermicro are going to establish operations in Memphis in order to support xAI's extension of Colossus, while FT reports that the chamber of commerce saying that it would establish an "xAI special operations team" in order to "provide round-the-clock concierge service to the company".

The expansion up to over 1 million AI GPUs isn't going to be cheap, not by a long shot, as the new B200 and GB200 chips are expensive, and Elon was just provided with priority access to NVIDIA GB200 AI chips in January 2025 at a cost of $1.08 billion. But, for 1 million+ AI GPUs would be magnitudes more expensive: tens of billions of dollars.

Elon Musk's xAI plans 10x expansion of Colossus AI cluster, with over 1 million AI GPUs 51
2

It's not just the raw AI GPU costs, but the associated costs of expanding xAI's new Colossus supercomputer in terms of building it, powering it, and cooling the vast array of AI servers.