Global Giveaway - Win 1 of 3 ID-Cooling High-Performance Coolers, open worldwide until Dec 9

AI servers of the future: 'rack density' of 1000kW+ with NVIDIA's next-gen Rubin Ultra AI GPUs

Predictions on next-gen AI servers see NVIDIA's future-gen Rubin Ultra AI GPU architecture inside of next-gen AI server racks will use 1000kW+ of power.

AI servers of the future: 'rack density' of 1000kW+ with NVIDIA's next-gen Rubin Ultra AI GPUs
Comment IconFacebook IconX IconReddit Icon
Gaming Editor
Published
2 minutes read time
TL;DR: AI servers are projected to consume over 1000 kW of power due to NVIDIA's upcoming Rubin Ultra AI GPU and HBM4 memory. Current AI servers use 130-250 kW, but future models like Blackwell Ultra and Rubin AI servers will require 250-900 kW, with up to 576 GPUs per rack by 2026-2027.

AI servers of the future are expected to use over 1000 kW of power, with the rise of NVIDIA's next-gen Rubin Ultra AI GPU and its new HBM4 memory coming that will see a rise in power consumption of AI servers.

The current best AI servers and clusters with a rack density of 130 kW to 250 kW of power according to an analyst by data center firm Vertiv. But these numbers are going to skyrocket with Blackwell Ultra and Rubin AI servers using between 250 kW and 900 kW of power with up to 576 GPUs in a single rack expected in 2026-2027.

After that, NVIDIA will have its future-gen, beefed-up Rubin Ultra AI GPUs inside of new AI servers in 2028-2029+ that will use 1000 kW or more. Vertiv notes that "densification roadmaps point to extreme peak rack densities of 1mW+ resulting in estimated new build average rack density increasing across varying workloads applications and market segments".

Rewinding the clock back to just 4 years ago, in 2020 the average rack density was rated at around 8.2 kW, but with the insatiable demand of AI, that power consumption has skyrocketed to the likes of 132 kW with NVIDIA's new GB200 NVL72 AI cabinet, which is the highest power-consuming server in history.

NVIDIA's next-gen Rubin and Rubin Ultra AI GPUs are going to be quite exciting, with the new Rubin AI GPU architecture and future-gen HBM4 memory, which you can read more about here.

Photo of the ASUS TUF Gaming GeForce RTX 4090 OG OC Edition
Best Deals: ASUS TUF Gaming GeForce RTX 4090 OG OC Edition
Country flag Today 7 days ago 30 days ago
Loading... Loading...
Buy
* Prices last scanned on 12/4/2024 at 11:47 pm CST - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission from any sales.
NEWS SOURCE:wccftech.com

Gaming Editor

Email IconX IconLinkedIn Icon

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Related Topics

Newsletter Subscription