NVIDIA H100 AI GPUs inside of data centers use as much electricity as Guatemala and Lithuania

NVIDIA will have over 3.5 million H100 AI GPUs in 2024, using around 13,000 GWh of electricity per year, as much as countries like Guatemala/

2 minutes & 34 seconds read time

NVIDIA's current-gen H100 AI GPU is deployed across the world in countless data centers, supercomputers, and AI platforms... with over 3.5 million units expected to ship in 2024.

NVIDIA powers the Jupiter supercomputer with its new H200 AI GPU (source: NVIDIA)

NVIDIA powers the Jupiter supercomputer with its new H200 AI GPU (source: NVIDIA)

Market analysis source, Stock Talk, has published an estimated figure on the power consumption of all of these NVIDIA H100 AI GPUs in the wild. In the tweet, it said: "By next year, NVIDIA's ~3.5 million units of deployed H100 GPUs will consume a whopping 13,000 GWh of electricity annually, which is greater than the power consumption of some entire countries like Guatamela and Lithuania".

This is something we have heard before, where crypto mining installations were using as much power as countries, where I reported back in 2020 that one particular Bitcoin mining facility in Kazakhstan was using enough power for 180,000 homes. Another story in 2021 pointed to the fact that Bitcoin mining was using more electricity than countries like the Netherlands and Argentina.

NVIDIA's extensive market share (90%+) of the AI GPU business has seen its AI GPUs used across the planet, and that's just for the A100 and H100 AI GPUs. NVIDIA has its upcoming refreshed H200 AI GPU, and then in 2024 and beyond, we'll have the new Blackwell GPU architecture and B100 AI GPU to look forward to. B100 will have improved power consumption, and magnitudes more AI power up for grabs.

If the power numbers are bad right now, NVIDIA is expected to ship somewhere between 1.5 and 2 million new AI GPUs in 2024, so we should expect those power numbers and panic to skyrocket by 3x the power numbers in 2024 with all those new AI GPUs being turned on.

NVIDIA's Grace Hopper Superchips (GH200) will be powering the Jupiter supercomputer, which is located at the Forschungszentrum Jülich facility in Gemany, and acts as part of the EuroHPC Joint Undertaking and contracted to Eviden and ParTec. The new Jupiter supercomputer will be used for Material Science, Climate Research, Drug Discovery, and more

Inside the new Jupiter supercomputer, it defines a new class of supercomputers that are designed to propel AI for scientific discovery, with a huge 93 ExaFLOPS of AI performance thanks to its huge 24,000 x GH200 Grace Hopper Superchips, 1.0 EF delivered HPC performance, Quantum-2 InfiniBand, 1.2PB/sec of aggregate bandwidth, with 18.2mW of power consumption

Buy at Amazon

NVIDIA H100 80 GB Graphic Card PCIe HBM2e (NVIDIA H100 80 GB)

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 4/24/2024 at 2:45 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.
NEWS SOURCES:wccftech.com, twitter.com

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags