NVIDIA H100 AI GPU lead times improve: 4-month wait is now 2-3 month wait

NVIDIA's Hopper H100 AI GPU shortages are getting better: lead times are dropping from around 4 weeks, to AI GPU customers now waiting 8-12 weeks.

Published
Updated
1 minute & 50 seconds read time

NVIDIA's shortage of Hopper H100 AI GPUs is improving, with the previous 4-month wait now turning into 8-12 weeks.

NVIDIA H100 AI GPU lead times improve: 4-month wait is now 2-3 month wait 607

It was just a few months ago that we reported that NVIDIA AI GPU shipments had been "greatly accelerated," according to analysts, with waiting times of 8-11 months for AI GPU deliveries reduced to just 3-4 months. Now that 4-month wait, is a 2-3 month wait.

In a new report from TrendForce, Dell is reportedly capitalizing on AI, with Dell Taiwan's General Manager saying on April 9 that the company is experiencing stronger server orders and demand in the Taiwanese market. This surge is thanks to AI needs within Taiwan's own corporate sector.

NVIDIA has faced challenges with the complexity of its latest AI GPUs, as they require TSMC's advanced CoWoS packaging technology, which the Taiwanese contract chip manufacturer is quickly expanding its CoWoS capacity to keep up. But starting in 2024, lead times for NVIDIA's Hopper H100 AI GPU have been decreasing steadily, and now we're seeing it continue to speed up. From 11 months to 2-3 months now.

We've even reported that some NVIDIA AI GPU customers are offloading the expensive chips, and then we've seen AWS (Amazon Web Services) make it easier to rent out NVIDIA H100 AI GPUs through the cloud, which helps take some of the strain off of H100 AI GPUs being used elsewhere.

NVIDIA needs to get more and more H100 AI GPUs into the wild, but it also has its beefed-up H200 AI GPU with ultra-fast HBM3E right around the corner, and its next-generation Blackwell B200 AI GPU also just got unveiled, and will ramp up into production later this year. Elon Musk has recently said that training Grok 3 will require 100,000 x NVIDIA H100 AI GPUs, which is... uh, a lot.

Buy at Amazon

NVIDIA H100 80 GB Graphic Card PCIe HBM2e Memory 350W (NVIDIA H100 80 GB)

TodayYesterday7 days ago30 days ago
Buy at Newegg
$159.99$159.99-
$29449.95$29449.95$29449.95
* Prices last scanned on 7/19/2024 at 12:40 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags