NVIDIA's full-spec Blackwell B200 AI GPU uses 1200W of power, up from 700W on Hopper H100

NVIDIA's next-generation Blackwell B200 AI GPU uses up to 1200W of power, 500W more power than Hopper H100 AI GPU which consumes 700W of power.

2 minutes & 56 seconds read time

NVIDIA revealed its next-generation Blackwell B200 AI GPU at its recent GTC 2024 (GPU Technology Conference) event but left out some details that we're now discovering... like the new AI GPU consuming up to a whopping 1200W of power.

NVIDIA's new Blackwell B200 versus Hopper H100 AI GPUs (source: NVIDIA)

NVIDIA's new Blackwell B200 versus Hopper H100 AI GPUs (source: NVIDIA)

The new information on the Blackwell AI GPUs comes directly from NVIDIA SVP and GPU Architect, Jonah Albe, along with Ian Buck, the VP of Hyperscale and HPC at NVIDIA. Jonah pointed out that NVIDIA's new Blackwell GPU uses a completely different microarchitecture to Hopper, with Blackwell featuring 2nd Generation Transformer Engine Technology that adds both FP4 and FP6 compute formats, which along with new software optimizations that NVIDIA has made, unleashes Blackwell to be the fastest AI chip on the planet.

Blackwell has a 32% increase in FP64 compute performance with B200 versus Hopper H100, with Blackwell being an AI GPU first and foremost, FP64 compute performance isn't as important from an AI workload standpoint, where the lower you go, the faster the AI inferencing and training capabilities become.

NVIDIA moved to a chiplet (MCM or multi-chip module) design for Blackwell, improving performance through the use of chiplets versus improving yields on a monolithic GPU. Programmers could be worried of having to tweak their code for the chiplet -- or multi-chip -- design, but they won't need to worry. NVIDIA says that the GPUs don't know their separate, and act as one, driven by CUDA advancements that accelerate performance from the chiplet design.

Now, we might refer to NVIDIA's new Blackwell B200 as an "AI GPU," but CEO Jensen Huang doesn't. Jensen says that Blackwell is a platform that has a range of products based on GPUs. NVIDIA has three different Blackwell 'platforms', in Jensen's words, each with varying Blackwell GPU specs.

NVIDIA's new Blackwell B200 AI GPU (source: NVIDIA)

NVIDIA's new Blackwell B200 AI GPU (source: NVIDIA)

The full-spec Blackwell B200 features a maximum 1200W TDP, which is a 500W increase over the 700W that Hopper H100 consumes. NVIDIA's new GB200 Superchip will feature dual B200 AI GPUs and a Grace CPU that will consume 2700W in total. This is split into the 1200W x 2 from the B200 AI GPUs and 300W from the Grace CPU and I/O.

Under the full-spec B200 AI GPU, NVIDIA has B200 used inside of DGX and HGX platforms, which are optimized chips with 90% of the full-spec B200 variant, using around 1000W of power (200W less than full-spec B200). We don't know if NVIDIA is using a lower TDP on these B200 chips, or if they have cut-down specs versus the full-spec B200.

NVIDIA's last Blackwell GPU is the B100, which has a 700W TDP -- the same as Hopper H100 -- with 70% of the performance of the full-spec 1200W beast B200 AI GPU.

Buy at Amazon

NVIDIA H100 80 GB Graphic Card PCIe HBM2e Memory 350W

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 4/20/2024 at 4:38 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags