NVIDIA's new Grace CPU Superchip: 144-core CPU, 600GB of GPU memory

NVIDIA's new Grace CPU design unveiled with two new Superchip platforms: 144-core ARM-based Neoverse CPU, and huge 600GB of VRAM.

@anthony256
Published Wed, Mar 23 2022 6:30 PM CDT   |   Updated Tue, Apr 19 2022 10:51 PM CDT

NVIDIA unleashed its next-gen Hopper GPU architecture and new flagship NVIDIA H100 GPU, but also its next-gen Grace CPU design that has been unveiled alongside two new Superchip platforms.

NVIDIA's new Grace CPU Superchip: 144-core CPU, 600GB of GPU memory 03 | TweakTown.com
VIEW GALLERY - 3 IMAGES

The new NVIDIA Grace Hopper Superchip has been designed for giant-scale AI and HPC (high-performance computing) use, we have NVIDIA's in-house Grace CPU + Hopper GPU combo, with an insane 600GB of GPU memory, 900GB/sec of coherent NVLink interface, and it runs the NVIDIA Computing Stack software suite.

There's a huge 30x system memory bandwidth to the GPU improvement over the DGX A100 here, with a CPU and GPU that were designed for giant-scale AI and HPC. The 900GB/sec of coherent interface is 7x faster than PCIe 5.0 which is only just dropping into gamers' desktops now, with PCIe 5.0-enabled GPUs launching this year.

  • CPU+GPU designed for giant-scale AI and HPC
  • New 900 gigabytes per second (GB/s) coherent interface, 7X faster than PCIe Gen 5
  • 30X higher aggregate system memory bandwidth to GPU compared to DGX A100
  • Runs all NVIDIA software stacks and platforms, including NVIDIA HPC, NVIDIA AI, and NVIDIA Omniverse
NVIDIA's new Grace CPU Superchip: 144-core CPU, 600GB of GPU memory 02 | TweakTown.com
  • High-performance CPU for HPC and cloud computing
  • Super chip design with up to 144 Arm v9 CPU cores
  • World's first LPDDR5x with ECC Memory, 1TB/s total bandwidth
  • SPECrate2017_int_base over 740 (estimated)
  • 900 GB/s coherent interface, 7X faster than PCIe Gen 5
  • 2X the packaging density of DIMM-based solutions
  • 2X the performance per watt of today's leading CPU
  • Runs all NVIDIA software stacks and platforms, including RTX, HPC, AI, and Omniverse

NVIDIA also unveiled the second Superchip platform which has the Grace CPU, packing high-performance Grace ARM CPU cores that are also built for next-gen HPC and AI systems. There's 144 cores based on the ARM Neoverse architecture, pushing 740 SPECrate@2017_int_base performance.

That might not sound like much, but based on previous estimates on performance these numbers were at the 300-ish level, and now we're pushing 740. That's a 2.5x increase since NVIDIA first unveiled its new Grace CPU architecture.

NVIDIA's new Grace CPU not only packs 144 ARM v9 CPU cores, but it's the world's first with LPDDR5X memory, with 1TB of memory bandwidth. The new Grace CPUs will chew through some power, with 500W of power expected to be required.

Buy at Amazon

ZOTAC Gaming GeForce RTX™ 3080 Trinity OC LHR (ZT-A30800J-10PLHR)

TodayYesterday7 days ago30 days ago
$1044.99$998.22$1119.99
* Prices last scanned on 5/25/2022 at 1:26 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering.

Newsletter Subscription

Related Tags

Newsletter Subscription
Latest News
View More News
Latest Reviews
View More Reviews
Latest Articles
View More Articles