Technology and gaming content trusted in North America and globally since 1999
8,619 Reviews & Articles | 61,086 News Posts

NVIDIA's DGX-2: 16 x Tesla V100s, total of 512GB HBM2, $399K

NVIDIA's new DGX-2 is an absolute beast, packing some of the world's best technology

Anthony Garreffa | Mar 27, 2018 at 2:07 pm CDT (1 min, 14 secs time to read)

GTC 2018 - NVIDIA kicked off their annual GPU Technology Conference by unveiling the new Quadro GV100 graphics card, as well as the refreshed Tesla V100 with 32GB of HBM2, but the new DGX-2 was the ultimate unveil.

NVIDIA's DGX-2: 16 x Tesla V100s, total of 512GB HBM2, $399K |

NVIDIA's new DGX-2 packs a huge 16 x Tesla V100s with 32GB of HBM2 each for a total of 512GB of HBM2. The entire unit consumes 10kW of power, is capable of a huge 2 PFLOPs of compute performance and weighs 350 lbs.

Each of the Tesla V100s with 32GB of HBM2 are connected through NVIDIA's new NVSwitch technology, which packs an insane 14.4TB/sec of bandwidth.

Why did NVIDIA unveil the DGX-2? Well, there are plenty of use cases for these super-powered machines for AI, deep learning, and so much more that the previous-gen DGX-1 and its 8 x Tesla V100s with 16GB of HBM2 each. Bumping up to 16 x Tesla V100s with 32GB of HBM2 is a huge deal, as is the massive amounts of memory bandwidth.

I reached out to Patrick Moorhead, President & Principal Analyst, Moor Insights & Strategy, who said: "NVIDIA combined Volta architecture with the new, state of the art platform improvements and created DGX-2. The biggest feature in DGX-2 is the new NVSwitch, which enables memory sharing of 16 GPUs. This improves performance as well as reducing latency as the GPUs don't need to go to main memory as much".

Last updated: Apr 6, 2020 at 04:45 pm CDT

Anthony Garreffa

ABOUT THE AUTHOR - Anthony Garreffa

Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering.

Related Tags