GTC 2016 - NVIDIA just unveiled its next-generation Pascal architecture at GTC 2016, showcasing its new Tesla P100 video card - with an insane amount of power. The Tesla P100 has 16GB of HBM2, with an insane amount of horsepower behind it.
Well, NVIDIA also announced its new DGX-1 - the world's first Deep Learning supercomputer. DGX-1 packs 8x Tesla P100 video cards, each with 16GB of HBM2. DGX-1 has 7TB of SSDs, 2 x Intel Xeon processors, 170 TFlops of performance, Quad IP 100Gbps and dual 10GbE connectivity. It uses just 3200W of power (3.2kW) which might sound like a lot to you and I, but this is a supercomputer... not a traditional rackmount PC.
NVIDIA's new Pascal-based DGX-1 is priced at $129,000.