Vietnamese shop Nguyencongpc have been building custom AI servers based on NVIDIA GeForce RTX 5090 graphics cards, with 7 x RTX 5090 cards used with 28 power cables in total, and 4000W of power consumption for the custom AI servers.
If you thought cryptocurrency mining back a few years ago caused issues with GPU shortages, it seems we have to fear custom AI servers using consumer-focused GeForce RTX 50 series gaming GPUs creating shortages for PC gamers. At the time, NVIDIA gimped crypto mining performance, but crypto miners continued to find ways around that.
However, NVIDIA's new GeForce RTX 5090 graphics card ships with a huge 32GB of ultra-fast GDDR7 memory, with large pools of memory favored by AI workloads, so a Vietnamese shop has used 7 of them in a custom AI server for various AI workloads, and 7 x 32GB of RAM is a big deal for AI users.
The new AI servers are using dual 2000W power supplies with a total of 28 power cables (4 x 8-pin PCIe power cables converted to the 16-pin power connector on the RTX 5090) and with 7 x RTX 5090s, that's a total of 28 power cables and 4000W of power flowing to the graphics cards.
- Read more: RTX 4090 with upgraded 96GB VRAM teased: could release soon for AI workloads
- Read more: RTX 4090 modded with 48GB VRAM sells for $3400 in China, includes AIO cooler
The other thing is, we've seen upgraded GeForce RTX 4090 graphics cards with 48GB and even a huge 96GB of VRAM... upgraded from their stock 24GB of GDDR6X memory. This is for AI workloads, and once we get modders working on RTX 5090 upgrades from 32GB to higher pools of VRAM... well, AI servers like this will become even more popular.