China has 'renting services' for NVIDIA AI GPUs, cheaper than the US at as low as $6 per hour

Chinese cloud service providers have "renting services" where they rent out their hardware stack, with prices that are radically cheaper than those available in the United States... as low as $6 per hour.

2

The Financial Times reports that Chinese CSPs (cloud service providers) are renting out their AI GPU hardware, with small Chinese CSPs providing companies with an AI server that packs 8 x NVIDIA A100 AI GPUs that costs around $6 per hour to rent them out. If you're in the US, that would cost you around 50% more at $10 per hour.

US sanctions to the side, NVIDIA's newer H100 and older A100 AI GPUs are easily available in China, which is why the rental costs are so much lower than other regions. It's estimated that over 100,000 x NVIDIA H100 AI GPUs are in China right now, and they're openly being sold on Chinese marketplaces, smuggled all across the country according to one Chinese startup founder.

NVIDIA's H100 is sold in China for around $23,000 to $30,000, which is much cheaper than its peak when it was nigh impossible to buy higher-end AI chips in China because of US sanctions by the Biden administration.