Meta's long-term vision for AGI (artificial general intelligence) involved the use of 600,000 x NVIDIA H100 AI GPUs, something NVIDIA CEO Jensen Huang teased Meta CEO Mark Zuckerberg at SIGGRAPH 2024 this week Check it out:
In the video, NVIDIA CEO Jensen Huang says that Meta is "coming up on 100K H100s" to which Zuck replies that yeah, they're "good customers" for NVIDIA and "that's why you invited me to this Q&A", said Zuck in return to Jensen.
600,000 x NVIDIA H100 AI GPUs at an average cost of $30,000 each combines for a total of $15 billion in AI GPU purchases from Meta to NVIDIA alone. We've seen gigantic GPU clusters from Elon Musk and his xAI startup, with its new Memphis Supercluster needing some insane portable power generators just to get 32,000 x NVIDIA H100 AI GPUs operational in the cluster.
- Read more: Meta's long-term vision for AGI: 600,000 x NVIDIA H100-equivalent AI GPUs for future of AI
- Read more: Elon Musk's new Memphis Supercluster uses gigantic portable power generators, grid isn't enough
- Read more: Elon Musk turns on xAI's new AI supercomputer: 100K liquid-cooled NVIDIA H100 AI GPUs at 4:20am
- Read more: Meta's huge 16,384 NVIDIA H100 AI GPU cluster: HBM3 memory crashed half of Llama 3 training
- Read more: NVIDIA to make $210 billion revenue from selling its Blackwell GB200 AI servers in 2025 alone
Meta must have some truly insane power consumption to have 600,000 x NVIDIA H100 AI GPUs working away at AGI.
