Meta's long-term vision for AGI: 600,000 x NVIDIA H100-equivalent AI GPUs for future of AI

Mark Zuckerberg unveils Meta's goal in creating artificial general intelligence (AGI) with nearly 600,000 AI GPUs by the end of this year alone.

Published
Updated
1 minute & 45 seconds read time

Meta is on a war path towards artificial general intelligence (AGI), where CEO Mark Zuckerberg teased in a new Instagram post that the social networking giant is betting big on AI and AI GPUs.

Meta's long-term vision for AGI: 600,000 x NVIDIA H100-equivalent AI GPUs for future of AI 03

The company is currently training its next-gen model Llama 3, where Meta is building massive compute infrastructure to support their future roadmap, including 350,000 x NVIDIA H100 AI GPUs by the end of the year. Zuckerberg added that overall, almost 600,000 x H100-equivalents of compute will be ready, as they're also buying AMD's new Instinct MI300X AI accelerators, not just NVIDIA AI GPUs.

We should expect all this AI GPU power won't just be from NVIDIA's current-gen H100 AI GPU that's based on the Hopper GPU architecture, but NVIDIA's beefed-up H200 AI GPU and next-gen B100 AI GPU that's based on the next-gen Blackwell GPU architecture.

Dylan Patel, Chief Analyst from SemiAnalysis, explained that NVIDIA will be increasing the output of its Hopper-based AI GPUs, which is a big family now. NVIDIA's current-gen Hopper AI GPUs include the H100, H200, GH100, GH200, and H20. Patel notes that NVIDIA is boosting production from 773,000 in Q1 2024, to 811,000 in Q2 2024... close to 100,000 more AI GPUs made in three months.

Zuckerberg said: "Some updates on our AI efforts. Our long term vision is to build general intelligence, open source it responsibly, and make it widely available so everyone can benefit. We're bringing our two major AI research efforts (FAIR and GenAI) closer together to support this".

Meta's long-term vision for AGI: 600,000 x NVIDIA H100-equivalent AI GPUs for future of AI 01

He continued: "We're currently training our next-gen model Llama 3, and we're building massive compute infrastructure to support our future roadmap, including 350k H100s by the end of this year -- and overall almost 600k H100s equivalents of compute if you include other GPUs. Also really excited about our progress building new AI-centric computing devices like Ray Ban Meta smart glasses. Lots more to come soon".

Dylan Patel told Tom's Hardware: "While NVIDIA has capacity to continue to grow in the 2nd half, the demand modeling we have done indicates a fall off in Hopper demand as hyperscalers shift to looking towards Blackwell".

Buy at Amazon

NVIDIA H100 80 GB Graphic Card PCIe HBM2e Memory 350W (NVIDIA H100 80 GB)

TodayYesterday7 days ago30 days ago
Buy at Newegg
$139.99$139.99-
$30099.99$30099.99$33999.99
* Prices last scanned on 2/27/2024 at 8:37 pm CST - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags