Newsletter IconFacebook IconX IconThreads IconInstagram IconYouTube IconPinterest Icon
Giveaway: Win an ASRock B850 Riptide WiFi and Phantom Gaming PG-850G PSU

AMD Helios rackscale solution for AI offers 15% more AI Compute than NVIDIA Vera Rubin NVL72

Built for AI infrastructure and large-scale foundational-model training and inference, AMD Helios is an impressive new rack-scale solution.

AMD Helios rackscale solution for AI offers 15% more AI Compute than NVIDIA Vera Rubin NVL72
Comments
Senior Editor
Published
1-minute read time
TL;DR: AMD announced Helios, a rack-scale AI supercomputer combining 72 Instinct MI455X GPUs, 6th Gen EPYC Venice CPUs, ROCm, and Pensando networking to deliver 2.9 ExaFlops FP4, 15% higher peak FP4 compute than NVIDIA Vera Rubin NVL72, 31TB HBM4, and claimed 30% more tokens per dollar for scalable AI clusters.
Voice: Kosta Andreadis
0:00 / 2:37
Use left and right arrow keys to seek audio.

AMD has officially launched its AMD Helios rackscale solution for AI infrastructure and large-scale foundational-model training and inference. As a supercomputer, AMD Helios combines the new AMD Instinct MI455X GPU, 72 of them, with the latest 6th Gen AMD EPYC 'Venice' server CPUs, AMD ROCm software, and AMD Pensando networking. It's a lot of cutting-edge tech coming together, delivering 2.9 ExaFlops of FP4 Compute.

AMD Helios rackscale solution for AI offers 15% more AI Compute than NVIDIA Vera Rubin NVL72 5

According to AMD, it's enough to deliver 15% more compute (peak FP4 performance) than NVIDIA's latest Vera Rubin NVL72 rack-scale solution. And when it comes to raw specs, there is a notable difference in favor of Helios. For example, the 31TB of HBM4 memory capacity is 50% more than Vera Rubin. And with 43 TB/s scale-out bandwidth and 1.7 PB/s of memory bandwidth, AMD notes that Helios can offer AI companies 30% more tokens per dollar.

Popular Now: GTA Technical Director comments on GTA 6 running at 60 FPS on consoles

"As demand grows for AI factories and frontier AI, customers need infrastructure that scales efficiently from a single rack to large gigawatt-scale AI clusters while maximizing performance, performance per watt and cost per token," AMD explains. "AMD Helios delivers an integrated rack-scale building block that simplifies deployment while providing the compute, networking and open software foundation needed for the next generation of AI infrastructure."

AMD Helios rackscale solution for AI offers 15% more AI Compute than NVIDIA Vera Rubin NVL72 4

Frequently Asked Questions

TweakBot answers common questions about this news using TweakTown's own coverage from this page and related content from our archive. Tap a question to reveal the answer, or type your own below.

Question #1

How does Helios achieve the claimed 15% more peak FP4 compute than NVIDIA's Vera Rubin NVL72?

Question #2

What are the GPU and CPU components used in the AMD Helios rack-scale system?

Question #3

What networking hardware does Helios use for rack-to-rack and cluster connectivity?

Question #4

What total FP4 compute performance (in ExaFlops) does a single Helios rack deliver?

Have a question not listed here? Ask below and TweakBot will answer it.

Of course, AMD Helios isn't confined to a single rack, as it's designed for gigawatt-scale AI clusters thanks to the new AMD Pensando Vulcano 800 AI NICs providing high-bandwidth, low-latency connectivity for growth. And with that, AMD Helios is already being deployed to a wide range of leading AI companies like Anthropic, Meta, Microsoft, Oracle, OpenAI, as well as supporting the infrastructure of companies like Dell Technologies, Lenovo, IBM, and others.

Photo of the AMD Ryzen 3 3200G Desktop Processor

Best Deals: AMD Ryzen 3 3200G Desktop Processor

Prices last scanned 8 hours and 30 minutes ago

* Prices may be inaccurate. As an Amazon Associate, we earn from qualifying purchases. We earn affiliate commission from any Newegg or PCCG sales.

Comments

Senior Editor

Email IconX IconLinkedIn Icon

Kosta is a veteran gaming journalist that cut his teeth on well-respected Aussie publications like PC PowerPlay and HYPER back when articles were printed on paper. A lifelong gamer since the 8-bit Nintendo era, it was the CD-ROM-powered 90s that cemented his love for all things games and technology. From point-and-click adventure games to RTS games with full-motion video cut-scenes and FPS titles referred to as Doom clones. Genres he still loves to this day. Kosta is also a musician, releasing dreamy electronic jams under the name Kbit.

Stay Updated

Follow TweakTown for breaking tech news, reviews, and daily updates.

Add TweakTown as a preferred source on GoogleFind TweakTown on Apple News
Newsletter Subscription