AMD Instinct MI300X accelerator for AI revealed, combines CPU, GPU, and 192 GB of HBM3 memory

AMD's new Instinct MI300X is designed for generative AI and will compete with NVIDIA's H100 and Grace Hopper, and it's out soon too.

1 minute & 43 seconds read time

The AMD Instinct MI300X is a new high-performance computing hardware that could dent NVIDIA's dominance in the generative AI space by offering an alternative to the popular H100 GPU and the Grace Hopper CPU and GPU combo.

AMD Instinct MI300X showcased by AMD CEO Dr. Lisa Su, image credit: AMD.

AMD Instinct MI300X showcased by AMD CEO Dr. Lisa Su, image credit: AMD.

AMD Instinct MI300X is like the latter in that it's an APU with up to 24 'Zen 4' Cores alongside CDNA 3 GPU Architecture. Making full use of AMD's groundbreaking chiplet design with 8 Chiplets and 8 Memory Stacks using 5nm and 6nm processes, the real kicker is up to a whopping 192 GB of HBM3 Memory - which makes it tailor-made for memory-intensive AI workloads.

And it's right around the corner, too, with AMD noting that the CPU-only MI300A version is sampling right now, with the full MI300X expected to do the same next quarter with full production and availability in Q4 2023. The MI300A is currently being deployed in the El Capitan 2 Exaflop supercomputer.

AMD Instinct MI300X accelerator for AI revealed, combines CPU, GPU, and 192 GB of HBM3 memory 02

AMD calls the new AMD Instinct MI300X "the world's most advanced accelerator for generative AI," thanks in part to the massive amount of memory it offers. "With the large memory of AMD Instinct MI300X, customers can now fit large language models such as Falcon-40, a 40B parameter model on a single MI300X accelerator," AMD adds.

And with that, this is a supercomputer chip, with the AMD Instinct Platform set to combine eight MI300X accelerators into a single design and solution for AI inference and training. Not to mention 1.5TB of HBM3 memory.

Regarding the MI300X's performance, AMD states that it delivers 8X the AI performance compared to the CDNA 2-based AMD Instinct MI250X accelerators. And with unified memory architecture, it's set to deliver an impressive 5X increase in performance per watt over CDNA 2.

Make no mistake, the AMD Instinct MI300X isn't simply AMD's take on delivering a massive GPU for AI, it'll play a major role in the company's data center-focused future as all-thing AI and AI hardware dominate the high-performance computing market.

"AI is really the defining technology that's shaping the next generation of computing," AMD CEO Dr. Lisa Su said during the reveal of the AMD Instinct MI300X. "When we try to size it, we think about the data center AI accelerator TAM growing from something like $30 billion this year, over 50 percent compound annual growth rate to over $150 billion in 2027."

Buy at Amazon

AMD Ryzen 7 5800X3D 8-core, 16-Thread Desktop Processor with AMD 3D V-Cache

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 9/29/2023 at 2:15 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Kosta might be a relatively new member of TweakTown, but he’s a veteran gaming journalist that cut his teeth on well-respected Aussie publications like PC PowerPlay and HYPER back when articles were printed on paper. A lifelong gamer since the 8-bit Nintendo era, it was the CD-ROM-powered 90s that cemented his love for all things games and technology. From point-and-click adventure games to RTS games with full-motion video cut-scenes and FPS titles referred to as Doom clones. Genres he still loves to this day. Kosta is also a musician, releasing dreamy electronic jams under the name Kbit.

Newsletter Subscription

Related Tags