AMD Instinct MI300 GPU: 3D die-stacking, HBM3, PCIe 5.0, 600W+ power

AMD's next-gen Instinct MI300: CDNA 3 GPU with 5nm and 6nm + 3D die-stacking + 8 x HBM3 stack memory + PCIe 5.0 + 600W+ of power.

Published Thu, Apr 28 2022 9:49 PM CDT   |   Updated Sat, May 21 2022 2:56 AM CDT

AMD has been featured considerably in new leaks from Moore's Law is Dead, with Tom providing some more details on AMD's next-gen Instinct MI300 accelerator.

AMD Instinct MI300 GPU: 3D die-stacking, HBM3, PCIe 5.0, 600W+ power 01 |

The new AMD Instinct MI300 accelerator will be the next-gen datacenter-focused GPU, where we should see multiple versions of it hitting the market. In the new leaks, the fact is made clear: "the first thing that needs to be made clear is every source tells me (Tom @ MLID) there are many variants of MI300. The one I am detailing today is just one I'm familiar with".

With the most confidence in the leaks, we're being told to expect that each 6nm die has connections for two stacks of HBM3 memory, with 12+ metal layers in total. The 6nm dies were built to "work with multiple products" that can be stacked on top. The MI300 design itself has a bottom layer that should be occupied mostly with a huge interpose (around 2750mm2 which is insane). On top of the interposer is reportedly a "series of rectangular 6nm tiles that house I/O controllers, IP Blocks, "and likely cache" of around 320-360mm2 per 6nm tile according to Tom.

Each of the Compute Dies would measure in at around 110mm2, with the interposer arriving at 2750mm2 -- absolutely mammoth -- with the Compute Dies having around 20,000 connections each. This might not sound like much if you don't know about the die connections, but that's double the connections between the dies than the super-fast new Apple M1 Ultra SoC.

We should see 1 x 6nm + 1 x 5nm tile using 150W of power, so a full high-end Instinct MI300 accelerator should push up to 600W or so.

Buy at Amazon

AMD Ryzen 9 5950X

TodayYesterday7 days ago30 days ago
* Prices last scanned on 5/21/2022 at 11:22 pm CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering.

Newsletter Subscription

Related Tags

Newsletter Subscription
Latest News
View More News
Latest Reviews
View More Reviews
Latest Articles
View More Articles