Micron's new HBM3 Gen2 memory is the world's fastest with 1.2 TB/s of memory bandwidth

Micron is currently rolling out 24GB HBM3 Gen2 memory to select customers, and with 1.2 TB/s of throughput is a massive leap over previous generations.

1 minute & 19 seconds read time

Micron has announced that it's currently sampling its new 24GB HBM3 Gen2 memory to its customers, with the new high-speed memory featuring 1.2 TB/s of memory bandwidth. Micron notes that HBM3 Gen2 delivers 2.5 times greater performance per watt than previous generations, making it ideal for AI data centers where performance, capacity, and efficiency are important.

Micron's new HBM3 Gen2 memory is the world's fastest with 1.2 TB/s of memory bandwidth 02

The 8-high stack of 24GB of HBM3 Gen2 has increased pin speed to over 9.2Gb/s, a 50% improvement over existing HBM3 solutions. Over a 1024-bit bus, you've got 1.2 TB/s of bandwidth, which is a massive improvement over the current 820 GB/s found in existing HBM3.

With the current AI boom and race to see who can build the most supercomputers, this sort of thing will give Micron's flagship memory products an edge over the competition. With 24GB HBM3 Gen2 memory rolling out, Micron adds that 12-high stack 36GB capacity options will begin sampling in early 2024. And as part of its roadmap Micron lists 'HBMNext' as the next evolution beyond HBM3 Gen2, with 64GB capacity and over 2 TB/s of bandwidth arriving sometime around 2026.

"Micron's HBM3 Gen2 technology was developed with a focus on unleashing superior AI and high-performance computing solutions for our customers and the industry," said Praveen Vaidyanathan, vice president and general manager of Micron's Compute Products Group. "One important criterion for us has been the ease of integrating our HBM3 Gen2 product into our customers' platforms."

And with the following quote from NVIDIA, we assume that Team Green is one of the customers getting access to early HBM3 Gen2 samples.

"At the core of generative AI is accelerated computing, which benefits from HBM high bandwidth with energy efficiency," said Ian Buck, vice president of Hyperscale and HPC Computing at NVIDIA. "We have a long history of collaborating with Micron across a wide range of products and are eager to be working with them on HBM3 Gen2 to supercharge AI innovation."

Buy at Amazon

Crucial X6 4TB Portable SSD - Up to 800MB/s

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 9/28/2023 at 9:31 pm CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Kosta might be a relatively new member of TweakTown, but he’s a veteran gaming journalist that cut his teeth on well-respected Aussie publications like PC PowerPlay and HYPER back when articles were printed on paper. A lifelong gamer since the 8-bit Nintendo era, it was the CD-ROM-powered 90s that cemented his love for all things games and technology. From point-and-click adventure games to RTS games with full-motion video cut-scenes and FPS titles referred to as Doom clones. Genres he still loves to this day. Kosta is also a musician, releasing dreamy electronic jams under the name Kbit.

Newsletter Subscription

Related Tags