Micron has crammed 512 GB of DDR5 memory into a single stick, pushing next-gen Intel and AMD servers to a staggering 12 TB of total memory in a single 24-slot dual-socket server.
The module, built using advanced vertical interconnect packaging, stacks DRAM dies and connects them with through-silicon vias to maximize density without sacrificing performance. This allows a single 24-slot dual-socket server to handle up to 12 TB of DDR5 memory, which is a staggering amount. Micron says the design improves power efficiency by over 60% compared to using four 128 GB RDIMMs.
- Read more: Micron ships its fastest DDR5 RDIMMs yet, with 256GB modules hitting 9,200 MT/s and 40% better power efficiency
- Read more: SK hynix's new 256GB RDIMM server memory module passes Intel's tests, ready for Xeon 6 platform
- Read more: Micron ships world's first 256GB LPDRAM SOCAMM2 memory module
"Micron continues to set the pace for memory technology, delivering a new class of ultra-dense, high-performance server memory that helps customers keep larger datasets closer to the compute engines that need them. A 512GB RDIMM enables multi-terabyte servers, supporting larger AI and database workloads, greater virtualization density and improved power efficiency, all within existing server footprints," said Raj Narasimhan, senior vice president and general manager of the Cloud Memory Business Unit at Micron
AMD and Intel are actively validating the module, which is slated to deliver speeds of up to 9200 MT/s. Micron says the module helps keep larger datasets closer to the compute engines, reducing reliance on slower storage tiers and improving performance in AI, analytics, and database workloads.
"AMD solutions continue to advance data center performance, scalability and efficiency as AI and data-intensive workloads reshape infrastructure requirements. Our close engineering collaboration with Micron brings compute and memory innovation together to help customers realize the full value of AMD-powered platforms. Together, we're enabling balanced, high-performance infrastructure for the growing scale and complexity of modern workloads," said Amit Goel, corporate vice president, Compute and Enterprise AI Platform Solutions Engineering, AMD
Frequently Asked Questions
Open a question for an answer from TweakTown's coverage of this news, or ask your own below.
Which Intel and AMD server platforms are being validated for Micron’s 512GB DDR5 RDIMM?
What kind of server memory configurations are needed to reach 12TB with these 512GB modules?
How does Micron’s vertical interconnect packaging affect capacity, bandwidth, and power use?
What workloads are expected to benefit most from a 512GB DDR5 module at up to 9,200 MT/s?
Have a question that isn't listed here? Ask below, and TweakBot will answer it.
"The growth of AI and other data-intensive workloads is placing new demands on server infrastructure, making memory capacity and bandwidth increasingly important to overall system performance. Intel is working closely with Micron to validate its 512GB DDR5 RDIMM and help enable future server platforms designed to meet the growing demands of next-generation data center workloads," said Karin Eibschitz Segal, general manager of platform and system engineering in Intel's Data Center Group
