JEDEC chills on next-gen HBM4 thickness: 16-Hi stacks with current bonding tech allowed

HBM3E memory is about to be unleashed with NVIDIA's upcoming beefed-up H200 AI GPU, but now JEDEC has reportedly relaxed the rules for HBM4 memory configurations.

2

JEDEC has reportedly reduced the package thickness of HBM4 down to 775 micrometers for both 12-layer and 16-layer HBM4 stacks, as it gets more complex at higher thickness levels, making it easier... especially as HBM makers fly in the face of insatiable demand for AI GPUs (now, and into the future with HBM4-powered chips).

HBM manufacturers, including SK hynix, Micron, and Samsung, were poised to use hybrid bonding with the process, a newer packaging technology, and more to reduce the package thickness of HBM4, which uses direct bonding with the onboard chip and wafer. However, HBM4, being a new technology, sees that hybrid bonding would increase pricing, making HBM4-powered AI GPUs of the future even more expensive.

In a new report from ZDNet Korea, sources said that HBM manufacturers would use the "relaxation" pathed out by JEDEC. We know that SK hynix will be mass-producing next-generation HBM4 memory in 2026, with the first batch of samples expected to boast 36GB per stack.

• Read more: SK hynix: next-gen HBM4 memory will enter mass production in 2026
• Read more: TSMC rumored to be teaming with SK hynix on next-gen HBM memory
• Read more: NVIDIA to soak up most HBM supply for its AI GPUs, HBM4 is coming in 2026

SK hynix, Micron, and Samsung are participants in the evolution of HBM4 memory technology, as well as NVIDIA, AMD, and Intel are "participating in the consultation," reports ZDNet Korea. These companies "failed to produce results in the first and second negotiations" which is because "participating companies have expressed opposition to relaxing the HBM4 standard to 775 micrometers".

However, during the recent third consultation, it was agreed upon that 775 micrometers for both 12-layer stacked HBM4 and 16-layer stacked HBM4. This is thanks to memory companies actively asserting that maintaining the current 720-micrometer thickness has "reached its limit." NVIDIA, AMD, and other are "also said to have positively accepted the proposal in order to smoothly receive HBM from the memory companies.