SK hynix was the initial exclusive supplier of HBM3 to NVIDIA, Samsung and Micron catching up

Samsung will have its HBM inside of NVIDIA's upcoming H200 AI GPU, also receiving certification for AMD's new Instinct MI300 AI GPU.

2 minutes & 25 seconds read time

NVIDIA and AMD's best AI GPUs use HBM3 memory, but with the introduction of the H200 AI GPU, NVIDIA will be the first to market with an HBM3E-based AI GPU.

SK hynix was the initial exclusive supplier of HBM3 to NVIDIA, Samsung and Micron catching up 1510

HBM3E will be found inside of NVIDIA's upcoming H200 and next-gen B100 AI GPUs, with TrendForce noting that the supply bottleneck through advanced CoWoS packaging technology and the long production cycle of HBM extend the timeline from wafer initiation to the final production past 6 months.

NVIDIA's current H100 AI GPU uses HBM3 memory primarily supplied by SK hynix, which has caused stock worldwide issues due to the crazy-high demand for AI GPUs. Samsung's entry into NVIDIA's supply chain with its new HBM3 memory in late 2023, were "initially minor, signifies its breakthrough in this segment," reports TrendForce.

The report by TrendForce reads: "Samsung's stride continued as its HBM3 offerings received AMD MI300 series certification by 1Q24, enhancing its standing as a crucial supplier to AMD. This milestone paves the way for an increase in Samsung's HBM3 production distribution starting from 1Q24. It's worth noting that Micron has not yet entered the HBM supply market, leaving SK hynix and Samsung as key players. Samsung, in particular, is poised to rapidly gain market share with AMD's MI300 series distribution scaling up over the subsequent quarters".

The report continues that starting this year, a huge shift from HBM3 to HBM3E will occur, positioning HBM3E memory as the new mainstream in the HBM market. TrendForce reports that SK hynix leads the way with its HBM3E validation in Q1 2024, closely followed by Micron, which will have its HBM3E memory towards the end of Q1 2024, ready for NVIDIA's new H200 AI GPU, which will drop by the end of Q2 2024.

Samsung is "slightly behind in sample submissions" but expected to complete its HBM3E validation by the end of Q1 2024, with shipments of its new HBM3E memory in Q2 2024. Samsung has "already made significant strides in HBM3, and its HBM3E validation is expected to be completed soon; the company is poised to significantly narrow the market share gap with SK hynix by the end of the year, reshaping the competitive dynamics in the HBM market".

Buy at Amazon

SABRENT Rocket 5 2TB Advanced Performance Internal M.2 PCIe GEN 5 14GB/s (SB-RKT5-2TB)

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 4/20/2024 at 8:52 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags