The world's largest chip: 2.6 trillion transistors and 850,000 cores

Cerebras has the world's largest chip: 2.6 trillion transistors -- that's 2,600,000,000,000 -- with 850,000 cores on TSMC 7nm.

Published
Updated
1 minute & read time

Cerebras has just unveiled the world's largest chip, which packs a mind boggling 2.6 trillion transistors and 850,000 cores.

The world's largest chip: 2.6 trillion transistors and 850,000 cores 01

The new Wafer Scale Engine (WSE) was unveiled at Hot Chips 2020, with Cerebras using TSMC's new 7nm process to cram the 850,000 cores onto the 2.6 trillion transistors. The previous-gen WSE had 1.2 trillion transistors, 400,000 cores, 18GB of on-chip memory, 9PB/sec memory banwidth, and 100Pb/s of total fabric bandwidth that consumed a total of 15kW of power.

How does this work? The Wafer Scale Engine magic is because instead of making the chip into a traditional monolithic processor die, Cerebras instead stitches the processor dies together with a communication fabric -- letting the many, many chips act as one unit.

The world's largest chip: 2.6 trillion transistors and 850,000 cores 02

If you want to compare this against the largest GPU in the world, that would be NVIDIA's new Ampere-based A100 which has 54.2 billion transistors. 54.2 billion transistors versus 2.6 trillion... that's just 0.45 trillion transistors in comparison between Cerebras and NVIDIA.

The world's largest chip: 2.6 trillion transistors and 850,000 cores 03
The world's largest chip: 2.6 trillion transistors and 850,000 cores 04

Cooling something like that isn't easy, so Cerebras used a pretty elaborate power delivery and cooling system to keep the original chips cool. We should expect a huge upgrade in the power delivery and cooling on the next-gen chip, even though there will be some major benefits moving from 16nm to 7nm.

The only question I have is: can it run Crysis?

Buy at Amazon

Moore's Law: The Life of Gordon Moore

TodayYesterday7 days ago30 days ago
$23.01$23.08$23.99
* Prices last scanned on 3/28/2024 at 6:56 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags