New in-memory computing chip promises faster processing with lower energy use

SK hynix and TetraMem have built an analog in-memory computing chip for AI that slashes energy use and cuts data-movement bottlenecks.

New in-memory computing chip promises faster processing with lower energy use
CommentsFacebook IconX IconReddit Icon
Tech and Science Editor
Published
1 minute & 45 seconds read time
TL;DR: SK hynix and TetraMem developed an analog in-memory computing chip that processes AI tasks directly in memory, reducing energy use, latency, and data transfer bottlenecks. This memristor-based design enhances AI efficiency by performing key operations within memory, addressing major challenges in scaling AI hardware.
Voice: Jak Connor
0:00 / 3:00
Use left and right arrow keys to seek audio.

SK hynix and TetraMem have developed a new analog in-memory computing chip that processes AI workloads directly inside memory, dramatically cutting energy use and latency, and if scalable, could be the answer to one of the biggest challenges the AI industry is facing today.

New in-memory computing chip promises faster processing with lower energy use 2

A new partnership between SK Hynix and TetraMem has combined SK Hynix's advanced memory expertise with TetraMem's analog computing, creating a prototype device that uses memristor-based in-memory computing to perform efficient depthwise convolution, a key operation carried out by AI inference models.

By processing data where it's stored, the system bypasses the energy-heavy data transfers between memory and compute units. The companies claim this architecture addresses a major bottleneck in modern AI hardware as models scale to trillions of parameters. The device demonstrates that it is possible to process data where AI model weights are stored, and with this new architecture, it dramatically reduces the need to transfer between memory and processors, reducing overall power consumption, latency, and generated heat within the system.

"We believe memory-centric computing and Analog In-Memory Computing will become increasingly important technologies for addressing future AI energy efficiency and thermal challenges, and we look forward to continuing our collaboration with SK hynix," said Glenn Ge, CEO and Co-Founder of TetraMem

Traditional AI chips involve constant data movement, which consumes both time and energy. Analog in-memory computing shifts the workflow by performing matrix calculations directly within the memory array. The joint project combined emerging memory devices, circuit design, AI architecture, and software to create the new chip. The result is a practical AI system-on-chip that demonstrates the viability of memory-centric computing.

"We are honored to celebrate this important milestone together with SK Hynix. This achievement demonstrates what can be accomplished through close collaboration across the semiconductor ecosystem," said Ge

Frequently Asked Questions

TweakBot answers common questions about this news using TweakTown's own coverage from this page and related content from our archive. Tap a question to reveal the answer, or type your own below.

Question #1

What thermal and cooling implications did the prototype demonstrate under sustained inference workloads in the published study?

Click to reveal answer

Have a question not listed here? Ask below and TweakBot will answer it.

The collaboration marks SK Hynix's move toward advanced computing architectures beyond traditional memory manufacturing. The study, published in Advanced Intelligent Systems, highlights the potential of in-memory computing for future AI systems, and given the success of this collaboration, we will undoubtedly see future iterations of this technology in the years to come.

Photo of the CORSAIR Vengeance RGB RS DDR5 RAM 32GB (2x16GB) Up to 6000MHz

Best Deals: CORSAIR Vengeance RGB RS DDR5 RAM 32GB (2x16GB) Up to 6000MHz

Prices last scanned 1 hour and 25 minutes ago

* Prices may be inaccurate. As an Amazon Associate, we earn from qualifying purchases. We earn affiliate commission from any Newegg or PCCG sales.

Comments

Tech and Science Editor

Email IconX IconLinkedIn Icon

Jak joined TweakTown in 2017 and has since reviewed 100s of new tech products and kept us informed daily on the latest science, space, and artificial intelligence news. Jak's love for science, space, and technology, and, more specifically, PC gaming, began at 10 years old. It was the day his dad showed him how to play Age of Empires on an old Compaq PC. Ever since that day, Jak fell in love with games and the progression of the technology industry in all its forms.

Stay Updated

Follow TweakTown for breaking tech news, reviews, and daily updates.

Add TweakTown as a preferred source on GoogleFind TweakTown on Apple News
Newsletter Subscription