Neuchips will show off its revolutionary Raptor Gen AI accelerator at CES 2024

Neuchips is a leading AI ASIC provider, and is teasing its revolutionary Raptor Gen AI accelerator chip, previously known as N3000, at CES 2024.

Published
Updated
1 minute & 51 seconds read time

Neuchips will be unveiling its revolutionary new Raptor Gen AI accelerator and Evo PCIe accelerator card LLM products at CES 2024, according to a new press release issued by the company.

Neuchips new Raptor Gen AI accelerator chip (source: Neuchips)

Neuchips new Raptor Gen AI accelerator chip (source: Neuchips)

The upcoming Neuchips Raptor Gen AI accelerator was previously known as the N3000, with the new chip solution enabling enterprises to deploy large language models (LLMs) inference at a "fraction of the cost" of existing solutions. We will get the full skinny on Neuchips' new AI processor at CES 2024 next week.

Neuchips CEO Ken Lau said in the press release: "We are thrilled to unveil our Raptor chip and Evo card to the industry at CES 2024. Neuchips' solutions represent a massive leap in price to performance for natural language processing. With Neuchips, any organisation can now access the power of LLMs for a wide range of AI applications".

Neuchips will be demoing its new Raptor and Evo AI processors at CES 2024, accelerating the Whisper and Llama AI chatbots on a Personal AI Assistant application. Neuchips says it will be using its AI accelerators to show off the power of LLM inferencing for real business needs.

Now, down to business. Neuchips' upcoming Raptor Gen AI chip has 200 tera operations per second (TOPS) per chip, with its outstanding performance for AI inferencing operations like Matrix Multiply, Vector, and embedding table lookup suits Gen AI and transformer-based AI models. Neuchips says that this new groundbreaking throughput is achieved through Neuchips' patented compression and efficiency optimizations that were tailor-made for neural networks.

Neuchips' new Raptor AI processor will be joined by the ultra-low powered Evo acceleration card, which combines PCIe Gen5 with 8 lanes and 32GB of LPDDR5 memory which has 64GB/s host I/O bandwidth, and 1.6Tbps of memory bandwidth, all for just 55W per card. Very, very nice to see, Neuchips.

Evo also features 100% scalability, which will allow customers to linearly increase performance by easily adding more chips. Neuchips points out that this modular design helps ensure customers' investment production for future AI workloads.

Neuchips is also teasing its upcoming half-height, half-length (HHHL) form factor product, Viper, which will be launching in the second half of 2024. Viper will have "even greater deployment flexibility," which the company says brings data center-class AI acceleration in a compact, small design.

We will see Neuchips' new Raptor Gen AI and Evo AI acceleration cards at CES 2024, so if you're there, the company says to drop by its booth (62700) to "enroll in a free trial program'. Neuchips will have technical sessions that will showcase the power of its new Raptor and Evo products, where they can slash deployment costs for speech-to-text applications, and more.

Buy at Amazon

NVIDIA H100 80 GB Graphic Card PCIe HBM2e Memory 350W (NVIDIA H100 80 GB)

TodayYesterday7 days ago30 days ago
Buy at Newegg
$126.99$126.99-
$30099.99$30099.99$33999.99
* Prices last scanned on 2/27/2024 at 8:37 pm CST - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.
NEWS SOURCE:techpowerup.com

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags