NVIDIA says RTX is the 'premium' AI PC platform, NPUs are for 'basic' AI PCs

NVIDIA announces iew ecosystem of 'Premium' AI PCs powered by RTX hardware, saying they're much better than NPU-enabled AI for 'Basic' AI PCs.

1 minute & 36 seconds read time

NVIDIA isn't going to be left out with the coming AI PC revolution, with AMD and Intel already releasing NPU-powered processors for AI workloads, NVIDIA has just announced the "Premium AI PC" with RTX hardware, compared to the "Basic AI PC" with an NPU on the CPU.

NVIDIA says RTX is the 'premium' AI PC platform, NPUs are for 'basic' AI PCs 14

NVIDIA compares that a Premium AI PC with an RTX GPU for AI workloads can provide gigantic performance uplifts for AI TOPS of between 100 and a whopping 1300+ TOPS (int8 + FP8 workloads) compared to just 10-45 TOPS on current, and next-gen CPUs with beefed-up NPUs.

Intel and AMD will combine the TOPS performance of the CPU + GPU + NPU, because if they used the NPU alone, the AI power is nowhere near as great. The more the NPU is used, the more resources that are taken away from other key parts of the chip: ya know, like the CPU and GPU.

NVIDIA says RTX is the 'premium' AI PC platform, NPUs are for 'basic' AI PCs 13

NVIDIA has been filling out its AI ecosystem with new tools including Chat With RTX -- a new RTX-powered AI chatbot -- which includes optimizations for GenAI and LLM (large language models) in the form of TensorRT which greatly increases AI performance.

NVIDIA says RTX is the 'premium' AI PC platform, NPUs are for 'basic' AI PCs 12

Think about it: there are over 100 million RTX owners out there, so the "Premium AI PC" segment already has a gigantic userbase. The new "AI PC" will be for more basic generative AI tasks, but you're going to need much more power (from your CPU and GPU on your new Intel or AMD processor) but for massive performance leaps, a dedicated GPU is what you need.

At least it's not like back in teh day with a PhysX card from Ageia, where if you wanted to run PhysX, you'd need a dedicated PhsyX card that was used in conjunction with your graphics card. I'm surprised we're not seeing NPU-specific AICs yet, but maybe in the future.

Buy at Amazon

ASUS TUF GeForce RTX® 4090 OC Edition

TodayYesterday7 days ago30 days ago
Buy at Newegg
* Prices last scanned on 7/19/2024 at 2:55 am CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.
NEWS SOURCE:wccftech.com

Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering and has recently taken a keen interest in artificial intelligence (AI) hardware.

Newsletter Subscription

Related Tags