Meta's next-gen Llama3 LLM is here and the Intel Arc A770 outperforms the GeForce RTX 4060

With the launch of Meta's next-generation Llama 3 LLM, Intel showcases that overal AI performance on the Intel Arc A770 16GB makes it best in class.

Published
Updated
2 minutes & 18 seconds read time

Generative AI and overall LLM performance are set to become significant elements in measuring CPU and GPU performance in the coming years. Intel's latest deep dive into Arc graphics highlights LLM performance on its current flagship Intel Arc A770 16GB graphics card for desktops.

Meta's next-gen Llama3 LLM is here and the Intel Arc A770 outperforms the GeForce RTX 4060 03

The GPU is generally available for around $300, and Intel is comparing its AI performance against NVIDIA's mainstream GeForce RTX 4060 8GB graphics card, which is its nearest Team Green price competitor. "We've looked at two discrete GPUs positioned in a similar price segment," Intel writes in its report.

Intel's test includes various models running with IPEX-LLM, an LLM library for PyTorch. This library contains optimizations for Intel hardware and uses the XMX AI acceleration found on Arc graphics cards to boost performance. On the GeForce RTX 4060 side, CUDA Torch is used.

With INT4 weight compression, FP16 execution, and a max output of 1024 tokens, the Intel Arc A770 16GB outclasses the GeForce RTX 4060 8GB when it comes to tokens-per-second performance. Overall, performance is up to 70% faster on the Arc A770 than the GeForce RTX 4060. The results also include the latest Llama3 model from Meta, which is cool. In fact, all Intel AI hardware supports Meta's next-generation Llama 3 LLM.

Meta's next-gen Llama3 LLM is here and the Intel Arc A770 outperforms the GeForce RTX 4060 02

One reason for this is that many AI models are reliant on GPU memory capacity and speed. Thus, the faster 16GB of VRAM on the Intel Arc A770 is better suited to AI workloads than the slower 8GB of VRAM on the GeForce RTX 4060. Of course, optimizations and other factors account for discrepancies in performance, and NVIDIA's CUDA is still widely considered the gold standard.

Still, this is an impressive showing for Intel, and with the Intel Arc A770 16GB being one of the most affordable 16GB GPUs on the market by a wide margin, Intel's AI advancements make it an excellent option for those looking for a powerful and affordable AI solution.

Buy at Amazon

SPARKLE Intel Arc A770 TITAN OC Edition 16GB GDDR6

TodayYesterday7 days ago30 days ago
$319.99$305.00$319.99
Buy at Newegg
$319.99$319.99$319.99
* Prices last scanned on 6/14/2024 at 11:51 pm CDT - prices may not be accurate, click links above for the latest price. We may earn an affiliate commission.
NEWS SOURCES:game.intel.com, intel.com

Kosta is a veteran gaming journalist that cut his teeth on well-respected Aussie publications like PC PowerPlay and HYPER back when articles were printed on paper. A lifelong gamer since the 8-bit Nintendo era, it was the CD-ROM-powered 90s that cemented his love for all things games and technology. From point-and-click adventure games to RTS games with full-motion video cut-scenes and FPS titles referred to as Doom clones. Genres he still loves to this day. Kosta is also a musician, releasing dreamy electronic jams under the name Kbit.

Newsletter Subscription

Related Tags