Intel smashes Stanford DAWNBench v1 inference tests

Intel fights against NVIDIA and Google in Stanford ImageNet inference tests, beats them both.

57 seconds read time

Intel might be working on its first foray into GPUs in the last 20 years, but in the meantime they're continuing to dominate the market with their Xeon CPUs with some rather impressive results coming out of Stanford and the Dawn Benchmark and Competition.

Intel smashes Stanford DAWNBench v1 inference tests |

The battle was between Intel's Xeon, Google's TPU v2 and NVIDIA's various GPUs including the Tesla V100. ImageNet used to take around 10 days to be trained, but now it can be done in just 31 minutes thanks to the super-powered Google TPU v2, representing an increase of a mind blowing 477x.

But it's not just brute speed as these companies and universties have to spend millions of dollars on hardware, so cost efficiency plays a big part, and that's where Intel kills it. Without using a GPU at all, Intel Xeon Scalable processors were able to process 10,000 images for just $0.02 and a latency of just 9.96ms.

The researchers were using Intel Optimized Caffe, where the closest competitor was the NVIDIA K80 GPU which also uses 4 CPUs for a cost of $0.07 and latency of 29.4ms... much higher than Intel's results. Considering this is just CPU power, imagine what Intel could do with some next-gen GPU technology and super-fast AI accelerators that we are expecting to be debuted at CES 2019.


Anthony joined the TweakTown team in 2010 and has since reviewed 100s of graphics cards. Anthony is a long time PC enthusiast with a passion of hate for games built around consoles. FPS gaming since the pre-Quake days, where you were insulted if you used a mouse to aim, he has been addicted to gaming and hardware ever since. Working in IT retail for 10 years gave him great experience with custom-built PCs. His addiction to GPU tech is unwavering.

Newsletter Subscription

Related Tags