Artificial Intelligence - Page 46

We already know that in the age of the Windows AI PC, devices are set to arrive with dedicated Copilot keys. Microsoft's AI is on track to be integrated with all parts of the operating system. Today, Intel executives at Intel's AI Summit in Taipei confirmed that Copilot AI services will soon run locally on PCs - as long as they meet a certain performance threshold.

That threshold is 40 TOPS of performance on the Neural Processing Unit (NPU) found in an AI PC. Based on this information, which Tom's Hardware confirmed, the definition of an AI PC has been given a specific hardware or performance baseline. Anything below 40 TOPS will still be able to run Copilot AI tasks and processes in the cloud, but it will serve as a way to differentiate hardware-based 'AI PCs' versus could-only devices.

Though it might take a generation or two to get there, Intel says it has next-gen products lined up that will fall into this 40 TOPS of performance category. Currently, The Meteor Lake NPU in Core Ultra chips offers only 10 TOPS performance, with AMD's Ryzen Hawk Point offering 16 TOPS.

NVIDIA might have just announced its next-generation Blackwell B200 AI GPU, but the beefed-up Hopper H200 AI GPU is smashing performance records in the very latest MLPerf 4.0 results.

NVIDIA's optimizations on TensorRT-LLM have been a non-stop chain of progression since the company released its AI Software suite last year. There were major performance increases from MLPerf 3.1 results to MLPerf 4.0, with NVIDIA amplifying Hopper's AI performance.

Using these new TensorRT-LLM optimizations, NVIDIA has pulled out a huge 2.4x performance leap with its current H100 AI GPU in MLPerf Inference 3.1 to 4.0 with GPT-J tests using an offline scenario. With server-based scenarios using GPT-J, NVIDIA's current H100 AI GPU had a huge 2.9x increase in MLPerf 3.1 to 4.0 performance.

OpenAI's impressive new text-to-video tool, Sora, loves some GPU compute power. New numbers from Factorial Funds estimate that 720,000 x NVIDIA H100 AI GPUs would be needed for peak times on Sora.

720,000 x NVIDIA AI GPUs is a monumental amount of AI GPU computing power. With each costing around $30,000 x 720,000, that's $21.6 billion. Not only is it a mountain of money, but the amount of power at 700W per GPU is astounding, too, totaling 504,000,000W of power. Yeah, that's a lot of power.

Factorial Funds estimated that Sora used between 4,200 and 10,500 NVIDIA H100 AI GPUs for one month, with a single H100 AI GPU capable of generating a one-minute video in about 12 minutes, or around 5 x one-minute videos per hour.

Since OpenAI announced its new AI video generation platform, Sora, the company has been slowly releasing videos created by its new model, increasing the hype surrounding the tool before it becomes available to the public.

OpenAI has now taken to its blog to share a new selection of Sora-created videos, but this time around, they have been made by a select group of filmmakers, artists, advertising agencies, and musicians. OpenAI is attempting to demonstrate the capabilities of Sora when its in the hands of creatives, and how the upcoming text-to-video tool can be used by creatives to help bring ideas to reality.

As you can probably imagine, all of the lucky individuals who were able to use Sora to create some content praised the capabilities of the new tool, with there being no mention of what video content Sora was trained on to be able to create the new content.

UL Solutions, the creators of the popular 3DMark benchmark suite for PC gamers, is expanding its professional range of UL Procyon benchmarks with the arrival of the Procyon AI Image Generation Benchmark. Built around the Stable Diffusion AI model, this new benchmark measures the generative AI performance of a modern GPU.

In the benchmark results, part of UL's announcement, we see the GeForce RTX 4060 Ti deliver a score of 1080 - not that we have any reference to know how good or bad that is. Regardless, it's a powerful tool that supports multiple inference engines (Intel OpenVINO, NVIDIA TensorRT, and ONNX runtime with DirectML).

It also measures CPU and GPU temperatures, clock speeds, and usage. However, don't expect this to appear on Steam like 3DMark. Procyon AI Image Generation Benchmark is aimed at the professional space; it costs $5000 USD for an annual site license.

NVIDIA showcased a new AI-powered technology that could revolutionize game development and the PC modding community. Described as a "virtual 3D printer," LATTE3D turns text prompts into 3D objects within seconds. The company notes that the 3D creations are created in a popular format that can be slotted into virtual environments for games or other applications with a few clicks.

"A year ago, it took an hour for AI models to generate 3D visuals of this quality - and the current state of the art is around 10 to 12 seconds," said Sanja Fidler, vice president of AI research at NVIDIA. "We can now produce results an order of magnitude faster, putting near-real-time text-to-3D generation within reach for creators across industries."

NVIDIA adds that by running on a single GPU like the NVIDIA RTX A6000, 3D shapes, animals, and objects are created instantly.

NVIDIA is absolutely dominating the AI GPU business with a purported 90% of the AI market taken by Team Green, but now a coalition of tech companies, including Google, Intel, and Qualcomm, are fighting back... they want to take down CUDA a notch or three.

In a new report by Reuters, the site says that Google, Intel, and Qualcomm have "plans to loosen NVIDIA chokehold by going after the chip giant's secret weapon: the software that keeps developed tied to NVIDIA chips," which is CUDA. Reuters continues, adding "they are part of an expanding group of financiers and companies hacking away at NVIDIA's dominance in AI".

Vinesh Sukumar, Qualcomm's head of AI and machine learning, told Reuters: "We're actually showing developers how you migrate out from an NVIDIA platform".

TinyCorp has just announced that it will offer new TinyBox AI systems with either AMD or NVIDIA AI hardware inside. AMD systems will start at $15,000, while NVIDIA hardware inside will start at $25,000.

The company offers its new TinyBox AI systems with 6 x AMD Radeon RX 7900 XTX graphics cards inside, starting at $15,000 per system. Meanwhile, TinyCorp offers a TinyBox AI system with 6 x NVIDIA GeForce RTX 4090 graphics cards, with this monster AI system starting at $25,000.

TinyCorp has been experiencing issues with AMD hardware, posting about its issues and new AI systems on X. The company explained that it was going to sell just AMD-powered systems, but due to various issues, it was forced to offer NVIDIA chips for AI GPU usage.

Broadcom has been silently working on what appears to be one of the largest processors ever made, with 12 stacks of HBM memory, making this mystery XPU a bigger beast than NVIDIA's just-announced Blackwell B200 AI GPU.

In some new photos posted to X by our friend Patrick Moorhead, founder of top-ranked, technology analyst and advisory firm Moor Insights and Strategy. He snapped a photo with Frank Ostojic, who runs Broadcom's custom silicon group, and their new third-gen XPU design from a large "consumer AI company". You can see the picture of the XPU above.

Broadcom's mysterious third-gen XPU design features 12 stacks of HBM memory, which makes it bigger than NVIDIA's new Blackwell B200 AI GPU that the company unveiled at GTC 2024 last week.

OpenAI recently revealed its upcoming video-generation software named Sora, which is set to revolutionize how videos are made through users simply typing out what kind of video they want created and then waiting for it to be generated.

The unveiling of Sora was certainly mind-blowing as the examples that were shown were almost indistinguishable from human-created videos. To be completely fair, the Sora-created videos did feature some tell-tale signs of AI-generated content such as errors with physics, human hands, and people walking. But, at a glance, or without knowing what these tell-tale signs are, the videos were would pass completely undetected by viewers.

Now, Bloomberg has reported that OpenAI, the creators of Sora, are now taking the new AI-powered tool to directors and film studios in Hollywood. The report doesn't state which film studios or directors have showcased the new technology, but an OpenAI spokesperson did confirm the company is trying to collaborate with the industry.