AMD has provided some instructions on how to run DeepSeek's exciting new R1 distilled "reasoning" model on AMD Ryzen AI and Radeon products... yeah, you can run a local DeepSeek R1 model on your PC at home.
AMD explains: "Reasoning models add a "thinking" stage before the final output - which you can see by expanding the "thinking" window before the model gives its final answer. Unlike conventional LLMs, which one-shot the response, CoT LLMs perform extensive reasoning before answering. The assumptions and self-reflection the LLM performs are visible to the user and this improves the reasoning and analytical capability of the model - albeit at the cost of significantly longer time-to-first-(final output)token".
"A reasoning model may first spend thousands of tokens (and you can view this chain of thought!) to analyze the problem before giving a final response. This allows the model to be excellent at complex problem-solving tasks involving math and science and attack a complex problem from all angles before deciding on a response. Depending on your AMD hardware, each of these models will offer state-of-the-art reasoning capability on your AMD Ryzen™ AI processor or Radeon™ graphics cards".
- Read more: Analysts: DeepSeek is the 'Temu of AI' as it wreaks havoc on the AI industry
- Read more: President Trump plans tariffs on foreign chips, says DeepSeek success 'a positive'
- Read more: NVIDIA statement on DeepSeek: says its AI app is an 'excellent AI advancement'
- Read more: DeepSeek Janus-Pro 7B model for task-specific AI models, rivals DALL-E 3
- Read more: NVIDIA shares bleed $384B in a few hours after DeepSeek shocks AI world
- Read more: DeepSeek's new AI app: top free app on the Apple App Store, ahead of ChatGPT
- Read more: Chinese AI firm DeepSeek has 50,000 NVIDIA H100 AI GPUs says CEO, even with US restrictions
You can read the entire article with a step-by-step process on running DeepSeek R1 on your AMD Ryzen AI and Radeon-powered products right here.