AMD shows you how to run DeepSeek on your Ryzen AI CPU and Radeon GPU

AMD has provided some instructions on how to run DeepSeek's exciting new R1 distilled "reasoning" model on AMD Ryzen AI and Radeon products... yeah, you can run a local DeepSeek R1 model on your PC at home.

AMD explains: "Reasoning models add a "thinking" stage before the final output - which you can see by expanding the "thinking" window before the model gives its final answer. Unlike conventional LLMs, which one-shot the response, CoT LLMs perform extensive reasoning before answering. The assumptions and self-reflection the LLM performs are visible to the user and this improves the reasoning and analytical capability of the model - albeit at the cost of significantly longer time-to-first-(final output)token".

"A reasoning model may first spend thousands of tokens (and you can view this chain of thought!) to analyze the problem before giving a final response. This allows the model to be excellent at complex problem-solving tasks involving math and science and attack a complex problem from all angles before deciding on a response. Depending on your AMD hardware, each of these models will offer state-of-the-art reasoning capability on your AMD Ryzen™ AI processor or Radeon™ graphics cards".

You can read the entire article with a step-by-step process on running DeepSeek R1 on your AMD Ryzen AI and Radeon-powered products right here.