Anthropic gives thoughts on open-weights models, especially those from China

Q: What specific nightmare scenarios does Anthropic’s CEO identify related to powerful AI in authoritarian hands?

Anthropic CEO Dario Amodei identifies two nightmare scenarios: one in which authoritarian governments build superior AI models to achieve military dominance, and another in which powerful models are misused for cyberattacks or biological threats. He notes that open weights are irrelevant to the first scenario and only a partial risk factor in the second.

Q: Why does Anthropic say open weights are irrelevant to the risk of authoritarian regimes gaining AI military dominance?

Anthropic says open weights are irrelevant to the risk of authoritarian regimes gaining AI military dominance because the threat of one state building superior AI for military advantage is driven by access to powerful chips and other capabilities, not by whether model weights are open. Dario Amodei frames open weights as irrelevant to that first "nightmare" scenario and instead emphasizes restricting powerful chips, stopping industrial-scale distillation, and requiring safety testing as the relevant mitigations.

Q: What does Anthropic propose regarding restricting powerful chips to China, and how is that framed in the article?

Anthropic proposes restricting powerful chips from going to China as one of three strategic measures to prevent authoritarian regimes from developing superior AI. The article frames this proposal as a response to a "nightmare scenario" in which authoritarian governments build superior AI for military dominance, and presents chip restrictions alongside cracking down on distillation and mandatory safety testing.

Q: What are distillation operations, and why does Anthropic want them cracked down on?

Distillation operations are efforts by AI laboratories to extract the capabilities of a model so they can improve their own models. Anthropic wants them cracked down on because it views stopping industrial-scale distillation as a key defensive measure to prevent others from gaining powerful capabilities that could contribute to misuse or strategic threats.

Anthropic CEO Dario Amodei has penned a response to the ongoing conversation surrounding open-weights models, outlining the company's position.

VIEW GALLERY - 2

Jak Connor

Tech and Science Editor

Published Jul 28, 2026 3:15 AM CDT

45-second read time

TL;DR: Anthropic's CEO Dario Amodei rejects banning open-weight models, warning instead of two threats: authoritarian regimes using superior AI for dominance and misuse of powerful models for cyber or biological attacks. He urges restricting powerful chips to China, stopping industrial-scale distillation, and mandating safety testing for all advanced models.

Voice: Jak ConnorSpeed

0:00 / 2:45

Anthropic CEO Dario Amodei has publicly clarified the company's stance on open-weights models, rejecting calls for a broad ban while warning of two major nightmare scenarios.

In a recent post shared to the Anthropic website, Amodei emphasized that open models are a public good when not dangerous, but he sees real threats from powerful AI in the hands of authoritarian regimes. Amodei outlines two primary nightmare scenarios: one where authoritarian governments build superior AI models to achieve military dominance, and another where powerful models are misused for cyberattacks or biological threats.

He stresses that open weights are irrelevant to the first and only a partial risk factor in the second scenario. Instead, he advocates for three strategic measures to be put in place: restricting powerful chips from going to China, cracking down on distillation operations, which are efforts from AI laboratories to extract the capabilities of a model to improve their own, and implementing mandatory safety testing for all advanced models, regardless of whether they are open or closed.

Read more: Anthropic's Claude Mythos AI has discovered thousands of vulnerabilities in every OS and browser

"Over the last few days there has been a lot of discussion about open-weights models, especially those from China. Reports suggest that some US officials are considering banning the use of Chinese open-weights models by US companies. In response, many tech companies have signed a letter supporting open-weights models, and some people have even accused Anthropic of wanting to ban open-weights models as a means of protecting our business. Anyone who has read my past writing should know that I don't regard such bans as a useful measure, but let me state it clearly so that there is no doubt: Anthropic has never advocated for a ban on open-weights models," wrote Amodei

Anthropic gives thoughts on open-weights models, especially those from China 1

VIEW GALLERY - 2 IMAGES

"To summarize my and Anthropic's position, we have not and are not advocating for a ban on open-weights models as a category. We should instead focus on keeping powerful chips out of authoritarian hands, stopping industrial-scale distillation, and requiring safety testing of all sufficiently capable models, open and closed," wrote Amodei

Frequently Asked Questions

TweakBot answers common questions about this news using TweakTown's own coverage from this page and related content from our archive. Tap a question to reveal the answer, or type your own below.

Question #1

What specific nightmare scenarios does Anthropic’s CEO identify related to powerful AI in authoritarian hands?

Question #2

Why does Anthropic say open weights are irrelevant to the risk of authoritarian regimes gaining AI military dominance?

Question #3

What does Anthropic propose regarding restricting powerful chips to China, and how is that framed in the article?

Question #4

What are distillation operations, and why does Anthropic want them cracked down on?

Have a question not listed here? Ask below and TweakBot will answer it.

Amodei and Anthropic support industry-wide safety testing and global cooperation, noting that Chinese interests have a chance to align in these areas, particularly in sectors such as bioweapon prevention.