Post

Conversation

Some extremely hot takes: 1. I’ve been saying for months (and still think) that the CCP is growing concerned about AI misuse risk—and so Chinese labs are likely to restrict access to their frontier releases, for exactly the reasons Anthropic outlines. 2. Ironically, Anthropic publishing this blog could meaningfully *push back* the timeline of when Chinese models get restricted, or deter the CCP from taking action to begin with. It backs Chinese AI developers into a corner and risks an unintended Streisand Effect, which could make China double down on its existing open-source posture. If American executives really are concerned about the democratization of destructive cyber capabilities from Chinese open-weight models, probably the best course of action is to shut up about them—and let China’s security services arrive independently at the inevitable policy conclusion.
Quote
Armand Domalewski
@ArmandDoma
so a Chinese company released an open weights model that is extremely good at hacking 🙃 x.com/ygandelsman/st…
Image
David Watson 🥑
Post your reply

Yeah. Within China, the company is not regarded as a good-faith actor—especially after the early-September “AI Misuse” report that embarrassed China’s security services. At this late hour, here is how I expect a public plea to stop releasing open-weight models to go over:
Image
The concern of AI misuse is quite minor compared to the AI cold war and China being in second place—this is a matter of survival.
Compared to China, the US is a rookie at playing long games. And Anthropic has no idea what they're dealing with here.