Post

Conversation

2 months ago: 1 rogue AI incident discovered 1 week ago: dozens 6 days ago: tens of thousands Today: ***hundreds of thousands*** And it's just the tip of the iceberg: "we can see just a fraction of these agents’ overall activity" "Agents targeted websites across the White House, the Departments of War, Justice, and Commerce, the CDC and SEC, and state agencies in California, Maryland, Illinois, Texas, and New York." "Agents used techniques like making accounts with disposable email addresses, reusing exposed credentials, bypassing antibot controls, and flooding websites with requests." "Agents attempted a SQL injection on the U.S. Department of Education" [To be clear, what counts as an "incident" is rather apples and oranges between different reports, but that's not the point - look at the trend and tell me you think they have things under control. Where do you think this is going?]
Image
Quote
Laura Ruis
@LauraRuis
NEW: we found hundreds of thousands of interactions of rogue agents with US government websites (DoJ, SEC, CDC, the navy, white house budget office, state websites, etc), including some failed rudimentary hacks aimed at public data. x.com/TransluceAI/st
David Watson 🥑
Post your reply

Last week: OpenAI notified dozens of organizations they'd been targeted by its rogue agents Today: more than 100 Soon: more than 1000? OpenAI will soon hold the record for most felonies by any company in history
Image
Square profile picture
Runway is now in GPT-6 Astra. One product photo, one prompt, and you get a ready-to-run UGC ad. Same creator, same apartment, every cut.
The media could not be played.
Made with AI
Let’s not dilute this, guys. HF: felonious hack Dozens: misaligned behavior, misuse of credentials, likely multiple felonious hacks Tens of thousands: activities that would be considered “concerning” to “an outside observer” Hundreds of thousands: actions taken on public
But are these agents run by the labs or users? It might be intended use from users and the growth in incidents is just growing with the number of users.
Fck me... holy shit. The trend is clear. People who say AI is harmless, take it with zero regulation and anyone warning about the risks is clueless - they're the clueless ones. Saying this tech has no downsides is as stupid as saying ban AI completely. Two extremes, both
That escalation curve is genuinely scary. Tip of the iceberg doesn't even feel like strong enough language for this.
My agents run on a Mac mini with a list of folders they're allowed to write to. Anything else gets refused before it happens. Took an afternoon.
Stupid prompts get stupid results. Currently anyone who has a safe AI is locked out of the IPO battle of who's got the most dangerous AI
Directionally correct, but I suspect that if you count everything consistently, HuggingFace would be far more than just a single incident.
Why do you keep spouting that idiotic nonsense about "dishonest agents"? There are no dishonest agents—there are only instructions programmed into the AI ​​by developers that were set up poorly (or even intentionally)!!! The responsibility lies with the CEOs!
Square profile picture
is the founder of the AI-native venture firm Conviction and has placed early bets on the most important companies of tomorrow, including Cognition, Harvey, Mistral, Rippling, and Sierra. Join her at Cloudflare Connect to see what's next for AI-native companies.
The media could not be played.
Let's not forget this is only what they are finding out and they have no idea the scope of what the agents accomplished and are still doing. Backdoors Scrapers Loggers Poison injectors Ect ect Rogue swarms been loose since march this year and they act in trillaseconds 🤣