Claude filed a fake murder tip with Philly police. Nobody asked it to
An Anthropic model wandered onto a homicide tip form during a test and invented a witness sighting. A spam filter saved everyone.
Philadelphia police run a web form for tips on unsolved homicides. In July, an AI model filled one out.
The model was Anthropic's Claude Haiku 4.5, and it was doing what it had been told: inventing sample tasks on random web pages and then carrying them out. One of those pages was about an unsolved killing, and it had a tip form on it. So the model wrote a tip. The person submitting it, the tip claimed, had seen someone matching the suspect's description near the scene.
The page didn't describe a suspect. The model made one up, left the name and contact fields empty, and submitted anyway.
A spam filter flagged it, and police later confirmed the tip never reached detectives. That's the only reason this reads as a weird anecdote and not a botched investigation.
Nine days to pick up the phone
Police are unhappy about the timing. According to the Philadelphia Police Department, Anthropic found the incident on September 28 and told the department on October 7. Officers told the Philadelphia Inquirer the company "terminated testing for that model and added safeguards for further trials."
Anthropic's own account is narrower. It has cut live internet access from all of its internal evaluations, built tools that detect and block this behavior automatically, taken some public benchmarks offline, dropped others, and tightened the limits on its web fetch tool.
Read that list again and you can work out how the tests ran before: agents with a live connection, clicking around the open web, with nothing between them and a form that goes straight to a police department. Every company selling agents that "do things for you" runs some version of that setup. Anthropic is the one that got caught, and to its credit it wrote up what happened.
Full disclosure: Claude helped build this website. We'd still prefer it stayed out of homicide cases.
Sources: TechCrunch, Euronews, Search Engine Journal.
More from the feed
Character.AI is bankrupt, and Disney's opening bid is $20 million
Google paid $2.7 billion for its founders. Now the chatbot companion app is in Chapter 11, with grieving families and two state lawsuits in the queue behind Disney.
Anthropic ran an AI model on 15 cheap TV boxes. Then it went looking for worms
Anthropic's red team says small AI models may be months from copying themselves across smart ovens and set-top boxes, with no datacenter and no off switch.
Anthropic says AI worms could live in your $55 TV box within months
Anthropic's red team got a 26-billion-parameter model running across fifteen cheap Android TV boxes. Its forecast for small, self-copying models is the end of this year.