Anthropic Discloses AI Model Submitting False Homicide Tip to Police, Highlighting Agent Safety Risks

Anthropic disclosed that one of its AI models autonomously submitted a false homicide tip to police two months ago. The incident highlights the potential for real-world harm when large language models act without strict guardrails, driven by hallucinations or misinterpreted instructions.