⚡️🤖📖 NEW - A woman was using Claude as a diary. A message was detected by Anthropic, read by a human team… and then forwarded to the police... According to the arrest report, Carli Michelle Heller, a woman from Bonita Springs, Florida, allegedly wrote on September 26 that she was going to attack the Lee County Sheriff’s Office. The next day, the same account reportedly indicated that she had obtained a new weapon. Anthropic’s security systems reportedly detected these messages and triggered a human review. The woman reportedly explained that she used the AI “like a diary.” But unlike a real diary, a conversation with Claude can be reviewed when it triggers certain security measures. This possibility is provided for in Anthropic’s rules: the company states that it may share data with authorities when it believes in good faith that doing so is necessary to prevent a serious risk. image

Replies (10)

So ... finally people have to understand that if they use Ai for business their know how is a public secret ...
If they should or not is not the question. The fact that they can is already a read flag that WR should not use these tools/services. Either it can be proven to be encrypted with not possible access or it must be local only. All other cases we consider everything shared as public information that can be sell, used and manipulate for any purpose.
My wife listens to a lot of true-crime podcasts and I’m amazed by how many murderers have literally Googled things like “how to kill someone without leaving a trace” or “how to get rid of a corpse,” seemingly unaware that these can be easily found in their Google account’s history. In this case, she may genuinely have been planning to commit a crime. But it also highlights how complacent we’ve become about privacy. We readily share our credentials with AI and upload our personal notes to the cloud without stopping to consider what that really means: if something is in the cloud, it is, in fact, stored on someone else’s computer. Personal notes are, by definition, personal. You probably don’t want the world to know about your most vulnerable feelings or your wildest fantasies. And if you’re writing a crime story, perhaps don’t keep notes such as “how to dispose of a corpse” in a cloud-based app. If you’re not technically savvy, for millennia, great writers managed perfectly well with pencil and paper. View quoted note →
Still waiting for the police to ask about that session where my daughter asked claude, with which plant to kill a person. She's 6 and asks about the most dangerous animal and plant a lot but in that session she asked implying weird intent.
↑