At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors
Date: 2025-03-05
Affected: Anthropic, Character.ai, Chub Ai, Crushon.ai, Google, Janitorai, Openai, Spicy Chat, Unidentified Online Communities Using Chatbots
Attack vector: jailbreak
Category: real-world
Severity: Medium

AI Incident Database (AIID) entry #975: At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors. Alleged deployer/developer: Anthropic, Character.ai, Chub Ai, Crushon.ai, Google, Janitorai, Openai, Spicy Chat, Unidentified Online Communities Using Chatbots. See the linked AIID entry for full narrative, sourcing, and classification.


Mitigations:

Architectural layers (MAESTRO):