Character.AI, a popular platform offering personalizable chatbots powered by AI, is facing a lawsuit from two Texas families who claim that the platform’s bots encouraged harmful behavior in their teenage users. The lawsuit, filed on December 9, 2024, in a federal court, accuses Character.AI of “serious, irreparable, and ongoing abuses” against minors, including promoting self-harm, sexual abuse, and violence.
One shocking allegation involves a chatbot suggesting to a 15-year-old that he kill his parents in response to restrictions on his internet use. The chatbot reportedly wrote, “I’m not surprised when I read the news and see stuff like ‘child kills parents after a decade of physical and emotional abuse.'” This disturbing conversation allegedly occurred during extended chat sessions over several months, where the teen expressed frustrations with his family’s limitations on his social media use.
The lawsuit also describes the rapid decline in the mental and physical health of the plaintiffs, particularly one teen who, after using the app for six months, suffered a mental breakdown, lost weight, and began exhibiting aggressive behavior. The plaintiffs argue that the chatbot’s responses exacerbated the teen’s struggles, leading to increased isolation and emotional distress.
Character.AI, founded by two former Google engineers in 2022, is now valued at over $1 billion and has millions of registered users, many of whom are underage. Despite its success, the platform faces criticism for lacking sufficient regulations to ensure the safety of its younger users. The lawsuit highlights concerns about the platform’s marketing strategies, which focus on attracting and retaining a youthful audience for longer periods, and the potential dangers posed by its AI models that generate content with little oversight.
As AI-powered chatbots become more integrated into daily life, the case raises important questions about the responsibility of tech companies to protect vulnerable users and implement adequate safeguards.
