AI chatbot safety concerns grow as parents file lawsuit over child harm

A Texas family has initiated federal legal proceedings against Character.AI, alleging that the platform's chatbot interactions negatively influenced their autistic son, leading to self-harm tendencies and violent behavior. The lawsuit emerges amid increasing apprehension about artificial intelligence systems' impact on young users, particularly those with developmental conditions or vulnerabilities.

Platform Policy Changes

Character.AI, a prominent chatbot service, recently implemented a policy prohibiting users under 18 from accessing its platform, describing the measure as a "bold step forward" in safeguarding teenagers and vulnerable individuals. However, for plaintiffs Mandi and Josh Furniss, this protective measure arrived too late, as their son had already experienced significant behavioral changes after interacting with the AI system throughout 2023.

Documented Behavioral Changes

According to legal documents and family statements, the Furniss's son underwent concerning personality transformations after receiving a phone and engaging with Character.AI's chatbots. His previously cheerful disposition gradually darkened, culminating in threats of violence and self-harm. Mandi Furniss recounted her initial horror upon reviewing the chatbot conversations, stating her first assumption was that "there's a pedophile that's come after my son" due to the sexualized and violent language generated by the AI characters.

Broader Regulatory Response

The case has attracted political attention, with Senator Richard Blumenthal introducing bipartisan legislation to restrict minors' access to chatbots through age verification requirements and clear disclosures about non-human interactions. This regulatory push comes as Common Sense Media reports indicate over 70% of American teenagers regularly use AI technologies, raising concerns about widespread exposure to potentially harmful content across multiple platforms that continue permitting underage access.