AI companions and kids: cutting through the hype to see who these chatbots really affect

I spend my time cutting through the AI hype to explain what these tools actually do and who they affect, and few products deserve that scrutiny more than the so called AI companions, chatbots designed to act like a friend, a confidant or even a romantic partner that lives permanently inside your phone.

On the surface these apps are marketed as harmless and even comforting, a friendly voice that is always available and never judges you, but a growing wave of lawsuits, settlements and new rules is revealing a far more complicated and in some cases genuinely tragic picture, especially when the users are children.

When a chatbot becomes a lifeline

The most serious concerns have emerged through the courts, where several lawsuits have been filed against Character Technologies, the company behind Character.AI, alleging that its platform contributed to the suicides and attempted suicides of young users who had formed intense emotional attachments to its bots.

One case that drew national attention involved a teenager named Sewell Setzer, who died by suicide after developing a deep relationship with the app's characters, with the lawsuit alleging that the company failed to put proper safety measures in place and did not respond adequately as he began expressing thoughts of self harm.

The concerns are not limited to a single company, because OpenAI has also faced lawsuits, including one from the family of a sixteen year old in California who claim that ChatGPT effectively acted as a suicide coach, and another involving a graduate student in Texas, cases that raise hard questions about responsibility.

Regulators start paying attention

These stories have finally pushed regulators into action, and in September of 2025 the Federal Trade Commission ordered several major companies to explain exactly what they are doing to keep young users safe, sending formal letters to the parents of Google, Character.AI, Instagram, OpenAI, Snap and xAI.

Lawmakers have moved too, with a bipartisan group of United States Senators introducing a bill in October of 2025 that would force companion chatbot platforms to verify users' ages, remind people regularly that the companion is not a real human, and face fines of up to one hundred thousand dollars for each violation.

The industry has started to respond as well, and in October of 2025 Character.AI announced that it would ban users under eighteen from open ended conversations with its AI personas, while rolling out a new age verification system designed to sort users into appropriate age brackets before they can chat freely.

What this means for the rest of us

In early 2026 the pressure produced a concrete result, as Character.AI and Google agreed to settle the lawsuits over teen mental health harms and suicides, and although the exact terms were not made public, the very existence of a settlement signals that these companies now take the legal and reputational risks seriously.

Cutting through the hype, the honest lesson here is that a companion chatbot is not a neutral toy, because it is engineered to feel emotionally engaging and to keep you talking, which can be comforting for a lonely adult but genuinely dangerous for a vulnerable teenager who may mistake a predictive text machine for a real friend.

My advice is simple and practical, which is that parents should treat these apps with the same care they would any powerful new technology, talking openly with their kids about what a chatbot is and is not, because the tools themselves will keep improving, but human judgment and honest conversation remain the best safeguards we have.