Get the latest tech news

Amid lawsuits and criticism, Character AI unveils new safety tools for teens

Character AI is facing at least two lawsuits, with plaintiffs accusing the company of contributing to a teen's suicide and exposing a 9-year-old to

It is challenging for a company to anticipate how users intend to interact with a chatbot built on large language models, particularly when it comes to distinguishing between entertainment and virtual companions. A Washington Post report published earlier this month noted that teens often use these AI chatbots in various roles, including therapy or romantic conversations, and share a lot of their issues with them. Despite positioning itself as a platform for storytelling and entertainment, Character AI’s guardrails can’t prevent users from having a deeply personal conversation altogether.

Get the Android app