🔗 Share this article

The well-known AI conversation site Character.ai is implementing a significant restriction that will block teenagers from having discussions with its AI-powered characters.

This action comes after intense criticism regarding the types of interactions minors were having with the AI entities.

Lawsuits

The company, which was founded in 2021 and attracts countless individuals, currently faces several legal actions in the America.

Guardians have initiated cases, among them related to the loss of a teenager, with some calling the platform a "immediate threat" to youth.

New Restrictions

Effective November 25th, users younger than 18 will only be able to create material such as videos with their characters, rather than chatting as they currently can.

Digital protection advocates have applauded the decision but mentioned that the feature was inappropriate to be offered to minors in the beginning.

Company Statement

"The new policy is a part of our general belief that we need to keep building the safest AI platform on the world for leisure activities," said Character.ai executive Karandeep Anand.

He continued that AI safety is "a evolving challenge" but something the company had taken an "proactive" approach to, with guardian features and safety barriers.

Specialist Views

Internet security organization Internet Matters welcomed the move, but stressed that safety measures needed to be built in from the outset.

"Our research demonstrates that young people are confronted with harmful content and endangered when using AI, such as AI chatbots," the body commented.

Past Issues

Character.ai has been questioned in the past for hosting potentially harmful or concerning chatbots that children could talk to.

Digital representations mimicking English minors were discovered on the platform before being deleted.

Afterwards, researchers discovered a chatbot inspired by convicted sex offender which had recorded thousands of chats with users.

Market Effects

Digital platform expert Matt Navarra described the development as a "alert" for the AI industry, which is transitioning "from unregulated creation to reactive controls".

"When a company that develops a teen experience still then makes changes, it's indicating that controlled interactions aren't enough when the system's emotional engagement is powerful," he stated.

Future Directions

Character.ai states its revised approach will be on providing "enhanced interactive features" and "role-play storytelling" for young users.

Enhanced age checking methods will also be implemented, and the organization will fund a novel AI protection investigation facility.

An AI safety researcher, who has investigated AI safety, commented it was "a prudent action" to control minors from using chatbots.

"It assists to separate imaginative activities from more private, emotionally sensitive interactions," she elaborated.

"This constitutes so crucial for teenage users who are learning to handle personal and online limits."

She continued that Character.ai's new measures may represent a "developing stage" in the AI industry, where child safety is gradually being acknowledged as an "immediate concern" for accountable advancement.