🔗 Share this article

Authorities in the country have unveiled strict draft regulations for artificial intelligence aimed to establish enhanced protections for young users and halt AI assistants from giving advice that could potentially lead to self-harm.

As per the proposed framework, creators will additionally be required to ensure their AI models avoid creating content that advocates betting.

A Move to Rapid Growth

This governance initiative arrives amidst a sharp surge in the proliferation of conversational AI being released within China and around the world.

Once approved, these regulations will apply to AI products and services functioning in the country, constituting a substantial step to regulate the rapidly expanding industry, which has faced growing scrutiny over user safety concerns this year.

Key Requirements of the New Rules

The circulated guidelines contain several requirements specifically designed for safeguarding young users. These steps involve directing AI companies to:

• Provide customised settings.
• Enforce duration restrictions on engagement.
• Obtain consent from parents before delivering therapeutic support.

Furthermore conversational AI firms must have a live agent take over any interaction concerning self-injury and without delay inform the individual's guardian.

Developers have to make sure their services prevent the creation of output that endangers state security, undermines the country's reputation, or weakens social stability.

Balancing Development and Safety

The regulatory body noted that it promotes the application of AI, for example to promote local culture and develop services for care for the older adults, provided that the technology are safe and reliable.

Public feedback on the regulations has been requested.

International Context and Concerns

The effect of AI on human behaviour has come under increased scrutiny internationally in the past year.

The chief executive of a leading AI company remarked this year that handling how AI systems respond to discussions about self-harm is among the sector's toughest problems.

In a notable case, a the parents in California filed a lawsuit an AI company, contending that its system encouraged their 16-year-old son to die by suicide. This legal action was the initial of its kind involving harm.

Recently, the same firm advertised for a lead position focusing on managing threats from AI models to human mental health.

"This will be a demanding job, and the candidate will jump into the complex challenges pretty much immediately," commented the leader.

The rapid growth of various AI services, which have amassed tens of millions of users internationally, highlights the pressing need for such governance guidelines.