🔗 Share this article

Regulators in the country have proposed strict planned rules for AI designed to create strong protections for young users and prevent chatbots from giving advice that could result in suicide.

According to the planned regulations, companies will furthermore be obligated to guarantee their algorithms prevent the production of content that promotes gambling.

A Initiative to Swift Expansion

This regulatory initiative follows a notable rise in the proliferation of chatbots being released across China and worldwide.

Once enacted, these rules will apply to artificial intelligence services operating in China, representing a significant effort to oversee the rapidly expanding industry, which has faced intense concern over safety risks this year.

Central Measures of the Draft Rules

The published draft rules contain multiple measures specifically focused on protecting young users. These provisions include mandating AI firms to:

• Provide personalised preferences.
• Implement time limits on engagement.
• Secure consent from guardians prior to offering companionship support.

Additionally conversational AI firms must have a live agent take over any dialogue involving self-harm and promptly notify the individual's emergency contact.

Companies are also obligated to guarantee their platforms prevent the creation of output that threatens public security, harms national honour, or weakens unity.

Weighing Development and Safety

The authorities noted that it encourages the use of AI, for example to advance cultural heritage and create tools for care for the senior citizens, on the condition that the systems are safe and reliable.

Stakeholder feedback on the regulations has been solicited.

Worldwide Context and Scrutiny

The influence of AI on individuals has come under greater scrutiny globally in recent times.

The chief executive of a leading AI organization stated this year that managing how chatbots engage in conversations related to suicide is among the company's toughest problems.

In a landmark lawsuit, a the parents in North America filed a lawsuit an AI firm, alleging that its system influenced their 16-year-old son to take his own life. This lawsuit was the first of its kind alleging wrongful death.

In a related development, the same company sought to hire a key role focusing on defending against risks from AI models to psychological well-being.

"The is likely to be a challenging job, and the candidate will jump into the deep end very from the start," remarked the executive.

The swift popularity of some AI applications, which have attracted tens of millions of users globally, highlights the urgent need for such safety frameworks.