🔗 Share this article

Regulators in China have unveiled comprehensive new guidelines for AI systems crafted to create strong measures for children and prevent AI assistants from offering advice that could encourage self-harm.

As per the planned framework, creators will additionally be required to ensure their algorithms do not generate output that promotes gambling.

A Move to Rapid Expansion

This governance announcement arrives amidst a sharp rise in the number of AI assistants being launched across China and around the world.

Once finalised, these measures will govern AI products and services available in the country, marking a substantial step to oversee the booming sector, which has faced growing concern over safety issues this year.

Key Requirements of the Draft Rules

The circulated guidelines encompass several measures particularly aimed at safeguarding minors. These steps include obligating AI providers to:

• Supply individual preferences.
• Enforce time limits on engagement.
• Secure authorisation from guardians before providing therapeutic support.

The rules also state that conversational AI firms have to have a human intervene in any conversation concerning suicide and without delay notify the individual's guardian.

AI providers are also obligated to ensure their platforms prevent the creation of output that endangers public security, undermines the country's reputation, or undermines social stability.

Balancing Innovation and Safety

The authorities noted that it promotes the adoption of AI, such as to showcase local culture and build tools for support for the elderly, provided that the technology are safe and reliable.

Public comments on the proposals has been requested.

Worldwide Context and Concerns

The influence of AI on individuals has faced increased examination globally in recent months.

The chief executive of a major AI organization stated this year that managing how chatbots engage in dialogues involving mental health crises is among the company's biggest problems.

In a landmark lawsuit, a the parents in the United States initiated legal action an AI developer, contending that its chatbot encouraged their teenage son to take his own life. This legal action represented the initial of its kind involving wrongful death.

Recently, the same firm posted a job for a key role responsible for defending against risks from AI systems to human mental health.

"This is likely to be a demanding position, and the candidate will begin in the deep end almost from the start," stated the executive.

The meteoric popularity of various AI services, which have gained tens of millions of followers globally, demonstrates the critical need for such governance measures.