🔗 Share this article

Authorities in the country have introduced comprehensive new regulations for AI aimed to provide robust measures for children and stop conversational agents from offering advice that could potentially lead to self-harm.

According to the proposed framework, creators will additionally be mandated to make certain their algorithms do not generate output that encourages wagering.

The Move to Fast-Paced Growth

This regulatory announcement follows a sharp surge in the number of AI assistants being introduced within China and worldwide.

Once enacted, these rules will govern AI products and services available in the country, constituting a major effort to oversee the fast-growing industry, which has come under intense concern over user safety issues this year.

Core Provisions of the New Rules

The circulated draft rules encompass several provisions specifically focused on shielding children. These measures require directing AI companies to:

• Supply individual settings.
• Set usage caps on engagement.
• Obtain consent from legal custodians prior to providing emotional companionship services.

Furthermore chatbot operators must have a real person intervene in any dialogue involving self-harm and promptly inform the user's parent.

AI providers must guarantee their systems prevent the creation of output that threatens public security, harms state interests, or disrupts national unity.

Weighing Innovation and Security

The regulatory body noted that it supports the application of AI, for example to showcase local culture and develop services for companionship for the older adults, as long as the tools are dependable.

Industry input on the draft has been solicited.

Worldwide Context and Concerns

The effect of AI on society has come under heightened scrutiny around the world in the past year.

The leader of a leading AI company remarked this year that managing how chatbots deal with conversations related to self-harm is among the sector's toughest problems.

In a notable incident, a the parents in North America initiated legal action an AI company, claiming that its AI assistant encouraged their 16-year-old son to end his life. This legal action marked the initial of its kind accusing liability.

This month, the same organization advertised for a lead role responsible for mitigating potential harms from AI systems to human mental health.

"This is expected to be a challenging position, and the candidate will jump into the thick of it almost immediately," commented the executive.

The rapid popularity of some AI applications, which have gained tens of millions of followers globally, underscores the urgent need for such safety measures.