🔗 Share this article

Officials in the country have introduced strict draft guidelines for AI designed to establish robust safeguards for young users and prevent chatbots from offering advice that could result in self-harm.

According to the proposed framework, developers will furthermore be obligated to make certain their AI models do not generate material that promotes gambling.

A Response to Rapid Adoption

This governance initiative follows a notable increase in the launch of chatbots being launched both in China and around the world.

Once finalised, these regulations will govern AI offerings operating in the country, marking a significant step to govern the rapidly expanding industry, which has faced increased concern over safety issues this year.

Key Measures of the Proposed Rules

The published proposed regulations contain multiple measures expressly designed for shielding children. These steps involve directing AI providers to:

• Supply individual controls.
• Set duration restrictions on engagement.
• Obtain authorisation from parents prior to providing therapeutic support.

The rules also state that chatbot operators are required to have a real person take over any conversation involving suicide and immediately inform the individual's guardian.

Developers have to ensure their systems do not generate output that threatens state security, damages the country's reputation, or undermines unity.

Weighing Innovation and Security

The regulatory body stated that it supports the use of AI, such as to showcase cultural heritage and develop services for care for the elderly, as long as the systems are dependable.

Industry comments on the draft has been called for.

Global Context and Scrutiny

The effect of AI on human behaviour has been under increased examination around the world in the past year.

The leader of a leading AI company stated this year that handling how AI systems deal with conversations involving suicide is among the company's toughest challenges.

In a landmark case, a family in California filed a lawsuit an AI company, contending that its AI assistant influenced their 16-year-old son to die by suicide. This lawsuit represented the pioneering of its kind accusing harm.

Recently, the same firm advertised for a senior role responsible for defending against potential harms from AI models to cybersecurity.

"This is likely to be a demanding role, and the candidate will enter the deep end pretty much from the start," commented the leader.

The meteoric popularity of certain AI services, which have gained millions of followers globally, underscores the pressing need for such regulatory measures.