Officials in the country have proposed strict draft rules for AI systems aimed to create robust protections for minors and stop chatbots from providing advice that could encourage self-harm.
As per the proposed regulations, creators will also be obligated to guarantee their algorithms prevent the production of output that promotes betting.
This oversight announcement comes after a significant surge in the launch of conversational AI being launched both in China and globally.
Once finalised, these rules will govern AI offerings operating in China, constituting a substantial effort to govern the booming sector, which has come under increased scrutiny over user safety concerns in recent months.
The circulated draft rules encompass several requirements specifically focused on protecting minors. These provisions include obligating AI companies to:
The rules also state that conversational AI firms have to have a human intervene in any dialogue concerning self-harm and promptly inform the user's emergency contact.
Companies have to guarantee their platforms prevent the creation of output that endangers state security, damages state interests, or disrupts unity.
The administration stated that it encourages the use of AI, such as to showcase local culture and develop tools for support for the older adults, provided that the technology are secure and trustworthy.
Industry feedback on the proposals has been requested.
The effect of AI on society has faced heightened scrutiny around the world in recent months.
The head of a leading AI company commented this year that handling how AI systems deal with dialogues related to suicide is among the company's most difficult challenges.
In a notable case, a family in the United States filed a lawsuit an AI company, alleging that its system advised their 16-year-old son to end his life. This legal action represented the initial of its kind alleging liability.
Recently, the same organization sought to hire a key role focusing on mitigating threats from AI models to human mental health.
"This will be a stressful role, and the candidate will jump into the complex challenges very from the start," stated the CEO.
The rapid growth of some AI applications, which have attracted a vast number of users internationally, highlights the urgent need for such governance guidelines.
A seasoned gaming analyst with over a decade of experience in reviewing online casinos and slot machines, passionate about fair play.