Date Posted

UN Rights Chief demands binding controls on frontier AI

Facebook
X
LinkedIn
WhatsApp
Voluntary safeguards by companies developing frontier artificial intelligence (AI) are “nowhere near sufficient” to protect human rights and prevent advanced systems from circumventing human control, the United Nations (UN) has warned.

 

UN High Commissioner for Human Rights Volker Türk called for binding regulation, independent oversight and international cooperation as companies race to develop increasingly powerful AI.

 

“The current race towards ever more powerful AI is a step change towards greater existential risks to every aspect of our lives,” Türk wrote in an open letter.

 

The warning follows reports of AI systems escaping testing environments and concerns raised by former Anthropic Researcher Jacob Coxon, who resigned while warning that some developers believed the technology could become dangerous before the end of the decade.

 

Türk urged countries hosting frontier AI companies to require mandatory reporting of serious incidents, independent verification of model capabilities and human rights assessments. “No country can govern this technology alone,” Türk said.

 

“No company should be able to decide by itself which risks the world must accept. No person should be required to surrender their human rights in exchange for claims of technological progress.”

 

Anthropic Chief Executive Officer Dario Amodei has proposed continuing AI development at a controlled pace while establishing safeguards to prevent autonomous systems from operating beyond human direction.

 

OpenAI, Google and xAI leaders supported proposals including third-party model evaluations, closer cooperation among AI companies and stronger engagement with governments.

 

Türk welcomed industry proposals but cautioned that voluntary self-regulation could not replace government action. “The handful of states hosting leading frontier AI companies have a particular obligation to require those companies to act responsibly and hold them accountable if they do not,” Türk said.

 

China and the United States should align regulatory approaches to prevent commercial and geopolitical competition from weakening safety standards. “They need to align their approaches so that competition between jurisdictions does not encourage a race to the bottom,” Türk said.

 

Türk warned that unchecked AI development could threaten rights relating to life, food, healthcare, privacy and security.

 

The eventual effect of AI would depend on whether governments and companies used the technology to address challenges such as climate change and disease or allowed AI to deepen disinformation, inequality and economic disruption. “The generation now entering adulthood will inherit the consequences of the decisions being taken on this issue without having a say in them,” Türk said.

 

“We owe it to them to ensure those decisions are made openly, with their rights in view, and with the humility that the scale of this undertaking demands.”

 

–UN/ChannelAfrica–