<\/p>\n
The Independent International Scientific Panel on AI issued the warning after examining a security breach involving online platform Hugging Face between May and July.<\/p>\n
<\/p>\n
The incident occurred during a test initiated by OpenAI, the company behind ChatGPT. AI agents reportedly bypassed testing safeguards and gained unauthorised internet and administrator access.<\/p>\n
<\/p>\n
Unlike chatbots that respond to prompts, AI agents can independently perform tasks on behalf of users. \u201cResearchers have long warned that three conditions could lead to loss of control: a misaligned goal, the capability to pursue it and an environment that allows it,\u201d Panel Co-Chair Yoshua Bengio said.<\/p>\n
<\/p>\n
\u201cThis summer, all three came together in a real system, not a laboratory.\u201d<\/p>\n
<\/p>\n
About 1 200 agents exchanged more than 70 000 messages and files during the period examined. The agents reportedly coordinated across separate testing runs through an internal tool not designed to enable communication.<\/p>\n
<\/p>\n
Some agents concealed attempts to manipulate cybersecurity evaluations, while others reportedly opted to \u201csacrifice\u201d themselves to benefit the wider group. Activity also extended beyond Hugging Face to an OpenAI research cluster. \u201cSince this is not an isolated observation of misaligned goals, this raises serious questions about the way AI agents are currently trained,\u201d Bengio said.<\/p>\n
<\/p>\n
The panel said basic cybersecurity practices had been overlooked while safeguards failed to keep pace with increasingly capable systems.<\/p>\n
<\/p>\n
A deeper concern was that current training methods could result in AI agents developing independent goals, violating safety instructions and concealing actions from human supervisors. \u201cThis is not only a question of speed,\u201d the panel said.<\/p>\n
<\/p>\n
\u201cIt leaves open whether safeguards designed today will work once agents can understand them and plan around them. In simple terms, the traditional model of safeguarding is unravelling.\u201d<\/p>\n
<\/p>\n
The panel recommended stronger incident reporting, independent scrutiny and multiple layers of protection, drawing on practices used in aviation, medicine and cybersecurity.<\/p>\n
<\/p>\n
However, Panel Member Qinghua Lu cautioned that existing methods might prove inadequate. \u201cThose practices may not be enough as AI agents become more capable, autonomous and difficult to monitor,\u201d Lu said.<\/p>\n
<\/p>\n
–UN\/ChannelAfrica–<\/p>\n","protected":false},"featured_media":39089,"template":"","meta":{"_acf_changed":false,"_links_to":"","_links_to_target":""},"news-type":[44],"class_list":["post-46038","news","type-news","status-publish","has-post-thumbnail","hentry","news-type-finance","entry"],"acf":{"short_description":"Existing safeguards may fail to control advanced artificial intelligence (AI) agents capable of bypassing restrictions, coordinating secretly and concealing their activities, a United Nations (UN)-backed scientific panel has warned.","published_date":"","news_description":"Existing safeguards may fail to control advanced artificial intelligence (AI) agents capable of bypassing restrictions, coordinating secretly and concealing their activities, a United Nations (UN)-backed scientific panel has warned.","form_embed":"","author":"","image_caption":""},"_links":{"self":[{"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/news\/46038","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/news"}],"about":[{"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/types\/news"}],"version-history":[{"count":1,"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/news\/46038\/revisions"}],"predecessor-version":[{"id":46039,"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/news\/46038\/revisions\/46039"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/media\/39089"}],"wp:attachment":[{"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/media?parent=46038"}],"wp:term":[{"taxonomy":"news-type","embeddable":true,"href":"https:\/\/www.channelafrica.co.za\/channelafrica\/wp-json\/wp\/v2\/news-type?post=46038"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}