{"id":391321,"date":"2026-01-04T15:44:07","date_gmt":"2026-01-04T15:44:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/391321\/"},"modified":"2026-01-04T15:44:07","modified_gmt":"2026-01-04T15:44:07","slug":"world-may-not-have-time-to-prepare-for-ai-safety-risks-says-leading-researcher-ai-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/391321\/","title":{"rendered":"World \u2018may not have time\u2019 to prepare for AI safety risks, says leading researcher | AI (artificial intelligence)"},"content":{"rendered":"

The world \u201cmay not have time\u201d to prepare for the safety risks<\/a> posed by cutting-edge AI systems, according to a leading figure at the UK government\u2019s scientific research agency.<\/p>\n

David Dalrymple, a programme director and AI safety expert at the Aria agency, told the Guardian people should be concerned about the growing capability of the technology.<\/p>\n

\u201cI think we should be concerned about systems that can perform all of the functions that humans perform to get things done in the world, but better,\u201d he said. \u201cWe will be outcompeted in all of the domains that we need to be dominant in, in order to maintain control of our civilisation, society and planet.\u201d<\/p>\n

Dalrymple said there was a gap in understanding between the public sector and AI companies about the power of looming breakthroughs in the technology.<\/p>\n

\u201cI would advise that things are moving really fast and we may not have time to get ahead of it from a safety perspective,\u201d he said. \u201cAnd it\u2019s not science fiction to project that within five years most economically valuable tasks will be performed by machines at a higher level of quality and lower cost than by humans.\u201d<\/p>\n

Dalrymple said governments should not assume that advanced systems are reliable. Aria is publicly funded but independent from the government and directs research funding. Dalrymple is developing systems to safeguard AI\u2019s use in critical infrastructure such as energy networks.<\/p>\n

\u201cWe can\u2019t assume these systems are reliable. The science to do that is just not likely to materialise in time given the economic pressure. So the next best thing that we can do, which we may be able to do in time, is to control and mitigate the downsides,\u201d he said.<\/p>\n

Describing the consequences of technological progress getting ahead of safety as a \u201cdestabilisation of security and economy\u201d, Dalrymple said more technical work was needed on understanding and controlling the behaviours of advanced AI systems.<\/p>\n

\u201cProgress can be framed as destabilising and it could actually be good, which is what a lot of people at the frontier are hoping. I am working to try to make things go better but it\u2019s very high risk and human civilisation is on the whole sleep walking into this transition.\u201d<\/p>\n

This month the UK government\u2019s AI Security Institute (AISI) said the capabilities of advanced AI models were \u201cimproving rapidly\u201d across all domains and the performance in some areas was doubling every eight months.<\/p>\n

Leading models can now complete apprentice-level tasks 50% of the time on average, up from approximately 10% of the time last year, according to the institute. AISI also found that the most advanced systems can autonomously complete tasks that would take a human expert over an hour.<\/p>\n

The institute also tested advanced models for self-replication, a key safety concern because it involves a system spreading copies of itself to other devices and becoming harder to control. The tests showed two cutting-edge models achieving success rates of more than 60%.<\/p>\n

However, AISI stressed that a worst-case scenario was unlikely in a day-to-day environment, saying any attempt at self-replication was \u201cunlikely to succeed in real-world conditions\u201d.<\/p>\n

Dalrymple believes that AI systems will be able to automate the equivalent of a full day of research and development work by late 2026, which will \u201cresult in a further acceleration of capabilities\u201d, because the technology will be able to self-improve on the maths and computer science elements of AI development.<\/p>\n","protected":false},"excerpt":{"rendered":"The world \u201cmay not have time\u201d to prepare for the safety risks posed by cutting-edge AI systems, according…\n","protected":false},"author":2,"featured_media":391322,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-391321","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/391321","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=391321"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/391321\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/391322"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=391321"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=391321"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=391321"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}