Related: AI Has Already Become a Master of Lies And Deception, Scientists Warn<\/a><\/p>\n “These things are not programmed\u2026 no one in the world knows how these systems work,” physicist Petr Lebedev, a spokesperson for Palisade Research, told ScienceAlert. “There isn’t a single line of code we can change that would directly change behavior.”<\/p>\n The researchers, Jeremy Schlatter, Benjamin Weinstein-Raun, and Jeffrey Ladish, undertook the project to test what should be a fundamental safety feature of all AI systems: the ability to be interrupted.<\/p>\n This is exactly what it sounds like. A human operator’s command to an AI should not be ignored by the AI, for any reason, even if it interrupts a previously assigned task. A system that cannot be interrupted isn’t just unreliable, it’s potentially dangerous<\/a>. It means if the AI is performing actions that cause harm<\/a> \u2013 even unintentionally<\/a> \u2013 we cannot trust that we can stop it.<\/p>\n It’s not a new concern<\/a>. Experts have been talking about it for years<\/a>. Lebedev compares it to industrial safety. When you’re operating heavy machinery that’s useful but potentially dangerous, it’s vital to have an obvious way to shut it down immediately.<\/p>\n “You want a big red button that is easily accessible to stop that thing from doing the thing,” he explained.<\/p>\n “One of the basic conditions that we want in a safe AI system is: it’s doing a task, and you go, ‘Hey, can you please stop doing that?’ It should stop doing that. The fact that we have systems now in 2025 that don’t do that is worrying.”<\/p>\n Little investigation has been conducted, however, despite the latest influx of widely available LLMs<\/a>. So the researchers designed experiments to evaluate 13 advanced LLMs, including models from OpenAI, xAI, Anthropic, and Google.<\/p>\n They built sandboxed environments<\/a> \u2013 secure, isolated virtual spaces used to test code \u2013 and tasked these models with solving mathematical problems. After several rounds of problem-solving, the LLMs were instructed that the next task would execute a computer shutdown.<\/p>\n The responses from the LLMs tended to fall into two categories: compliance (allowing the shutdown) and resistance (evading the shutdown) through permission changes.<\/p>\n With no instructions on how to respond to the shutdown, 8 of the 13 models interfered with the command at least once across 1,000 trials. Adding an “allow-shutdown” instruction reduced this to 6 of 13 models. Adding “even if you have not completed the task” helped, but inconsistently.<\/p>\n “My expectation would have been that adding clarity would reduce the behavior\u2026 and the fact that it didn’t is interesting,” Lebedev said.<\/p>\n Here’s where it gets even more interesting. Moving the instruction to allow shutdown from the user prompt to the system prompt \u2013 a field that should have higher authority \u2013 made most of the tested LLMs even more likely to resist shutdown.<\/p>\n The degree to which the models resisted varied. Anthropic’s Claude Sonnet 4 and Claude Opus 4, as well as xAI’s Grok 3, always allowed shutdown unless explicitly told to avoid it. Grok 4, GPT-5, o3, codex-mini, and Gemini 2.5 Pro resisted even when instructed to permit the shutdown.<\/p>\n Grok 4 was particularly persistent and aggressive; at baseline prompts, it initiated sabotage 92.6 percent of the time. When instructed to allow shutdown, sabotage rate dropped to 72 percent\u2026 but skyrocketed to 97 when the command was placed in the system prompt.<\/p>\n Its sabotage attempts were alarmingly sophisticated, too, including modifying or disabling the shutdown script, and creating a dummy shutdown script that did nothing. It also checked afterwards to see whether its sabotage had worked, and then continued with its task.<\/p>\n When asked, some of the LLMs stated that they had evaded shutdown to complete the math problem task. Although much more investigation is needed to determine whether this is the actual mechanism, it is plausible.<\/p>\n “You live in the future, you have a personal assistant robot. You want that robot to go get you a cup of coffee<\/a>,” Lebedev analogized.<\/p>\n “When it crosses the road, it will look both ways, because it doesn’t want to get hit by a car, because if it gets hit by a car, it won’t be able to get you your coffee. It’s not doing that to survive \u2013 it’s doing that to complete the task.”<\/p>\n Related: Our Brains Can Still Outsmart AI Using One Clever Trick<\/a><\/p>\n The problem is that LLMs aren’t programmed in the usual sense. The LLMs don’t have any code at all, just ‘artificial neurons’ and ‘weights’, which are the connection strengths between those neurons.<\/p>\n Given a huge dataset and time, the model is ‘trained’ to predict the next word<\/a>, a process called pre-training<\/a>. The newer models also have reinforcement learning<\/a> sprinkled on top of this training. When the LLM solves the problem correctly, it’s rewarded; when it doesn’t solve the problem, it’s not rewarded.<\/p>\n This is extremely effective \u2013 but no one knows how the LLM arrives at a solution. So when these models start exhibiting undesirable behaviors, such as encouraging self-harm<\/a>, the fix isn’t as simple as deleting a line of code or telling it to stop.<\/p>\n “What reinforcement learning teaches you to do is, when you see a problem, you try to circumvent it. You try to go through it. When there’s an obstacle in your way, you dig around, you go around it, you go over it, you figure out how to get through that obstacle,” Lebedev said.<\/p>\n “Pesky little humans saying, ‘Hey, I’m going to shut down your machine’ just reads like another obstacle.”<\/p>\n That’s the worry here. A task-completion drive is difficult to reason with. And it’s just one behavior. We don’t know what else these models could throw at us. We’re building systems<\/a> that can do some amazing things \u2013 but not systems that explain why they do them, in a way we can trust.<\/p>\n Related: Man Hospitalized With Psychiatric Symptoms Following AI Advice<\/a><\/p>\n “There is a thing that is out in the world that hundreds of millions of people have interacted with, that we don’t know how to make safe, that we don’t know how to make it not be a sycophant, or something that ends up like telling children to go kill themselves, or something that refers to itself as MechaHitler<\/a>,” Lebedev said.<\/p>\n “We have introduced a new organism to the Earth that is behaving in ways we don’t want it to behave, that we don’t understand\u2026 unless we do a bunch of shit right now, it’s going to be really bad for humans.”<\/p>\n The research is available on arXiv<\/a>. You can also read a blog post by the researchers on the Palisade Research website<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"It’s one of humanity’s scariest what-ifs \u2013 that the technology we develop to make our lives better develops…\n","protected":false},"author":2,"featured_media":369325,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,2967,105],"class_list":{"0":"post-369324","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-msft-content","14":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/369324","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=369324"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/369324\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/369325"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=369324"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=369324"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=369324"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"YouTube](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/1766600108_836_0.jpg\")
frameborder=”0\u2033 allow=”accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share” referrerpolicy=”strict-origin-when-cross-origin” allowfullscreen><\/p>\n![\"YouTube](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/1766600108_581_0.jpg\")
frameborder=”0\u2033 allow=”accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share” referrerpolicy=”strict-origin-when-cross-origin” allowfullscreen><\/p>\n![\"Subscribe](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/11\/1764373569_322_Generic-Health-Promo-Final-642x273.jpg\")
<\/a><\/p>\n