{"id":928384,"date":"2026-10-11T00:32:09","date_gmt":"2026-10-11T00:32:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/928384\/"},"modified":"2026-10-11T00:32:09","modified_gmt":"2026-10-11T00:32:09","slug":"microsofts-nadella-says-ai-needs-an-emergency-brake-humans-control","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/928384\/","title":{"rendered":"Microsoft&#8217;s Nadella says AI needs an \u2018emergency brake\u2019 humans control"},"content":{"rendered":"<p>Microsoft Chairman and CEO <a href=\"https:\/\/www.cnbc.com\/satya-nadella\/\" rel=\"nofollow noopener\" target=\"_blank\">Satya Nadella<\/a> on Saturday called for advanced artificial intelligence systems to be built with containment, independent controls and an &#8220;emergency brake&#8221; that lets authorized people pause or shut a model down mid-task.<\/p>\n<p>&#8220;We need to surround non-deterministic models with strong, deterministic system design, human controls, and reliable operating procedures, and establish industry standards where existing ones are insufficient,&#8221;  Nadella <a href=\"https:\/\/x.com\/satyanadella\/article\/2108931348857827686\" target=\"_blank\" rel=\"nofollow\">wrote<\/a> in a post on social media platform X.<\/p>\n<p>&#8220;Treating frontier closed and open weight models like insider risks is a way to build such a system,&#8221; he said. <\/p>\n<p>Nadella&#8217;s comments come amid warnings from top tech executives and researchers \u2014 including <a href=\"https:\/\/www.cnbc.com\/quotes\/MSFT\/\" rel=\"nofollow noopener\" target=\"_blank\">Microsoft<\/a> co-founder <a href=\"https:\/\/www.cnbc.com\/2026\/08\/26\/bill-gates-ai-jobs-economic-upheaval.html\" rel=\"nofollow noopener\" target=\"_blank\">Bill Gates<\/a>, Anthropic CEO <a href=\"https:\/\/www.cnbc.com\/2026\/09\/14\/anthropic-walks-tightrope-to-nasdaq-pushing-slowdown-and-pursuing-ipo.html\" rel=\"nofollow noopener\" target=\"_blank\">Dario Amodei<\/a>, OpenAI CEO <a href=\"https:\/\/www.cnbc.com\/2026\/09\/12\/anthropics-amodei-proposes-plan-to-slow-the-pace-of-advancing-ai-capabilities.html\" rel=\"nofollow noopener\" target=\"_blank\">Sam Altman<\/a> and <a href=\"https:\/\/www.cnbc.com\/quotes\/SPCX\/\" rel=\"nofollow noopener\" target=\"_blank\">SpaceX<\/a> CEO Elon Musk \u2014 about insufficient AI safety protocols and claims that the technology is moving too fast. <\/p>\n<p>An AI researcher <a href=\"https:\/\/www.cnbc.com\/2026\/09\/09\/anthropic-researcher-quits-ai-safety.html\" rel=\"nofollow noopener\" target=\"_blank\">quit Anthropic last month<\/a> and accused the company, and its chief rival, OpenAI, of &#8220;gambling with our lives.&#8221; Later that day, an alignment lead at Anthropic focused on AI safety <a href=\"https:\/\/x.com\/EvanHub\/status\/2097497037956891126?s=20\" target=\"_blank\" rel=\"nofollow\">said<\/a> there&#8217;s a greater than 10% chance that the technology could &#8220;kill all humans&#8221; within the next decade.<\/p>\n<p>Conversely, President <a href=\"https:\/\/www.cnbc.com\/donald-trump\/\" rel=\"nofollow noopener\" target=\"_blank\">Donald Trump<\/a> has repeatedly <a href=\"https:\/\/www.cnbc.com\/2026\/09\/11\/trump-ai-extinction-risks.html\" rel=\"nofollow noopener\" target=\"_blank\">dismissed AI extinction risks<\/a> and has instead emphasized that the industry needs to stay ahead of China. Trump also recently introduced <a href=\"https:\/\/www.cnbc.com\/2026\/10\/03\/trump-jay-clayton-ai-czar.html\" rel=\"nofollow noopener\" target=\"_blank\">a new &#8220;AI Force,&#8221;<\/a> led by Director of National Intelligence <a href=\"https:\/\/www.cnbc.com\/jay-clayton\/\" rel=\"nofollow noopener\" target=\"_blank\">Jay Clayton<\/a>, to help facilitate the industry and root out bad actors.\u00a0<\/p>\n<p>Microsoft&#8217;s Nadella wrote Saturday that AI systems should be designed around &#8220;principles of observability.&#8221; <\/p>\n<p>They include model diversity; a human-readable footprint of the model&#8217;s actions; continuous system testing; independent controls and auditability; containment; and incident disclosure, Nadella wrote. <\/p>\n<p>&#8220;The most trustworthy Super Intelligence system will not be the one with the model we trust most,&#8221; he wrote. &#8220;It will be the one that enables us to trust the model the least.&#8221;<\/p>\n","protected":false},"excerpt":{"rendered":"Microsoft Chairman and CEO Satya Nadella on Saturday called for advanced artificial intelligence systems to be built with&hellip;\n","protected":false},"author":2,"featured_media":928385,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,16975,2158,45,161,49,48,283,1377,1376,13627,11318,66,17276,61],"class_list":["post-928384","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-bill-gates","tag-breaking-news-technology","tag-business","tag-business-news","tag-ca","tag-canada","tag-cybersecurity","tag-donald-j-trump","tag-donald-trump","tag-microsoft-corp","tag-satya-nadella","tag-science","tag-space-exploration-technologies-corp","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/928384","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=928384"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/928384\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/928385"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=928384"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=928384"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=928384"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}