{"id":833981,"date":"2026-11-14T03:30:17","date_gmt":"2026-11-14T03:30:17","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/833981\/"},"modified":"2026-11-14T03:30:17","modified_gmt":"2026-11-14T03:30:17","slug":"this-ai-mechanic-can-peer-inside-the-black-box-of-other-neural-networks","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/833981\/","title":{"rendered":"This AI \u2018mechanic\u2019 can peer inside the black box of other neural networks"},"content":{"rendered":"<p> <img decoding=\"async\" class=\"figure__image\" alt=\"Overhead view of a car with front bonnet open and the legs of a mechanic visible underneath the car.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/11\/d41586-026-03679-8_53974808.jpg\"\/><\/p>\n<p class=\"figure__caption u-sans-serif\">Some AI models behave like mechanics \u2014 fixing issues in other models that they neither designed nor fully understand. Credit: Mint Images\/Getty<\/p>\n<p>Researchers have used an artificial-intelligence model to read and tinker with the internal workings of another AI network \u2014 offering a new way to <a href=\"https:\/\/www.nature.com\/articles\/d41586-024-01314-y\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-024-01314-y\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">peek into the \u2018black box\u2019 of AI<\/a>.<\/p>\n<p>Computer scientists usually improve models by training them in tiny increments or by building them from scratch. A team at the Massachusetts Institute of Technology (MIT) in Cambridge has demonstrated how an AI model called GPT-6 Astra can interpret the raw internal values of some other models well enough to predict what different parts of the systems do. It can then edit the models to make improvements \u2014 including boosting their mathematical abilities. The authors reported their findings in a preprint<a href=\"#ref-CR1\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">1<\/a> on 2 November.<\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-023-02366-2\" class=\"u-link-inherit\" data-track=\"select_article\" data-track-action=\"view recommended article\" data-track-context=\"related article widget on news body\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"recommended__image\" alt=\"\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/11\/d41586-026-03679-8_25837556.jpg\"\/><\/p>\n<p class=\"recommended__title u-serif\">ChatGPT is a black box: how AI research can break it open<\/p>\n<p><\/a><\/p>\n<p>Frontier AI models are \u201cshowing early sparks\u201d of an ability to treat neural networks like files that they can read, reason about and change, says co-author Rikiya Takehi, a machine-learning researcher at MIT.<\/p>\n<p>The results do not mean that Astra, developed by OpenAI in San Francisco, California, can explain or understand how a given AI network works. But the findings suggest that general-purpose AI models \u2014 such as ChatGPT or Claude \u2014 might be able to modify a network in useful ways, like a mechanic who can identify and fix issues in an engine that they neither designed nor fully understand. <\/p>\n<p>Interpreting AI<\/p>\n<p>Researchers already try to interpret how different components of a network create its outputs. The preprint shows that it is possible to automate some of these \u2018interpretability\u2019 methods, says Fazl Barez, an AI-safety researcher at the University of Oxford, UK.<\/p>\n<p>Researchers hope that better understanding models in this way will help to create safer AI systems, although Barez cautions that <a href=\"https:\/\/x.com\/FazlBarez\/status\/2119822397788561434\" data-track=\"click\" data-label=\"https:\/\/x.com\/FazlBarez\/status\/2119822397788561434\" data-track-category=\"body text link\" rel=\"nofollow\">this assumption is \u201clargely untested\u201d<\/a>.<\/p>\n<p>It remains unclear if Astra is going beyond applying information and techniques learned in its training. Barez says he would be surprised if Astra is able to read and interpret models in ways that go beyond existing human abilities. <\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-026-03313-7\" class=\"u-link-inherit\" data-track=\"select_article\" data-track-action=\"view recommended article\" data-track-context=\"related article widget on news body\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" class=\"recommended__image\" alt=\"\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/11\/d41586-026-03679-8_53888498.jpg\"\/><\/p>\n<p class=\"recommended__title u-serif\">Three reasons why AI is not conscious and perhaps never will be<\/p>\n<p><\/a><\/p>\n<p>Still, if developed further, such ability to reprogram models might be an asset in developing AI for science, says Marinka Zitnik, a computer scientist and bioinformatician at Harvard University in Cambridge, Massachusetts. For example, it could help to spot errors in a model ahead of real-world testing, she says.<\/p>\n<p>Neuron editing<\/p>\n<p>Frontier AI systems are based on massive neural networks \u2014 brain-inspired architectures in which layers of processing units, or neurons, are linked by billions of \u2018weights\u2019, values that represent the strength of connections inside a model. The strength of each weight is slowly nudged during training to make the model better at, for example, predicting a protein structure or the next word in a sentence.<\/p>\n<p>The complex way in which a model\u2019s features link to its outputs means they are often described as black boxes. Interpretability researchers run experiments to work out, for example, which weights are activated under specific conditions. Researchers have also previously developed custom models that can learn to edit other models<a href=\"#ref-CR2\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">2<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"Some AI models behave like mechanics \u2014 fixing issues in other models that they neither designed nor fully&hellip;\n","protected":false},"author":2,"featured_media":833982,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[59,4230,11376,4231,90,86,56,54,55],"class_list":["post-833981","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-gb","tag-humanities-and-social-sciences","tag-machine-learning","tag-multidisciplinary","tag-science","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/833981","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=833981"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/833981\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/833982"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=833981"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=833981"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=833981"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}