{"id":560599,"date":"2026-03-25T21:46:12","date_gmt":"2026-03-25T21:46:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/560599\/"},"modified":"2026-03-25T21:46:12","modified_gmt":"2026-03-25T21:46:12","slug":"first-peer-reviewed-paper-spills-the-secrets","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/560599\/","title":{"rendered":"first peer-reviewed paper spills the secrets"},"content":{"rendered":"<p> <img decoding=\"async\" class=\"figure__image\" alt=\"A small handmade toy robot posed amongst plants, vials, and test tubes so as to appear they are undertaking scientific research.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/ca\/wp-content\/uploads\/2026\/03\/d41586-026-00899-w_52203850.jpg\"\/><\/p>\n<p class=\"figure__caption u-sans-serif\">AI Scientist, an autonomous research AI tool, produced three research papers, one of which was accepted by peer reviewers at a machine-learning conference. Credit: Olesia Kononenko\/iStock via Getty<\/p>\n<p>In August 2024, a team of machine-learning researchers launched the first ever artificial-intelligence tool that aimed to <a href=\"https:\/\/www.nature.com\/articles\/d41586-024-02842-3\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-024-02842-3\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">fully automate the scientific process<\/a>. \u2018AI scientist\u2019, created by Sakana AI, a company based in Tokyo, can perform the full cycle of scientific discovery, from idea generation to testing its ideas to writing them up in a scientific paper. Almost two years on, there are many different <a href=\"https:\/\/www.nature.com\/articles\/d41586-025-01069-0\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-025-01069-0\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">AI research assistants<\/a> available for researchers to use, and a few of them are designed to do autonomous research in the same way that AI Scientist does.<\/p>\n<p>Now, AI Scientist is thought to be one of the first such tools to go through the peer-review process at a leading academic journal. The paper, published today in Nature<a href=\"#ref-CR1\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">1<\/a>, updates a 2024 preprint that described the tool<a href=\"#ref-CR2\" data-track=\"click\" data-action=\"anchor-link\" data-track-label=\"go to reference\" data-track-category=\"references\">2<\/a>, including by toning down its reported capabilities. The latest paper also describes how AI Scientist submitted three original research papers generated by the tool to a leading machine-learning conference, one of which was accepted by peer reviewers. Still, Sakana AI co-founder David Ha says that the paper is not at the same level of the best human-produced papers that were accepted by the same conference.<\/p>\n<p>When the system was unveiled in 2024, \u201cwe were the first group to have demonstrated that you could have AI do the entire scientific process that underlies the creation of a paper\u201d, says study co-author Jeff Clune, a computer scientist at the University of British Columbia in Vancouver, Canada.<\/p>\n<p>\u201cI think it\u2019s a remarkable technological achievement,\u201d says Jevin West, a computational social scientist at the University of Washington in Seattle, which \u201creally forces us to think about what science is\u201d. However, automating science comes with several risks, adds West. These include journals and conferences being <a href=\"https:\/\/www.nature.com\/articles\/d41586-025-03967-9\" data-track=\"click\" data-label=\"https:\/\/www.nature.com\/articles\/d41586-025-03967-9\" data-track-category=\"body text link\" rel=\"nofollow noopener\" target=\"_blank\">flooded with papers<\/a> of modest originality, he says.<\/p>\n<p>Human review<\/p>\n<p>AI Scientist is a collection of \u2018agents\u2019 built on top of existing large language models (LLMs), such as GPT-4o or Claude Sonnet 4. It prompts those LLMs to search the literature on a given topic, generate hypotheses and design a set of possible research directions. Next, AI Scientist writes code, executes it and measures its efficiency. Finally, it writes a paper describing the results. The authors of the paper also created an \u2018automated reviewer\u2019 to evaluate the quality of the tool\u2019s output. The results \u201capproach borderline acceptability for machine learning conference workshops\u201d, the authors write.<\/p>\n<p>In response to peer-review comments, the Sakana AI team toned down claims made in the original preprint that AI Scientist automated the \u201centire\u201d scientific process. The Nature paper also describes the AI Scientist project \u2014 including how the tool took part in a controlled peer-review experiment at the International Conference on Learning Representations (ICLR) in April 2025. In agreement with the ICLR organizers, Ha and his collaborators submitted three AI-generated papers to the peer-review board for one of the conference\u2019s workshops.<\/p>\n<p><a href=\"https:\/\/www.nature.com\/articles\/d41586-025-03363-3\" class=\"u-link-inherit\" data-track=\"click\" data-track-label=\"recommended article\" rel=\"nofollow noopener\" target=\"_blank\"><\/p>\n<p class=\"recommended__title u-serif\">AI bots wrote and reviewed all papers at this conference<\/p>\n<p><\/a><\/p>\n<p>\u201cReviewers were told ahead of time that some fraction of the papers might be AI-generated,\u201d says Clune. One of the papers was accepted, in what creators of AI Scientist say was the first time that an autonomous system passed a \u2018Turing test\u2019 for an AI-generated paper \u2014 a test designed to check whether human reviewers find the paper indistinguishable from those written by human researchers. <\/p>\n<p>Ha adds that ultimately the role of AI should be to aid human scientists rather than replace them. \u201cWe did it this way because from a scientific standpoint, it is interesting to see how far we can push it, but the reality is these are tools that should be used as co-scientists,\u201d says Ha.<\/p>\n<p>AI co-scientist<\/p>\n","protected":false},"excerpt":{"rendered":"AI Scientist, an autonomous research AI tool, produced three research papers, one of which was accepted by peer&hellip;\n","protected":false},"author":2,"featured_media":560600,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[49,48,1099,796,1100,66,61],"class_list":["post-560599","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ca","tag-canada","tag-humanities-and-social-sciences","tag-machine-learning","tag-multidisciplinary","tag-science","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/560599","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=560599"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/560599\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/560600"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=560599"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=560599"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=560599"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}