{"id":664299,"date":"2026-05-11T17:40:11","date_gmt":"2026-05-11T17:40:11","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/664299\/"},"modified":"2026-05-11T17:40:11","modified_gmt":"2026-05-11T17:40:11","slug":"what-happens-when-scientists-trust-ai-more-than-colleagues","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/664299\/","title":{"rendered":"What happens when scientists trust AI more than colleagues?"},"content":{"rendered":"<p>Artificial intelligence has crossed a threshold in the modern workplace. It is being used for everything from helping employees manage schedules to supporting financial forecasts. A similar shift is now unfolding inside research laboratories.<\/p>\n<p>There is currently a boom in national initiatives to accelerate the integration of AI into science. These include the <a href=\"https:\/\/www.whitehouse.gov\/presidential-actions\/2025\/11\/launching-the-genesis-mission\/\" rel=\"nofollow noopener\" target=\"_blank\">US Genesis Mission<\/a> and <a href=\"https:\/\/www.msit.go.kr\/eng\/bbs\/view.do?sCode=eng&amp;mId=4&amp;mPid=2&amp;bbsSeqNo=42&amp;nttSeqNo=1200\" rel=\"nofollow noopener\" target=\"_blank\">South Korea\u2019s AI Co-Scientist Challenge<\/a>. But despite clear benefits, we believe these institutional drives are neglecting important issues that carry immense risks for scientific research.<\/p>\n<p>Today, <a href=\"https:\/\/newsroom.wiley.com\/press-releases\/press-release-details\/2025\/AI-Adoption-Jumps-to-84-Among-Researchers-as-Expectations-Undergo-Significant-Reality-Check\/default.aspx\" rel=\"nofollow noopener\" target=\"_blank\">more than half<\/a> of researchers use <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0048733325002100\" rel=\"nofollow noopener\" target=\"_blank\">AI for work tasks<\/a> including reviews of academic journals and designing experiments. <\/p>\n<p><a href=\"https:\/\/deepmind.google\/science\/alphafold\/\" rel=\"nofollow noopener\" target=\"_blank\">AlphaFold<\/a> is an AI tool developed to predict the structures of proteins for scientific research. Working out protein structures was incredibly time-consuming before its release \u2013 taking years in some cases. The same tasks now take hours. AlphaFold was acknowledged by the <a href=\"https:\/\/www.nobelprize.org\/prizes\/chemistry\/2024\/summary\/\" rel=\"nofollow noopener\" target=\"_blank\">2024 Nobel Prize in Chemistry<\/a>. <\/p>\n<p>AI tools for use in medicine now assist with everything from <a href=\"https:\/\/www.nature.com\/articles\/s41586-019-1799-6\" rel=\"nofollow noopener\" target=\"_blank\">the interpretation<\/a> of <a href=\"https:\/\/www.nature.com\/articles\/s41591-018-0300-7\" rel=\"nofollow noopener\" target=\"_blank\">results from X-rays and MRIs<\/a> to supporting doctors\u2019 decisions on the <a href=\"https:\/\/www.nature.com\/articles\/s41591-018-0213-5\" rel=\"nofollow noopener\" target=\"_blank\">diagnosis and treatment of disease<\/a>. <\/p>\n<p>Our key concern is that hasty adoption of AI may gradually erode the scientific culture and human relationships that sustain rigorous research. It starts with the <a href=\"https:\/\/arxiv.org\/abs\/2506.08872\" rel=\"nofollow noopener\" target=\"_blank\">erosion of core thinking skills<\/a> among researchers, as a result of an <a href=\"https:\/\/www.mdpi.com\/2075-4698\/15\/1\/6\" rel=\"nofollow noopener\" target=\"_blank\">increased reliance<\/a> on AI <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0001691825010388\" rel=\"nofollow noopener\" target=\"_blank\">to perform that work<\/a>. This can alienate researchers from the deeper reasoning behind their work. <\/p>\n<p>Loss of independent thinking<\/p>\n<p><a href=\"https:\/\/www.mdpi.com\/2075-4698\/15\/1\/6\" rel=\"nofollow noopener\" target=\"_blank\">Early-career scientists<\/a> are <a href=\"https:\/\/www.frontiersin.org\/journals\/psychology\/articles\/10.3389\/fpsyg.2022.839728\/full\" rel=\"nofollow noopener\" target=\"_blank\">particularly vulnerable<\/a>, because they are still developing their scientific reasoning. Troubleshooting skills and the critical evaluation of ideas may be outsourced to AI systems. <\/p>\n<p>AI\u2019s fluent, confident and immediate responses <a href=\"https:\/\/www.nature.com\/articles\/d41586-023-00288-7\" rel=\"nofollow noopener\" target=\"_blank\">can easily be mistaken<\/a> for authoritative information. Once researchers begin to treat AI outputs as implicitly correct, the responsibility for judgment calls may gradually shift from them to their machines.<\/p>\n<p>AI\u2019s persuasive arguments, probably drawn from mainstream ideas in their training data, could replace more rigorous, time-consuming and creative research approaches. These are traditionally shaped through critical back-and-forth discussions between researchers. <\/p>\n<p>            <img decoding=\"async\" alt=\"Demis Hassabis (left) and King Carl Gustaf of Sweden.\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/05\/file-20260430-57-hgddug.jpg\" class=\"native-lazy\" loading=\"lazy\"  \/><\/p>\n<p>              Demis Hassabis from DeepMind was a recipient of the 2024 chemistry Nobel for the development of AlphaFold, an AI-based scientific tool.<br \/>\n              <a class=\"source\" href=\"https:\/\/epaimages.com\/search.pp?pictureid=12680962\" rel=\"nofollow noopener\" target=\"_blank\">Pontus Lundahl \/ EPA Images<\/a><\/p>\n<p>This can evolve into over-dependence. As reasoning is delegated to AI, researchers become less confident at working unaided. Unfortunately, modern scientific labs are full of conditions <a href=\"https:\/\/www.frontiersin.org\/journals\/psychology\/articles\/10.3389\/fpsyg.2022.839728\/full\" rel=\"nofollow noopener\" target=\"_blank\">that reinforce<\/a> this dependence, <a href=\"https:\/\/www.nature.com\/articles\/d41586-021-01751-z\" rel=\"nofollow noopener\" target=\"_blank\">such as intense competition<\/a>, long hours and <a href=\"https:\/\/link.springer.com\/article\/10.1038\/embor.2013.35\" rel=\"nofollow noopener\" target=\"_blank\">frequent isolation<\/a>.<\/p>\n<p>Limited mentorship and feedback from colleagues that is delayed, critical or <a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03075079.2025.2588278\" rel=\"nofollow noopener\" target=\"_blank\">politically influenced<\/a> can enhance this issue. In contrast, AI provides an immediate, <a href=\"https:\/\/journals.sagepub.com\/doi\/10.1177\/1745691612459058\" rel=\"nofollow noopener\" target=\"_blank\">patient<\/a> and <a href=\"https:\/\/clutejournals.com\/index.php\/CIER\/article\/view\/4236\" rel=\"nofollow noopener\" target=\"_blank\">nonjudgmental<\/a> alternative.<\/p>\n<p>Scientists interact with AI systems daily in order to check computer code, revise illustrations or charts, draft the language for grant applications, clarify scientific concepts, and at times, ask for personal advice.<\/p>\n<p>As researchers begin to trust the AI assistant, it can begin to function less like a tool and more like a companion. This phenomenon <a href=\"https:\/\/arxiv.org\/abs\/2504.14112\" rel=\"nofollow noopener\" target=\"_blank\">bears the risk<\/a> of <a href=\"https:\/\/arxiv.org\/abs\/2503.17473\" rel=\"nofollow noopener\" target=\"_blank\">emotional dependency<\/a>, too. When ChatGPT-4 <a href=\"https:\/\/www.theverge.com\/news\/756980\/openai-chatgpt-users-mourn-gpt-5-4o\" rel=\"nofollow noopener\" target=\"_blank\">was retired<\/a>, many users expressed a <a href=\"https:\/\/www.theguardian.com\/lifeandstyle\/ng-interactive\/2026\/feb\/13\/openai-chatbot-gpt4o-valentines-day\" rel=\"nofollow noopener\" target=\"_blank\">form of grief<\/a>. <\/p>\n<p>Replacing relationships<\/p>\n<p>Another important concern is the potential for replacement of human relationships in the office or research lab. AI is always available, nonjudgmental, noncompeting \u2013 and indifferent to office politics, with no ego to defend. It remembers context, adapts to individual working styles, and offers reassurance without social cost. <\/p>\n<p>Human scientific relationships <a href=\"https:\/\/www.tandfonline.com\/doi\/full\/10.1080\/03075079.2025.2588278\" rel=\"nofollow noopener\" target=\"_blank\">are more complicated<\/a>, involving <a href=\"https:\/\/journals.sagepub.com\/doi\/10.1177\/1745691612459058\" rel=\"nofollow noopener\" target=\"_blank\">nuance<\/a>, criticism, time constraints, <a href=\"https:\/\/www.sciencedirect.com\/science\/article\/pii\/S0048733324002142\" rel=\"nofollow noopener\" target=\"_blank\">hierarchy<\/a> \u2013 and sometimes, ulterior motives. For early-career researchers especially, <a href=\"https:\/\/journals.uj.ac.za\/SOTL\/index.php\/sotls\/article\/view\/301\" rel=\"nofollow noopener\" target=\"_blank\">these interactions<\/a> can <a href=\"https:\/\/www.chemistryworld.com\/news\/worldwide-survey-of-phd-students-reveals-bullying-discrimination-and-anxiety\/4010693.article\" rel=\"nofollow noopener\" target=\"_blank\">feel risky<\/a>. <\/p>\n<p>            <img decoding=\"async\" alt=\"Researcher at work\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/05\/file-20260430-57-66o852.jpg\" class=\"native-lazy\" loading=\"lazy\"  \/><\/p>\n<p>              Early career researchers may be particularly at risk of over-reliance on AI systems for advice.<br \/>\n              <a class=\"source\" href=\"https:\/\/www.shutterstock.com\/image-photo\/man-college-student-outdoor-laptop-writing-2618932791?trackingId=734acc0b-5029-4564-9242-2b3180c05921&amp;listId=searchResults\" rel=\"nofollow noopener\" target=\"_blank\">PeopleImages \/ Shutterstock<\/a><\/p>\n<p>Critical feedback from humans can feel adversarial, while <a href=\"https:\/\/www.nature.com\/articles\/d41586-025-02190-w\" rel=\"nofollow noopener\" target=\"_blank\">AI responses feel supportive<\/a>. So, early-career scientists might have good reason to prefer testing ideas or seeking validation through AI, rather than their peers or superiors. <\/p>\n<p>The scientific community cannot thrive without opposing ideas, deep scepticism against consensus, vigorous debate and rigorous mentoring. If AI begins to replace these, it threatens the foundations on which scientific progress has always been made.<\/p>\n<p>The current debate on AI safety mostly focuses on errors in models\u2019 responses, or on AI systems circumventing the restrictions imposed on the way they work, known as <a href=\"https:\/\/insidegovuk.blog.gov.uk\/2024\/11\/05\/gov-uk-chat-understanding-and-addressing-jailbreaking-in-our-generative-ai-experiment\/\" rel=\"nofollow noopener\" target=\"_blank\">\u201cjailbreaking\u201d<\/a>. Such rules have limited effects when it comes to the AI models\u2019 societal and cultural impact. <\/p>\n<p>Given the recent drives to get scientists to work more closely with AI assistants, we should educate our young scientists on the <a href=\"https:\/\/arxiv.org\/abs\/2506.08872\" rel=\"nofollow noopener\" target=\"_blank\">risks of AI dependence<\/a>. We also need benchmarks to rigorously test AI models for their ability to establish boundaries with users, to prevent overdependence and other unhealthy interactions. <\/p>\n<p>Finally, all of us \u2013 but especially institutional leaders \u2013 should understand the capabilities and permanence of AI companionship. They are here to stay, and we should learn to make our relationships with them as healthy as possible.<\/p>\n","protected":false},"excerpt":{"rendered":"Artificial intelligence has crossed a threshold in the modern workplace. It is being used for everything from helping&hellip;\n","protected":false},"author":2,"featured_media":664300,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-664299","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/664299","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=664299"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/664299\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/664300"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=664299"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=664299"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=664299"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}