{"id":345339,"date":"2026-03-24T12:57:13","date_gmt":"2026-03-24T12:57:13","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/345339\/"},"modified":"2026-03-24T12:57:13","modified_gmt":"2026-03-24T12:57:13","slug":"using-your-ai-chatbot-as-a-search-engine-be-careful-what-you-believe-2","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/345339\/","title":{"rendered":"Using your AI chatbot as a search engine? Be careful what you\u00a0believe"},"content":{"rendered":"<p>Large language models are looking to generate reasonable-looking sentences, rather than accurate ones, meaning they can churn out misinformation faster than people can produce safe information, let alone fact-check and correct it.<\/p>\n<p>During the first world war, the British government was looking for ways to help people stretch their limited food supplies. It found pamphlets from a noted 19th-century herbalist who said rhubarb leaves could be used as a vegetable along with the stalks.<\/p>\n<p>The government duly printed its own pamphlets advising people to eat rhubarb leaves as a salad rather than throwing them out. There was one problem: <a href=\"https:\/\/www.healthline.com\/nutrition\/rhubarb-leaves#oxalic-acid\" target=\"_blank\" rel=\"nofollow noopener\">rhubarb leaves can be poisonous<\/a>. People reportedly died or became ill.<\/p>\n<p>The advice was corrected and the pamphlets pulled from circulation. But during the second world war, the government was again looking for ways to stretch food supplies.<\/p>\n<p>It found a stockpile of old resources from the previous war that explained unorthodox sources of food, including rhubarb leaves. Reusing the pamphlets seemed an efficient thing to do, so they were sent out to the public. Once again, people reportedly died or became ill.<\/p>\n<p>Those pamphlets were misinformation, but the public had no reason to suspect them either time. They were official resources developed by the government \u2013 why wouldn\u2019t they be safe?<\/p>\n<p>That is how misinformation can cause problems even after the initial error is corrected. And the moral of the story still reverberates in the age of generative artificial intelligence (AI).<\/p>\n<p><img alt=\"\" src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7\" decoding=\"async\" data-nimg=\"responsive\" style=\"position:absolute;top:0;left:0;bottom:0;right:0;box-sizing:border-box;padding:0;border:none;margin:auto;display:block;width:0;height:0;min-width:100%;max-width:100%;min-height:100%;max-height:100%\"\/>Photo: Getty Images<br \/>\nChatbots are not search engines<\/p>\n<p>Generative AI is used to generate text and images (and other forms of data) based on original information it has ingested. But it can also be an engine for churning out misinformation faster than people can produce safe information, let alone <a href=\"https:\/\/journals.sagepub.com\/doi\/10.1177\/2631787720929704\" target=\"_blank\" rel=\"nofollow noopener\">fact-check and correct it<\/a>.<\/p>\n<p>And as the rhubarb story illustrates, corrections can\u2019t always properly remove the original contamination.<\/p>\n<p>AI platforms such as ChatGPT and Claude don\u2019t work like a conventional search engine. But people use them as one because they seem to <a href=\"https:\/\/www.moronichannel.org\/entertainment\/lifestyle\/77-of-americans-treat-chatgpt-as-a-search-engine-research-finds\/\" target=\"_blank\" rel=\"nofollow noopener\">summarise complex topics quickly<\/a> and require fewer clicks than conventional internet searches.<\/p>\n<p>Search engines rely on articles and text about a given topic, and then <a href=\"https:\/\/pi.math.cornell.edu\/%7Emec\/Winter2009\/RalucaRemus\/Lecture3\/lecture3.html\" target=\"_blank\" rel=\"nofollow noopener\">weigh how reliable those articles are<\/a>. Generative AI instead relies on huge bodies of text, from which it measures the odds of words appearing next to each other.<\/p>\n<p>These \u201c<a href=\"https:\/\/www.ibm.com\/think\/topics\/large-language-models\" target=\"_blank\" rel=\"nofollow noopener\">large language models<\/a>\u201d are purely looking to generate reasonable-looking sentences, rather than accurate ones.<\/p>\n<p>For example, if \u201cgreen eggs and ham\u201d appeared frequently enough in its huge pile of words, it is more likely to describe \u201ceggs and ham\u201d as green if someone asks.<\/p>\n<p>\u2018Plausible yet incorrect\u2019<\/p>\n<p>OpenAI, which developed ChatGPT, has admitted (based on its own study) there\u2019s <a href=\"https:\/\/www.computerworld.com\/article\/4059383\/openai-admits-ai-hallucinations-are-mathematically-inevitable-not-just-engineering-flaws.html\" target=\"_blank\" rel=\"nofollow noopener\">no way to stop false information<\/a> being presented as truth due to the way generative AI works. Explaining why large language models \u201challucinate\u201d, the <a href=\"https:\/\/arxiv.org\/pdf\/2509.04664\" target=\"_blank\" rel=\"nofollow noopener\">researchers wrote<\/a>: \u201cLike students facing hard exam questions, large language models sometimes guess when uncertain, producing plausible yet incorrect statements instead of admitting uncertainty.\u201d<\/p>\n<p>This can have real-world consequences. One recent study showed ChatGPT <a href=\"https:\/\/www.theguardian.com\/technology\/2026\/feb\/26\/chatgpt-health-fails-recognise-medical-emergencies\" target=\"_blank\" rel=\"nofollow noopener\">failed to recognise a medical emergency<\/a> in more than half of cases. This can be exacerbated by already existing errors in medical records, which a <a href=\"https:\/\/www.theguardian.com\/society\/2025\/may\/01\/one-in-four-patients-in-england-find-errors-in-medical-records-watchdog-says\" target=\"_blank\" rel=\"nofollow noopener\">UK inquiry in 2025 found<\/a> affected up to one in four patients.<\/p>\n<p>While a doctor might order more tests to confirm a diagnosis, <a href=\"https:\/\/www.livescience.com\/health\/rectal-garlic-insertion-for-immune-support-medical-chatbots-confidently-give-disastrously-misguided-advice-experts-say\" target=\"_blank\" rel=\"nofollow noopener\">one researcher explained<\/a> that generative AI \u201cdelivers the wrong answer with the exact same confidence as the right one\u201d.<\/p>\n<p>The problem, as <a href=\"https:\/\/bsky.app\/profile\/astrokatie.com\/post\/3lrxfsxnkms2c\" target=\"_blank\" rel=\"nofollow noopener\">another scientist noted<\/a>, is that generative AI \u201cfinds and mimics patterns of words\u201d. Being right or wrong is not really the point: \u201cIt was supposed to make a sentence and it did.\u201d<\/p>\n<p>Research has shown generative AI tools <a href=\"https:\/\/www.bbc.co.uk\/mediacentre\/2025\/new-ebu-research-ai-assistants-news-content\" target=\"_blank\" rel=\"nofollow noopener\">misrepresent the news<\/a> 45% of the time, no matter the language or geographic region. And there is now genuine concern about AI risking lives by <a href=\"https:\/\/www.insidehook.com\/adventure\/experts-concerns-ai-generated-hiking-routes\" target=\"_blank\" rel=\"nofollow noopener\">generating non-existent hiking routes<\/a>.<\/p>\n<p>It\u2019s easy to make fun of generative AI when it <a href=\"https:\/\/www.bbc.com\/news\/articles\/cd11gzejgz4o\" target=\"_blank\" rel=\"nofollow noopener\">advises people<\/a> to eat rocks or hold toppings on a pizza base with glue.<\/p>\n<p>But other examples aren\u2019t so amusing \u2013 such as the supermarket meal planner that suggested a recipe that would <a href=\"https:\/\/www.theguardian.com\/world\/2023\/aug\/10\/pak-n-save-savey-meal-bot-ai-app-malfunction-recipes\" target=\"_blank\" rel=\"nofollow noopener\">produce chlorine gas<\/a>, or the dietary advice that left someone with <a href=\"https:\/\/www.livescience.com\/health\/food-diet\/man-sought-diet-advice-from-chatgpt-and-ended-up-with-bromide-intoxication\" target=\"_blank\" rel=\"nofollow noopener\">chronic toxic exposure to bromide<\/a>.<\/p>\n<p><img alt=\"\" src=\"data:image\/gif;base64,R0lGODlhAQABAIAAAAAAAP\/\/\/yH5BAEAAAAALAAAAAABAAEAAAIBRAA7\" decoding=\"async\" data-nimg=\"responsive\" style=\"position:absolute;top:0;left:0;bottom:0;right:0;box-sizing:border-box;padding:0;border:none;margin:auto;display:block;width:0;height:0;min-width:100%;max-width:100%;min-height:100%;max-height:100%\"\/><\/p>\n<p>Look for older information<\/p>\n<p>Education and establishing good rules around the appropriate and cautious use of generative AI will be essential, especially as it makes inroads into governments, bureaucracies and complex organisations.<\/p>\n<p>Politicians are <a href=\"https:\/\/newsroom.co.nz\/2026\/03\/06\/how-ministers-use-ai\/\" target=\"_blank\" rel=\"nofollow noopener\">already using generative AI<\/a> in their everyday work, including for policy research. And hospital emergency departments are using AI tools to <a href=\"https:\/\/www.rnz.co.nz\/news\/national\/588244\/ai-scribe-tool-being-used-in-emergency-departments\" target=\"_blank\" rel=\"nofollow noopener\">record patient notes to save time<\/a>.<\/p>\n<p>One safeguard is to try to source more reliable information produced before AI-contaminated text and imagery infiltrated the internet.<\/p>\n<p>There are even tools available to help simplify that process, including one <a href=\"https:\/\/tegabrain.com\/Slop-Evader\" target=\"_blank\" rel=\"nofollow noopener\">created by Australian artist Tega Brain<\/a> \u201cthat will only return content created before ChatGPT\u2019s first public release on November 30 2022\u201d.<\/p>\n<p>Finally, if your instinct is to fact-check the story at the start of this article, good old-fashioned books might be your best bet: references to how the British government twice encouraged rhubarb poisoning can be found in the <a href=\"https:\/\/alnwickgardenshop.com\/product\/the-poison-garden-alnwick\/\" target=\"_blank\" rel=\"nofollow noopener\">The Poison Garden\u2019s A-Z of Poisonous Plants<\/a> and <a href=\"https:\/\/www.hachettebookgroup.com\/titles\/fen-inkwright\/botanical-curses-and-poisons\/9781454956716\/\" target=\"_blank\" rel=\"nofollow noopener\">Botanical Curses and Poisons: The Shadow Lives of Plants<\/a>.<\/p>\n<p>This article is republished from <a href=\"https:\/\/theconversation.com\" target=\"_blank\" rel=\"nofollow noopener\">The Conversation<\/a> under a Creative Commons licence. Read the <a href=\"https:\/\/theconversation.com\/using-your-ai-chatbot-as-a-search-engine-be-careful-what-you-believe-277616\" target=\"_blank\" rel=\"nofollow noopener\">original article<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"Large language models are looking to generate reasonable-looking sentences, rather than accurate ones, meaning they can churn out&hellip;\n","protected":false},"author":2,"featured_media":345340,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[3],"tags":[4036,492,366,42,359,19052,43,66524,40,38,41,39],"class_list":["post-345339","post","type-post","status-publish","format-standard","has-post-thumbnail","category-headlines","tag-chatgpt","tag-comments-enabled","tag-generative-ai","tag-headlines","tag-internet","tag-misinformation","tag-news","tag-search-engines","tag-top-news","tag-top-stories","tag-topnews","tag-topstories"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/345339","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=345339"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/345339\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/345340"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=345339"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=345339"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=345339"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}