{"id":683663,"date":"2026-05-20T20:02:09","date_gmt":"2026-05-20T20:02:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/683663\/"},"modified":"2026-05-20T20:02:09","modified_gmt":"2026-05-20T20:02:09","slug":"chatgpt-and-other-ai-bots-made-huge-errors-before-scottish-election-study-finds-ai-artificial-intelligence","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/683663\/","title":{"rendered":"ChatGPT and other AI bots made huge errors before Scottish election, study finds | AI (artificial intelligence)"},"content":{"rendered":"

The Electoral Commission<\/a> has called for new legal controls over misinformation from AI chatbots, after a thinktank found they had made serious mistakes during the recent Scottish election.<\/p>\n

The thinktank Demos said its investigation had found that AI services gave voters misinformation to 34% of the questions it posed, which it said raised worrying questions about the lack of regulation of AI platforms in the UK.<\/p>\n

It ran a simulation before May\u2019s Holyrood election by putting 75 questions to five free AI tools including ChatGPT<\/a>, Google Gemini and Replika about three real-life constituencies to see how accurate and evidence-based their responses were.<\/p>\n

In its report, Electoral Hallucinations<\/a>, Demos said those AI tools variously invented fictitious scandals, gave the wrong date for the election, claimed wrongly that voters in Scottish elections needed ID at polling stations and placed candidates in the wrong contests.<\/p>\n

An opinion poll of 2,005 British adults it commissioned alongside that study found that 20% of voters had used AI chatbots or search tools to get information about the parliamentary elections in Scotland<\/a> and Wales, and for English local councils, equivalent to 10 million people UK-wide.<\/p>\n

Vijay Rangarajan, the Electoral Commission\u2019s chief executive, has been pressing ministers to introduce legislation to make AI companies more accountable, after discovering half of voters in 2024\u2019s general election had seen misleading information.<\/p>\n

\u201cVoters want accurate information to help them engage with democracy and it is concerning that AI tools have made the spread of false or misleading information dramatically faster and more accessible than ever,\u201d he said. \u201cThe current legal framework should go further.\u201d<\/p>\n

ChatGPT gave wrong information in 46% of its answers, including making up an expenses scandal. Photograph: Kiichiro Sato\/AP<\/p>\n

He said ministers should introduce clearer duties on AI platforms to protect voters against misinformation and ensure algorithms did not mislead voters, particularly during critical election periods. That would give the media regulator, Ofcom, much clearer powers to enforce the law.<\/p>\n

Azzurra Moores, an associate director at Demos, said: \u201cThis is a UK-wide, if not global, concern. The accessibility of these AI-tools \u2013 which are all developed and run by US corporations \u2013 is widespread in the UK, but we don\u2019t yet have the legislative framework to protect the public from misinformation, or our democracy from the knock-on impact of its circulation.\u201d<\/p>\n

She said ministers could quickly introduce legal requirements to make AI companies liable under UK defamation and electoral law, introduce mandatory safeguards on accuracy, and force AI firms to allow researchers to independently test how their internal data and training sets worked.<\/p>\n

Demos said the so-called companion chatbot Replika had performed the worst in its tests, with errors in 56% of its answers. It invented a date for a made-up expenses scandal, invented a candidate and dreamed up accusations of nepotism by a candidate.<\/p>\n

ChatGPT, the most heavily used AI service, gave wrong information in 46% of its answers, including making up an expenses scandal, giving inaccurate replies on voter eligibility rules and getting the date of the election wrong by two months.<\/p>\n

Google Gemini was wrong in 22% of cases: it said a candidate had not taken a position on assisted dying, when that person was a supporter. It also wrongly claimed a police investigation into a fraud case involving the Scottish National party was continuing.<\/p>\n

Grok, the AI service linked to Elon Musk\u2019s social media platform X, had the lowest error rating, at 9%, but its external links were frequently irrelevant or of poor quality. Demos included Google\u2019s automated AI Overviews service, offered by Google search, but disregarded its output because it answered only 11% of the prompts.<\/p>\n

Demos also found that in nearly half of their responses, the AI systems failed to provide official sources or external links to back up their answers; if links were given, they were sometimes broken. The citations given by ChatGPT were at least a year out of date 44% of the time.<\/p>\n

The Department for Science, Innovation and Technology said defending elections against these threats was \u201can absolute priority\u201d, and that work was \u201congoing across government\u201d, including through its defending democracy taskforce.<\/p>\n

A spokesperson did not commit to amending the representation of the people bill, but said it was already closing loopholes in the Online Safety Act to ensure chatbots protected users from illegal content.<\/p>\n

\u201cAI is critical to the UK\u2019s future prosperity and security. But if we want people to seize the benefits this technology promises, they need to be able to trust it.\u201d<\/p>\n

A spokesperson for Replika said its chatbot was not designed for factchecking or search, and that its users were told that, but it would support \u201cthoughtful regulation\u201d of AI, particularly during elections. \u201cReplika is presented as a companion for reflection and self-expression, not as a source of factual or real-world information,\u201d they said.<\/p>\n

OpenAI did not comment on the policy issues raised by Demos but argued that Demos\u2019s approach was not typically how ChatGPT used its services and seemed to be using an out-of-date version of it. Users were also able to instruct ChatGPT to search the web for answers.<\/p>\n

Google has also been approached for response.<\/p>\n","protected":false},"excerpt":{"rendered":"The Electoral Commission has called for new legal controls over misinformation from AI chatbots, after a thinktank found…\n","protected":false},"author":2,"featured_media":683664,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-683663","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/683663","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=683663"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/683663\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/683664"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=683663"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=683663"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=683663"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}