{"id":94954,"date":"2025-08-26T22:23:07","date_gmt":"2025-08-26T22:23:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/94954\/"},"modified":"2025-08-26T22:23:07","modified_gmt":"2025-08-26T22:23:07","slug":"ai-video-game-guides-are-not-reliable-reveals-new-study-by-indie-developer","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/94954\/","title":{"rendered":"AI video game guides are not reliable reveals new study by indie developer"},"content":{"rendered":"<p>\t\t<img fetchpriority=\"high\" width=\"646\" height=\"363\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/08\/SEI_263401525-5c8c.jpg\" class=\"article-image wp-image-24003709\" alt=\"Trash Goblin key art of goblin delicately chiselling trinket in basement\" decoding=\"sync\"\/><br \/>\n\t\tGoogle Gemini has been warning Trash Goblin players of issues that don\u2019t exist (Spilt Milk)<\/p>\n<p><a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/tag\/artificial-intelligence\/\" rel=\"nofollow noopener\" target=\"_blank\">AI<\/a> is proving an unsuitable substitute for <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/entertainment\/gaming\/\" rel=\"nofollow noopener\" target=\"_blank\">video game<\/a> guides and one indie developer has highlighted exactly why it doesn\u2019t work.<\/p>\n<p>If you wanted another reason to be wary of <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/tag\/artificial-intelligence\/\" rel=\"nofollow noopener\" target=\"_blank\">AI<\/a> (or rather large language models, which is all the are) there\u2019s the increasing likelihood of it rendering video game guides redundant and putting guide writers out of work.<\/p>\n<p>Between <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/tag\/microsoft\/\" rel=\"nofollow noopener\" target=\"_blank\">Microsoft<\/a> implementing its Copilot software <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2024\/05\/21\/xbox-use-ai-mean-end-game-guides-youtube-videos-20882844\/\" rel=\"nofollow noopener\" target=\"_blank\">into Minecraft<\/a> and <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/tag\/google\/\" rel=\"nofollow noopener\" target=\"_blank\">Google<\/a>\u2019s own AI overviews, people can now easily find tips and tricks for when they get stuck, so there\u2019s no need to visit dedicated websites\u2026 at least in theory.<\/p>\n<p>It has repeatedly been demonstrated that because these AI systems scour and regurgitate information (when they\u2019re not <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2024\/05\/24\/googles-ai-overview-answers-already-becoming-a-little-unhinged-20904326\/\" rel=\"nofollow noopener\" target=\"_blank\">being completely unhinged<\/a>) they often get things completely wrong and yet state it as unequivocal fact. It\u2019s reportedly got so bad that one indie studio has suggested game developers need to start implementing better tutorials as a countermeasure.<\/p>\n<p>Chances are you\u2019ve already encountered something like this, whether it\u2019s related to video games or not. You\u2019ll be searching for information online, only for Google\u2019s AI overview to give you an answer that you already know is incorrect, like saying <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2025\/06\/13\/yakuza-0-directors-cut-review-kiryu-nintendo-switch-2-23391410\/\" rel=\"nofollow noopener\" target=\"_blank\">Yakuza 0 Director\u2019s Cut<\/a>, which launched on Switch 2 in June, <a href=\"https:\/\/bsky.app\/profile\/liamrobertson.bsky.social\/post\/3lx5aqoa4zc2c\" rel=\"nofollow noopener\" target=\"_blank\">doesn\u2019t actually exist<\/a>.<\/p>\n<p>UK indie studio Spilt Milk has decried such AI overviews as \u2018frustrating\u2019 while speaking with <a href=\"https:\/\/www.gamefile.news\/p\/google-ai-overview-false-tips-trash-goblin\" rel=\"nofollow noopener\" target=\"_blank\">Game File\u2019s Stephen Totilo<\/a>, as Google\u2019s Gemini AI has been spreading misinformation about the studio\u2019s management game Trash Goblin since its launch on PC this past May.<\/p>\n<p>\t\t\t\tExpert, exclusive gaming analysis\t\t\t<\/p>\n<p>Sign up to the <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/newsletters\/game-central\/\" rel=\"nofollow noopener\" target=\"_blank\">GameCentral newsletter<\/a> for a unique take on the week in gaming, alongside the latest reviews and more. Delivered to your inbox every Saturday morning.<\/p>\n<p>Creative director Andrew Smith and programmer Simon Roth have performed rigorous testing of Gemini to see if it can accurately answer questions about their game and, so far, the answer appears to mostly be \u2018no.\u2019<\/p>\n<p>For instance, during a test on August 19, the AI stated that trinkets could be damaged during the game\u2019s chiselling phase, which is patently incorrect since while there is a chiselling phase, it\u2019s impossible for trinkets to be damaged.<\/p>\n<p>When we asked it the same question ourselves today, it did answer correctly but there\u2019s no telling when the AI started offering the right answer or whether it will continue to do so consistently.<\/p>\n<p>Rigorous testing saw the AI repeatedly give incorrect information, in some cases drawing it from unrelated sources for different games.<\/p>\n<p>So, what can be done about this? Roth thinks one solution is simply coming up with more in-depth tutorials so players won\u2019t feel like they need to rely on Google, which could be something more developers adopt if such issues become even more widespread.<\/p>\n<p>The team also plans to start checking whether players seeking help have consulted an AI or not since they could wind up trying to look into issues that don\u2019t exist.<\/p>\n<p>Smith, meanwhile, is frustrated that he\u2019s unable to offer any input on Gemini\u2019s answers, but \u2018then they have to admit that AI is not able to learn just by scraping \u2013 it has to involve a person who\u2019s an expert, and that\u2019s kind of the crux of it, isn\u2019t it?\u2019<\/p>\n<p>This is the real meat of the problem regarding AI serving as a games guide. It doesn\u2019t play the game itself; it simply scrapes the internet and repeats what it finds, meaning it\u2019s very easy to mix stuff up and present incorrect info.<\/p>\n<p>And if guides writers lose work because AI usage becomes more common place, that\u2019s fewer reliable guides to draw from, which creates this awful ouroboros where the AI becomes more and more inaccurate because it\u2019s putting more and more humans out of work.<\/p>\n<p>\t\t<img width=\"646\" height=\"363\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/08\/SEI_257906736-8e4d.jpg\" class=\"article-image wp-image-23584723\" alt=\"Xbox console on a green background.\" loading=\"lazy\" decoding=\"async\"\/><br \/>\n\t\tXbox is very keen on further AI implementation for its next console (Microsoft)<\/p>\n<p>Email\u00a0<a href=\"https:\/\/metro.co.uk\/2025\/08\/26\/ai-video-game-guides-not-reliable-reveals-new-study-indie-developer-24003643\/mailto:gamecentral@metro.co.uk\" rel=\"nofollow noopener\" target=\"_blank\">gamecentral@metro.co.uk<\/a>, leave a comment below,\u00a0<a href=\"https:\/\/twitter.com\/GameCentral\" rel=\"nofollow noopener\" target=\"_blank\">follow us on Twitter<\/a>.<\/p>\n<p>To submit Inbox letters and Reader\u2019s Features more easily, without the need to send an email, just use our\u00a0<a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/submit-stuff\/\" rel=\"nofollow noopener\" target=\"_blank\">Submit Stuff page here<\/a>.<\/p>\n<p>For more stories like this,\u00a0<a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/entertainment\/gaming\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">check our Gaming page<\/a>.<\/p>\n<p class=\"metro-more-link\">Arrow<br \/>\nMORE: <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2025\/08\/19\/next-gen-xbox-will-special-hardware-just-ai-reveals-microsoft-23949748\/?ico=more_text_links\" class=\"\" rel=\"nofollow noopener\" target=\"_blank\">Next gen Xbox will have special hardware just for AI reveals Microsoft<\/a><\/p>\n<p class=\"metro-more-link\">Arrow<br \/>\nMORE: <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2025\/07\/15\/candy-crush-developers-replaced-ai-tools-helped-make-23669139\/?ico=more_text_links\" class=\"\" rel=\"nofollow noopener\" target=\"_blank\">Candy Crush developers replaced by the AI tools they helped make<\/a><\/p>\n<p class=\"metro-more-link\">Arrow<br \/>\nMORE: <a data-ico=\"hyperlink-article\" href=\"https:\/\/metro.co.uk\/2025\/03\/17\/horizon-forbidden-west-voice-actor-says-new-ai-tech-usage-scares-me-22737371\/?ico=more_text_links\" class=\"\" rel=\"nofollow noopener\" target=\"_blank\">Horizon Forbidden West voice actor says new AI tech usage \u2018scares me\u2019<\/a><\/p>\n<p><a class=\"comment-now metro-button metro-comments-cta\" data-vars-position=\"bottom\" href=\"#metro-comments-container\"><br \/>\n\t\t\tComment now<\/p>\n<p>\t\t\tComments<br \/>\n\t\t<\/a>\t\t\t\t\t\t<\/p>\n<p>\t\t\t\tGameCentral<\/p>\n<p>Sign up for exclusive analysis, latest releases, and bonus community content.<\/p>\n<p>\t\t\t\t\t\t\t<script async src=\"https:\/\/platform.twitter.com\/widgets.js\" charset=\"utf-8\"><\/script><\/p>\n","protected":false},"excerpt":{"rendered":"Google Gemini has been warning Trash Goblin players of issues that don\u2019t exist (Spilt Milk) AI is proving&hellip;\n","protected":false},"author":2,"featured_media":94955,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,96,1132,205,844,1135,3121,86,56,54,55],"class_list":["post-94954","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-entertainment","tag-games-news","tag-gaming","tag-google","tag-pc-games","tag-steam","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/94954","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=94954"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/94954\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/94955"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=94954"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=94954"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=94954"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}