{"id":582788,"date":"2026-05-14T02:19:09","date_gmt":"2026-05-14T02:19:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/582788\/"},"modified":"2026-05-14T02:19:09","modified_gmt":"2026-05-14T02:19:09","slug":"see-through-local-ai-lies-with-irish-eyes","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/582788\/","title":{"rendered":"See through local AI lies with Irish eyes"},"content":{"rendered":"<p class=\"kicker t17\" style=\"\">AI + ML<\/p>\n<p>        Shutterstock\n    <\/p>\n<p class=\"subtitle \" style=\"\">ICCL Enforce project offers Verity fact-checking server<\/p>\n<p> You may find yourself living with a new tech stack. And you may find yourself in an unfamiliar world. And you may find yourself behind a keyboard and screen, with a mouse and inscrutable AI. And you may ask yourself, how do I vet this?\u00a0<\/p>\n<p>The Irish Council for Civil Liberties (ICCL) Enforce project has a suggestion: install its <a href=\"https:\/\/www.iccl.ie\/digital-data\/verity-mcp\/\" rel=\"nofollow noopener\" target=\"_blank\">Verity MCP server<\/a>.<\/p>\n<p>&#8220;LLMs [large language models] confidently claim things that are manifestly untrue,&#8221; the advocacy organization explains. &#8220;Enforce has developed Verity, a tool that helps minimise false claims and fake sources from self-hosted LLMs.&#8221;<\/p>\n<p>An MCP (Model Context Protocol) server provides AI models with access to external tools, data, and services.<\/p>\n<p>The Verity MCP server offers access to a set of smaller models that will try to assess the accuracy of a primary local LLM, something <a href=\"https:\/\/www.theregister.com\/software\/2026\/05\/02\/how-to-roll-your-own-local-ai-coding-agents\/5230018\" rel=\"nofollow noopener\" target=\"_blank\">more people have begun to explore<\/a> in response to rising prices at cloud AI providers, availability issues, and privacy concerns.<\/p>\n<p>Verity is not simply an <a href=\"https:\/\/arxiv.org\/abs\/2411.15594\" rel=\"nofollow noopener\" target=\"_blank\">LLM-as-judge<\/a> setup in which one LLM evaluates the output of another. Rather, it&#8217;s a set of seven layers designed to review model output.\u00a0<\/p>\n<p>The system involves: strict rules for fact sourcing; a strong critic LLM that differs from the primary model family; a small critic LLM similar to the strong critic but from different training data; an encoder transformer trained on <a href=\"https:\/\/medium.com\/data-science\/fine-tuning-pre-trained-transformer-models-for-sentence-entailment-d87caf9ec9db\" rel=\"nofollow noopener\" target=\"_blank\">entailment<\/a> labels; a regex evaluator; <a href=\"https:\/\/arxiv.org\/html\/2410.02217v1\" rel=\"nofollow noopener\" target=\"_blank\">a stochastic re-sampler<\/a> for catching low-confidence guesses; and a <a href=\"https:\/\/developers.googleblog.com\/unlock-gemini-reasoning-with-logprobs-on-vertex-ai\/\" rel=\"nofollow noopener\" target=\"_blank\">logprob analyser<\/a> that checks token entropy. <\/p>\n<p>The reference build assumes a 2021 PC, with an Nvidia RTX 5070 Ti (16 GB, 2025) for the primary model (Qwen 3.5 9B, Q4_K_M), and an AMD Radeon RX 5700 XT (8 GB, 2019) for the critic models (IBM Granite 3.2 8B &amp; 2B, Q4_K_M).\u00a0<\/p>\n<p>The <a href=\"https:\/\/github.com\/johnnyryan\/Verity\" rel=\"nofollow noopener\" target=\"_blank\">hardware recommendations<\/a> call for a system with two GPUs, but that&#8217;s to allow concurrent delivery of a second opinion from the Verity checker. On a machine with one GPU, like a MacBook Pro or Mac mini, the system can be configured to evaluate the primary LLM&#8217;s output after the fact.<\/p>\n<p>&#8220;Even the biggest LLMs inevitably produce false claims,&#8221; said Dr Johnny Ryan, director of ICCL Enforce, in an email to The Register. &#8220;This is a feature of how an LLM works. But this is dangerous when people start to put their faith in these systems. LLMs are being incorporated into judicial systems, public services, corporate life, the military, and people\u2019s private decision making. For example, Google\u2019s automated search summaries will confidently claim things that are not proven by the sources they cite.&#8221;<\/p>\n<p>Ryan said if people intend to rely on LLMs for factual answers, they need a verification process.<\/p>\n<p>&#8220;One beauty of running LLMs on your own hardware is that you can take steps against this,&#8221; he said, adding that local operation provides an opportunity to enlist old hardware to offer a second opinion alongside the main model output.<\/p>\n<p>&#8220;So for example, when your machine is working on an answer to a question you have asked, you can have an old graphics card that independently produces a second opinion using a different LLM on the same machine, and the two can then debate at the end without significantly slowing down the process,&#8221; he explained.<\/p>\n<p>The downside of an all-local approach is that models have a training cutoff and won&#8217;t be very useful for checking facts established after that date unless armed with tools for online data fetching. If you can get Verity up and running, that shouldn&#8217;t be a problem.\u00a0\u00ae<\/p>\n","protected":false},"excerpt":{"rendered":"AI + ML Shutterstock ICCL Enforce project offers Verity fact-checking server You may find yourself living with a&hellip;\n","protected":false},"author":2,"featured_media":582789,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-582788","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/582788","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=582788"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/582788\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/582789"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=582788"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=582788"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=582788"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}