{"id":235780,"date":"2025-10-31T11:08:24","date_gmt":"2025-10-31T11:08:24","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/235780\/"},"modified":"2025-10-31T11:08:24","modified_gmt":"2025-10-31T11:08:24","slug":"despite-risks-the-uks-justice-system-will-be-powered-by-chatgpt","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/235780\/","title":{"rendered":"Despite Risks, the UK\u2019s Justice System Will Be Powered by ChatGPT"},"content":{"rendered":"<p>Megan Kirkwood is a fellow at Tech Policy Press.<\/p>\n<p><img alt=\" \" loading=\"lazy\" width=\"1024\" height=\"576\" decoding=\"async\" data-nimg=\"1\" style=\"color:transparent;aspect-ratio:1.7777777777777777;width:100%;height:auto\" src=\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2025\/10\/8697ea8f058c29460197ca8a90588905fe06268d-1200x675.png\"\/><\/p>\n<p>The UK Ministry of Justice &amp; Crown Prosecution Service government office building in Westminster. <a href=\"https:\/\/www.shutterstock.com\/image-photo\/london-january-2018-ministry-justice-crown-1014039436\" rel=\"nofollow noopener\" target=\"_blank\">Shutterstock<\/a><\/p>\n<p>Last week, the UK\u2019s Ministry of Justice <a href=\"https:\/\/www.gov.uk\/government\/news\/openai-to-expand-into-uk-data-hosting-after-major-growth-deal\" target=\"_blank\" rel=\"noopener nofollow\">announced <\/a>that, following its <a href=\"https:\/\/www.gov.uk\/government\/publications\/ai-action-plan-for-justice\/ai-action-plan-for-justice#embed-ai-across-the-justice-system\" target=\"_blank\" rel=\"noopener nofollow\">successful<\/a> pilot of OpenAI\u2019s ChatGPT Enterprise, it has <a href=\"https:\/\/openai.com\/index\/the-next-chapter-for-uk-sovereign-ai\/\" target=\"_blank\" rel=\"noopener nofollow\">secured<\/a> an agreement to adopt its technology alongside a data residency agreement. According to the government\u2019s <a href=\"https:\/\/www.gov.uk\/government\/news\/openai-to-expand-into-uk-data-hosting-after-major-growth-deal\" target=\"_blank\" rel=\"noopener nofollow\">press release<\/a>:<\/p>\n<p>The landmark plan, secured through OpenAI\u2019s ongoing partnership with the Ministry of Justice, will see the company enable its business customers to store their data on British soil for the first time British businesses will be able to host data on secure, sovereign servers not only enhances privacy and accountability but reinforces national resilience in the face of growing global cyber threats.<\/p>\n<p>The agreement follows the <a href=\"https:\/\/www.gov.uk\/government\/publications\/memorandum-of-understanding-between-the-uk-and-openai-on-ai-opportunities\/memorandum-of-understanding-between-uk-and-openai-on-ai-opportunities\" target=\"_blank\" rel=\"noopener nofollow\">Memorandum of Understanding<\/a> (MOU) signed between the UK government and OpenAI earlier this year, which gives the company <a href=\"https:\/\/www.techpolicy.press\/uk-deepens-dependence-on-us-tech-with-new-openai-partnership\/\" target=\"_blank\" rel=\"noopener nofollow\">broad influence<\/a> over UK policy, including AI infrastructure build out and AI adoption. However, because that deal is neither binding nor a paid consultancy, there are no obligations to publish further details beyond the public notice.<\/p>\n<p>I previously <a href=\"https:\/\/www.techpolicy.press\/uk-deepens-dependence-on-us-tech-with-new-openai-partnership\/\" target=\"_blank\" rel=\"noopener nofollow\">wrote<\/a> that while the MOU \u201cemphasizes sovereignty, stating that the partnership is to illustrate the use of AI in these areas to encourage UK firms [&#8230;], with OpenAI guiding the initiative, it is likely to favor startups that use their technology.\u201d What this latest announcement shows is that instead, OpenAI has advocated for the use of generative AI in public services, then effectively put itself to the top of the procurement queue. The deal comes as OpenAI seeks <a href=\"https:\/\/www.ft.com\/content\/74d537c6-bd80-4797-9897-3d5455dfc414\" target=\"_blank\" rel=\"noopener nofollow\">more funding and investment<\/a> in its aggressive expansion, bolstered by the company\u2019s <a href=\"https:\/\/www.nytimes.com\/2025\/10\/28\/technology\/openai-restructure-for-profit-company.html\" target=\"_blank\" rel=\"noopener nofollow\">restructuring<\/a> to a for-profit company.<\/p>\n<p>The Register <a href=\"https:\/\/www.theregister.com\/2025\/10\/24\/ministry_of_justice_chatgpt\/\" target=\"_blank\" rel=\"noopener nofollow\">reported<\/a> that while \u201c[i]t doesn&#8217;t appear that [ChatGPT] will feature in lawmaking,\u201d neither OpenAI nor the Ministry of Justice gave the publication any specifics, \u201cbeyond what has already been made public,\u201d such as about timelines or the size of the deal. But CityAM <a href=\"https:\/\/www.cityam.com\/uk-justice-ministry-adopts-chatgpt-to-cut-red-tape\/\" target=\"_blank\" rel=\"noopener nofollow\">reported<\/a> that \u201cpublic procurement records list the total contract award at \u00a36.75m, covering two years from October 2025,\u201d though that report acknowledges that full details are yet to be released.<\/p>\n<p>OpenAI\u2019s <a href=\"https:\/\/openai.com\/index\/the-next-chapter-for-uk-sovereign-ai\/\" target=\"_blank\" rel=\"noopener nofollow\">press release<\/a> states that its technology will continue to aid \u201croutine tasks including writing support, compliance and legal work, data and research processes, and document analysis.\u201d The Independent <a href=\"https:\/\/www.independent.co.uk\/news\/uk\/politics\/david-lammy-openai-british-government-ministry-of-justice-b2850512.html\" target=\"_blank\" rel=\"noopener nofollow\">quoted<\/a> the Deputy Prime Minister, David Lammy, who said the OpenAI agreement is \u201cenabling us to be more human not less. By adopting AI, we\u2019re cutting the burdensome admin and ensuring frontline staff can spend more of their time doing the things only humans can do \u2013 monitoring offenders and protecting the British public.\u201d<\/p>\n<p>What the data residency agreement gets wrong about sovereignty<\/p>\n<p>The announcement of the procurement deal also introduces expanded data residency for OpenAI customers to \u201cstore their data on British soil for the first time,\u201d which the company says will allow British businesses \u201cto host data on secure, sovereign servers.\u201d This is intended to encourage adoption of OpenAI technology by \u201cboth Government and companies\u201d while adhering to <a href=\"https:\/\/www.gov.uk\/data-protection\" target=\"_blank\" rel=\"noopener nofollow\">data protection<\/a> <a href=\"https:\/\/ico.org.uk\/for-organisations\/uk-gdpr-guidance-and-resources\/international-transfers\/international-transfers-a-guide\/\" target=\"_blank\" rel=\"noopener nofollow\">rules<\/a>. However, merely allowing US companies to maintain UK servers does not necessarily equate to the UK having sovereign control over the data and services hosted on those servers.<\/p>\n<p>Our Content delivered to your inbox.<\/p>\n<p>Join our newsletter on issues and ideas at the intersection of tech &amp; democracy<\/p>\n<p>Thank you!<\/p>\n<p style=\"text-align:center\">You have successfully joined our subscriber list.<\/p>\n<p>For instance, the US <a href=\"https:\/\/www.justice.gov\/criminal\/media\/999391\/dl?inline\" target=\"_blank\" rel=\"noopener nofollow\">CLOUD Act<\/a> (Clarifying Lawful Overseas Use of Data Act) mandates that <a href=\"https:\/\/wire.com\/en\/blog\/cloud-act-eu-data-sovereignty\" target=\"_blank\" rel=\"noopener nofollow\">US law enforcement<\/a> can \u201ccompel American companies to provide access to data stored abroad, even if that data belongs to non-US persons and resides in data centers located in the European Union.\u201d Thus, all data hosted on those UK OpenAI servers could be seized. Second, a vast majority of the value of the deal will accrue back to OpenAI and is unlikely to disperse throughout the UK economy. It is widely <a href=\"https:\/\/www.techrepublic.com\/article\/why-data-centers-fail-to-bring-new-jobs-to-small-towns\/\" target=\"_blank\" rel=\"noopener nofollow\">understood<\/a> that data centers <a href=\"https:\/\/www.npr.org\/2025\/04\/10\/nx-s1-5355017\/data-centers-bring-money-to-small-towns-but-do-they-also-bring-jobs\" target=\"_blank\" rel=\"noopener nofollow\">do not<\/a> create jobs, and the announcement is clear in its push to get public and private institutions to adopt OpenAI\u2019s technology, which will see the company pocket revenue from ChatGPT Enterprise at a time when the value of generative AI in the workplace is <a href=\"https:\/\/www.techpolicy.press\/generative-ais-productivity-myth\/\" target=\"_blank\" rel=\"noopener nofollow\">being questioned<\/a>.<\/p>\n<p>Meanwhile, UK-based companies are being crowded out in favor of OpenAI. UKAI, a trade association, has bemoaned the UK government\u2019s focus on US Big Tech. Tim Flagg, UKAI\u2019s chief executive, <a href=\"https:\/\/www.theguardian.com\/politics\/2025\/may\/14\/minister-accused-of-being-too-close-to-big-tech-after-analysis-of-meetings\" target=\"_blank\" rel=\"noopener nofollow\">told The Guardian<\/a> that \u201cthere is a huge imbalance between a handful of global players who are able to influence directly what No. 10 is thinking about on policy, and the thousands of other businesses that make up the AI industry across the UK.\u201d<\/p>\n<p>The AI push in public services<\/p>\n<p>The UK\u2019s central government <a href=\"https:\/\/www.gov.uk\/government\/news\/prime-minister-sets-out-blueprint-to-turbocharge-ai\" target=\"_blank\" rel=\"noopener nofollow\">insists<\/a> that all public institutions should adopt AI\u2014 usually referring to generative AI applications like large-language model chatbots, the government tends to be imprecise in specifying which applications it refers to in communications. The Ministry of Justice and the Department of Health and Social Care are two prominent examples of AI implementation in public services.<\/p>\n<p>For instance, the UK government has pushed <a href=\"https:\/\/www.gov.uk\/government\/news\/major-nhs-ai-trial-delivers-unprecedented-time-and-cost-savings\" target=\"_blank\" rel=\"noopener nofollow\">note-taking and productivity software<\/a> onto health care workers, such as AI transcription services during patient appointments, <a href=\"https:\/\/www.gov.uk\/government\/news\/ai-doctors-assistant-to-speed-up-appointments-a-gamechanger\" target=\"_blank\" rel=\"noopener nofollow\">to \u201ccreate<\/a> structured medical notes and even draft patient letters.\u201d The hope is that AI applications will boost productivity by speeding up work without additional hiring or other costs, though the trials <a href=\"https:\/\/www.gosh.nhs.uk\/news\/gosh-pilots-ai-tool-to-give-clinicians-more-quality-time-with-patients\/\" target=\"_blank\" rel=\"noopener nofollow\">evaluating such tools<\/a> rarely, if ever, mention the harms emanating from incorrect outputs of large language models, which are <a href=\"https:\/\/ainowinstitute.org\/publications\/research\/3-consulting-the-record-ai-consistently-fails-the-public\" target=\"_blank\" rel=\"noopener nofollow\">inherent to their function<\/a>. In healthcare settings, errors could have life-threatening consequences, and liability, according to the National Health Service (NHS) <a href=\"https:\/\/www.england.nhs.uk\/long-read\/guidance-on-the-use-of-ai-enabled-ambient-scribing-products-in-health-and-care-settings\/#appendix-in-depth-considerations-and-actions\" target=\"_blank\" rel=\"noopener nofollow\">guidance<\/a> on AI-transcription tools, \u201cremains complex and largely uncharted\u201d and will likely fall to the NHS Trust in cases of medical negligence.<\/p>\n<p>The Ministry of Justice is not only the first department to pilot ChatGPT Enterprise; it has also launched an entire digital overhaul, including a \u201c<a href=\"https:\/\/ai.justice.gov.uk\/\" target=\"_blank\" rel=\"noopener nofollow\">Justice AI Unit<\/a>\u201d described as \u201can interdisciplinary team of AI specialists, designers, technologists, and operational experts working to embed responsible AI across the justice system.\u201d The <a href=\"https:\/\/ai.justice.gov.uk\/\" target=\"_blank\" rel=\"noopener nofollow\">website<\/a> for the project looks and reads like a tech product; even its design is <a href=\"https:\/\/openai.com\/\" target=\"_blank\" rel=\"noopener nofollow\">similar<\/a> to OpenAI\u2019s. The services on the Justice AI Unit page promise widespread AI implementation, including for <a href=\"https:\/\/ai.justice.gov.uk\/ai-in-action\/ai-assistants\" target=\"_blank\" rel=\"noopener nofollow\">administrative <\/a><a href=\"https:\/\/ai.justice.gov.uk\/ai-in-action\/speech-ai\" target=\"_blank\" rel=\"noopener nofollow\">tasks<\/a> and <a href=\"https:\/\/ai.justice.gov.uk\/ai-in-action\/single-identity\" target=\"_blank\" rel=\"noopener nofollow\">managing criminal records<\/a> through a single digital identity for criminals.<\/p>\n<p>The Ministry of Justice has also <a href=\"https:\/\/www.gov.uk\/government\/news\/ai-to-stop-prison-violence-before-it-happens\" target=\"_blank\" rel=\"noopener nofollow\">set its sights<\/a> on implementing tools that \u201cprevent\u201d violent outbreaks before they happen by assessing \u201cfactors such as a prisoner\u2019s age and previous involvement in violent incidents while in custody.\u201d Such plans appear to ignore the <a href=\"https:\/\/www.propublica.org\/article\/machine-bias-risk-assessments-in-criminal-sentencing\" target=\"_blank\" rel=\"noopener nofollow\">documented harms<\/a> emanating from predictive crime technology, which will reproduce historical bias and are largely <a href=\"https:\/\/news.harvard.edu\/gazette\/story\/2024\/06\/does-ai-help-humans-make-better-decisions-artificial-intelligence-law\/#:~:text=Results%20showed%20that%20AI%20alone,AI%2Dassisted%20decision%2Dmaking\" target=\"_blank\" rel=\"noopener nofollow\">inaccurate<\/a>. In their <a href=\"https:\/\/press.princeton.edu\/books\/hardcover\/9780691249131\/ai-snake-oil\" target=\"_blank\" rel=\"noopener nofollow\">book<\/a> AI Snake Oil: What Artificial Intelligence Can Do, What it Can\u2019t, and How to Tell the Difference, computer scientists Arvind Narayanan and Sayash Kapoor document the multitude of problems inherent with \u201cpredictive\u201d AI. Applied in criminal justice, AI can cause harm by using inaccurate metrics. Narayanan and Kapoor discuss a model which used arrest data rather than crime data, which assumes that all arrests equal crime, when of course innocent people are arrested or found innocent in court. They also point out massive racial disparities in policing, which further skews the bias and accuracy of outputs.<\/p>\n<p>Narayanan and Kapoor emphasize that even with huge datasets, predictive tools remain inaccurate. Though the Ministry of Justice is yet to release more details on the full range of factors that its model will consider, there is substantial evidence that such predictive tools only serve to surveil and discriminate against those <a href=\"https:\/\/www.ethnicity-facts-figures.service.gov.uk\/crime-justice-and-the-law\/policing\/number-of-arrests\/latest\/\" target=\"_blank\" rel=\"noopener nofollow\">overrepresented<\/a> in arrest and crime <a href=\"https:\/\/www.gov.uk\/government\/publications\/black-asian-and-minority-ethnic-disproportionality-in-the-criminal-justice-system-in-england-and-wales\" target=\"_blank\" rel=\"noopener nofollow\">data<\/a>. While the Ministry of Justice <a href=\"https:\/\/www.gov.uk\/government\/publications\/ai-action-plan-for-justice\/ai-action-plan-for-justice#our-ai-action-plan-for-justice\" target=\"_blank\" rel=\"noopener nofollow\">maintains<\/a> that \u201cAI should support, not substitute, human judgment,\u201d the drive to increase efficiency through automation risks using \u201c<a href=\"https:\/\/www.techpolicy.press\/anatomy-of-an-ai-coup\/\" target=\"_blank\" rel=\"noopener nofollow\">convenience and efficiency<\/a>\u201d narratives \u201c<a href=\"https:\/\/www.techpolicy.press\/anatomy-of-an-ai-coup\/\" target=\"_blank\" rel=\"noopener nofollow\">to bolster claims<\/a> to expand digital surveillance and strip away democratic processes while diminishing accountability.\u201d<\/p>\n<p>Broadly implementing AI tools is part of the Ministry of Justice\u2019s AI Action Plan, with a key goal to <a href=\"https:\/\/www.gov.uk\/government\/publications\/ai-action-plan-for-justice\/ai-action-plan-for-justice#the-opportunity\" target=\"_blank\" rel=\"noopener nofollow\">enable<\/a> \u201ceconomic growth by supporting the UK\u2019s world-leading legal and LawTech sectors\u201d <a href=\"https:\/\/www.gov.uk\/government\/publications\/ai-action-plan-for-justice\/ai-action-plan-for-justice#our-ai-action-plan-for-justice\" target=\"_blank\" rel=\"noopener nofollow\">and<\/a> \u201cstrengthen our partnerships to support AI-driven legal innovation.\u201d Injecting AI into the functioning of the Ministry of Justice is, beyond a drive for \u201cefficiency,\u201d clearly a response to the UK government\u2019s demand that government departments <a href=\"https:\/\/www.ft.com\/content\/1244bb6e-5fcb-41c7-bca4-2a76a7ff670c\" target=\"_blank\" rel=\"noopener nofollow\">push economic growth<\/a> as a primary goal, with particular emphasis on <a href=\"https:\/\/www.theguardian.com\/politics\/2024\/oct\/14\/keir-starmer-promise-slash-red-tape-investment-summit\" target=\"_blank\" rel=\"noopener nofollow\">investment<\/a> to drive that growth. Indeed, the Ministry of Justice <a href=\"https:\/\/www.gov.uk\/government\/publications\/ai-action-plan-for-justice\/ai-action-plan-for-justice#the-opportunity\" target=\"_blank\" rel=\"noopener nofollow\">points to<\/a> companies like Google DeepMind, OpenAI, Anthropic, Microsoft, Scale AI and Meta AI as potential collaborators \u201cto drive forward sector growth.\u201d<\/p>\n<p>While many may find it troubling that a department tasked with overseeing the justice system is concerning itself with boosting the AI industry, it also points to the continued trend of the UK government willingly outsourcing important public infrastructure to US Big Tech, and in particular OpenAI, a firm that shows no hesitation in <a href=\"https:\/\/www.techpolicy.press\/techs-love-affair-with-trump-grows-stronger-by-the-day\/\" target=\"_blank\" rel=\"noopener nofollow\">cozying up<\/a> to an antidemocratic US administration.<\/p>\n","protected":false},"excerpt":{"rendered":"Megan Kirkwood is a fellow at Tech Policy Press. The UK Ministry of Justice &amp; Crown Prosecution Service&hellip;\n","protected":false},"author":2,"featured_media":235781,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-235780","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/235780","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=235780"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/235780\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/235781"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=235780"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=235780"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=235780"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}