{"id":598397,"date":"2026-04-21T22:29:12","date_gmt":"2026-04-21T22:29:12","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/598397\/"},"modified":"2026-04-21T22:29:12","modified_gmt":"2026-04-21T22:29:12","slug":"sullivan-cromwell-files-emergency-please-dont-sanction-us-for-all-these-ai-hallucinations-letter","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/598397\/","title":{"rendered":"Sullivan & Cromwell Files Emergency ‘Please Don’t Sanction Us For All These AI Hallucinations’ Letter"},"content":{"rendered":"

\t\t\t\t\t\"\"\t\t\t\t\t\t\t\t\t<\/p>\n

There is a certain dark comedy in watching the law firm that advises OpenAI on its \u201csafe and ethical deployment<\/a>\u201d of artificial intelligence rush to the federal bankruptcy docket seeking leniency after realizing they\u2019ve filed a lengthy brief riddled with AI hallucinations. It doesn\u2019t matter where on the Am Law 100 food chain you are, the AI psychedelic experience can come for anyone who lets their editorial standards slip.<\/p>\n

In a letter dated Saturday, Sullivan & Cromwell partner Andrew Dietderich wrote<\/a> Chief Bankruptcy Judge Martin Glenn of the Southern District of New York a letter that will live forever in the Biglaw Hall of Hilarity. Dietderich informed the court that he had learned on Thursday that the firm\u2019s emergency motion in the Chapter 15 case of Prince Global Holdings \u2014 the BVI-incorporated husk of a Cambodian forced-labor scam conglomerate<\/a> \u2014 had gotten high on its own supply of AI tools. <\/p>\n

The inaccuracies and errors in the Motion include artificial intelligence (\u201cAI\u201d) \u201challucinations.\u201d \u201cHallucinations\u201d are instances in which artificial intelligence tools fabricate case citations, misquote authorities, or generate non-existent legal sources. We deeply regret that this has occurred. The Firm maintains comprehensive policies and training requirements governing the use of AI tools in legal work. These safeguards are designed to prevent exactly this situation. The Firm\u2019s policies on the use of AI were not followed in connection with the preparation of the Motion. In addition, the Firm has general policies and training requirements for the proper review of legal citations. Regrettably, this review process did not identify the inaccurate citations generated by AI, nor did it identify other errors that appear to have resulted in whole or in part from manual error.<\/p>\n

We hear a lot about the \u201csafeguards\u201d that lawyers put up around AI, but at the end of the day it feels like empty PR talk for \u201cwe like to think we\u2019re editing what we send out the door.\u201d Which, in fairness, is the ultimate safeguard. There are great tools out there designed to reduce the risk of a pernicious hallucination. And these tools will give lawyers a leg up when it comes to tamping down errors early. But there\u2019s no substitute for a junior having to print up the cases and do the meticulous checking\u2026 and then the midlevel doing the exact same thing. That\u2019s the manual review process the letter references. It\u2019s inefficient, but perfection isn\u2019t intended to be cheap and easy.<\/p>\n

That is, in fact, why someone hires Sullivan & Cromwell in the first place.<\/p>\n

Dietderich goes on to explain at some length \u2014 the firm has a whole program. Two required training modules. Tracked completions. Office Manual language instructing lawyers to \u201ctrust nothing and verify everything.\u201d Policies! Mandatory training! Verification requirements!<\/p>\n

And yet.<\/p>\n

This is what we\u2019re talking about when we say AI is in the process of making lawyers dumber<\/a>. In the earliest days of AI, it was easy to put all the blame on the human lawyers failing to maintain best editing practices. But as the technology advances and AI providers boast that they\u2019ve automated more and more steps in the process, the human can enter the workflow later in the game and that can subconsciously undermine the editing approach. We don\u2019t know how automated the S&C workflow is, but it\u2019s all a continuum \u2014 once AI joins the workflow, the clock starts ticking on someone looking at fully artificially generated work product and taking a slightly lighter red pen to the output. Before long, that\u2019s going to miss something.<\/p>\n

Schedule A to the letter catalogs the damage across the motion, the verified petition, the joint administration motion, the scheduling motion, and a couple of declarations \u2014 roughly 40 corrections. Some substantive, some less so, all embarrassing. The fixes include wrong pin cites, wrong volume numbers, parenthetical quotes that just\u2026 aren\u2019t in the cases.<\/p>\n

\"\"<\/p>\n

Build all the AI policies you want, but there is no substitute for having a human \u2014 preferably multiple humans \u2014 print everything out, take a ruler and a red pen, and go line by line cross-checking everything. It\u2019s tedious work for the lawyers and expensive work for the clients, but it\u2019s better than having to write\u2026 this letter.<\/p>\n

This is not a Sullivan & Cromwell problem. This is a profession problem. We have been covering<\/a> AI<\/a> hallucination<\/a> sanctions<\/a> cases so relentlessly that Damien Charlotin has now catalogued over a thousand of them<\/a>. Tools like BriefCatch\u2019s RealityCheck<\/a> exist specifically because firms can\u2019t be trusted to run this validation themselves. The problem cuts across the law firm equivalent of class lines. It\u2019s not just overwhelmed solo practitioners or overeager mid-tier firms looking to punch above their weight. Every firm will deal with this soon enough. They can either accept that using AI on the front end doesn\u2019t alleviate the back end labor or they can accept writing letters to judges after the fact.<\/p>\n

One last thing. The errors in the Chissick Declaration include Bluebook-style corrections to citations of Amnesty International and UN human rights reports about forced labor and trafficking in Cambodia. Those aren\u2019t AI hallucinations, but the simple human mistakes that arise from embracing the unhinged rules memorialized in the Bluebook. But they are a reminder of what this case is actually about: people held behind barbed wire and forced to run pig-butchering scams. The JPLs are trying to trace billions of dollars in crypto to make victims whole. They need a recognition order to do it. And they lost a couple of weeks of runway because S&C didn\u2019t check its work.<\/p>\n

(Check out the full letter on the next page\u2026)<\/p>\n

Earlier: Has AI Managed To Make Lawyers Even Dumber?<\/a>
Biglaw Firm \u2018Profoundly Embarrassed\u2019 After Submitting Court Filing Riddled With AI Hallucinations<\/a>
Am Law 100 Firm Accused Of Filing Brief Riddled With AI Hallucinations\u2026 AGAIN!<\/a>
Prosecutorial Error: \u2018AI Hallucinations\u2019 Are Popping Up In Criminal Cases<\/a>
New Tool Catches AI Hallucinations In Legal Briefs<\/a>
Understanding AI Hallucinations: Making Sure You Don\u2019t End Up At The Wrong Stop<\/a>
Legal AI Might Be Accurate\u2026 And Still Not Right<\/a><\/p>\n

\"Headshot\"Joe Patrice<\/a>\u00a0is a senior editor at Above the Law and co-host of Thinking Like A Lawyer<\/a>. Feel free to\u00a0email<\/a> any tips, questions, or comments. Follow him on\u00a0Twitter<\/a>\u00a0or Bluesky<\/a> if you\u2019re interested in law, politics, and a healthy dose of college sports news. Joe also serves as a Managing Director at RPN Executive Search<\/a>.<\/p>\n

\t\t\t\t\t\t\t