Sign up to see the future, today<\/p>\n
Can\u2019t-miss innovations from the bleeding edge of science and tech<\/p>\n
The new courtroom gotcha? Check whether your opponent left in brainless AI hallucinations, and tattle on them to the judge.<\/p>\n
This is precisely how the prestigious Wall Street law firm Sullivan & Cromwell, which boasts clients including Donald Trump<\/a>, was recently humiliated. On Saturday, Andrew Dietderich, the cohead of the firm\u2019s restructuring group, apologized to federal judge Martin Glenn after it emerged that its filing in a major case was riddled with bogus citations that an AI made up.<\/p>\n \u201cWe deeply regret that this has occurred,\u201d Dietderich wrote in the groveling letter<\/a>.<\/p>\n The errors were caught by an opposing firm, Boies \u200bSchiller Flexner, in a motion S&C filed in a federal bankruptcy court in Manhattan.\u00a0In some passages, the filing straight-up misquoted US bankruptcy code, and cited the decisions from other cases that were either inaccurately summarized or misidentified. One of the cases cited by S&C in the motion wasn\u2019t even a case, Boies Schiller Flexner lawyers found.<\/p>\n No doubt terrified of potentially being sanctioned, Dietderich extolled S&C\u2019s rigorous practices and safeguards around AI in the apology letter, which include \u201ctraining requirements governing the US of AI tools in legal work,\u201d and lamented that its AI policies \u201cwere not followed\u201d while preparing the motion.\u00a0\u00a0<\/p>\n \u201cI want to assure the Court that the Firm\u2019s policies governing AI use are both clear and rigorous,\u201d he stressed.\u00a0<\/p>\n Dietderich also claimed that the firm undertook \u201cimmediate remedial measures,\u201d including launching a review into how the AI hallucinations slipped through the cracks. A corrected version of the filing was later submitted to the court.<\/p>\n Which AI model, or models, were involved in the blunder wasn\u2019t specified. Sources close to the firm told the Financial Times<\/a>, however, that it has an enterprise license for OpenAI\u2019s ChatGPT.<\/p>\n The gaffe is the latest high profile example of lawyers tripping over themselves by using hallucinating AI tools. The AIs can incorrectly cite or misquote case law and may even invent nonexistent cases, egregious errors that are often overlooked by the lawyers using them. Other major firms have been embarrassed by AI blunders, including Morgan & Morgan<\/a>.<\/p>\n Judges have been happy to admonish lawyers that leave in AI garbled citations, including by imposing sanctions, and threatening to refer them to the state bar. Some get creative with their punishments: when two lawyers from the firm Cozen O\u2019Connor were caught leaving in erroneous AI material<\/a>, the judge said they could either choose to be sanctioned, or to write a letter to their law school deans explaining how they screwed up.<\/p>\n