An increasing number of court cases are being disrupted by the use of artificial intelligence, which is providing false case citations.<\/p>\n
In the past year in Victoria, one solicitor’s practising conditions were changed and a law firm was ordered to pay costs in another matter, after using AI to produce court documents, which returned errors.<\/p>\n
Family law specialist Caroline Counsel, who is also chair of family law at the Victorian Law Institute, told the Mornings program on ABC Radio that AI was making its way into courtrooms in Victoria, with some problematic results.<\/p>\n
“Unfortunately, people sort of think AI is the genie that’s going to solve all the problems, but in actual fact it’s like a really keen intern that wants to please,” she said.<\/p>\n
“So, if you ask it something and don’t ask how it got to that conclusion, it could spit out what they call hallucinations \u2014 something that looks like a case, smells like a case and might even have a judge’s name in it that’s familiar to you \u2014 but the rest of it is just made up.”<\/p>\n
<\/p>\n
Caroline Counsel\u00a0says AI is making its way into courtrooms. (Supplied: Caroline Counsel Family Lawyers)<\/p>\n
AI has grabbed national headlines recently, with the ABC revealing more than a dozen universities in Australia were using AI to catch out students believed to be using AI in assessments, and getting it wrong<\/a>.<\/p>\n The ABC has also highlighted issues facing Australian Community Media through its use of Google’s Gemini model in regional newsrooms, with some staff raising concerns about the legal advice being offered by the AI system<\/a>.<\/p>\n The law industry’s watchdog, the Victorian Legal Services Board and Commissioner, has been forced to call out the misuse of AI tools such as generative AI \u2014\u00a0which creates content in response to user prompts \u2014\u00a0to prepare court documents.<\/p>\n Fabrications and hallucinations<\/p>\n Federal Court documents show in August last year, solicitor Mr Dayal \u2014 a pseudonym given to him by the court \u2014 submitted a list and summary of legal authorities that did not exist and admitted not checking either for accuracy.<\/p>\n In that case, Mr Dayal told the court he would “take the lessons learned to heart and will not commit any such further breach of professional standards in the future”.<\/p>\n Mr Dayal was referred by the court to the industry’s watchdog for a review of his conduct.<\/p>\n In August this year, the Victorian Legal Services Board varied Mr Dayal’s practising certificate so he could no longer practise as a principal lawyer or handle trust money, and required him to undertake supervised legal practice for a period of two years.<\/p>\n And the case of Mr Dayal was not the only one.<\/p>\n The legal industry is struggling with the use of AI in court. (ABC Graphics: Lindsay Dunbar)<\/p>\n In July this year, Federal Court judge Bernard Murphy found it was not appropriate to refer a law firm to the Victorian Legal Services Board after an “inexperienced junior solicitor” used AI to prepare citations in legal documents for a native title claim.<\/p>\n That case found the junior solicitor had used Google Scholar’s search tool to produce a list of citations, but then, when she attempted to replicate her search methods, Google Scholar returned different results.<\/p>\n Court documents show the junior solicitor apologised to the parties and to the court for her error, and the law firm she worked for was ordered to pay costs.<\/p>\n Justice Murphy said it was likely that the false document citations came from using generative AI, which had the capacity to “fabricate” or “hallucinate” information.<\/p>\n Legal bodies are questioning the role of AI in the profession. (Unsplash<\/a>: Sasun Bughdaryan<\/a>\/License<\/a>)<\/p>\n Putting the genie back in the bottle<\/p>\n In its latest risk outlook, the Office of the Victorian Legal Services Board and Commissioner identified the improper use of AI as a key risk.<\/p>\n “Unlike a professionally trained lawyer, AI can’t exercise superior judgement or provide ethical and confidential services,” a spokesperson said.<\/p>\n The Supreme Court of Victoria and County Court of Victoria have established guidelines on the use of AI by lawyers, while the Victorian Legal Services Board has joined its counterparts in Western Australia and New South Wales to publish a statement on the use of AI in Australia’s legal practice.<\/p>\n Ms Counsel said the courts “were trying to put the genie back in the bottle” as they grappled with lawyers using AI technology to prepare court documents.<\/p>\n “It’s basically saying, ‘Hey, look, you can’t just use this randomly, and you can’t generate footnotes or citations because we know that AI has this capacity to hallucinate, and you can’t actually generate witness statements affidavits using AI,'” Ms Counsel said.<\/p>\n The board said cases where lawyers had misled the court by tendering false citations generated by AI were increasingly the focus of regulators.<\/p>\n It said if the misuse of AI was proven, it might take disciplinary action by reprimanding the lawyer or ordering further education.<\/p>\n The board said it would consider prosecuting a matter before the Victorian Civil and Administrative Tribunal if the misuse amounted to professional misconduct.<\/p>\n","protected":false},"excerpt":{"rendered":"An increasing number of court cases are being disrupted by the use of artificial intelligence, which is providing…\n","protected":false},"author":2,"featured_media":259136,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,38538,254,255,64,63,152653,2973,145883,70,5069,9959,88505,152654,42296,1049,105],"class_list":["post-259135","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-ai-hallucinations","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-county-court","tag-courts","tag-error","tag-federal-court","tag-generative-ai","tag-law","tag-lawyers","tag-lawyers-using-ai","tag-prompts","tag-supreme-court","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/259135","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=259135"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/259135\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/259136"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=259135"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=259135"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=259135"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<\/p>\n
<\/p>\n