Sign up to see the future, today<\/p>\n
Can\u2019t-miss innovations from the bleeding edge of science and tech<\/p>\n
If you\u2019ve been to a medical appointment in the past two or three years, chances are high that your doctor was using an AI scribe: software that listens into the conversation, transcribing it and structuring it into the format of medical notes.<\/p>\n
In theory it\u2019s a cool idea, but pain points abound. Earlier this week, Ontario\u2019s auditor general \u2014 an accountability officer acting under the Legislative Assembly of Ontario \u2014 released a special report<\/a> warning that AI medical scribes were \u201cnot evaluated adequately,\u201d and may present \u201cfabricated information\u201d to medical professionals.<\/p>\n First reported by Global News<\/a>, the audit took a look at 20 AI scribe platforms and found that \u201call AI scribe systems from the 20 [government] approved vendors showed one or more inaccuracies at the procurement testing phase,\u201d such as \u201challucinations (fabrication), incorrect information, or missing or incomplete information.\u201d<\/p>\n \u201cInaccuracies in medical notes generated by AI Scribe systems could potentially result in inadequate or harmful treatment plans that may potentially impact patient health outcomes,\u201d the report declared.<\/p>\n Muddying the waters, Ontario\u2019s Minister of Public and Business Service Delivery and Procurement, Stephen Crawford, noted that the hallucinations were observed during testing by state regulators, and had not been recording during actual medical visits.<\/p>\n \u201cLet\u2019s be very clear about that, that\u2019s not actually in operational use with doctors, that\u2019s in the optional stage where we\u2019re reviewing the various scribes,\u201d Crawford told Global News.<\/p>\n Still, the auditor general, Shelley Spence, noted that the various scribes are nonetheless in use by around 5,000 doctors<\/a> across Ontario. Talking to reporters, Spence said she went so far as to ask her physician to \u201cplease look at the transcript when you\u2019re done with my own visit.\u201d <\/p>\n That news comes as another AI scribe system, OpenEvidence, faces growing scrutiny in the US over hallucinations and incomplete answers. <\/p>\n As several doctors told NBC News<\/a>, for example, OpenEvidence can occasionally draw overly strong conclusions from medical studies with relatively small sample sizes.<\/p>\n While many physicians express appreciation<\/a> for the new tool, it remains to be seen how they fare under real-world conditions \u2014 and how the medical world will judge them once the AI hype wears off.<\/p>\n