AI usage is exploding on both sides<\/p>\n
Since ChatGPT\u2019s release in late 2022, patient use of GenAI chatbots for health information has grown exponentially. In Australia, about one in ten adults<\/a> now seeks health advice from ChatGPT. Patients use it to research symptoms, clarify medical jargon, create care plans when specialist support is delayed, and seek second opinions.<\/p>\n Some examples are striking. A US mother used ChatGPT to help diagnose her child\u2019s tethered cord syndrome<\/a> after traditional consultations missed it. But there\u2019s also harm: AI has misclassified neurological symptoms<\/a>, delaying stroke treatment.<\/p>\n On the clinician side, adoption is equally rapid. Two-thirds of US physicians<\/a> now use AI tools, up from 38% a year earlier. The fastest-growing application is AI-powered medical scribes, ambient systems that automatically generate clinical notes, promising to reduce documentation burden.<\/p>\n In Australia, we\u2019re seeing similar patterns but lack data. My team at Macquarie University is conducting the first national survey of Australian GPs using digital scribes. If you\u2019re using these tools, please share your experience at https:\/\/gpscribesurvey.getcds.net\/<\/a>.<\/p>\n Why this is different from \u201cDr Google\u201d<\/p>\n Unlike a Google search that returns verifiable links, AI chatbots deliver synthesised reasoning without producing a completely verifiable output. When ChatGPT generates a differential diagnosis, neither you nor your patient can trace how it reached that conclusion. Medical knowledge then becomes something to interpret rather than verify.<\/p>\n The statistics are concerning: only 19% of users<\/a> cross-check chatbot outputs, yet people trust AI responses as much as doctors\u2019 advice, even when inaccurate. This trust-without-verification fundamentally alters consultation dynamics. Yet the potential and capabilities AI opens are undeniable, and soon practising with AI assistance could be seen as inevitable as working with the internet, possible without it, but increasingly impractical.<\/p>\n The risks and opportunities<\/p>\n AI can empower patients to prepare better questions and participate more actively in decisions. But three key risks emerge:<\/p>\n Trust erosion: Research shows patient satisfaction drops when AI authorship is revealed after the fact. In one study, patients rated AI-drafted messages as more empathetic than human ones, until they learned AI wrote them. Transparency needs collaborative review, not post-hoc disclosure.<\/p>\n Digital divides: This poses particular risks for CALD populations and people without English as first language. Most AI systems are trained on English data and perform poorly otherwise, potentially widening health inequities.<\/p>\n Accountability gaps: Triadic care means doctor and patient retain responsibility for decisions through shared understanding. AI provides input, but accountability cannot be delegated to algorithms making autonomous recommendations.<\/p>\n What doctors can do now<\/p>\n The first step is simple: make AI use visible. For patient AI use, try: \u201cHave you used AI or looked anything up about this? Let\u2019s review it together.\u201d This normalises disclosure and creates opportunities for collaborative interpretation.<\/p>\n For your own AI use, brief transparency builds trust. \u201cI\u2019ve checked this interaction with an AI tool, and here\u2019s what it suggests\u201d, paired with joint review, increases patient trust in both you and the decision.<\/p>\n Documentation matters too. Health systems should add simple \u201cAI involvement\u201d fields in electronic records. Recording why you accepted, modified, or rejected an AI suggestion creates patterns for safety learning and audit trails. For digital AI scribes, gaining patient consent is key before using them for consultation transcription.<\/p>\n Generalist doctors are well-suited to navigate this shift. Our core task has always been dialogue and interpretation with patients, working with uncertainty and helping people weigh options among both general and specialised advice. The consultation is becoming less about exchanging facts and more about co-creating understanding, now with a third voice that needs critical interpretation.<\/p>\n Moving forward together<\/p>\n Australian healthcare is making progress on AI governance. The Department of Health and Aged Care<\/a> has conducted consultations on safe and responsible AI in healthcare, the RACGP<\/a> has released guidance on conversational AI and scribes, and professional bodies are developing frameworks. But integrating AI into everyday consultations requires practical action at the frontline.<\/p>\n GPs can start now by making AI use visible in our practices, asking patients about their AI use, documenting our own, and insisting on transparent systems rather than black-box automation. These grassroots practices will inform the broader policy work happening at state and federal levels.<\/p>\n The second and third papers in the BMJ series, published in coming weeks, examine patient perspectives and the clinical competencies needed to use AI transparently and effectively. Together, these papers argue that triadic care is inevitable but manageable, if we make it visible and maintain human judgment at the centre.<\/p>\n The consultation room has changed. There\u2019s now a third voice in the dialogue. Australian GPs can shape how that voice is integrated, not as replacement for clinical expertise, but as a tool we interpret together, critically and collaboratively, in service of better care.<\/p>\n The first step is transparency. The second is dialogue. That conversation needs to start now.<\/p>\n Dr David Fraile Navarro is a trained GP and a Research Fellow in Generative AI at the Centre for Health Informatics, Australian Institute of Health Innovation, Macquarie University, Sydney. He is lead author of \u201cGenerative AI and the changing dynamics of clinical consultations,\u201d published in the BMJ this week as part of a three-paper series on AI in clinical encounters.<\/p>\n If you\u2019re an Australian GP using AI-powered medical scribes, please contribute to the national survey at https:\/\/gpscribesurvey.getcds.net\/<\/a><\/p>\n The statements or opinions expressed in this article reflect the views of the authors and do not necessarily represent the official policy of the AMA, the\u00a0MJA\u00a0or\u00a0InSight+\u00a0unless so stated.\u00a0<\/p>\n Subscribe to the free\u00a0InSight+\u00a0weekly newsletter\u00a0here<\/a>. It is available to all readers, not just registered medical practitioners.\u00a0<\/p>\n![\"When](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/shutterstock_1242800767-1024x683.jpg\")
Today\u2019s medical encounters often involve not just patient and GP, but also AI systems (goodluz \/ Shutterstock).<\/p>\n