Many of us already use generative artificial intelligence (AI) tools such as ChatGPT for health advice. They give quick, confident and personalised answers, and the experience can feel more private than speaking to a human. <\/p>\n
Now, several AI companies have unveiled<\/a> dedicated \u201chealth and wellness<\/a>\u201d tools. The most prominent is ChatGPT Health<\/a>, launched by OpenAI earlier this month.<\/p>\n ChatGPT Health promises to generate more personalised answers, by allowing users to link medical records and wellness apps, upload diagnostic imaging and interpret test results.<\/p>\n But how does it really work? And is it safe? <\/p>\n Most of what we know about this new tool comes from the company that launched it, and questions remain about how ChatGPT Health would work in Australia. Currently, users in Australia can sign up for a waitlist to request access.<\/p>\n Let\u2019s take a look.<\/p>\n AI health advice is booming<\/p>\n Data from 2024 shows<\/a> 46% of Australians had recently used an AI tool. <\/p>\n Health queries are popular. According to OpenAI, one in four<\/a> regular ChatGPT users worldwide submit a health-related prompt each week. <\/p>\n Our 2024 study<\/a> estimated almost one in ten Australians had asked ChatGPT a health query in the previous six months. <\/p>\n This was more common for groups that face challenges<\/a> finding accessible health information, including:<\/p>\n people born in a non-English speaking country Among those who hadn\u2019t recently used ChatGPT for health, 39% were considering using it soon.<\/p>\n How accurate is the advice?<\/p>\n Independent research consistently shows<\/a> generative AI tools do sometimes give unsafe health advice, even when<\/a> they have access to a medical record. <\/p>\n There are several high-profile examples of AI tools giving unsafe health advice, including when ChatGPT allegedly encouraged suicidal thoughts<\/a>. <\/p>\n Recently, Google removed several AI Overviews on health topics \u2013 summaries which appear at the top of search results \u2013 after a Guardian investigation found the advice about blood tests results<\/a> was dangerous and misleading. <\/p>\n This was just one health prompt they studied. There could be much more advice the AI is getting wrong we don\u2019t know about yet. <\/p>\n So, what\u2019s new about ChatGPT Health?<\/p>\n The AI tool has several new features<\/a> aimed to personalise its answers. <\/p>\n According to OpenAI, users will be able to connect their ChatGPT Health account with medical records and smartphone apps such as MyFitnessPal. This would allow the tool to use personal data about diagnoses, blood tests, and monitoring, as well as relevant context from the user\u2019s general ChatGPT conversations. <\/p>\n OpenAI emphasises<\/a> information doesn\u2019t flow the other way: conversations in ChatGPT Health are kept separate from general ChatGPT, with stronger security and privacy. The company also says ChatGPT Health data won\u2019t be used to train foundation models.<\/p>\n OpenAI says it has worked with more than 260 clinicians in 60 countries<\/a> (including Australia), to give feedback on and improve the quality of ChatGPT Health outputs.<\/p>\n In theory, all of this means ChatGPT Health could give more personalised answers compared to general ChatGPT, with greater privacy. <\/p>\n Read more: But are there still risks?<\/p>\n Yes. OpenAI openly states<\/a> ChatGPT Health is not designed to replace medical care and is not intended for diagnosis or treatment. <\/p>\n It can still make mistakes. Even if ChatGPT Health has access to your health data, there is very little information about how accurate and safe the tool is, and how well it has summarised the sources it has used. <\/p>\n The tool has not been independently tested. It\u2019s also unclear whether ChatGPT Health would be considered a medical device<\/a> and regulated as one in Australia. <\/p>\n The tool\u2019s responses may not reflect Australian clinical guidelines, our health systems and services, and may not meet the needs of our priority populations. These include First Nations people, those from culturally and linguistically diverse backgrounds, people with disability and chronic conditions, and older adults.<\/p>\n We don\u2019t know yet if ChatGPT Health will meet data privacy and security<\/a> standards we typically expect for medical records in Australia. <\/p>\n Currently, many Australians\u2019 medical records are incomplete due to patchy uptake of MyHealthRecord, meaning even if you upload your medical record, the AI may not have the full picture of your medical history. <\/p>\n For now, OpenAI says<\/a> medical record and some app integrations are only available in the United States.<\/p>\n So, what\u2019s the best way to use ChatGPT for health questions?<\/p>\n In our research<\/a>, we have worked with community members to create short educational materials<\/a> that help people think about the risks that come with relying on AI for health advice, and to consider other options. <\/p>\n Higher risk<\/p>\n Health questions that would usually require clinical expertise to answer carry more risk of serious consequences. This could include: <\/p>\n finding out what symptoms mean AI responses can often seem sensible \u2013 and increasingly personalised \u2013 but that doesn\u2019t necessarily mean they are correct or safe. So, for these higher-risk questions, the best option is always to speak with a health professional. <\/p>\n Lower risk<\/p>\n Other health questions are less risky. These tend to be more general, such as:<\/p>\n learning about a health condition or treatment option Ideally, AI is just one of the information sources you use.<\/p>\n Where else can I get free advice?<\/p>\n In Australia we have a free 24\/7 national phone service, where anyone can speak with a registered nurse about their symptoms: 1800 MEDICARE<\/a> (1800 633 422). <\/p>\n
\nthose who spoke another language at home
\npeople with limited health literacy.<\/p>\n
\n Can you say no to your doctor using an AI scribe?<\/a><\/p>\n
\nasking for advice about treatment
\ninterpreting test results. <\/p>\n
\nunderstanding medical terms
\nbrainstorming what questions to ask during a medical appointment. <\/p>\n