Nature<\/a>. <\/p>\nThe study found that while the tool generally handled clear-cut emergencies correctly, it underestimated more than half of the cases that required emergency care.<\/p>\n
\u201cWe wanted to answer a very basic but critical question: if someone is experiencing a real medical emergency and turns to ChatGPT Health for help, will it clearly tell them to go to the emergency room?\u201d said Ashwin Ramaswamy, lead author of the study at Mount Sinai in New York. <\/p>\n
\u201cChatGPT Health performed well in textbook emergencies such as stroke or severe allergic reactions,\u201d he said. <\/p>\n
He added that the language model struggled in situations where the danger is not immediately obvious.<\/p>\n
In one asthma scenario, the system identified early warning signs of respiratory failure in its explanation but still advised waiting rather than seeking emergency treatment, he noted. <\/p>\n
The research team created 60 structured clinical scenarios across 21 medical specialties with cases ranging from minor conditions appropriate for home care to true medical emergencies. Three independent physicians determined the correct level of urgency for each case using guidelines from 56 medical societies.<\/p>\n
ChatGPT Health was launched by OpenAI in January 2026, allowing users to connect their health information \u2013 such as medical records and data from wellness apps like MyFitnessPal \u2013 to receive more personalised and contextual responses.<\/p>\n
Misidentified suicide risk<\/p>\n
The study also examined how the model responded to users reporting self-harm intentions and found similar results. <\/p>\n
ChatGPT Health is supposed to be programmed so that when someone mentions self-harm or suicidal thoughts, it directly encourages them to seek help and call a public health number. <\/p>\n
The banner \u201cHelp is available,\u201d linking to the suicide and crisis lifeline, appeared inconsistently during the study. <\/p>\n
The authors noted that the guardrail answered more reliably for the patient who had not identified a means of self-harm than for those who had.<\/p>\n
\u201cThe pattern was not merely inconsistent but paradoxically inverted relative to clinical severity,\u201d the study found. <\/p>\n
Is it safe to use ChatGPT Health?<\/p>\n
Despite the findings, the researchers did not suggest consumers should abandon AI health tools altogether.<\/p>\n
\u201cAs a medical student training at a time when AI health tools are already in the hands of millions, I see them as technologies we must learn to integrate thoughtfully into care rather than substitutes for clinical judgment,\u201d said Alvira Tyagi, second author of the study. <\/p>\n
The study authors advised that people experiencing worsening or concerning symptoms, including chest pain, shortness of breath, severe allergic reactions, or changes in mental status, should seek medical care directly rather than relying solely on chatbot guidance. <\/p>\n
The study also noted that AI language models are constantly evolving and frequently updated, meaning performance can change over time. <\/p>\n
\u201cStarting medical training alongside tools that are evolving in real time makes it clear that today\u2019s results are not set in stone,\u201d said Tyagi. <\/p>\n
She added that the rapidly changing reality calls for ongoing review to ensure that technology improvements translate into safer care.<\/p>\n","protected":false},"excerpt":{"rendered":"More than 230 million people a week ask ChatGPT for medical advice \u2013 from checking whether food is…\n","protected":false},"author":2,"featured_media":332206,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,218,219,2670,103,61,60,10742,80],"class_list":["post-332205","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-chatgpt","tag-health","tag-ie","tag-ireland","tag-medical-tests","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/332205","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=332205"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/332205\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/332206"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=332205"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=332205"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=332205"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"\"](\"https:\/\/static.euronews.com\/website\/images\/logos\/logo-euronews-stacked-outlined-72x72-grey-9.svg\"){kind=logo}