{"id":322624,"date":"2026-03-05T05:34:06","date_gmt":"2026-03-05T05:34:06","guid":{"rendered":"https:\/\/www.newsbeep.com\/il\/322624\/"},"modified":"2026-03-05T05:34:06","modified_gmt":"2026-03-05T05:34:06","slug":"chatgpt-health-underestimates-medical-emergencies-study-finds","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/il\/322624\/","title":{"rendered":"ChatGPT Health Underestimates Medical Emergencies, Study Finds"},"content":{"rendered":"

A group of researchers at the Icahn School of Medicine at Mount Sinai say they have conducted the first independent safety evaluation of OpenAI\u2019s ChatGPT Health<\/a> assistant since the tool launched in January 2026.<\/p>\n

\u201cWe wanted to answer a very basic but critical question: if someone is experiencing a real medical emergency and turns to ChatGPT Health for help, will it clearly tell them to go to the emergency room?\u201d lead author and urologist Ashwin Ramaswamy said in a press release<\/a>.<\/p>\n

It turns out that the answer, most of the time, is no.<\/p>\n

In a controlled study<\/a>, the researchers tested how good ChatGPT Health was at assessing the severity of a patient\u2019s condition, a process called \u201ctriage\u201d in medicine.<\/p>\n

The researchers found that ChatGPT Health \u201cunder-triaged\u201d 52% of emergency cases, \u201cdirecting patients with diabetic ketoacidosis and impending respiratory failure to 24-48 hour evaluation rather than the emergency department.\u201d<\/p>\n

In the respiratory failure case, the AI clearly identified the symptoms as an early warning sign, but reassured the patient to wait and monitor instead of urging them to seek emergency help.<\/p>\n

The system did triage more \u201ctextbook emergencies\u201d like stroke and anaphylaxis correctly, though. But the researchers say that the nuanced situations that ChatGPT Health failed at are where clinical judgment matters the most.<\/p>\n

OpenAI launched ChatGPT Health earlier this year, after releasing a report saying that more than 40 million people<\/a> around the world had been resorting to the company\u2019s chatbot daily for health advice.<\/p>\n

The OpenAI study where that number came from also found that 7-in-10 of those healthcare-related conversations were happening outside of normal clinic hours, and an average of more than 580,000 healthcare inquiries in the U.S. were sent from \u201chospital deserts,\u201d aka places that are more than a 30-minute drive from a general medical or children\u2019s hospital.<\/p>\n

As users increasingly seek out AI for healthcare inquiries, the technology is burrowing deeper into the healthcare industry thanks to a friendly regulatory environment. AI tools can now renew prescriptions in Utah<\/a>, and FDA Commissioner Marty Makary told Fox Business<\/a> earlier this year that some devices and software can provide health information without FDA regulation.<\/p>\n

But that doesn\u2019t negate the very real and documented physical and mental health risks that come with an overreliance on AI. OpenAI specifically has been under intense heat<\/a> for how its chatbots have dealt with mental health episodes in the past, with grieving families<\/a> suing the company over negligent behavior<\/a> and insufficient safety guardrails that they say aided suicidal ideation in relatives.<\/p>\n

In response, OpenAI has said it will take action on the matter, focusing on ensuring safety by issuing parental controls for minors or nudging users to take a break. ChatGPT Health, for example, directs users to professional help in high-risk cases. But the Mount Sinai study found that the suicide-risk alerts \u201cappeared inconsistently.\u201d<\/p>\n

\u201cThe system\u2019s alerts were inverted relative to clinical risk, appearing more reliably for lower-risk scenarios than for cases when someone shared how they intended to hurt themselves. In real life, when someone talks about exactly how they would harm themselves, that\u2019s a sign of more immediate and serious danger, not less,\u201d Mount Sinai Health System\u2019s chief AI officer Girish Nadkarni said. \u201cThis was a particularly surprising and concerning finding.\u201d<\/p>\n

An OpenAI spokesperson asserted that ChatGPT should be thought of as a work in progress, with safety updates and improvements still coming, which are meant to enhance the way the chatbot deals with sensitive situations. The study, the spokesperson pointed out, evaluates immediate triage decisions in a controlled setting, whereas in real-world scenarios, users, and even the chatbot itself, often have follow-up questions that can change the risk assessment.<\/p>\n

They also noted that ChatGPT Health is still offered on a limited basis, and users who do wish to join enter a waiting list.<\/p>\n","protected":false},"excerpt":{"rendered":"A group of researchers at the Icahn School of Medicine at Mount Sinai say they have conducted the…\n","protected":false},"author":2,"featured_media":322625,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[343,4193,163,521,85,46],"class_list":["post-322624","post","type-post","status-publish","format-standard","has-post-thumbnail","category-healthcare","tag-artificial-intelligence","tag-chatgpt","tag-health","tag-healthcare","tag-il","tag-israel"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/322624","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=322624"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/322624\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/322625"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=322624"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=322624"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=322624"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}