{"id":167306,"date":"2025-09-19T09:16:16","date_gmt":"2025-09-19T09:16:16","guid":{"rendered":"https:\/\/www.newsbeep.com\/us\/167306\/"},"modified":"2025-09-19T09:16:16","modified_gmt":"2025-09-19T09:16:16","slug":"chatgpt-can-give-you-medical-advice-should-you-take-it","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us\/167306\/","title":{"rendered":"ChatGPT can give you medical advice. Should you take it?"},"content":{"rendered":"

An artist in Germany who liked to draw outdoors showed up at the hospital with a bug bite and a host of symptoms that doctors couldn\u2019t quite connect. After a month and several unsuccessful treatments, the patient started plugging his medical history into ChatGPT, which offered a diagnosis<\/a>: tularemia, also known as rabbit fever. The chatbot was correct, and the case was later written up in a peer-reviewed medical study<\/a>.<\/p>\n

Around the same time, another study<\/a> described a man who appeared at a hospital in the United States with signs of psychosis, paranoid that his neighbor had been poisoning him. It turns out, the patient had asked ChatGPT for alternatives to sodium chloride, or table salt. The chatbot suggested sodium bromide<\/a>, which is used to clean pools. He\u2019d been eating the toxic substance for three months and, once he\u2019d stopped, required three weeks in a psychiatric unit to stabilize.<\/p>\n

You\u2019re probably familiar with consulting Google for a mystery ailment. You search the internet for your symptoms, sometimes find helpful advice, and sometimes get sucked into a vortex of anxiety and dread, convinced that you\u2019ve got a rare, undiagnosed form of cancer. Now, thanks to the wonder that is generative AI, you can carry out this process in more detail. Meet Dr. ChatGPT.<\/p>\n

AI chatbots are an appealing stand-in for a human physician, especially given the ongoing doctor shortage as well as the broader barriers to accessing health care in the United States. <\/p>\n

ChatGPT is not a doctor in the same way that Google is not a doctor. Searching for medical information on either platform is just as likely to lead you to the wrong conclusion as it is to point toward the correct diagnosis. Unlike Google search, however, which simply points users to information, ChatGPT and other large language models (LLMs) invite people to have a conversation about it. They\u2019re designed to be approachable, engaging, and always available. This makes AI chatbots an appealing stand-in for a human physician, especially given the ongoing doctor shortage<\/a> as well as the broader barriers to accessing health care<\/a> in the United States.<\/p>\n

As the rabbit fever anecdote shows, these tools can also ingest all kinds of data and, having been trained on reams of medical journals, sometimes arrive at expert-level conclusions that doctors missed. Or it might give you really terrible medical advice.<\/p>\n

There\u2019s a difference between asking a chatbot for medical advice and talking to it about your health in general. Done right, talking to ChatGPT could lead to better conversations with your doctor and better care. Just don\u2019t let the AI talk you into eating pool cleaner.<\/p>\n

The right and wrong ways to talk to Dr. ChatGPT<\/p>\n

Plenty of people are talking to ChatGPT about their health. About one in six adults in the United States say they use AI chatbots for medical advice on a monthly basis, according to a 2024 KFF poll<\/a>. A majority of them aren\u2019t confident in the accuracy of the information the bots provide \u2014 and frankly, that level of skepticism is appropriate given the stubborn tendency for LLMs to hallucinate and the potential for bad health information to cause harm. The real challenge for the average user is knowing how to distinguish between fact and fabrication.<\/p>\n

\u201cHonestly, I think people need to be very careful about using it for any medical purpose, especially if they don\u2019t have the expertise around knowing what\u2019s true and what\u2019s not,\u201d said Dr. Roxana Daneshjou<\/a>, a professor and AI researcher at the Stanford School of Medicine. \u201cWhen it\u2019s correct, it does a pretty good job, but when it\u2019s incorrect, it can be pretty catastrophic.\u201d<\/p>\n

Chatbots also have a tendency to be sycophantic, or eager to please, which means they might steer you in the wrong direction if they think that\u2019s what you want.<\/p>\n

The situation is precarious enough, Daneshjou added, that she encourages patients to go instead to Dr. Google, which serves up trusted sources. The search giant has been collaborating with experts from the Mayo Clinic and Harvard Medical School for a decade<\/a> to present verified information about conditions and symptoms after the rise of something called \u201ccyberchondria,\u201d or health anxiety enabled by the internet.<\/p>\n

This condition is much older than Google<\/a>, actually. People have been searching for answers to their health questions since the Usenet days of the 1980s, and by the mid-2000s, eight in 10 people were using the internet<\/a> to search for health information. Now, regardless of their reliability, chatbots are poised to receive more and more of these queries. Google even puts its problematic AI-generated results<\/a> for medical questions above the vetted results from its symptom checker<\/a>.<\/p>\n

If you\u2019ve got a list of things to ask your doctor about, ChatGPT could help you craft questions.<\/p>\n

But if you skip the symptom checking side of things, tools like ChatGPT can be really helpful if you just want to learn more about what\u2019s going on with your health based on what your doctor\u2019s already told you or to gain a better understanding of their jargony notes. Chatbots are designed to be conversational, and they\u2019re good at it. If you\u2019ve got a list of things to ask your doctor about, ChatGPT could help you craft questions. If you\u2019ve gotten some test results and need to make a decision with your doctor about the best next steps, you can rehearse that with a chatbot without actually asking the AI for any advice.<\/p>\n

In fact, when it comes to just talking, there\u2019s some evidence that ChatGPT is better at it. One study from 2023<\/a> compared real physician answers to health questions from a Reddit forum to AI-generated responses when a chatbot was prompted with the same questions. Health care professionals then evaluated all of the responses and found that the chatbot-generated ones were both higher quality and more empathetic<\/a>. This is not the same thing as a doctor being in the same room as a patient, discussing their health. Now is a good time to point out that, on average, patients get just 18 minutes<\/a> with their primary care doctor on any given visit. If you go just once a year, that\u2019s not very much time to talk to a doctor.<\/p>\n

You should be aware that, unlike your human doctor, ChatGPT is not HIPAA-compliant. Chatbots generally have very few privacy protections<\/a>. That means you should expect any health information you upload will get stored in the AI\u2019s memory and be used to train large language models in the future. It\u2019s also theoretically possible that your data could end up being included in an output for someone else\u2019s prompt. There are more private ways to use chatbots<\/a>, but still, the hallucination problem and the potential for catastrophe exist.<\/p>\n

The future of bot-assisted health care <\/p>\n

Even if you\u2019re not using AI to figure out medical mysteries, there\u2019s a chance your doctor is. According to a 2025 Elsevier report<\/a>, about half of clinicians said they\u2019d used an AI tool for work and slightly more said these tools save them time, and one in five say they\u2019ve used AI for a second opinion on a complex case. This doesn\u2019t necessarily mean your doctor is asking ChatGPT to figure out what your symptoms mean.<\/p>\n

Doctors have been using AI-powered tools to help with everything from diagnosing patients to taking notes since well before ChatGPT even existed. These include clinical decision support systems built specifically for doctors, which currently outperform off-the-shelf chatbots \u2014 although the chatbots can actually augment the existing tools<\/a>. A 2023 study found that doctors working with ChatGPT performed only slightly better<\/a> at diagnosing test cases than those working independently. Interestingly, ChatGPT alone performed the best.<\/p>\n

That study made headlines<\/a>, probably for the suggestion that AI chatbots are better than doctors at diagnosis. One of its co-authors, Dr. Adam Rodman<\/a>, suggests that this wouldn\u2019t necessarily be the case if doctors would be more open to listening to ChatGPT rather than assuming the chatbots were wrong when the doctor disagreed with their conclusions. Sure, the AI can hallucinate, but it can also spot connections that humans may have missed. Again, look at the rabbit fever case.<\/p>\n

\u201cPatients need to talk to their doctors about their LLM use, and honestly, doctors should talk to their patients about their LLM use.\u201d<\/p>\n

\u201cThe average doctor has a sense of when something is hallucinating or going off the rails,\u201d said Rodman, a hospitalist at Beth Israel Deaconess Medical Center and instructor at Harvard Medical School. \u201cI don\u2019t know that the average patient necessarily does.\u201d<\/p>\n

Nevertheless, in the near term, you shouldn\u2019t expect to see Dr. ChatGPT making an appearance at your local clinic. You\u2019re more likely to see AI working as a scribe<\/a>, saving your doctor time taking notes and possibly, one day, analyzing that data to help your doctor. Your doctor might use AI to help draft messages to patients<\/a> more quickly. In the near future, as AI tools get better, it\u2019s possible that more clinicians use AI for diagnosis and second opinions. That still doesn\u2019t mean you should rush to ChatGPT with your urgent medical concerns. If you do, tell your doctor about how that went.<\/p>\n

\u201cPatients need to talk to their doctors about their LLM use, and honestly, doctors should talk to their patients about their LLM use,\u201d said Rodman. \u201cIf we just both step kind of out of the shadow world and talk to each other, we\u2019ll have more productive conversations.\u201d<\/p>\n

A version of this story was also published in the User Friendly newsletter. Sign up here<\/a> so you don\u2019t miss the next one!<\/p>\n","protected":false},"excerpt":{"rendered":"An artist in Germany who liked to draw outdoors showed up at the hospital with a bug bite…\n","protected":false},"author":2,"featured_media":167307,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[181,20660,97,252,4530,271,259,1343,5599,74,20661],"class_list":["post-167306","post","type-post","status-publish","format-standard","has-post-thumbnail","category-health","tag-artificial-intelligence","tag-even-better","tag-health","tag-health-care","tag-innovation","tag-life","tag-mental-health","tag-policy","tag-public-health","tag-technology","tag-technology-media"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/167306","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=167306"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/167306\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/167307"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=167306"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=167306"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=167306"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}