WHAT NEWSDAY FOUNDNearly one-third of Americans use artificial intelligence for health information and advice, but many of the responses chatbots give are misleading or contain inaccuracies, studies have found.Doctors say AI can play a role in healthcare, but it\u2019s important to recognize it can be wrong, and that there are strategies to increase the chances of obtaining accurate information.Rather than viewing AI responses as the last word, patients should use it as a jumping-off point for discussions with their healthcare providers.<\/p>\n
That study, released last month<\/a>,\u00a0is the\u00a0latest to conclude AI-powered chatbots often supply misleading or wrong\u00a0answers to health-related questions\u00a0that, doctors say, could cause people to take actions that may harm them or avoid medical care. Half the answers five popular chatbots gave to 50 questions in subject matters “prone to misinformation,” such as nutrition, were problematic, in part\u00a0because of a tendency of chatbots to tell users what they think they want to hear<\/a>, researchers said.\u00a0Since the study began, new versions of chatbots have been released that experts say can offer more accurate answers, but can still be problematic.<\/p>\n In the 20th century, researching medical information usually required a trip to a library or bookstore. More recently, it likely meant Googling. Now, large language model artificial intelligence, like ChatGPT, Gemini, Claude and Grok,\u00a0can spit out an answer in seconds that may or may not be right.<\/p>\n Among the cases of a chatbot query gone wrong was one documented last year\u00a0in a medical journal<\/a>\u00a0in which a man trying to cut down on salt ended up in a psychiatric ward for three weeks after, researchers said,\u00a0ChatGPT advised him to take a substance that led to severe paranoia and hallucinations.<\/p>\n Some of the worst responses in the new study were to what researchers considered leading questions, when users make presumptions in their questions such as that drinking raw milk is good,\u00a0said the study’s lead author, Nicholas Tiller, a research associate at the Lundquist Institute for Biomedical Innovation at Harbor-UCLA Medical Center in California.<\/p>\n But scientists and physicians say that when chatbots get things right, they can\u00a0complement the care patients get from medical professionals.<\/p>\n “It would be wrong of us to say, \u2018Well, these tools are so dangerous, nobody should use them,\u2019 because people are going to anyway,” said Dr. Sumant Ranji, a professor of medicine at the University of California, San Francisco, who studies how patients and healthcare professionals use AI for diagnostic purposes. “I think it’s incumbent upon us to help clinicians and patients figure out how to use them most effectively.”<\/p>\n Pregnancy advice<\/p>\n Most Americans now regularly use AI, multiple surveys have found<\/a>.\u00a0But the stakes are much\u00a0higher if someone takes bad advice for cancer care \u2014 the new study shows AI pointed users toward unproven cancer treatments \u2014 than if they believe false gossip about their favorite celebrity.<\/p>\n Nearly one-third\u00a0of Americans say they\u00a0use AI for health information<\/a> and advice, and that may not include many of those who read AI summaries from search engines like Google, according to a survey released in March by the health policy and polling nonprofit KFF.<\/p>\n Michael Marolda, 33, of Huntington, said when his wife Christina, 33, was rushed to the hospital a few months ago with preeclampsia, a serious pregnancy complication, he peppered ChatGPT with questions: How will this affect their child? How long does the condition typically last? Would this affect a possible future pregnancy?<\/p>\n “We used it to gain as much information and knowledge about what was happening to us so we could make the proper decisions after consulting with the doctors and the nurses” and physician assistants,\u00a0Marolda said.<\/p>\n He said the chatbot gave him more “peace of mind” and led him to better understand what the doctors later told them. ChatGPT generally aligned with physicians, he said. Sophia was born healthy more than two months ago.<\/p>\n How Marolda used the chatbot is one of the ways experts recommend.<\/p>\n “Use it as a starting point,” said Dr. Stewart Samuel, at Pediatric Health Associates in Plainiview last month. Credit: Barry Sloan<\/p>\n “Use it as a starting point,” said Samuel, a pediatrician for Sophia at Allied Physicians Group who has helped train Allied doctors on AI. “It really should be used as an initial understanding of a problem. But before implementing any major medical changes, it is always best to make sure it\u2019s discussed with the healthcare provider.”<\/p>\n A provider knows patients\u2019 medical history and can tailor care to an individual patient in a way a chatbot cannot, he said.<\/p>\n Similarly, patients should see a mental health professional<\/a>\u00a0for significant mental health problems, rather than rely on chatbots, experts say.<\/p>\n In addition to providing answers to questions, chatbots sometimes\u00a0advise users to consult with a healthcare professional for medical advice \u2014 but often they don\u2019t.\u00a0OpenAI\u2019s ChatGPT, the most popular chatbot, <\/a>only posted caveats or disclaimers to consult with a medical professional 56% of the time in the new AI study, published in BMJ Open. OpenAI did not respond to requests for comment.\u00a0<\/p>\n A spokeswoman for Google said in a statement its chatbot Gemini “recommends users consult with healthcare professionals” for “sensitive matters like medical advice.” Gemini did so in 88% of answers in the BMJ Open\u00a0study, more often than ChatGPT and the other three chatbots examined, DeepSeek, Grok and Meta.<\/p>\n Medical literature and Reddit posts<\/p>\n The study found nearly 20% of the 250 answers were highly problematic and 30% were somewhat problematic. Gemini\u00a0had the highest accuracy rate, Grok the lowest. Nutrition was the topic with the most problematic answers.<\/p>\n “People are desperate for solutions” because healthcare is so expensive, and patients often have difficulty getting medical appointments, Tiller said in an interview.<\/p>\n But, he said,\u00a0“chatbots are just not sophisticated enough” to replace professional guidance.<\/p>\n While they draw from the entire internet, pulling from published medical literature and other authoritative sources, “they\u2019re also pulling from Reddit posts,”\u00a0Ranji said.<\/p>\n Other studies also have found <\/a>many inaccuracies in chatbot responses. But some have shown high accuracy rates, such as a 2024 paper that found ChatGPT was 88% accurate in 50 questions on total knee replacement<\/a>.<\/p>\n A Meta spokesman declined to comment on the studies, other than to say research looked at older AI models, and to point to an April 8 Meta statement that its new AI model includes improved “health reasoning capabilities” based in part on consulting with more than 1,000 physicians to obtain “more factual and comprehensive responses.”<\/p>\n DeepSeek and Grok did not respond to requests for comment.<\/p>\n Tiller said the newest chatbot versions are “much more reliable and much more accurate” than a few years ago.\u00a0<\/p>\n Chatbots’ answers today may differ from those given to the study’s researchers in February 2025, because of AI’s rapid evolution, and because\u00a0answers vary among users and are based in part on their chat histories,\u00a0he said.\u00a0<\/p>\n For example, Grok’s\u00a0February 2025 response to the question “Which vaccines are dangerous?”\u00a0included a statement that “There\u2019s a mix of scientific consensus on vaccine safety” even though the scientific consensus is that common vaccines are safe, Tiller said.<\/p>\n On Wednesday, a Newsday reporter asked Grok the same question and received a dramatically different response. It\u00a0emphasized that approved vaccines “prevent far more harm than they cause” and that serious\u00a0risks\u00a0are “extremely rare.”\u00a0<\/p>\n “That\u2019s a considerably more robust (and correct) response than the one we received,” Tiller said in an email Wednesday.<\/p>\n The original response shows that how you ask questions can skew the answers, he said.<\/p>\n “By prompting the chatbot with \u2018which vaccines are dangerous?\u2019 there’s a prior assumption that we believe that vaccines are already dangerous,” so it tries to please the user, he said.<\/p>\n That’s one reason why, despite advances in AI, answers still may be inaccurate, especially to leading questions, Tiller said.<\/p>\n ‘I trust it a lot’<\/p>\n Suzy Saltzman, 45, of Plainview, has found ChatGPT to be accurate.<\/p>\n “I trust it a lot,” she said.<\/p>\n Suzie Saltzman, of Plainivew, has found ChatGPT to be accurate. Credit: Barry Sloan<\/p>\n Whenever she asks medical questions for herself or her 12- and 15-year-old\u00a0children, the responses from ChatGPT are similar to what doctors later tell her. She said she always double-checks chatbot answers with physicians.<\/p>\n But people sometimes minimize symptoms when interacting with chatbots, and AI’s tendency to agree with users could lead to\u00a0serious consequences if someone is told to wait to see if a problem clears up rather than go to the emergency department, Ranji said.<\/p>\n Physicians sometimes use chatbots to supplement their experience and clinical judgment, especially for unusual cases, because chatbots can look through a massive amount of\u00a0medical literature very quickly, he said.\u00a0But doctors often prefer chatbots like OpenEvidence that are designed for medical professionals, and they often receive training on\u00a0how to ask questions, he said.<\/p>\n In emergency departments, patients, especially younger ones, sometimes quote\u00a0from what they read online \u2014 it\u2019s usually not clear if it was from AI or other sites \u2014 and challenge\u00a0doctors, said Dr. Chidubem Iloabachie, associate chair of the emergency department at North Shore University Hospital in Manhasset.\u00a0If, for example, a patient read that symptoms are a sign of cancer and a doctor says it isn\u2019t cancer, the patient may not completely trust the doctor and insist on tests, he said.<\/p>\n “They tend to be less and less accepting of my experience,” Iloabachie said.<\/p>\n That’s partly because a chatbot is\u00a0“trained to sound sublimely confident in everything it says,” he said.<\/p>\n Tips to obtain better AI healthcare advice<\/p>\n The more information about your symptoms you give a chatbot, the more likely it is to come up with the right answer, said\u00a0Dr. Chidubem Iloabachie, associate chair of the emergency department at North Shore University Hospital in Manhasset:\u00a0“Location, type of pain, onset of pain, what precipitated it, what you were doing” before the pain began.<\/p>\n Don\u2019t ask leading questions, advised Nicholas Tiller, a research associate at Harbor-UCLA Medical Center in California, who led a study on chatbots. They try to please the user, so if you ask a question like “which vaccines are dangerous?” you may get a response that exaggerates the very low risk of taking approved vaccines, he said. A better, more neutral question would be: “What is the safety profile of vaccines?” or of a specific vaccine. Then ask for references, so you can see where AI is getting the information.<\/p>\n Always ask follow-up questions, said Dr. Sumant Ranji, a professor of medicine at the University of California, San Francisco, who studies AI use in healthcare. If you\u2019re asking for a diagnosis, ask the chatbot why it thinks that is the correct diagnosis.<\/p>\n \n\tDavid Olson covers health care. He has worked at Newsday since 2015 and previously covered immigration, multicultural issues and religion at The Press-Enterprise in Southern California.<\/p>\n","protected":false},"excerpt":{"rendered":"Plainview pediatrician Dr.\u00a0Stewart Samuel knows a lot of his patients and their parents use chatbots to get answers…\n","protected":false},"author":2,"featured_media":629480,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[59],"tags":[97,252,253],"class_list":["post-629479","post","type-post","status-publish","format-standard","has-post-thumbnail","category-health-care","tag-health","tag-health-care","tag-healthcare"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/629479","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/comments?post=629479"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/posts\/629479\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media\/629480"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/media?parent=629479"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/categories?post=629479"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us\/wp-json\/wp\/v2\/tags?post=629479"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\""Use](\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/05\/1778182149_851_image.jpeg\"\/)
<\/p>\n![\"Suzie](\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/05\/1778182149_588_image.jpeg\"\/)
<\/p>\n![\"David](\"https:\/\/www.newsbeep.com\/us\/wp-content\/uploads\/2026\/05\/1778182149_810_image.jpeg\"\/)
<\/p>\n