Relying on AI chatbots for healthcare can be ‘dangerous’ as they give bad advice and wrong diagnoses, a concerning study reveals.
Artificial intelligence is now able to ace most medical licensing exams taken by doctors but is unable to give humans better health advice than they can find using more traditional methods, researchers found.
Rebecca Payne, study co-author from Oxford University, said: ‘Despite all the hype, AI just isn’t ready to take on the role of the physician.
‘Patients need to be aware that asking a large language model about their symptoms can be dangerous, giving wrong diagnoses and failing to recognise when urgent help is needed.’
The academics wanted to find out how successful humans are when they use chatbots to identify their health problems and whether they require seeing a doctor or going to hospital.
The team presented nearly 1,300 UK-based participants with 10 different scenarios, such as a headache after a night out drinking, a new mother feeling exhausted or what having gallstones feels like.
Then the researchers randomly assigned the participants one of three chatbots: OpenAI’s GPT-4o, Meta’s Llama 3 or Command R+.
There was also a control group that used internet search engines.
AI is unable to give humans better health advice than they can find using more traditional methods, researchers found
People using the AI chatbots were only able to identify their health problem around a third of the time, while only around 45 percent figured out the right course of action.
This was no better than the control group, according to the study, published in the Nature Medicine journal.
The researchers pointed out the disparity between these disappointing results and how AI chatbots score extremely highly on medical benchmarks and exams, blaming the gap on a communication breakdown.
Unlike the simulated patient interactions often used to test AI, the real humans often did not give the chatbots all the relevant information.
And sometimes the humans struggled to interpret the options offered by the chatbot, or misunderstood or simply ignored its advice.
One out of every six US adults ask AI chatbots about health information at least once a month, the researchers said, with that number expected to increase as more people adopt the new technology.
‘This is a very important study as it highlights the real medical risks posed to the public by chatbots,’ David Shaw, a bioethicist at Maastricht University in the Netherlands who was not involved in the research said.
He advised people to only trust medical information from reliable sources, such as the UK’s National Health Service.
Share or comment on this article:
Relying on AI chatbots for healthcare can be ‘dangerous’ as they give bad advice and wrong diagnoses, researchers warn