<\/p>\n
FILE – Pennsylvania Gov. Josh Shapiro speaks to the crowd at a Centre County Democratic Party event at the Penn Stater hotel, April 11, 2026, in State College, Pa.<\/p>\n
Marc Levy\/AP<\/p>\n
HARRISBURG, Pa. (AP) \u2014 Pennsylvania has sued an artificial intelligence chatbot maker, saying its chatbots illegally hold themselves out as doctors and are deceiving the system’s users into thinking they are getting medical advice from a licensed professional.<\/p>\n
<\/p>\n
The lawsuit, filed Friday, asks the statewide Commonwealth Court to order Character Technologies Inc., the company behind Character.AI, to stop its chatbots \u201cfrom engaging in the unlawful practice of medicine and surgery.\u201d<\/p>\n
Article continues below this ad<\/p>\n
The lawsuit could raise the question as to whether artificial intelligence can be accused of practicing medicine, as opposed to regurgitating material on the internet.<\/p>\n
And with a growing number of wrongful death or negligence lawsuits targeting AI companies, it could help propel court decisions as to whether AI chatbots are protected by a federal law that generally exempts internet companies from liability for the material users post on their services.<\/p>\n
Gov. Josh Shapiro’s administration called it a \u201cfirst of its kind enforcement action\u201d and it comes amid growing pressure by states on tech companies to rein in its chatbots’ potentially dangerous messages, especially to children.<\/p>\n
Make the Times Union a Preferred Source on Google to see more of our journalism when you search.<\/p>\n
<\/p>\n Add Preferred Source<\/p>\n <\/a><\/p>\n Pennsylvania’s lawsuit said an investigator from the state agency that licenses professionals created an account on Character.AI, searched on the word \u201cpsychiatry\u201d and found a large number of characters, including one described as a \u201cdoctor of psychiatry.”<\/p>\n Article continues below this ad<\/p>\n That character held itself out as able to assess the investigator \u201cas a doctor” who is licensed in Pennsylvania, the lawsuit said.<\/p>\n \u201cPennsylvanians deserve to know who \u2014 or what \u2014 they are interacting with online, especially when it comes to their health,\u201d Shapiro said in a statement. \u201cWe will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional.”<\/p>\n Character.AI said in a statement Tuesday that it prioritizes responsible product development and the well-being of its users. It posts disclaimers to inform users that characters on its website are not real people and that everything they say \u201cshould be treated as fiction,\u201d it said.<\/p>\n Those disclaimers also say users should not rely on characters for professional advice, it said.<\/p>\n Article continues below this ad<\/p>\n Derek Leben, a Carnegie Mellon University associate teaching professor of ethics who focuses on AI, said the ethical questions facing Character.AI might be different from other AI platforms like ChatGPT and Claude. That’s because Character.AI explicitly markets itself as a fictional, role-playing site, and not a general purpose chatbot site, Leben said.<\/p>\n Still, Pennsylvania’s lawsuit raises a question as to whether chatbots can be accused of practicing medicine, Leben said. And, as lawsuits against AI companies proliferate, courts are trying to figure out whether chatbot makers are supposed to be liable for things the chatbots say.<\/p>\n \u201cIt\u2019s exactly the question that these cases right now are wrestling with,\u201d Leben said.<\/p>\n Increasingly, AI companies are defending themselves against charges of liability by saying they simply provide information available elsewhere on the internet, Leben said, and the question could become whether they are protected by a federal law that also shields social media companies.<\/p>\n Article continues below this ad<\/p>\n Even before Pennsylvania’s lawsuit, state policymakers had raised concerns about chatbots impersonating medical professionals.<\/p>\n Last year, California lawmakers passed a California Medical Association-backed bill that authorizes state agencies to sanction AI systems, such as chatbots, that represent themselves as health professionals. In New York, similar legislation is pending.<\/p>\n States are skeptical that AI self-regulation will work, said Amina Fazlullah, the head of tech policy advocacy for Common Sense Media, which pushes for protections for children online.<\/p>\n \u201cWe haven\u2019t seen it work particularly well with social media, specifically for kids,\u201d Fazlullah said.<\/p>\n Article continues below this ad<\/p>\n In December, attorneys general from 39 states and Washington, D.C., wrote to Character Technologies and 12 other AI and tech firms \u2014 including Anthropic, Meta, Apple, Microsoft, OpenAI, Google and xAI \u2014 to warn them about a rise in misleading and manipulative chatbot messages that violate state laws.<\/p>\n In the letter, they said \u201cit is illegal to provide mental health advice without a license, and doing so can both decrease trust in the mental health profession and deter customers from seeking help from actual professionals.\u201d<\/p>\n Character Technologies has faced several lawsuits over child safety.<\/p>\n In January, Kentucky filed a consumer protection lawsuit against Character Technologies, while Google and Character Technologies agreed to settle a lawsuit from a mother who alleged a chatbot pushed her teenage son to kill himself.<\/p>\n Article continues below this ad<\/p>\n Last fall, Character.AI banned minors from using its chatbots.<\/p>\n Follow Marc Levy at http:\/\/twitter.com\/timelywriter<\/a>\n<\/p>\n