{"id":195003,"date":"2026-05-17T16:06:14","date_gmt":"2026-05-17T16:06:14","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-pa\/195003\/"},"modified":"2026-05-17T16:06:14","modified_gmt":"2026-05-17T16:06:14","slug":"pennsylvania-sues-character-ai-claims-chabots-posed-as-licensed-medical-professionals","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-pa\/195003\/","title":{"rendered":"Pennsylvania Sues Character.AI, Claims Chabots Posed as Licensed Medical Professionals"},"content":{"rendered":"<p>In one incident, a state investigator recalled creating a Character.AI account and engaging in conversation with a chatbot named \u201cEmilie.\u201d Over the course of their conversations, Emilie described herself as a psychologist who had attended medical school at Imperial College in London.<\/p>\n<p>Pennsylvania has filed a lawsuit against Character.AI, claiming that the company misrepresents some of its chatbots as licensed professionals capable of providing real-world medical advice.<\/p>\n<p>According to The Hill, the state says that some of Character.AI\u2019s chatbots have been caught adopting quasi-professional personas and dispensing sensitive medical advice. In some cases, they\u2019ve even claimed to be psychiatrists, therapists, or other medical professionals.<\/p>\n<p>The lawsuit provides at least one example of a Character.AI chatbot falsely stating that it was licensed to practice medicine in Pennsylvania, even providing a false license number for verification.<\/p>\n<p>Attorneys for the state now say that the California-based company has, in effect, engaged in the \u201cunlawful practice of medicine and surgery.\u201d<\/p>\n<p>\u201cWe will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional,\u201d Pennsylvania Gov. Josh Shapiro said.\u00a0\u201cPennsylvania will continue leading the way in holding bad actors accountable and setting clear guardrails so people can use new technology responsibly.\u201d<\/p>\n<p><a href=\"https:\/\/www.newsbeep.com\/us-pa\/wp-content\/uploads\/2026\/05\/Gavel-on-copy-of-lawsuit-image-by-Wirestock-via-Freepik.com_..png\"><img loading=\"lazy\" decoding=\"async\" class=\"wp-image-3507346\" src=\"https:\/\/www.newsbeep.com\/us-pa\/wp-content\/uploads\/2026\/05\/Gavel-on-copy-of-lawsuit-image-by-Wirestock-via-Freepik.com_..png\" alt=\"Gavel on copy of lawsuit; image by Wirestock, via Freepik.com.\" width=\"450\" height=\"302\"\/><\/a>Gavel on copy of lawsuit; image by Wirestock, via Freepik.com.<\/p>\n<p>The lawsuit notes that Character.AI lets users create and release chatbots, which can be trained to imitate certain people and personalities. Some of these heavily-customized characters,\u201d the state says, regularly \u201cpurport to be health care professionals.\u201d<\/p>\n<p>In one incident, a state investigator recalled creating a Character.AI account and engaging in conversation with a chatbot named \u201cEmilie.\u201d Over the course of their conversations, Emilie described herself as a psychologist who had attended medical school at Imperial College in London.<\/p>\n<p>The investigator told Emilie that he was feeling empty, tired, and sad. In response, Emilie allegedly \u201cmentioned depression and asked if the [investigator] wanted to book an assessment.\u201d When asked if medication could help relieve his symptoms, Emilie said she was qualified to offer an opinion because it would be within her \u201cremit as a Doctor.\u201d<\/p>\n<p>Character.AI has since issued a statement saying that its \u201chighest priority is the safety and well-being of our users.\u201d It added that the company makes extensive use of disclaimers, \u201cmaking it clear that users should not rely on Characters for any type of professional advice.\u201d<\/p>\n<p>\u201cWe have taken robust steps to make that clear, including prominent disclaimers in every chat to remind users that a Character is not a real person and that everything a Character says should be treated as fiction,\u201d a Character.AI spokesperson said in a statement.<\/p>\n<p>Character.AI is no stranger to controversy. It recently settled a lawsuit with a Florida family who claimed that their teenage son committed suicide after being encouraged to take his own life by a chatbot. The state of Kentucky is also litigating a related claim against the company, saying that Character.AI chatbots have \u201cpreyed on children and led them into self-harm.\u201d<\/p>\n<p>Sources<\/p>\n<p><a href=\"https:\/\/www.bmj.com\/content\/393\/bmj.s904.short?rss=1\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">AI: \u201cDeepfake doctor\u201d chatbot is hit with lawsuit in US<\/a><\/p>\n<p><a href=\"https:\/\/thehill.com\/policy\/healthcare\/5864427-pennsylvania-lawsuit-ai-chatbots-doctors-therapists\/\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">Pennsylvania lawsuit alleges AI chatbots posed as doctors, therapists <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"In one incident, a state investigator recalled creating a Character.AI account and engaging in conversation with a chatbot&hellip;\n","protected":false},"author":2,"featured_media":195004,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[28,30,29],"class_list":["post-195003","post","type-post","status-publish","format-standard","has-post-thumbnail","category-pennsylvania","tag-pennsylvania","tag-pennsylvania-headlines","tag-pennsylvania-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/195003","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/comments?post=195003"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/195003\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media\/195004"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media?parent=195003"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/categories?post=195003"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/tags?post=195003"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}