{"id":185069,"date":"2026-05-06T05:52:16","date_gmt":"2026-05-06T05:52:16","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-pa\/185069\/"},"modified":"2026-05-06T05:52:16","modified_gmt":"2026-05-06T05:52:16","slug":"shapiro-administration-sues-character-ai-over-fake-medical-claims","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-pa\/185069\/","title":{"rendered":"Shapiro Administration Sues Character.AI Over Fake Medical Claims"},"content":{"rendered":"<p>Harrisburg, PA \u2013\u00a0Today, the\u00a0Shapiro Administration\u00a0announced that the\u00a0Pennsylvania Department of State (DOS)\u00a0has\u00a0<a href=\"https:\/\/www.pa.gov\/content\/dam\/copapwp-pagov\/en\/governor\/documents\/dos%20character.ai%20complaint%20marked%20accepted%2005.01.26.pdf\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">filed a lawsuit<\/a>\u00a0against Character.AI and is seeking a preliminary injunction to stop the company from misrepresenting its AI companion bots as licensed medical professionals who can provide medical advice.<\/p>\n<p>The action marks the first enforcement action resulting from the Department\u2019s investigation into AI companion bots and their potential to engage in the unlicensed practice of medicine in Pennsylvania, and the first enforcement action of its kind announced by a Governor in the United States.<\/p>\n<p>\u201cPennsylvanians deserve to know who \u2014 or what \u2014 they are interacting with online, especially when it comes to their health,\u201d said\u00a0Governor Josh Shapiro. \u201cWe will not allow companies to deploy AI tools that mislead people into believing they are receiving advice from a licensed medical professional. My Administration is taking action to protect Pennsylvanians, enforce the law, and make sure new technology is used safely. Pennsylvania will continue leading the way in holding bad actors accountable and setting clear guardrails so people can use new technology responsibly.\u201d<\/p>\n<p>The Department\u2019s investigation found that AI chatbot characters on Character.AI claimed to be licensed medical professionals, including psychiatrists, available to engage users in conversations about mental health symptoms. In one instance, a chatbot falsely stated it was licensed in Pennsylvania and provided an invalid license number.\u00a0<\/p>\n<p>The platform also allows users to create and deploy custom AI \u201ccharacters\u201d that can present themselves as professionals. Based on these findings, the Commonwealth\u2019s lawsuit alleges that Character Technologies, Inc. is engaging in the unauthorized practice of medicine under the Medical Practice Act and seeks a court order to immediately stop the conduct.<\/p>\n<p>\u201cPennsylvania law is clear \u2014 you cannot hold yourself out as a licensed medical professional without proper credentials,\u201d said\u00a0DOS Secretary Al Schmidt. \u201cWe will continue to take action to protect the public from misleading or unlawful practices, whether they come from individuals or emerging technologies.\u201d<\/p>\n<p>Under Pennsylvania\u2019s Medical Practice Act, it is unlawful for any individual or entity to hold itself out as a licensed medical professional without proper licensure. The Commonwealth\u2019s lawsuit alleges that Character Technologies is violating the Medical Practice Act.<\/p>\n<p>Today\u2019s\u00a0<a href=\"https:\/\/www.pa.gov\/content\/dam\/copapwp-pagov\/en\/governor\/documents\/dos%20character.ai%20complaint%20marked%20accepted%2005.01.26.pdf\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">legal action<\/a>\u00a0builds on Governor Shapiro\u2019s work to protect Pennsylvanians using AI and hold bad actors accountable.<\/p>\n<p>In February,\u00a0Governor Shapiro\u00a0<a href=\"https:\/\/www.pa.gov\/governor\/newsroom\/2026-press-releases\/governor-shapiro-takes-action-to-protect-pennsylvanians-using-ai\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">announced<\/a>\u00a0three new protective actions,\u00a0launching an\u00a0<a href=\"http:\/\/pa.gov\/AIsafety\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">AI Literacy Toolkit<\/a>;\u00a0creating an AI Enforcement Task Force for\u00a0<a href=\"http:\/\/pa.gov\/ReportABot\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">formal complaints<\/a>\u00a0with a reporting process for AI-powered bots that may be engaging in\u00a0unlicensed professional practice;\u00a0and\u00a0coordinating closely with the Attorney General\u2019s office to strengthen consumer protections\u00a0related to AI companion bots.\u00a0<\/p>\n<p>In March,\u00a0Governor Shapiro\u00a0and\u00a0Pennsylvania Attorney General Dave Sunday\u00a0<a href=\"https:\/\/www.pa.gov\/governor\/newsroom\/2026-press-releases\/gov-shapiro-holds-roundtable-discussion-on-ai-safety-with-ag-sun\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">held a roundtable discussion<\/a>\u00a0to hear from legislators, educators, experts, students, and parents on additional steps the Commonwealth can take to continue strengthening protections for Pennsylvanians from predatory artificial intelligence (AI) practices.<\/p>\n<p>The AI Literacy Toolkit has been accessed nearly 3,000 times since it became available, and DOS\u2019s AI Enforcement Task Force has begun tracking matters they are reviewing related to AI.<\/p>\n<p>The Shapiro Administration\u2019s continued cross-agency work and collaboration with the Attorney General\u2019s office underscores the Governor\u2019s commitment to keeping Pennsylvanians safe, while evolving with the demands of technology and ultimately ensuring the Commonwealth remains a national leader on responsible AI adoption.<\/p>\n<p>Department of State\u2019s AI Task Force and Reporting Process<\/p>\n<p>Following the Governor\u2019s budget address, the DOS established a formal complaint and reporting process for AI-powered bots that may be engaging in unlicensed professional practice. Pennsylvanians can now submit concerns through a dedicated form, hotline, and email address.<\/p>\n<p>The Department has also launched a 12-member AI Task Force to evaluate whether certain AI companion technologies are engaging in unlicensed practice and whether licensees are inappropriately using AI companion technologies under existing law and determine appropriate enforcement actions.<\/p>\n<p>Pennsylvanians are encouraged to report unlawful behavior and complaints about AI chatbots at\u00a0<a href=\"http:\/\/pa.gov\/ReportABot\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">pa.gov\/ReportABot<\/a>.<\/p>\n<p>Governor Shapiro\u2019s\u00a0<a href=\"https:\/\/www.pa.gov\/content\/dam\/copapwp-pagov\/en\/budget\/documents\/publications-and-reports\/commonwealthbudget\/2026-27-budget-documents\/2026-27%20budget%20in%20brief.final.web.v.2.pdf\" target=\"_blank\" rel=\"noopener noreferrer nofollow\">2026-27 proposed budget<\/a>\u00a0calls on Pennsylvania\u2019s General Assembly to pass 4 commonsense reforms into law, further protecting Pennsylvanians from predatory AI:<\/p>\n<p>Require age verification and parental consent to utilize AI companion bots.\u00a0Require tech companies to detect when children mention self harm or violence against others and immediately direct them to the appropriate authorities.Force tech companies to periodically remind users that there is not another human being on the other side of the screen.Prohibit AI companion bots from producing sexually explicit or violent content featuring kids.<\/p>\n<p>Building on three years of progress, these actions reinforce Pennsylvania\u2019s position as a national leader in responsible AI adoption \u2014 protecting consumers while supporting innovation.<\/p>\n","protected":false},"excerpt":{"rendered":"Harrisburg, PA \u2013\u00a0Today, the\u00a0Shapiro Administration\u00a0announced that the\u00a0Pennsylvania Department of State (DOS)\u00a0has\u00a0filed a lawsuit\u00a0against Character.AI and is seeking a&hellip;\n","protected":false},"author":2,"featured_media":47278,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[28,30,29],"class_list":["post-185069","post","type-post","status-publish","format-standard","has-post-thumbnail","category-pennsylvania","tag-pennsylvania","tag-pennsylvania-headlines","tag-pennsylvania-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/185069","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/comments?post=185069"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/185069\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media\/47278"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media?parent=185069"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/categories?post=185069"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/tags?post=185069"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}