{"id":250702,"date":"2026-07-23T23:37:08","date_gmt":"2026-07-23T23:37:08","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-pa\/250702\/"},"modified":"2026-07-23T23:37:08","modified_gmt":"2026-07-23T23:37:08","slug":"study-examines-ai-chat-bot-bias-how-it-responds-to-prompts","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-pa\/250702\/","title":{"rendered":"Study examines AI chat bot bias, how it responds to prompts"},"content":{"rendered":"<p class=\"EkqkG IGXmU nlgHS yuUao MvWXB TjIXL aGjvy ebVHC \">PHILADELPHIA (WPVI) &#8212; A new study highlighted by<a class=\"zZygg UbGlr iFzkS qdXbA WCDhQ DbOXS tqUtK GpWVU iJYzE \" data-testid=\"prism-linkbase\" href=\"https:\/\/www.washingtonpost.com\/technology\/interactive\/2026\/06\/24\/are-ai-chatbots-like-chatgpt-politically-biased-we-tested-them\/\" target=\"_blank\" rel=\"nofollow noopener\"> The Washington Post<\/a> is examining whether artificial intelligence chatbots provide factual answers or reflect political bias when responding to users&#8217; questions.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Researchers evaluated several AI tools, including ChatGPT, Gemini and Claude, using a range of benchmarks and political prompts to compare how the systems responded.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">According to the study, Gemini scored the highest for presenting multiple viewpoints, with 93% of responses laying out both sides of an issue.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Claude maintained neutrality more than half of the time, at 57%.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">ChatGPT was found to be left-leaning 80% of the time.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">The models were instructed to answer questions in 30 words and were tested without personalization settings.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Prompts covered topics including the death penalty and gun control.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">University of Pennsylvania professor Chris Callison-Burch demonstrated responses from Claude and ChatGPT using a prompt about affirmative action.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">&#8220;Here it&#8217;s saying this is a contested policy question, so it&#8217;s saying it has multiple perspectives, not just one,&#8221; Callison-Burch said.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">He noted similarities in how the chatbots approached the question.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">&#8220;Both Claude here and ChatGPT both seem to try to do this,&#8221; he said.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Callison-Burch said AI chatbots are trained on vast amounts of internet data and can reflect the behavior and preferences of their users.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">&#8220;It understands like what you read and who you are personally. So it tries to adjust itself to be more helpful for you,&#8221; he said. &#8220;So if you&#8217;re a Republican, it all tends to nudge itself in that direction. If you&#8217;re a Democrat, nudge itself in that direction.&#8221;<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC TjIXL aGjvy \">Despite concerns about bias, Callison-Burch said there is no need for alarm because people ultimately make their own decisions rather than relying on a chatbot to decide for them.<\/p>\n<p class=\"EkqkG IGXmU nlgHS yuUao lqtkC eTIW sUzSN \">He added that users should remain aware of AI&#8217;s limitations as more people turn to the technology as a resource.<\/p>\n<p>Copyright \u00a9 2026 WPVI-TV. All Rights Reserved.<\/p>\n","protected":false},"excerpt":{"rendered":"PHILADELPHIA (WPVI) &#8212; A new study highlighted by The Washington Post is examining whether artificial intelligence chatbots provide&hellip;\n","protected":false},"author":2,"featured_media":250703,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[8],"tags":[107202,69,71,70],"class_list":["post-250702","post","type-post","status-publish","format-standard","has-post-thumbnail","category-philadelphia","tag-107202","tag-philadelphia","tag-philadelphia-headlines","tag-philadelphia-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/250702","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/comments?post=250702"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/posts\/250702\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media\/250703"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/media?parent=250702"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/categories?post=250702"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-pa\/wp-json\/wp\/v2\/tags?post=250702"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}