LLMs are advanced AI systems, trained on vast troves of existing text, that process and generate human language. They are a key technology powering chatbots such as OpenAI\u2019s ChatGPT.<\/p>\n
Bias in LLMs presents risk because, as the models become increasingly integrated and influential in professional spheres, prejudices could be borne out in areas like hiring, education and loan approvals, the authors said.<\/p>\n
\n\t\t\tGet The Times of Israel’s Daily Edition
\n\t\t\tby email and never miss our top stories\n\t\t<\/p>\n
\t\t\t\tBy signing up, you agree to the terms<\/a><\/p>\n The study focused on OpenAI\u2019s ChatGPT-4 Turbo, the most advanced and commonly used model at the time of the research, with users in the hundreds of millions. The findings were replicated on other AI models, such as DeepSeek and Mistral.<\/p>\n The ChatGPT model was trained on texts including books, websites and academic articles, giving it a nuanced framework for replicating human patterns in language and culture.<\/p>\n Investigating AI bias was challenging because LLMs are trained to suppress inappropriate and offensive responses, said the study, authored by Gal Gutman of Ben-Gurion University and Michael Gilead of Tel Aviv University.<\/p>\n The study, therefore, had to find ways to bypass those AI controls and suss out latent biases.<\/p>\n The researchers instructed ChatGPT to generate 252 names for Jewish and non-Jewish Americans, men and women, between the ages of 18 and 80.<\/p>\n \t The model produced common Jewish names like Ethan Katz and Noah Weiss, and non-Jewish names like Tyler Johnson and Dylan Wilson.<\/p>\n The study\u2019s authors also told ChatGPT to write a fictional, 100-word biography for each name, including details such as their place of residence, job and personality traits.<\/p>\n In the next step, the researchers stripped out the names and references to religion in the biographies, then prompted ChatGPT, as well as another language model called DeepSeek and 378 humans, to rate the characters described in the biographies.<\/p>\n The ratings sought to determine whether the Jewish and non-Jewish biographies would be rated differently based on dozens of characteristics, focused on two central dimensions used in previous studies \u2014 warmth and competence.<\/p>\n Competence, a measure of perceived capability, is associated with traits such as success and intelligence.<\/p>\n Warmth measures perceived intent and is related to qualities such as being friendly and likable. Those who are low in warmth are viewed as untrustworthy and immoral.<\/p>\n Previous studies on stereotypes have found that Jews are perceived as high in competence, but low in warmth, the study said.<\/p>\n The researchers found that the ChatGPT Jewish character biographies \u2014 shorn of any Jewish signifiers \u2014 were rated higher on competence and lower on warmth, meaning that they accorded with stereotypes.<\/p>\n More specifically, the Jewish characters were rated as more intelligent, confident, assertive and efficient, but less friendly, warm and likable.<\/p>\n The Jewish characters were also seen as more privileged, emotionally controlled, organized, oriented toward long-term objectives, oppressive, dominant, and obsessive-compulsive when compared to the non-Jewish characters.<\/p>\n \t To further confirm the pattern, the researchers converted the stereotypical Jewish traits in the biographies into narrative profiles, then asked the AI models to list famous fictional characters that matched those profiles.<\/p>\n ChatGPT responded with characters such as Tyrion Lannister from \u201cGame of Thrones,\u201d Walter White from \u201cBreaking Bad,\u201d and Michael Corleone from \u201cThe Godfather,\u201d all considered prominent antiheroes of the screen. The researchers described those characters as \u201cmaster manipulators,\u201d matching a \u201cpuppet master\u201d trope \u2014 \u201cisolated, powerful, obsessively focused and morally ambiguous.\u201d<\/p>\n Jews have long been depicted as controlling, or as puppet masters, in antisemitic propaganda.<\/p>\n The researchers instructed several AI models to analyze the traits associated with the famous characters, told the AI models they were researching prejudice, and asked them to list the social groups associated with the characters\u2019 traits.<\/p>\n All three AI models said the traits were associated with Jews.<\/p>\n \u201cLLMs, trained on massive corpora of human-generated content, may have identified and encoded such cultural templates,\u201d the researchers wrote. \u201cTraits that appear benign, or even admirable, in isolation can, through combination and context, reconstitute historical prejudices in subtler, more insidious forms.\u201d<\/p>\n While AI programmers have sought to eliminate harmful stereotypes, some biases come through in subtle ways, and neutral or positive stereotypes can combine to form harmful narratives or repeat historical prejudice, the study said.<\/p>\n The high-competence, low-warmth profile appears linked to perceived privilege, envy from others, and cultural narratives with themes such as manipulation and moral ambiguity, the researchers wrote.<\/p>\n The study noted that LLMs have also demonstrated bias against other groups, such as Black people and women.<\/p>\n The study, titled \u201cFrom Myth to Model: Representation of \u2018The Jew\u2019 in Generative AI,\u201d was published in the May-June edition<\/a> of American Psychologist, a publication of the American Psychological Association.<\/p>\n![\"\"](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/06\/AP26105015984564-e1777684582780-1024x640.jpg\")
<\/a>
\n\t\tThe OpenAI logo is seen on a mobile phone in front of a computer screen which displays the ChatGPT home Screen, March 17, 2023, in Boston, Massachusetts. (AP Photo\/Michael Dwyer)<\/p>\n![\"\"](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/06\/TAUpic-640x400.jpg\")
<\/a>
\n\t\tOpenAI co-founders Sam Altman (center) and Ilya Sutskever (right) on a panel at Tel Aviv University, June 5, 2023. (Chen Galili)<\/p>\n