{"id":142062,"date":"2026-01-20T20:59:05","date_gmt":"2026-01-20T20:59:05","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-ca\/142062\/"},"modified":"2026-01-20T20:59:05","modified_gmt":"2026-01-20T20:59:05","slug":"ai-has-a-bias-problem-can-we-build-something-smarter","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-ca\/142062\/","title":{"rendered":"AI has a bias problem. Can we build something smarter?"},"content":{"rendered":"<p>From assessing a patient\u2019s cancer risk to setting criminal sentences, AI and algorithms are increasingly used to make life-altering decisions in health care and law. But how can we ensure that these algorithms are designed to remove the biases inherent to human decision-making, rather than reproducing them?<\/p>\n<p>This is a question <a href=\"https:\/\/people.eecs.berkeley.edu\/~emmapierson\/\" rel=\"nofollow noopener\" target=\"_blank\">Emma Pierson<\/a>, an assistant professor of computer science at UC Berkeley, grapples with every day.\u00a0<\/p>\n<p>\u201cAlgorithms have a lot of potential advantages over people for being fair decision-makers, but those advantages have not always been realized \u2014 and it can be quite hard to realize them,\u201d Pierson said.\u00a0<\/p>\n<p>In her work, Pierson is developing AI and machine learning methods for medicine and the social sciences, with the goal of improving health care and reducing social inequality. Recently, she developed a new test for detecting racial discrimination in policing. She is also working to reduce racial and gender bias in algorithms, particularly those that are used to assess disease risk and make critical decisions about patient care.\u00a0<\/p>\n<p>\u201cI am trying to use AI to make a healthier and fairer world,\u201d Pierson said.\u00a0<\/p>\n<p>Pierson was recently named the <a href=\"https:\/\/cdss.berkeley.edu\/news\/emma-pierson-named-zhang-family-endowed-professor-uc-berkeley-eecs\" rel=\"nofollow noopener\" target=\"_blank\">Zhang Family Endowed Professor<\/a> and is affiliated with the <a href=\"https:\/\/bair.berkeley.edu\/\" rel=\"nofollow noopener\" target=\"_blank\">Berkeley AI Research Lab<\/a>, <a href=\"https:\/\/computationalhealth.berkeley.edu\/\" rel=\"nofollow noopener\" target=\"_blank\">Computational Precision Health<\/a> and the <a href=\"https:\/\/humancompatible.ai\/\" rel=\"nofollow noopener\" target=\"_blank\">Center for Human-Compatible AI<\/a>.<\/p>\n<p>People over particles<\/p>\n<p>Pierson was an undergraduate studying physics at Stanford University when she learned that her mother, who had been diagnosed with breast cancer a few years earlier, was a carrier of the BRCA1 gene mutation. Pierson had a 50% chance of also having the mutation, which confers a high risk of breast and ovarian cancers. Genetic testing a few years later confirmed she was a carrier.\u00a0<\/p>\n<p>\u201cIt was very scary and upsetting, but also quite focusing in terms of finding what I wanted to do with my life,\u201d Pierson said.\u00a0<\/p>\n<p>Pierson, who had been using statistical methods to study galaxies, already had the notion that she was \u201cmore interested in people than particles.\u201d She upended her studies, deciding to focus instead on how she could apply computer models to the fields of health care and the social sciences.\u00a0<\/p>\n<p>Soon after beginning a graduate program in computer science, also at Stanford, Pierson began working on police traffic stop data collected as part of the <a href=\"https:\/\/openpolicing.stanford.edu\/\" rel=\"nofollow noopener\" target=\"_blank\">Stanford Open Policing Project<\/a>. The data revealed undeniable racial disparities, galvanizing Pierson to focus her work not only on improving health care, but also on identifying and addressing racial inequalities.<\/p>\n<p>\u201cIf you looked at the very basic statistics of the data \u2014 the racial disparities in how likely people were to be searched or arrested after a stop \u2014 the gaps were huge,\u201d Pierson said. \u201cIt was apparent that something catastrophic was going on.\u201d\u00a0<\/p>\n<p>However, her work on police traffic stop data also highlighted the importance of designing precise statistical tools for understanding the how and why of inequalities. In a study <a href=\"https:\/\/www.science.org\/doi\/10.1126\/sciadv.adx5829\" rel=\"nofollow noopener\" target=\"_blank\">published late last year<\/a>, Pierson and her collaborator <a href=\"https:\/\/bowers.cornell.edu\/people\/nora-gera\" rel=\"nofollow noopener\" target=\"_blank\">Nora Gera<\/a>, a graduate student at Cornell University, devised a new way to test whether inequities are caused by discrimination rather than other factors.<\/p>\n<p>I am trying to use AI to make a healthier and fairer world.<\/p>\n<p>Emma Pierson<\/p>\n<p>In traffic stop data from Texas, Colorado and Arizona, they noticed that there were a number of individuals who police reported as white in some encounters and Hispanic in others. In the study, they compared how these individuals were treated when they were perceived as white versus Hispanic, finding that drivers were significantly more likely to be searched and arrested when the police perceived them as Hispanic.\u00a0<\/p>\n<p>The findings provide strong evidence that racial bias was likely a cause of the disparities.<\/p>\n<p>\u201cThe reason we looked at white and Hispanic drivers is because those were the most commonly confused racial groups in the particular data that we looked at, but there\u2019s no reason you couldn\u2019t apply it to other categories,\u201d Pierson said.\u00a0<\/p>\n<p>This same approach could be applied in other situations where a person\u2019s racial or gender category is determined by how they are perceived, rather than being self-reported, and where there are multiple perceptions of the same person over time.\u00a0<\/p>\n<p>\u201cFor instance, you could look at the same person over time in different health care settings when their race is inconsistently perceived and see how they\u2019re treated differently,\u201d Pierson said.<\/p>\n<p>Counteracting human biases<\/p>\n<p>Using data to pinpoint the root causes of racial and gender disparities is just the first step in addressing these gaps. Pierson is also working to design AI algorithms that can help counteract the biases inherent in human thinking.<\/p>\n<p>But creating and implementing fair and unbiased algorithms in the real world comes with a host of challenges. Like humans, algorithms trained on biased data will also make biased decisions. In addition, many of the algorithms used in health care and law are created by corporations and are proprietary, meaning it is difficult for the public to scrutinize or critique how they were designed and trained.\u00a0<\/p>\n<p>\u201cIf an algorithm is unfair, it can also reproduce unfairness on a much vaster scale than any single human decision maker,\u201d Pierson said.\u00a0<\/p>\n<p>However, Pierson points to <a href=\"https:\/\/www.nytimes.com\/2019\/12\/06\/business\/algorithm-bias-fix.html\" rel=\"nofollow noopener\" target=\"_blank\">a New York Times article<\/a> by MIT professor Sendhil Mullainathan, which argues that \u201cdiscrimination by algorithm can be more readily discovered and more easily fixed\u201d than discrimination by humans. Experiments <a href=\"https:\/\/news.berkeley.edu\/2019\/10\/24\/widely-used-health-care-prediction-algorithm-biased-against-black-people\/\" rel=\"nofollow noopener\" target=\"_blank\">can be designed to reveal bias<\/a> even in proprietary algorithms, and researchers like Pierson are finding ways to address these biases once they have been uncovered.<\/p>\n<p>Recently, Pierson has been studying how to design algorithms that will perform well in the presence of missing data. This question is especially pertinent in medicine, where algorithms that predict disease risk often omit many important factors \u2014 such as a patient\u2019s genetic history or exposure to pollutants \u2014 because these factors are unknown. Instead, the race of the patient is often used as a variable.\u00a0<\/p>\n<p>\u201cRace is a socially constructed variable, not biological,\u201d Pierson said. \u201cAnd historically, race has been included in medical decision-making and in algorithms in racist ways. By using race in these algorithms, we might worry about further entrenching health disparities.\u201d\u00a0<\/p>\n<p>If an algorithm is unfair, it can also reproduce unfairness on a much vaster scale than any single human decision maker.<\/p>\n<p>Emma Pierson<\/p>\n<p>However, simply removing race from medical algorithms doesn\u2019t necessarily help reverse medical disparities. In <a href=\"https:\/\/www.pnas.org\/doi\/abs\/10.1073\/pnas.2402267121\" rel=\"nofollow noopener\" target=\"_blank\">a 2024 paper<\/a>, Pierson and her team found that removing race from a cancer risk prediction algorithm caused it to under-predict risk for Black patients, potentially reducing access to colorectal cancer screens. And in <a href=\"https:\/\/jamanetwork.com\/journals\/jamainternalmedicine\/fullarticle\/2842982\" rel=\"nofollow noopener\" target=\"_blank\">a survey study published last month<\/a> in JAMA Internal Medicine, Pierson and her collaborators found that many patients are comfortable including race in medical algorithms, as long as doctors are transparent about how the information is being used.\u00a0<\/p>\n<p>\u201cI think it\u2019s fair to say that in a world where we had access to all data for all people and everything was perfectly equitable, we would not need to use race in algorithms,\u201d Pierson said.\u00a0 \u201cBut it is also important to consider the world we are actually in and design algorithms that help us make the best decisions for patients today with the data we actually have.\u201d<\/p>\n<p>Pierson says that doctors decided to test her mother for the BRCA1 gene because she was Ashkenazi Jewish, an ethnicity 10 times more likely than the general population to carry these cancer-causing mutations. Without the testing, Pierson\u2019s mother might not have lived to see her children grow up, and Pierson might not have learned this critical information about her medical risk.<\/p>\n<p>\u201cMy experience [with the BRCA1 mutation] has really crystallized for me that these risk tools are not just abstractions or interesting objects of study, but things that concretely affect people\u2019s fundamental health and life decisions,\u201d Pierson said. \u201cThey are vitally important to get right.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"From assessing a patient\u2019s cancer risk to setting criminal sentences, AI and algorithms are increasingly used to make&hellip;\n","protected":false},"author":2,"featured_media":142063,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[2080,1279,143,145,144],"class_list":["post-142062","post","type-post","status-publish","format-standard","has-post-thumbnail","category-oakland","tag-artificial-intelligence","tag-data","tag-oakland","tag-oakland-headlines","tag-oakland-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/142062","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/comments?post=142062"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/142062\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media\/142063"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media?parent=142062"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/categories?post=142062"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/tags?post=142062"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}