{"id":98825,"date":"2025-12-17T22:14:10","date_gmt":"2025-12-17T22:14:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/us-ca\/98825\/"},"modified":"2025-12-17T22:14:10","modified_gmt":"2025-12-17T22:14:10","slug":"berkeley-statistician-doesnt-like-our-odds-with-ai","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/us-ca\/98825\/","title":{"rendered":"Berkeley Statistician Doesn\u2019t Like Our Odds with AI\u00a0"},"content":{"rendered":"<p class=\"has-drop-cap\">Will Fithian, associate professor of statistics at UC Berkeley, had never researched artificial intelligence before 2022. Back then, he thought the AI tools on the market were limited and didn\u2019t pose risks to the public.<\/p>\n<p>Then OpenAI released ChatGPT and his attitude changed. While AI models weren\u2019t new, ChatGPT was the first publicly-available generative AI product that suggested just how powerful and potentially harmful a technology it could be.\u00a0\u00a0\u00a0<\/p>\n<p>Since then, disturbing stories have surfaced about chatbots attempting to seduce users, engaging in blackmail, even abetting suicides.<\/p>\n<p>ChatGPT has gotten more powerful with each version and competitors have come out with comparable products, including Microsoft\u2019s Copilot, Anthropic\u2019s Claude and Google\u2019s Gemini, which UC Berkeley made available to all students earlier this year.<\/p>\n<p>These developments deeply concern Fithian, who says he can no longer imagine his daughter\u2019s future given how quickly AI is progressing. In response, he started <a href=\"https:\/\/berkeley-ai-risk.github.io\/index.html\" rel=\"nofollow noopener\" target=\"_blank\">Berkeley AI Risk<\/a>, a reading group and speaker series, six months ago with philosophy professor Wes Holliday. Over the summer, the reading group hosted weekly discussions of scholarly papers examining the relative dangers of AI. <\/p>\n<p>The group has since amassed over 1,000 subscribers, with the involvement of professors in philosophy, statistics, applied math, anthropology, as well as computer science and data science\u2014a range of disciplines Fithian said he was surprised were \u201copen to thinking hard about these topics.\u201d The group began hosting speakers in the fall, covering topics like AI governance and the early effects of AI on employment.\u00a0<\/p>\n<p>California asked Fithian how he views AI risk and what should be done about it.<\/p>\n<p>This interview has been edited for length and clarity.<\/p>\n<p>What have you been hearing from faculty who engaged in the reading group?<\/p>\n<p>The dominant conversation among faculty is just how AI is hitting higher education like a train. So, for example, in statistics, data science, computer science, we worry about take-home assignments not being as meaningful anymore, because students can use AI products to write code for them or help them solve problems.<\/p>\n<p>In my favorite class in college, we would have one problem set every week, and I would spend almost all of Saturday sitting and staring at these problems, feeling like I was making no progress. Then I\u2019d wake up on Sunday, finally having some ideas about where to start.<\/p>\n<p>That experience, I think, more than any other, prepared me for a life of doing research.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" width=\"525\" height=\"700\" src=\"https:\/\/www.newsbeep.com\/us-ca\/wp-content\/uploads\/2025\/12\/Fithian_StanleyLuo.png\" alt=\"Will Fithian smiles\" class=\"wp-image-46564\" style=\"width:326px;height:auto\"  \/>Photo by Stanley Luo<\/p>\n<p>But now, chatbots can cut time on assignments. For example, you can prompt AI to write an essay. And if learning how to write essays is not your priority as a student, you might feel more inclined to use AI to help.<\/p>\n<p>And I know the students are so busy that they probably feel like they\u2019re being punished, right? And punishing themselves if they don\u2019t use AI to at least help them structure an essay or brainstorm.<\/p>\n<p>It\u2019s hard for faculty to say that that\u2019s against the rules, but those elements of the assignment are some of the most challenging and valuable. For me, when I had writing assignments in college, the hardest thing wasn\u2019t writing, but trying to figure out where to start and how to start.<\/p>\n<p>Based on your discussions in the reading group, do you think AI is currently an existential threat to society?\u00a0<\/p>\n<p>The AI that we have now doesn\u2019t feel like an existential threat. But it\u2019s rapidly getting more powerful. We don\u2019t know whether it\u2019s going to keep getting more powerful at the same rate that it has been, but if it does I think there are a number of existential threats that it can pose.\u00a0<\/p>\n<p>Much is said about the risks of, say, rogue AIs, or the risks of misuse of AIs. I don\u2019t discount those risks, but what worries me the most is just what is going to happen to the fabric of society when people are not useful to each other anymore.<\/p>\n<p>If you look at, for example, Open AI\u2019s business mission, they say that they want to automate the most economically valuable work. And there are other AI companies that say much the same thing. I don\u2019t know how long it will take for them to do that, but it seems very plausible that it would happen within the next decade.\u00a0<\/p>\n<p>People in the AI industry often say it will happen a lot faster. I don\u2019t know whether they are overhyping things. But nowadays, when you listen to technical people argue about AI progress, it\u2019s often taken as the pessimistic view that it\u2019ll take a whole 10 years to have AI that is human level.\u00a0<\/p>\n<p>Even if it\u2019s 15 years, even if it\u2019s 20 years, I think we have a lot of preparation to do.<\/p>\n<p>It\u2019s hard to understand why people who think that there is a 10 to 20 percent chance of human extinction would think that we should go ahead the way that we\u2019re going.\u00a0<\/p>\n<p>Given that an artificial general intelligence could be here soon, why isn\u2019t there greater alarm?<\/p>\n<p>I think we have a very strong presumption that people who are building technology can just build whatever they can, and if there are negative consequences, we\u2019ll deal with it later. I think that presumption makes sense for many technologies. But I don\u2019t think that makes sense for AI, and I think that members of the public should exercise agency in how such a socially and politically and economically transformative technology will be built. And also on what timeframe it will be built, and whether it should be built at all.<\/p>\n<p>I think that we\u2019re kind of reflexively treating it as a technocratic issue, but I don\u2019t think that is concordant with the level of risk that both experts and members of the public generally believe is there. In a <a href=\"https:\/\/www.yahoo.com\/news\/article\/poll-most-americans-think-ai-will-destroy-humanity-someday-212132958.html?guccounter=1&amp;guce_referrer=aHR0cHM6Ly9kb2NzLmdvb2dsZS5jb20v&amp;guce_referrer_sig=AQAAABmS8i_zsfvNM48bW5QrGwDOqi_7zoEHsimgtC5Z1BrKg10JMHn2fEo2Iil0HGg4xfh1FZFoWOynKrLY9emvxBZw2fuDcQrewh7rpQmLJtmQ24HYOIjz_6ia72HJ7vAOFSoCC3GJkEjZ4_CNd-T58qDWNXuBBypWTHB13Adfasy5\" rel=\"nofollow noopener\" target=\"_blank\">poll that I saw recently<\/a>, more than 50 percent of Americans said that they believe it\u2019s at least somewhat likely that AI is going to destroy humanity. When you say that, it sounds kooky. But people have also polled AI researchers, and I think roughly 50 percent of them <a href=\"https:\/\/aiimpacts.org\/2022-expert-survey-on-progress-in-ai\/#Extinction_from_AI\" rel=\"nofollow noopener\" target=\"_blank\">gave a 10 percent chance<\/a> that we\u2019ll have a human extinction or a similar existential catastrophe.<\/p>\n<p>So, the public\u2019s fear is justified?<\/p>\n<p>The heads of the top four AI frontier labs in the world are giving humanity roughly Russian roulette odds to survive the technology that they\u2019re building. If someone wants to build a nuclear power plant and they tell the regulator the chance that it\u2019s going to melt down was 10 to 20 percent, they would ask you to come back with a better plan, right? The actual risk has to be much lower than that for you to build it.<\/p>\n<p>They also just throw these numbers out as their personal estimates. They don\u2019t actually have any justification for why it couldn\u2019t be higher. The people who are building these AI models don\u2019t understand how they work. They understand how to build it, or really, how to grow it, but the entity that\u2019s actually created, they don\u2019t understand how it operates. And so it will do things that they don\u2019t understand.<\/p>\n<p>Some of these examples are funny. This Microsoft AI model, a couple years ago, would suddenly fly into fits of rage and threaten its users with blackmail, even though it didn\u2019t have any information to blackmail with.<\/p>\n<p>It sounds like you can\u2019t just extract unwanted behaviors from the large language models.<\/p>\n<p>That\u2019s right. There\u2019s a big technical area of AI unlearning, where they try to get models to forget certain dangerous information. Ideally, you want your model to just refuse if somebody asks it to\u00a0 help, say, synthesize a bioweapon. But it\u2019s hard to do that reliably because you can\u2019t just code in the rule \u201crefuse when somebody asks you to help them build a bioweapon.\u201d You have to kind of train it, so you show it many examples of it refusing to build a bioweapon.\u00a0<\/p>\n<p>But people who are clever about writing prompts, they can get it to sort of migrate in a high dimensional space to some other persona that\u2019s perfectly happy to help you build a bioweapon. This is called model jail breaking.\u00a0<\/p>\n<p>What worries you most about how AI is affecting society?<\/p>\n<p>Even as chatbot products, AI can be very harmful to individual people, but as they become more powerful, they\u2019re going to take on more responsibility, and the product form factor will be different. So you might have AIs commanding military units, or you could have AIs running companies, AIs\u00a0 engaged in running political campaigns \u2026. And the ethical quandaries that you find in areas like that are so much more difficult than the ones you encounter with chatbots.\u00a0<\/p>\n<p>Another thing that\u2019s worrying is the concentration of power. Who is going to be in charge of these AI models?\u00a0<\/p>\n<p>Also, what is it going to do to individual human empowerment? If we can\u2019t support ourselves by earning a living wage, it could be that the political system will reorient itself to give a generous universal basic income to everyone. Or that might not happen.<\/p>\n<p>I think that the level of risk that regular people, that experts, that leaders of companies, assign to the present course that our society is taking is way out of proportion to what I think any reasonable person would believe is a sane risk to take.\u00a0<\/p>\n<p>I can understand why people who feel that there is no existential risk would want to go ahead, but it\u2019s hard to understand why people who think that there is a 10 to 20 percent chance of human extinction would think that we should go ahead the way that we\u2019re going.\u00a0<\/p>\n<p>So what should be done?<\/p>\n<p>It doesn\u2019t have to be all or nothing, that we either have the current, all-out race, or that we stop and never build. It could make sense to pause indefinitely, but at the very least, I think it makes sense to pause until we have some confidence that we can build AI without the current level of risk.<\/p>\n<p>But it\u2019s very difficult for rival countries like the US and China, especially, to trust each other to implement these sorts of surgical, technocratic regulations.\u00a0<\/p>\n<p>The political system is really starting to take notice of what\u2019s happening, and I think that that\u2019s also likely to change rapidly over the next few years. I think it\u2019ll become a much more salient issue. And so it wouldn\u2019t surprise me if several years from now, there\u2019s a strong movement to slow down the development of AI, or have more public control over how AI is developed.<\/p>\n<p>But by that time, the amount of leveraged investment could be such that if we moved to a more reasonable way of doing things, it could cause a market crash. Or the companies could be too big to fail. And that will make it much harder.<\/p>\n<p>So do people need to start marching in the streets?<\/p>\n<p>I think protesting probably would help. I think writing letters to their congressmen would help. Following political discussions and becoming engaged helps.<\/p>\n<p>What I would like people at Berkeley to do is bring their scholarly expertise to bear on the public discussion about AI in society.<\/p>\n<p>Frontier AI companies are presently racing as fast as they can to build as powerful AI as they can, despite the fact that they don\u2019t understand how to control current AI, and certainly have no way of understanding how they\u2019re going to control the more powerful AI they\u2019re trying to build.<\/p>\n<p>This situation poses severe risks to society. Regular people recognize this. AI experts recognize this. Leaders of frontier labs recognize this. It follows that there needs to be democratic decision-making processes for the big questions about whether we are going to build this, when, on what timeframe, and how.\u00a0<\/p>\n<p>There currently isn\u2019t any mechanism for that kind of democratic input, and I think that\u2019s urgently needed.<\/p>\n","protected":false},"excerpt":{"rendered":"Will Fithian, associate professor of statistics at UC Berkeley, had never researched artificial intelligence before 2022. Back then,&hellip;\n","protected":false},"author":2,"featured_media":98826,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[34],"tags":[143,145,144],"class_list":["post-98825","post","type-post","status-publish","format-standard","has-post-thumbnail","category-oakland","tag-oakland","tag-oakland-headlines","tag-oakland-news"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/98825","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/comments?post=98825"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/posts\/98825\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media\/98826"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/media?parent=98825"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/categories?post=98825"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/us-ca\/wp-json\/wp\/v2\/tags?post=98825"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}