{"id":7396,"date":"2025-07-19T06:15:25","date_gmt":"2025-07-19T06:15:25","guid":{"rendered":"https:\/\/www.newsbeep.com\/ca\/7396\/"},"modified":"2025-07-19T06:15:25","modified_gmt":"2025-07-19T06:15:25","slug":"the-ethics-of-ai-jobs-are-100m-salaries-worth-the-societal-risk","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ca\/7396\/","title":{"rendered":"The ethics of AI jobs: Are $100M salaries worth the societal risk?"},"content":{"rendered":"

It\u2019s a good time to be a highly in-demand AI engineer. To lure leading researchers away from OpenAI and other competitors, Meta has reportedly offered pay packages totalling more than $100 million<\/a>. Top AI engineers are now being compensated like football superstars.<\/p>\n

Few people will ever have to grapple with the question of whether to go work for Mark Zuckerberg\u2019s \u201csuperintelligence\u201d venture in exchange for enough money to never have to work again (Bloomberg columnist Matt Levine recently pointed out<\/a> that this is kind of Zuckerberg\u2019s fundamental challenge: If you pay someone enough to retire after a single month, they might well just quit after a single month, right? You need some kind of elaborate compensation structure to make sure they can get unfathomably rich without simply retiring.)<\/p>\n

Most of us can only dream of having that problem. But many of us have occasionally had to navigate the question of whether to take on an ethically dubious job (Denying insurance claims? Shilling cryptocurrency? Making mobile games more habit-forming?) to pay the bills.<\/p>\n

For those working in AI, that ethical dilemma is supercharged to the point of absurdity. AI is a ludicrously high-stakes technology \u2014 both for good and for ill \u2014 with leaders in the field warning<\/a> that it might kill us all. A small number of people talented enough to bring about superintelligent AI<\/a> can dramatically alter the technology\u2019s trajectory. Is it even possible for them to do so ethically?<\/p>\n

AI is going to be a really big deal<\/p>\n

On the one hand, leading AI companies offer workers the potential to earn unfathomable riches and also contribute to very meaningful social good \u2014 including productivity-increasing tools that can accelerate medical breakthroughs<\/a> and technological discovery, and make it possible for more people to code, design, and do any other work that can be done on a computer.<\/p>\n

On the other hand, well, it\u2019s hard for me to argue that the \u201cWaifu engineer<\/a>\u201d that xAI is now hiring for \u2014 a role that will be responsible for making Grok\u2019s risqu\u00e9 anime girl \u201ccompanion\u201d AI even more habit-forming \u2014 is of any social benefit whatsoever, and I in fact worry that the rise of such bots will be to the lasting detriment of society. I\u2019m also not thrilled about the documented cases of ChatGPT encouraging delusional beliefs in vulnerable users with mental illness<\/a>.<\/p>\n

Much more worryingly, the researchers racing to build powerful AI \u201cagents\u201d<\/a> \u2014 systems that can independently write code, make purchases online, interact with people, and hire subcontractors for tasks \u2014 are running into plenty of signs that those AIs might intentionally deceive humans<\/a> and even take dramatic and hostile action against us. In tests, AIs have tried to blackmail their creators<\/a> or send a copy of themselves to servers where they can operate more freely.<\/p>\n

For now, AIs only exhibit that behavior when given precisely engineered prompts designed to push them to their limits. But with increasingly huge numbers of AI agents populating the world, anything that can happen under the right circumstances, however rare, will likely happen sometimes.<\/p>\n

Over the past few years, the consensus among AI experts has moved from \u201chostile AIs trying to kill us is completely implausible\u201d to \u201chostile AIs only try to kill us in carefully designed scenarios.\u201d Bernie Sanders<\/a> \u2014 not exactly a tech hype man \u2014 is now the latest politician to warn that as independent AIs become more powerful, they might take power from humans. It\u2019s a \u201cdoomsday scenario,\u201d as he called it, but it\u2019s hardly a far-fetched one anymore.<\/p>\n

And whether or not the AIs themselves ever decide to kill or harm us, they might fall into the hands of people who do. Experts worry that AI will make it much easier both for rogue individuals to engineer plagues<\/a> or plan acts of mass violence<\/a>, and for states to achieve heights of surveillance over their citizens that they have long dreamed of but never before been able to achieve.<\/p>\n

Sign up here<\/a> to explore the big, complicated problems the world faces and the most efficient ways to solve them. Sent twice a week.<\/p>\n

In principle, a lot of these risks could be mitigated if labs designed and adhered to rock-solid safety plans, responding swiftly to signs of scary behavior among AIs in the wild. Google, OpenAI, and Anthropic do have safety plans, which don\u2019t seem fully adequate to me but which are a lot better than nothing. But in practice, mitigation often falls by the wayside in the face of intense competition between AI labs. Several labs<\/a> have weakened their safety plans<\/a> as their models came close to meeting pre-specified performance thresholds. Meanwhile, xAI<\/a>, the creator of Grok, is pushing releases with no apparent safety planning whatsoever.<\/p>\n

Worse, even labs that start out deeply and sincerely committed to ensuring AI is developed responsibly have often changed course later<\/a> because of the enormous financial incentives in the field. That means that even if you take a job at Meta, OpenAI, or Anthropic with the best of intentions, all of your effort toward building a good AI outcome could be redirected toward something else entirely.<\/p>\n

So should you take the job?<\/p>\n

I\u2019ve been watching this industry<\/a> evolve for seven years now. Although I\u2019m generally a techno-optimist who wants to see humanity design and invent new things, my optimism has been tempered by witnessing AI companies openly admitting their products might kill us all, then racing ahead with precautions that seem wholly inadequate to those stakes. Increasingly, it feels like the AI race is steering off a cliff.<\/p>\n

Given all that, I don\u2019t think it\u2019s ethical to work at a frontier AI lab unless you have given very careful thought to the risks that your work will bring closer to fruition, and you have a specific, defensible reason why your contributions will make the situation better, not worse. Or, you have an ironclad case that humanity doesn\u2019t need to worry about AI at all, in which case, please publish it so the rest of us can check your work!<\/p>\n

When vast sums of money are at stake, it\u2019s easy to self-deceive. But I wouldn\u2019t go so far as to claim that literally everyone working in frontier AI is engaged in self-deception. Some of the work documenting what AI systems are capable of and probing how they \u201cthink\u201d is immensely valuable. The safety and alignment teams at DeepMind, OpenAI, and Anthropic have done and are doing good work.<\/p>\n

But anyone pushing for a plane to take off while convinced it has a 20 percent chance of crashing<\/a> would be wildly irresponsible, and I see little difference in trying to build superintelligence as fast as possible.<\/p>\n

A hundred million dollars, after all, isn\u2019t worth hastening the death of your loved ones or the end of human freedom. In the end, it\u2019s only worth it if you can not just get rich off AI, but also help make it go well.<\/p>\n

It might be hard to imagine anyone who\u2019d turn down mind-boggling riches just because it\u2019s the right thing to do in the face of theoretical future risks, but I know quite a few people who\u2019ve done exactly that. I expect there will be more of them in the coming years, as more absurdities like Grok\u2019s recent MechaHitler<\/a> debacle go from sci-fi to reality.<\/p>\n

And ultimately, whether or not the future turns out well for humanity may depend on whether we can persuade some of the richest people in history to notice something their paychecks depend on their not noticing: that their jobs might be really, really bad for the world.<\/p>\n

You\u2019ve read 1 article in the last month<\/p>\n

Here at Vox, we’re unwavering in our commitment to covering the issues that matter most to you \u2014 threats to democracy, immigration, reproductive rights, the environment, and the rising polarization across this country.<\/p>\n

Our mission is to provide clear, accessible journalism that empowers you to stay informed and engaged in shaping our world. By becoming a Vox Member, you directly strengthen our ability to deliver in-depth, independent reporting that drives meaningful change.<\/p>\n

We rely on readers like you \u2014 join us.<\/p>\n

\"Swati<\/p>\n

Swati Sharma<\/p>\n

Vox Editor-in-Chief<\/p>\n","protected":false},"excerpt":{"rendered":"It\u2019s a good time to be a highly in-demand AI engineer. To lure leading researchers away from OpenAI…\n","protected":false},"author":2,"featured_media":7397,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[62,276,277,49,48,8050,140,61],"class_list":["post-7396","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-ca","tag-canada","tag-future-perfect","tag-innovation","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/7396","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/comments?post=7396"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/posts\/7396\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media\/7397"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/media?parent=7396"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/categories?post=7396"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ca\/wp-json\/wp\/v2\/tags?post=7396"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}