{"id":629486,"date":"2026-09-19T10:54:13","date_gmt":"2026-09-19T10:54:13","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/629486\/"},"modified":"2026-09-19T10:54:13","modified_gmt":"2026-09-19T10:54:13","slug":"for-10-years-ive-listened-to-people-say-ai-will-kill-us-all-heres-what-i-think-the-irish-times","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/629486\/","title":{"rendered":"For 10 years, I\u2019ve listened to people say AI will kill us all. Here\u2019s what I think \u2013 The Irish Times"},"content":{"rendered":"

Just over a decade ago, I spent some months listening to people speak \u2013 in San Francisco, in London, in Oxford \u2013 about the alarming possibilities that would be unleashed by artificial intelligence<\/a>. At that time, AI was still basically an abstract notion: a thing that was imminent, and would surely be transformative, but which did not yet have a meaningful presence in the culture, other than as a vague spectre conjured by science fiction. <\/p>\n

I was especially interested in a small but vocal group of people who had positioned themselves as the Cassandras of Silicon Valley. These people, many of whom worked in the field of AI, were convinced that, unless very specific safeguards were put in place, there was a strong likelihood that humanity would be wiped out by artificial intelligence. <\/p>\n

Their figurehead was Nick Bostrom, a Swedish philosopher long associated with the Transhumanist movement, and who in those days ran a research institute at Oxford called the Future of Humanity Institute. <\/p>\n

Bostrom believed that AI would eventually reach a level of \u201csuperintelligence\u201d that far outstripped its human creators, and that it would continue improving itself in a runaway feedback loop. If its goals were not properly aligned with \u201chuman values\u201d \u2013 whatever we might judge those to be \u2013 an artificial superintelligence could end up causing catastrophic harm to humanity, simply because human welfare was not built into the AI\u2019s originally encoded aims.<\/p>\n

One of Bostrom\u2019s most infamous ideas was a thought experiment known as the \u201cpaper clip maximiser\u201d. In this scenario, a superintelligent AI in the service of a stationery company is instructed to maximise the production of paper clips. The AI, pursuing its goal with a total singularity of purpose, could end up converting all available matter, including all carbon-based lifeforms, into paper clips or paper clip-production infrastructure. In such a scenario the goal of maximising the production of paper clips has been achieved, but at the cost of the annihilation of all life on Earth. <\/p>\n

It was a deliberately absurd thought experiment, but one which Bostrom and his followers believed illustrated a real problem: without properly aligned goals, even trivial instructions to a superintelligent AI could result in apocalypse.<\/p>\n

I personally didn\u2019t buy it, but I was fascinated by it \u2013 as a way of thinking about the rationalist mindset that was in the ascendant in Silicon Valley, and of how that rationalism could, taken to extremes, amount to a kind of madness. <\/p>\n

A lot has happened since then. To Be a Machine, the book that emerged out of those encounters and various others, was published in 2017. AI is no longer an abstraction, a futurist spectre lurking on the margins of our cultural awareness. And these people and their ideas are no longer remotely fringe. <\/p>\n

At time of writing, the international media is whipping itself into an anxious (and faintly libidinal) sweat over the prospect that AI might wipe us all out. \u201cAI could possibly end humanity. How are humans supposed to process that?\u201d asks one headline in the New York Times<\/a>. \u201cWhy the AI race has its creators fearing human extinction\u201d reads another in the Financial Times<\/a>. <\/p>\n

[\u00a0\u2018Gambling with our lives\u2019: How talk in AI companies is increasingly turning to doomsdayOpens in new window<\/a>\u00a0]<\/p>\n

The cause of all this was the resignation of Jacob Coxon, a researcher at the AI company Anthropic<\/a>, in protest against the company\u2019s irresponsible approach to building superintelligent AI. \u201cThe people building AI,\u201d he said, \u201cearnestly believe that it could kill us all by the end of the decade.\u201d He himself put the probability at about 10 per cent. Troublingly, Anthropic\u2019s chief executive Dario Amodei publicly agreed with this assessment.<\/p>\n

\"DarioDario Amodei, the chief executive of Anthropic. Photograph: Karsten Moran\/New York Times<\/p>\n

I have complicated feelings about all of this. First of all, Anthropic owes me, personally, several thousand dollars \u2013 awarded, but not yet paid, as part of a recent $1.5 billion (\u20ac1.3 billion) class action settlement to authors whose books were illegally used to train the company\u2019s AI models. <\/p>\n

For reasons both self-interested and humanitarian, I would hate for AI to end the world before that cheque hit my account. (This would be a classic paper clip maximiser scenario, of course: annihilating all life on earth to avoid paying out a legal settlement.) But it also strikes me that if Anthropic owes me a measly few grand for infringing my copyright, then surely it should have to compensate me considerably more for forcing me, and my loved ones, to live under the constant threat of annihilation. <\/p>\n

But really, I don\u2019t buy it now any more than I did 10 years ago. AI has, it is true, become a significantly more powerful technology, and a cultural and economic presence so vast it threatens to block out the sun. And there are real threats, more immediate and tangible than the vague threat that AI will take all our jobs \u2013 which, as many economists have pointed out, works very well to keep wages down. Just last week, we learned of numerous attempts to use Claude, Anthropic\u2019s AI chatbot, to produce biological weapons.<\/p>\n

[\u00a0Will AI kill us all?Opens in new window<\/a>\u00a0]<\/p>\n

But it\u2019s also very obvious that these apocalyptic ideas feed into a viciously recursive AI hype cycle, and serve the sector\u2019s abysmal hunger for investment capital. A product powerful enough, in the wrong hands, to wipe out humanity is, after all, surely a product powerful enough, in the right hands, to do extraordinary things, and make its investors even more vastly wealthy than they already are. <\/p>\n

And if building a machine risks tanking the global economy and causes irrecoverable environmental devastation; if it must be built on vast amounts of extracted and uncompensated labour; if it makes entire fields of human endeavour economically obsolete; and finally crushes democracy beneath a tide of disinformation and rampant inequality \u2013 then so be it. There is money to be made. There are paper clips to produce.<\/p>\n

Let\u2019s not forget, in this discussion, how relentlessly Silicon Valley has lobbied against government regulation. Tech billionaires\u2019 collective move towards full support of Donald Trump turned partly on his commitment to repeal AI regulations put in place under Joe Biden. When they talk now about the need for \u201cguardrails\u201d, what they are talking about is self-regulation, which is naturally less of an impediment to maximal growth.<\/p>\n

And here is where there is some truth, some poetic truth, to the idea of AI existential risk. I have always read the apocalyptic scenario as a metaphor for the more tangible threat of rampant capitalism, for the way technology itself, in the hands of unprecedentedly wealthy individuals and corporations, can be devastating to human flourishing. <\/p>\n

What is the current feral incarnation of techno-capitalism, after all, if not a machine hell-bent on the goal of market dominance, a paper clip maximiser that treats human lives as little more than raw material for the production of profit?<\/p>\n","protected":false},"excerpt":{"rendered":"Just over a decade ago, I spent some months listening to people speak \u2013 in San Francisco, in…\n","protected":false},"author":2,"featured_media":629487,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[220,3673,218,219,256936,61,60,80],"class_list":["post-629486","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-anthropic","tag-artificial-intelligence","tag-artificialintelligence","tag-dario-amodi","tag-ie","tag-ireland","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/629486","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=629486"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/629486\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/629487"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=629486"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=629486"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=629486"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}