{"id":619203,"date":"2026-06-03T16:44:17","date_gmt":"2026-06-03T16:44:17","guid":{"rendered":"https:\/\/www.newsbeep.com\/uk\/619203\/"},"modified":"2026-06-03T16:44:17","modified_gmt":"2026-06-03T16:44:17","slug":"can-autonomous-ai-powered-killer-drones-take-morality-onboard-drones-military","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/uk\/619203\/","title":{"rendered":"Can autonomous AI-powered killer drones take morality onboard? | Drones (military)"},"content":{"rendered":"

Should the AI-powered drones of the future have a licence to kill? The question is becoming ever more pressing as governments and the defence industry acknowledge that drone systems will play an increasingly crucial role<\/a> in future warfare.<\/p>\n

With drones being deployed in huge numbers in the Ukraine<\/a> war and AI being used to assist bombing missions in the Iran conflict, there is an expectation among some observers that weapons will have to operate with increased operational autonomy, which means they will need something approximating a moral framework.<\/p>\n

Last year Mustafa Suleyman, chief executive of Microsoft\u2019s AI arm and a co-founder of the UK-based DeepMind, was unequivocal<\/a> about the issue of machines making moral decisions. He said: \u201cAIs cannot be people \u2013 or moral beings.\u201d<\/p>\n

David Omand, the former head of the UK spy agency, GCHQ, has told the Guardian he believes AI can create a \u201cmoral\u201d configuration for unmanned weapons, while the UK armed forces minister, Al Carns, told the Financial Times recently there must be an option to \u201ctake the human out of the loop\u201d in decision-making<\/a>. This brings into focus the ethical and technological challenge of whether morality can be programmed into an autonomous weapons system.<\/p>\n

Zee Talat, an academic specialising in machine learning at the University of Edinburgh\u2019s school of informatics, argues that large language models \u2013 the technology that underpins modern generative AI systems such as chatbots \u2013 are fundamentally incapable of moral decision-making.<\/p>\n

AI systems are trained on vast amounts of data that allow them to build a probabilistic model of what is the next most likely word or sentence in a sequence. This is not how humans make moral and ethical decisions, says Talat, even if the model has ingested all the philosophical tracts known to humanity.<\/p>\n

\u201cIf you have a machine that\u2019s probabilistic by nature it will veer towards the most likely answer in a situation. Do we think that morality follows probabilistic notions?\u201d says Talat, who has recently co-authored a paper that argues ethical evaluation is an \u201copen-ended, debate-based, sociopolitical process\u201d, which AI cannot keep up with.<\/p>\n

Andrew Rogoyski, of the Institute for People-Centred AI at the University of Surrey, says AI systems have become much more sophisticated since the arrival of ChatGPT in 2022 \u2013 as the emergence of so-called \u201creasoning\u201d models shows<\/a>. Nonetheless, can they replicate the nuance of moral decision-making?<\/p>\n

\u201cMorality is deeply complex, contested, culturally shaped, and something most humans never fully resolve, even for themselves,\u201d he says. \u201cPerhaps the real question is whether we understand morality well enough to codify it. Until we do, we cannot expect machines to embody something we ourselves cannot clearly articulate.\u201d<\/p>\n

This leads to the question of whether it is possible to have a universally recognised moral code for autonomous weapons. Programming morality into drones is problematic, according to Jessica Dorsey, an assistant professor of international law at Utrecht University in the Netherlands. Her concerns include determining whose morality the drone is following, a difficult process given the United Nations is still trying to achieve a global consensus on autonomous weapons governance<\/a>.<\/p>\n

There is also the issue of how to programme an AI system to distinguish between a combatant and a civilian. Article 57 of the Geneva conventions \u2013 a series of international treaties regulating the conduct of war \u2013 states that combatants should do \u201ceverything feasible to verify that the objectives to be attacked are neither civilians nor civilian objects \u2026 but are military objectives\u201d.<\/p>\n

If you don\u2019t get the law right you will end up repeating flawed decisions on a vast scale if AI-powered drones are deployed en masse, says Dorsey.<\/p>\n

\u201cWar is filled with so many variables and it is a given that things will go wrong. And when that happens at AI-like speed, it is difficult to unravel,\u201d she says.<\/p>\n

But some experts argue that giving drones greater autonomy, and programming rules of engagement and morality into them, will be a necessity if other nation states continue to develop and deploy similar technology at pace.<\/p>\n

\u201cFor any military to compete effectively against other high-end militaries it is going to need a large amount of systems that will be required to take decisions on their own,\u201d says Nicholas Wright, a neuroscientist and author of Warhead, a book on the human brain and war.<\/p>\n

AI-powered drones are still a nascent technology, and, despite tech industry hype, there are only limited examples of their deployment on the battlefield. More than 100<\/a> startups across the US and Europe are now building drones and drone software platforms. These range from light, low-altitude drones designed for imaging and surveillance to heavier craft designed to carry weapons. But the companies building them \u2013 and envisioning the warfare of the future \u2013 have sharply conflicting views on what their decision-making might look like in future wars.<\/p>\n

\u201cMorality is the province of human beings, which is why AI-assisted weapons systems need to be built in a way that extends the judgment and decision-making of the operator rather than wholesale replacing it,\u201d says Olaf Hichwa, the co-founder of Neros, a US drone startup.<\/p>\n

For Hichwa, drones will not replace human decision-makers, but enhance the abilities of their human pilots.<\/p>\n

\u201cA lot of people are looking at autonomy somewhat incorrectly. They\u2019re not looking at it through the eyes of the user. They\u2019re saying, let\u2019s make fully autonomous weapon systems,\u201d he says.<\/p>\n

\u201cBut the reality of warfare is that it\u2019s still very much a human-on-human interaction.\u201d<\/p>\n

One use of AI in warfare, he says, might be to reduce the cognitive burden of the people who have to operate craft such as FPV (first-person view) drones \u2013 small craft heavily used in the Ukraine conflict which transmit a view of the battlefield to their human pilots via a video link. In one scenario, a drone could guide itself for the \u201clast mile\u201d of a mission.<\/p>\n

\u201cOne example of autonomy is \u2026 right now, pilots require a lot of very precise training to get the drone to travel along the right angle. Some autonomy could be the user or the human sets a general path and the drone follows that path.\u201d<\/p>\n

Jon Gruen, the chief executive of Fortem Technologies, which builds systems to defend against drones, has a different view. He points out that the US already uses autonomous defence systems to intercept incoming drones and missiles, and that AI is used \u201call the way through\u201d in many of these instances, in identifying targets and, at times, launching a weapon at them.<\/p>\n

\u201cWhen you detect something, you then need to identify it. That identification is done autonomously now for the most part.\u201d<\/p>\n

The same technology can now be used to deploy a weapon, he says, including when to fire a weapon and then guiding it to its target.<\/p>\n

Alex Fink, the US chief executive of Swarmer, a US-Ukraine startup that develops software for autonomous drones, says there could be a future scenario where humans might not select individual targets at all but instead designate a \u201ckill box\u201d, in which anything in a given area at a given time is fair game for an autonomous system to target.<\/p>\n

\u201cA human certifies this area, there are no friendlies, and I guarantee there will be no friendlies in the next 15 minutes. Any vehicle in this area is pre-approved for this period of time,\u201d says Fink.<\/p>\n

\u201cIf a human is able to take that responsibility upon themselves, that they know there will be no friendlies, no bystanders in this area, then that type of mission is possible.\u201d<\/p>\n

But if the technology is there, the moral and legal consensus is not.<\/p>\n","protected":false},"excerpt":{"rendered":"Should the AI-powered drones of the future have a licence to kill? The question is becoming ever more…\n","protected":false},"author":2,"featured_media":619204,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[554,733,4308,86,56,54,55],"class_list":["post-619203","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-technology","tag-uk","tag-united-kingdom","tag-unitedkingdom"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/619203","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/comments?post=619203"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/posts\/619203\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media\/619204"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/media?parent=619203"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/categories?post=619203"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/uk\/wp-json\/wp\/v2\/tags?post=619203"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}