The Pentagon is aiming to increase funding more than a hundredfold for an autonomous drone warfare program, according to budget documents released this week, signalling a major pivot towards AI-powered war.<\/p>\n
In its 2027 budget<\/a>, the Pentagon has asked for over $54bn to fund the Defense Autonomous Warfare Group, a 24,000% increase on last year.<\/p>\n An overview of the budget describes this money as going towards \u201cautonomous and remotely operated systems across air, land, and above and below the sea,\u201d including the \u201cDrone Dominance\u201d program.<\/p>\n The amount is over half the entire defence budget of the UK. In an opinion piece published yesterday<\/a>, former CIA director David Petraeus said it was \u201cthe largest single commitment to autonomous warfare in history\u201d.<\/p>\n However, Petraeus and others warned that the US military<\/a>, and AI companies, are largely unprepared for the risks and responsibilities of autonomous war.<\/p>\n \u201cI think every AI company should be pretty worried about the future of AI weapons,\u201d said Jeffrey Ladish, director of Palisade Research and a former security researcher at Anthropic. Ladish said that autonomous systems could change the dynamics of military confrontation by making events such as coups easier to achieve and more common.<\/p>\n \u201cEvaluators keep finding exploitable failures in even the most advanced systems,\u201d said Peter Wallich, a former UK AI Security Institute official who advises MIT\u2019s AI Risk Initiative.<\/p>\n \u201cEvery frontier AI system the UK AI Security Institute tested in December had exploitable safeguard failures \u2026 in a defence context, those failures could endanger warfighters and civilians.\u201d<\/p>\n The Pentagon has been in a months-long dispute with the AI company Anthropic<\/a>, after Anthropic attempted to prohibit it from using its model for mass surveillance or fully autonomous lethal weapons.<\/p>\n In the overview of its budget request, it reiterated its commitment to obtaining \u201cthe latest models from the top American frontier AI labs\u201d to be used across the Department of Defense.<\/p>\n The Defense Autonomous Warfare Group (DAWG) is a newly-created Pentagon department. It has absorbed a previous Biden-era initiative which aimed to acquire<\/a> low-cost drones for use in future combat in the Pacific.<\/p>\n It is not clear whether the money will be spent on acquiring existing technologies, or developing new ones. US officials have described the aim of the group <\/a>as working with the private sector to test different systems for autonomous drones, with the aim of developing and integrating these drone technologies into the military.<\/p>\n The funding comes amid an ongoing effort by the US<\/a> to sever parts of its defence-tech ecosystem from China<\/a>, with sweeping bans on Chinese-made drones and components enacted last December.<\/p>\n Olaf Hichwa, the co-founder and chief technology officer of Neros Technologies, a US drone manufacturer, said he viewed the money as a positive sign that the Pentagon was responding to the rapid evolution in battlefield technologies, especially on the Ukrainian frontlines.<\/p>\n \u201cWhat I\u2019m excited for is that the Pentagon seems to be taking battlefield feedback seriously from Ukraine and from Centcom and around the world. This is a clear vote of confidence in small drones and I am hopeful it will be spent on useful systems,\u201d he said.<\/p>\n However, he said he hoped the funding would be spent on proven innovations. \u201cI do think the Department of War would benefit from an increased priority on useful autonomy. Sometimes we buy what looks good in a demo, because who doesn\u2019t love a swarm demo that wows a lot of generals on a military base.<\/p>\n \u201cBut my optimistic view is that DAWG will know how to separate cool demo technology from useful, battlefield-ready technology, especially in the autonomy space.\u201d<\/p>\n Questions remain over how the US might develop autonomous warfighting capabilities, and what this might entail.<\/p>\n Petraeus\u2019s opinion piece said that the US does not have a military doctrine for how to deploy autonomous formations \u2013 such as drone swarms. These technologies are under development, for example by the Ukrainian software company Swarmer<\/a>.<\/p>\n Petraeus also suggested that military leaders would need substantial training in how to manage and direct autonomous systems.<\/p>\n