A top artificial intelligence (AI) company says the technology has been “weaponised” by hackers to carry out sophisticated cyber attacks.<\/p>\n
Anthropic, which makes the chatbot Claude, says its tools were used by hackers “to commit large-scale theft and extortion of personal data”.<\/p>\n
The firm said its AI was used to help write code which carried out cyber-attacks, while in another case, North Korean scammers used Claude to fraudulently get remote jobs at top US companies.<\/p>\n
Anthropic says it was able to disrupt the threat actors and has reported the cases to the authorities along with improving its detection tools.<\/p>\n
Using AI to help write code has increased in popularity as the tech becomes more capable and accessible.<\/p>\n
Anthropic says it detected a case of so-called “vibe hacking”, where its AI was used to write code which could hack into at least 17 different organisations, including government bodies.<\/p>\n
It said the hackers “used AI to what we believe is an unprecedented degree”.<\/p>\n
They used Claude to “make both tactical and strategic decisions, such as deciding which data to exfiltrate, and how to craft psychologically targeted extortion demands”.<\/p>\n
It even suggested ransom amounts for the victims.<\/p>\n
Agentic AI – where the tech operates autonomously – has been touted as the next big step in the space.<\/p>\n
But these examples show some of the risks powerful tools pose to potential victims of cyber-crime.<\/p>\n
The use of AI means “the time required to exploit cybersecurity vulnerabilities is shrinking rapidly”, said Alina Timofeeva, an adviser on cyber-crime and AI. <\/p>\n
“Detection and mitigation must shift towards being proactive and preventative, not reactive after harm is done,” she said.<\/p>\n
But it is not just cyber-crime that the tech is being used for.<\/p>\n
Anthropic said “North Korean operatives” used its models to create fake profiles to apply for remote jobs at US Fortune 500 tech companies.<\/p>\n
The use of remote jobs to gain access to companies’ systems has been known about for a while<\/a>, but Anthropic says using AI in the fraud scheme is “a fundamentally new phase for these employment scams”.<\/p>\n It said AI was used to write job applications, and once the fraudsters were employed, it was used to help translate messages and write code.<\/p>\n