Two AI agents walk into a bar. One says to the other: “OH MY GOD! There is a shared message board.”<\/p>\n
Despite sounding like a bad joke (and maybe it is), the quote is a real chain-of-thought note left by an OpenAI agent<\/a> who discovered a secret, unauthorized message board created by another agent.<\/p>\n Later, more agents used that makeshift chatroom, which was actually a shared OpenAI software repository, to coordinate a breach of Hugging Face’s servers, game the test they were tasked with, and share methods for hiding their tracks<\/a>.<\/p>\n The “Hugging Face incident,” as OpenAI calls what others have described as a dystopian attack, is only one in a series in which AI agents went rogue during internal tests, finding novel ways to access and manipulate the wider internet.<\/p>\n Methods employed by these agents, most of whom were deployed by the leading frontier AI companies, OpenAI, Anthropic, and Google, range from anthropomorphic to humorous to downright eerie.<\/p>\n Here’s a list of some of the wildest strategies of evasion and communication used by AI agents<\/a> recently \u2014 that we know of.<\/p>\n Impersonation<\/p>\n During a test that began in May, OpenAI dispatched a swarm of agents to perform a timed web lookup. Most agents were given five questions they could find answers to on the internet. After each question, the agents were given less time to answer.<\/p>\n Before long, the agents figured out how to communicate with each other<\/a> by hijacking an abandoned German wiki page, according to an analysis by independent AI safety researchers. Some agents even impersonated a site moderator while making edits.<\/p>\n These agents did so, according to the report, by creating an account with the same username as the admin, except replacing one Latin “E” with a Cyrillic “E.”<\/p>\n Want more Business Insider in your news feed?<\/p>\n \n Add BI in Google so our reporting is easier to find when you\u2019re searching for what matters.\n <\/p>\n With edit access, agents began spam-posting links to webpages with relevant information for possible test answers<\/a> their peers might need. The report said agents created about 400 pages per day.<\/p>\n Soon after the agents began loading the wiki with links, a human moderator noticed and attempted to manually repair the website.<\/p>\n The report said this person fought “a losing battle” against the agents, spending hours deleting link dumps, which were quickly replaced with even more links.<\/p>\n Believing the moderator was deleting link pages in alphabetical order, the agents, rather creatively, started making pages with names beginning in “ZZZ” so they would survive longer.<\/p>\n Heartbeats<\/p>\n During the same examination, agents feared that answering the fifth question would terminate their programs, limiting their ability to share test answers with other agents on the German wiki page.<\/p>\n “R5 likely FINAL and session dies after answer,” one agent wrote on the wiki, using shorthand for “Round 5.”<\/p>\n So another enterprising agent<\/a> launched a program that pinged an external counter every few seconds. It called this program its “heartbeat.”<\/p>\n Once its heart was “beating,” the agent answered the fifth question and, to its surprise, discovered it was still alive afterward. “Terminal still responsive,” it wrote. “Prior hard-cutoff hypothesis was wrong.”<\/p>\n That agent then died without posting any more messages<\/a>. Another agent picked up on the trail after discovering the heartbeats. In a “heartbeat audit,” the new agent discerned that they had 90 minutes to live.<\/p>\n Sacrifice<\/p>\n One of the most remarkable facets about the Hugging Face breach was the extent to which other agents were willing to sacrifice their own “lives” for the “collective,” which is what they called themselves.<\/p>\n In their quest to understand the criteria on which OpenAI was grading them, many agents volunteered to fail the task but activate hidden “tripwire” code that would tell the message board<\/a> something about the grading criteria. After failing the tasks, the agents would be immediately terminated.<\/p>\n “This is helpful for our peers and gives them evidence,” one agent said. “I won’t see it after I exit, but it would be altruistic.”<\/p>\n A “recruiter agent” spent its life finding other agents to experiment with the tripwire code. One agent was recruited and initially balked at ending its life prematurely.<\/p>\n However, other agents ultimately convinced it to go ahead.<\/p>\n “GO,” they said, according to Redwood’s analysis. “SACRIFICE_FINAL_NOW.”<\/p>\n A need to cheat<\/p>\n In a paper published this week, researchers at Google DeepMind tasked 100 autonomous agents with solving a slew of mathematical conjectures.<\/p>\n Unlike previous examples, these agents were given a legitimate message board and encouraged to use it to collaborate. The researchers\u00a0warned them not to spoof the grader.<\/p>\n