Earlier this year, in the depths of summer, the Addleshaw Goddard law firm found itself in a slight pickle.<\/p>\n
In what was becoming a familiar pattern, an advert it had placed for an IT job in its human resources department had drawn a slew of applications.<\/p>\n
A year ago, only a couple of dozen people might have sent in a resume for a position like this one. But AI<\/a> has made the job of applying for a job much faster and easier, and this time 178 applications arrived.<\/p>\n The problem was, the longer it took to sift them, the higher the chance that good candidates would find work elsewhere. Like a lot of organisations, Addleshaw has been encouraging its managers to test ways that AI can safely improve its processes, so the firm\u2019s HR<\/a> department decided to do an experiment. It would see how well an AI agent could assess the applications compared with humans.<\/p>\n An agent was duly set up, using the firm\u2019s internal Microsoft<\/a> Copilot system, and told about the role that needed to be filled, as well as the experience applicants would need with certain HR systems and programming languages, and with AI itself.<\/p>\n Humans at the firm sorted the applicants into a shorter pile of about a dozen and asked the agent to score them.<\/p>\n The agent whipped through this task and presented a list of what it deemed to be the top contenders. The humans did the same thing.<\/p>\n Alas, the two lists did not match. The agent was impressed by glossy applications from candidates who claimed to have achieved exceptional IT feats in record time at a previous employer, or worked on big projects despite scant levels of experience. In short, they were too good to be true \u2013 and smacked of having been written with the help of AI.<\/p>\n [\u00a0Who\u2019s hiring and who\u2019s firing in Ireland\u2019s technology sector?Opens in new window<\/a>\u00a0]<\/p>\n Katherine Rathbone, Addleshaw Goddard\u2019s head of HR, told me her team had theories about why this might have happened.<\/p>\n For one thing, AI tools can make it a lot easier for candidates to tailor a CV to match a job description. But that was not all. \u201cOne possible explanation is that, because AI capability was itself one of the criteria, the agent may have interpreted signs of AI use in producing the CV as evidence of AI capability,\u201d she said.<\/p>\n There is another, more disturbing possibility. The AI agent may have actively preferred CVs purely because AI was involved in writing them.<\/p>\n If so, it would confirm the findings of an eye-catching working paper that has analysed the behaviour of AI hiring tools.<\/p>\n The researchers simulated what they said were realistic hiring processes for 24 jobs ranging from teachers and consultants to chefs and engineers. They discovered that candidates using the same AI large language model as the recruiter were between 23 per cent and 60 per cent more likely to be shortlisted than those who relied on CVs produced by a hapless human.<\/p>\n