Loading<\/p>\n
\u201cThese are the leaders of tomorrow; they are meant to be people managers,\u201d the applicant said.<\/p>\n
But their capabilities have been thrown into doubt after Turnitin software found that some had used AI for more than 50 per cent of their applications.<\/p>\n
Candidates were warned multiple times, including by text message, that their applications would be screened for AI.<\/p>\n
While 50 per cent was the benchmark FRNSW set for elimination from the selection process, the actual rate of AI use in the applications could be much higher.<\/p>\n
In its advice to candidates, FRNSW said that if Turnitin identifies that 50 per cent of a document is probably written by an AI tool, it could contain as much as 65 per cent AI writing.<\/p>\n
\u201cThis is the first time FRNSW has used an AI integrity checker in recruitment,\u201d Genders wrote in an earlier email, announcing the introduction of the AI screening software.<\/p>\n
\u201cFollowing extensive research and consultation with educational institutions and organisations experienced in this technology, Turnitin was selected for its proven reliability and accuracy compared with other systems assessed.\u201d<\/p>\n
But the FRNSW controversy is not the first time Turnitin has faced questions about its reliability.<\/p>\n
In March, students at Australian Catholic University<\/a> claimed it had wrongly accused them of using artificial intelligence. Curtin University announced in September <\/a>that it was disabling the Turnitin tool.<\/p>\n Loading<\/p>\n Advance Publications acquired the US-based multinational for $US1.75 billion ($2.6 billion) in 2019. Turnitin did not respond to requests for comment.<\/p>\n On its website, Turnitin states that its writing detection model may not always be accurate: \u201cIt may misidentify human-written, AI-generated, and AI-generated and AI-paraphrased text, so it should not be used as the sole basis for adverse action.\u201d<\/p>\n Genders told candidates he understood the process may have been \u201cdisappointing and frustrating\u201d.<\/p>\n \u201cWhile this approach was well-intentioned and supported by consultation with the [Fire Brigade Employees Union], the trial has highlighted inconsistencies in how AI usage was detected and interpreted,\u201d he said.<\/p>\n A spokesperson said FRNSW was satisfied with the outcomes of the recruitment process.<\/p>\n \u201cFRNSW is committed to maintaining a fair, transparent and merit-based selection process for all applicants in accordance with established recruitment guidelines and policies,\u201d they said.<\/p>\n