{"id":326707,"date":"2025-12-04T07:37:45","date_gmt":"2025-12-04T07:37:45","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/326707\/"},"modified":"2025-12-04T07:37:45","modified_gmt":"2025-12-04T07:37:45","slug":"deepfakes-and-ai-generated-abuse-material-targeting-australians-are-posing-a-national-security-risk-2","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/326707\/","title":{"rendered":"Deepfakes and AI-generated abuse material targeting Australians are posing a national security risk"},"content":{"rendered":"<p>Normal text sizeLarger text sizeVery large text size<\/p>\n<p>It wasn\u2019t the overtly pornographic nature of the computer-generated image of Coralie Alison that most disturbed her. It was how, on a fake body contorted into a degrading pose she hadn\u2019t performed, the small freckles on her arms were replicated. Each in its exact spot.<\/p>\n<p>Alison, the operations manager at Collective Shout, an Australian lobby organisation dedicated to the prevention of the exploitation of women and girls, says the AI image wasn\u2019t an isolated incident. <\/p>\n<p>Alison and her colleagues have borne the brunt of online attacks since 2019, when they decided to combat artificial intelligence deepfakes and \u201cnudify\u201d apps \u2013 <a href=\"https:\/\/www.theage.com.au\/link\/follow-20170101-p5jpaa\" rel=\"nofollow noopener\" target=\"_blank\">platforms where users can upload anybody\u2019s face to be morphed into sexually explicit or vulgar content<\/a>.<\/p>\n<p>But now, a terrifying new way to use AI has emerged. Pictures and videos depicting Alison and her colleagues being raped or tortured, using excruciating details from their social media profile pictures, are being shared on social media, produced by anonymous online predators armed with AI tools.<\/p>\n<p>\u201cThere were pictures of me with my face all sliced up with a knife, pictures of me with my throat slit and a dark figure behind me with the knife, and those photos were in my own bedroom at home,\u201d Alison says.<\/p>\n<p>\u201cThere were ones of me decapitated as well, like a man holding an axe in one hand and my head dripping with blood in the other, as well as me going through a human mincer, being minced alive \u2026 Those specific ones, I would say, were the worst that have ever been done of me.\u201d<\/p>\n<p>According to Toby Walsh, a professor of AI at the University of New South Wales, the nascent use of AI to produce violent threats of death, rape and torture means it\u2019s likely to rapidly filter into the mainstream.<\/p>\n<p>\u201cThese tools are now becoming widely, very cheaply available,\u201d Walsh says. \u201cThe technology is now very accessible. It doesn\u2019t require any expertise. Often doesn\u2019t even require you to pay any money. Many of the services are free.\u201d<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" alt=\"UNSW professor Toby Walsh says violent AI-generated abuse material has the potential to threaten democracy.\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/8a4dbcf596e9eb1a81eb4ee57f120b63b97158de.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>UNSW professor Toby Walsh says violent AI-generated abuse material has the potential to threaten democracy.Credit: Oscar Colman<\/p>\n<p>\u2018Threat to democracy\u2019<\/p>\n<p>Violent AI-generated abuse material has the potential to threaten democracy, warn Walsh and Melinda Tankard Reist, movement director of Collective Shout.<\/p>\n<p>\u201cYou could easily classify this as a national security threat,\u201d Walsh says. \u201cIf people outside Australia are making threats, and quite explicit, violent, death threats, to Australians, you could certainly see that if I were the security services, I would be incredibly worried.\u201d<\/p>\n<p>He said people within the armed forces, or with access to classified information, were open to significant blackmail threats using such content.<\/p>\n<p>\u201cGovernments could be thrown this way by the strategic release of material like this \u2026 It\u2019s even possibly our democracy could be compromised by people using these sorts of tools in malicious ways.\u201d<\/p>\n<p>Tankard Reist agrees. She and her colleagues have created a dossier of all the rape and torture deepfakes predators have made of them and shared on social media platform X.<\/p>\n<p>\u201cWe\u2019re gathering as much data as we can with engaged forensic experts and we\u2019re going to use the evidence about the abuse, the cyber-terror hate campaign against us, to call for reform in Australia and on a global level,\u201d Tankard Reist says.<\/p>\n<p><img decoding=\"async\" alt=\"Melinda Tankard Reist has been campaigning against the use of deepfakes.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/249ff36dd6663d845a16602cc24d3f1f58792749.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>Melinda Tankard Reist has been campaigning against the use of deepfakes.Credit: Janie Barrett<\/p>\n<p>\u201cNo woman should be subjected to what we\u2019ve been subjected to. It\u2019s beyond us, what we\u2019ve suffered individually \u2026 This has ramifications for democracy.\u201d<\/p>\n<p>The AFP prosecutes cases where a sexualised deepfake depicting a child is produced in Australia. The federal policing agency\u2019s powers stop, however, if a deepfake involves a person over 18, which is then investigated by states and territories.<\/p>\n<p>Meanwhile, the federal eSafety commissioner says that, depending on the nature of the deepfakes, the regulator could have powers under various complaint schemes to wrest distressing material from the internet.<\/p>\n<p>\u201cBut while our complaint schemes can offer meaningful relief to Australians in the midst of an online crisis, eSafety is not empowered to scan or police the entire internet,\u201d eSafety commissioner Julie Inman Grant says.<\/p>\n<p>\u201cWe are already receiving reports containing \u2018synthetic\u2019 AI-generated child sexual abuse material, terror and extremist content, as well as deepfake images and videos created by teens to bully their peers.\u201d<\/p>\n<p><img decoding=\"async\" alt=\"eSafety commissioner Julie Inman Grant.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/331fccaf56b9294b61965cd5ca686b2240417e21.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>eSafety commissioner Julie Inman Grant.Credit: Edwina Pickles<\/p>\n<p>The rapid deployment, increasing sophistication, and popular uptake of generative AI mean creating deepfakes is becoming more convincing and harder to distinguish from reality, Inman Grant says. \u201cWhich is why a greater burden must fall on the purveyors and profiteers of AI\u202fto take a more robust\u202fapproach, so they are engineering out misuse at the front end,\u201d she says.<\/p>\n<p>Last Monday, independent federal senator David Pocock introduced the <a href=\"https:\/\/www.davidpocock.com.au\/new_bill_to_protect_identity_in_deepfake_future\" rel=\"nofollow noopener\" target=\"_blank\">My Face, My Rights bill before federal parliament<\/a>, aiming to strengthen the eSafety commissioner\u2019s powers to issue removal notices and formal warnings to technology companies and individuals.<\/p>\n<p>What to do if a deepfake is made of youeSafety strongly encourages Australians who are targeted by serious online abuse to report it to the platform where it appears.If the platform fails to act, report it to <a href=\"https:\/\/www.esafety.gov.au\/report\" data-saferedirecturl=\"https:\/\/www.google.com\/url?q=https:\/\/www.esafety.gov.au\/report&amp;source=gmail&amp;ust=1764369009430000&amp;usg=AOvVaw3GN9MZNwRkYXYDANHBIy9g\" rel=\"nofollow noopener\" target=\"_blank\">eSafety.gov.au\/report<\/a>.\u202fIf you are concerned for your safety as a result of any online abuse, you should report to police.There are also criminal offences in some Australian states that cover deepfake intimate images, which are investigated by police.Scraping \u2018dark corners\u2019 of the net<\/p>\n<p>AI scrapes millions of websites across the internet to obtain information at the direction of what technology companies want it to learn. As Walsh describes it, AI tools are merely a \u201cmirror of what they are trained on\u201d.<\/p>\n<p>He says companies that offer AI \u2013 whether it\u2019s social media like X\u2019s Grok, Google\u2019s Gemini or AI services such as OpenAI \u2013 can wire their technology not to accept certain requests or generate offensive material. However, it is much easier never to feed the AI violent content in the first place.<\/p>\n<p><img decoding=\"async\" alt=\"Technology companies are allowing their AI to scan the internet recklessly because they are motivated to have the most advanced product, Walsh says.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/5c9e14b72c2719e347c887f8c47cef8e04f820c5.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>Technology companies are allowing their AI to scan the internet recklessly because they are motivated to have the most advanced product, Walsh says.Credit: Bloomberg<\/p>\n<p>\u201cIf you\u2019re just scraping The New York Times, there is much less you have to worry about than if you\u2019re scraping the dark corners of 4chan,\u201d Walsh says.<\/p>\n<p>Technology companies can utilise safeguards, he says, to prevent inappropriate or criminal material from being produced with AI, such as how to create a Molotov cocktail or self-harm.<\/p>\n<p>Loading<\/p>\n<p>\u201cYouTube has been doing this for years because they don\u2019t allow pornography \u2026 There are filters that can identify pornography by the amount of flesh that is just shown in the video,\u201d Walsh says.<\/p>\n<p>Technology companies are allowing their AI to scan the internet recklessly because they are motivated to have the most advanced product, Walsh says.<\/p>\n<p>Microsoft\u2019s spending on AI infrastructure soared to a<a href=\"https:\/\/www.reuters.com\/business\/microsofts-cloud-surge-lifts-revenue-above-expectations-2025-10-29\/\" rel=\"nofollow noopener\" target=\"_blank\"> record of about $35 billion ($53 billion)<\/a> in the September quarter after the company\u2019s shares rose nearly 7 per cent in extended trading in July. At the time, Microsoft said sales at Azure, the cloud-computing business that has integrated AI, <a href=\"https:\/\/www.afr.com\/technology\/microsoft-s-azure-cloud-revenue-surges-as-ai-spending-pays-off-20250731-p5mj4y\" rel=\"nofollow noopener\" target=\"_blank\">surpassed $US75 billion ($116 billion) on an annual basis.<\/a><\/p>\n<p>\u2018Digital tools of terror against women\u2019<\/p>\n<p>A disturbing finding for Tankard Reist, after investigating and herself being victim to rape deepfakes, was that it almost always depicted women and girls.<\/p>\n<p>\u201cIt goes beyond undressing and nudifying apps \u2013 as if that\u2019s not bad enough \u2013 but you can turn any girl, any female school teacher, into specific genres of porn, including torture porn, sadism, forced impregnation, slavery, hentai porn, bondage. Any woman or girl,\u201d Tankard Reist says.<\/p>\n<p><img decoding=\"async\" alt=\"The exponential growth of AI technology has powered a new proliferation of child pornography.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/12\/1764775466_61_d6179580197a2c84f854951ab175216a1fd73b28.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>The exponential growth of AI technology has powered a new proliferation of child pornography.Credit: Adobe Stock image\/Artwork: Marija Ercegovac<\/p>\n<p>\u201cThese are digital tools of terror against women.\u201d<\/p>\n<p>On Thursday, a British-based technology company banned Australians from accessing three nudify websites. It follows an enforcement effort by the eSafety regulator in September that found the company was<a href=\"https:\/\/www.esafety.gov.au\/newsroom\/media-releases\/esafety-moves-against-services-used-to-nudify-australian-school-children\" rel=\"nofollow noopener\" target=\"_blank\"> responsible for the creation of sexual exploitation material of Australian school children<\/a> on its platforms.<\/p>\n<p>Loading<\/p>\n<p>The eSafety regulator also said reports of image-based abuse of children have more than doubled in the past 18 months compared with the total number of reports in the seven years prior.<\/p>\n<p>Four out of five of these reports involved girls.<\/p>\n<p>\u201cShockingly, we found these services did little to deter the generation of synthetic child sexual abuse material by marketing alarming features such as undressing \u2018any girl\u2019, with options for \u2018schoolgirl\u2019 and \u2018sex mode\u2019 to name a few,\u201d Inman Grant said.<\/p>\n<p>While hardened by years of abuse, Alison said the issue of innocent women and girls having to reckon with deepfakes blazes at the front of her mind.<\/p>\n<p>\u201cI just think about all the schoolgirls around Australia that are going through this and might feel so isolated and alone and don\u2019t have the power to push back and get the result they need,\u201d Alison says.<\/p>\n<p>\u201cIt actually gives me a renewed sense of enthusiasm to keep going, so these abusers that wanted to try and stop us \u2026 it\u2019s backfired on them because I\u2019m only more determined to see justice be done.\u201d<\/p>\n<p>Start the day with a summary of the day\u2019s most important and interesting stories, analysis and insights. <a href=\"https:\/\/www.smh.com.au\/link\/follow-20170101-p57ogt\" rel=\"nofollow noopener\" target=\"_blank\">Sign up for our Morning Edition newsletter<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"Normal text sizeLarger text sizeVery large text size It wasn\u2019t the overtly pornographic nature of the computer-generated image&hellip;\n","protected":false},"author":2,"featured_media":325197,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":["post-326707","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-au","tag-australia","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/326707","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=326707"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/326707\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/325197"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=326707"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=326707"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=326707"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}