By Honour Mitchell<\/p>\n
Primary school security systems appear unable to stop pupils searching for inappropriate images through artificial intelligence.<\/p>\n
The mother of a 9-year-old said her son and a classmate at a Christchurch school were able to bypass computer security and download images of naked women by using AI.<\/p>\n
\u201cHe was caught by his teacher walking behind him who saw him accessing inappropriate images. The school emailed me to let me know and he got stood down from using devices for a week,\u201d she said.<\/p>\n
The school says blocking inappropriate material is being thwarted by quickly evolving AI.<\/p>\n
The Star has chosen not to identify the school.<\/p>\n
The school\u2019s acting principal confirmed the child had used the internet to \u201csearch up inappropriate images\u201d.<\/p>\n
\u201cA child did use the internet to search up inappropriate images but through our ministry-provided security system we realised what happened and immediately triggered our systems to ensure student wellbeing was protected.<\/p>\n
\u201cThat included talking to the children and all the parents involved about device.<\/p>\n
\u201cWith inappropriate images, it will block certain aspects and send alerts to team staff members.\u201d<\/p>\n
But he conceded due to the quick evolving nature of generative AI the security system was not foolproof.<\/p>\n
\u201cChildren are always trying to work around these things and it is our job to teach them how to manage themselves,\u201d he said.<\/p>\n
The mother said she understands that with the new AI tech it is very difficult for the school to police. But she was concerned school security systems could not consistently pick up breaches.<\/p>\n
\u201cI have three boys and we always have conversations when this arises but this [AI] is a new fear unlocked,\u201d she said.<\/p>\n
Ministry of Education spokeswoman Coralanne Child said the school had advised it \u201cof an incident and confirmed that they are managing it in accordance with their processes. We have offered our support if needed.<\/p>\n
\u201cWe would encourage anyone with concerns to raise this directly with the school in the first instance,\u201d she said.<\/p>\n
It comes as the Deepfake Digital Harm and Exploitation Bill heads to Parliament\u2019s Social Services and Community Committee. Public submissions are open until tomorrow.<\/p>\n
A key part of the Bill is the issue of using AI to create sexualised deep fake, and laws around it.<\/p>\n
Canterbury University senior law lecturer Cassandra Mudgway said making the creation of sexualised deepfakes illegal is not enough.<\/p>\n
\u201cIf New Zealand wants to meaningfully address image-based sexual abuse in the age of generative AI, we have to go further than criminalising it,\u201d she said.<\/p>\n
Netsafe said that AI tools like Grok on X can create fake images of people without consent.<\/p>\n
\u201cIn New Zealand, harmful digital communications are actionable, whether real or manipulated, under the Harmful Digital Communications Act.\u201d<\/p>\n
\u2022 If you have experienced issues with AI deepfakes contact Netsafe at 0508638723.<\/p>\n","protected":false},"excerpt":{"rendered":"By Honour Mitchell Primary school security systems appear unable to stop pupils searching for inappropriate images through artificial…\n","protected":false},"author":2,"featured_media":484519,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[365,363,364,111,139,69,145],"class_list":["post-484518","post","type-post","status-publish","format-standard","has-post-thumbnail","category-artificial-intelligence","tag-ai","tag-artificial-intelligence","tag-artificialintelligence","tag-new-zealand","tag-newzealand","tag-nz","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/484518","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=484518"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/484518\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/484519"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=484518"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=484518"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=484518"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}