{"id":233567,"date":"2025-10-22T22:42:28","date_gmt":"2025-10-22T22:42:28","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/233567\/"},"modified":"2025-10-22T22:42:28","modified_gmt":"2025-10-22T22:42:28","slug":"chatgpts-move-towards-ai-porn-a-risk-to-children-esafety-warns-2","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/233567\/","title":{"rendered":"ChatGPT\u2019s move towards AI porn a risk to children, eSafety warns"},"content":{"rendered":"<p>In February, OpenAI said it was exploring how to enable generations including gore and erotica in age-appropriate contexts. The company also seemed to echo xAI by saying it was embarking on a mission to seek the truth by allowing users to have \u201cintellectual freedom\u201d, primarily by not refusing to generate the things they asked for, even if others found them offensive.<\/p>\n<p>In March, OpenAI made a change allowing ChatGPT to create images of public and political figures, hateful symbols and racial features.<\/p>\n<p><img decoding=\"async\" alt=\"eSafety Commissioner Julie Inman Grant said creators of companion AI chatbots would need to prove children are not able to generate innapropriate content.\" loading=\"lazy\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/10\/2663d60eb45076a827eabe902dc534cdf69048f3.jpeg\" height=\"390\" width=\"584\" \/><\/p>\n<p>eSafety Commissioner Julie Inman Grant said creators of companion AI chatbots would need to prove children are not able to generate innapropriate content.Credit: The Sydney Morning Herald<\/p>\n<p>In Wednesday\u2019s post, Altman also said that ChatGPT would get new abilities to converse with a more human-like personality, and claimed the company could mitigate potential harmful downsides.<\/p>\n<p>\u201cWe made ChatGPT pretty restrictive to make sure we were being careful with mental health issues. We realise this made it less useful\/enjoyable to many users who had no mental health problems,\u201d he said in the post.<\/p>\n<p>\u201cNow that we have been able to mitigate the serious mental health issues and have new tools, we are going to be able to safely relax the restrictions in most cases.\u201d<\/p>\n<p>The company has previously attracted criticism for its attempts to inject personality or bond-forming into its chatbot, particularly when it comes to children interacting with it. In August, an American couple, whose 16-year-old son had died by suicide, sued OpenAI claiming ChatGPT had contributed to his decision to take his own life. The couple claimed the platform was intentionally designed to foster psychological dependency and that safeguards to detect mental distress were easily sidestepped.<\/p>\n<p>Loading<\/p>\n<p>Inman Grant said she had proactively registered enforceable industry codes to protect children from age-inappropriate content, including the \u201cclear and present danger\u201d posed by AI-driven companion chatbots.<\/p>\n<p>\u201cI do not want Australian children and young people serving as casualties of powerful technologies, thrust onto the market without guardrails and without regard for their safety and wellbeing,\u201d she said.<\/p>\n<p>\u201cUnder the codes, AI companion chatbots will need to implement appropriate age assurance measures to prevent children from accessing harmful material, such as sexually explicit conversations, unless they can show they have enough strong guardrails to protect kids from generating this material in the first place.\u201d<\/p>\n<p>This codes also cover explicit violence, suicidal ideation, self-harm and disordered eating. Breach of a direction to comply will carry penalties of up to $49.5 million.<\/p>\n<p>A spokesperson for federal communications minister Anika Wells backed eSafety and said the new codes would support the government\u2019s work to restrict access to sexualised content online.<\/p>\n<p>\u201cUnder these codes, generative AI services that have the highest risk of enabling children to generate pornography, self-harm material and high-impact violent material must implement appropriate age assurance measures,\u201d the spokesperson said.<\/p>\n<p>\u201cThe Australian Government is committed to protecting children from inappropriate content online.\u201d<\/p>\n<p>Get news and reviews on technology, gadgets and gaming in our Technology newsletter every Friday. <a href=\"https:\/\/www.theage.com.au\/link\/follow-20170101-p570wt\" rel=\"nofollow noopener\" target=\"_blank\">Sign up here.<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"In February, OpenAI said it was exploring how to enable generations including gore and erotica in age-appropriate contexts.&hellip;\n","protected":false},"author":2,"featured_media":233568,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-233567","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/233567","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=233567"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/233567\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/233568"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=233567"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=233567"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=233567"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}