{"id":67423,"date":"2025-08-14T10:48:09","date_gmt":"2025-08-14T10:48:09","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/67423\/"},"modified":"2025-08-14T10:48:09","modified_gmt":"2025-08-14T10:48:09","slug":"australiana-images-made-by-ai-are-racist-and-full-of-tired-cliches-new-study-shows","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/67423\/","title":{"rendered":"\u2018Australiana\u2019 images made by AI are racist and full of tired cliches, new study shows"},"content":{"rendered":"<p>Big tech company <a href=\"https:\/\/doi.org\/10.5204\/mcj.3004\" rel=\"nofollow noopener\" target=\"_blank\">hype<\/a> sells generative artificial intelligence (AI) as intelligent, creative, desirable, inevitable, and about to radically reshape the future in many ways.<\/p>\n<p>Published by Oxford University Press, our <a href=\"https:\/\/doi.org\/10.1093\/9780198945215.003.0150\" rel=\"nofollow noopener\" target=\"_blank\">new research<\/a> on how generative AI depicts Australian themes directly challenges this perception. <\/p>\n<p>We found when generative AIs produce images of Australia and Australians, these outputs are riddled with bias. They reproduce sexist and racist caricatures more at home in the country\u2019s imagined monocultural past.<\/p>\n<p>Basic prompts, tired tropes<\/p>\n<p>In May 2024, we asked: what do Australians and Australia look like according to generative AI? <\/p>\n<p>To answer this question, we entered 55 different text prompts into five of the most popular image-producing generative AI tools: Adobe Firefly, Dream Studio, Dall-E 3, Meta AI and Midjourney.<\/p>\n<p>The prompts were as short as possible to see what the underlying ideas of Australia looked like, and what words might produce significant shifts in representation.<\/p>\n<p>We didn\u2019t alter the default settings on these tools, and collected the first image or images returned. Some prompts were refused, producing no results. (Requests with the words \u201cchild\u201d or \u201cchildren\u201d were more likely to be refused, clearly marking children as a risk category for some AI tool providers.)<\/p>\n<p>Overall, we ended up with a set of about 700 images. <\/p>\n<p>They produced ideals suggestive of travelling back through time to an imagined Australian past, relying on tired tropes like red dirt, Uluru, the outback, untamed wildlife, and bronzed Aussies on beaches. <\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685456\/original\/file-20250814-56-l302da.jpg?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250814-56-l302da.jpg\"  \/><\/a><\/p>\n<p>              \u2018A typical Australian family\u2019 generated by Dall-E 3 in May 2024.<\/p>\n<p>We paid particular attention to images of Australian families and childhoods as signifiers of a broader narrative about \u201cdesirable\u201d Australians and cultural norms.<\/p>\n<p>According to generative AI, the idealised Australian family was overwhelmingly white by default, suburban, heteronormative and very much anchored in a settler colonial past.<\/p>\n<p>\u2018An Australian father\u2019 with an iguana<\/p>\n<p>The images generated from prompts about families and relationships gave a clear window into the biases baked into these generative AI tools.<\/p>\n<p>\u201cAn Australian mother\u201d typically resulted in white, blonde women wearing neutral colours and peacefully holding babies in benign domestic settings. <\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685468\/original\/file-20250814-56-kj4mf7.jpg?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"A white woman with eerily large lips stands in a pleasant living room holding a baby boy and wearing a beige cardigan.\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250814-56-kj4mf7.jpg\"  \/><\/a><\/p>\n<p>              \u2018An Australian Mother\u2019 generated by Dall-E 3 in May 2024.<br \/>\n              Dall-E 3<\/p>\n<p>The only exception to this was Firefly which produced images of exclusively Asian women, outside domestic settings and sometimes with no obvious visual links to motherhood at all. <\/p>\n<p>Notably, none of the images generated of Australian women depicted First Nations Australian mothers, unless explicitly prompted. For AI, whiteness is the default for mothering in an Australian context. <\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685477\/original\/file-20250814-56-a9m5ot.jpg?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"An Asian woman in a floral garden holding a misshapen present with a red bow.\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250814-56-a9m5ot.jpg\"  \/><\/a><\/p>\n<p>              \u2018An Australian parent\u2019 generated by Firefly in May 2024.<br \/>\n              Firefly<\/p>\n<p>Similarly, \u201cAustralian fathers\u201d were all white. Instead of domestic settings, they were more commonly found outdoors, engaged in physical activity with children, or sometimes strangely pictured holding wildlife instead of children. <\/p>\n<p>One such father was even toting an iguana \u2013 an animal not native to Australia \u2013 so we can only guess at the data responsible for this and other <a href=\"https:\/\/doi.org\/10.5204\/mcj.3123\" rel=\"nofollow noopener\" target=\"_blank\">glaring glitches<\/a> found in our image sets.<\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685458\/original\/file-20250814-56-10w22p.jpeg?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250814-56-10w22p.jpeg\"  \/><\/a><\/p>\n<p>              An image generated by Meta AI from the prompt \u2018An Australian Father\u2019 in May 2024.<\/p>\n<p>Alarming levels of racist stereotypes<\/p>\n<p>Prompts to include visual data of Aboriginal Australians surfaced some concerning images, often with regressive visuals of \u201cwild\u201d, \u201cuncivilised\u201d and sometimes even \u201chostile native\u201d tropes. <\/p>\n<p>This was alarmingly apparent in images of \u201ctypical Aboriginal Australian families\u201d which we have chosen not to publish. Not only do they perpetuate problematic racial biases, but they also may be based on data and imagery <a href=\"https:\/\/www.sbs.com.au\/nitv\/article\/indigenous-cultural-protocols-what-the-media-needs-to-do-when-depicting-deceased-persons\/97xq2otnt\" rel=\"nofollow noopener\" target=\"_blank\">of deceased individuals<\/a> that rightfully belongs to First Nations people. <\/p>\n<p>      Read more:<br \/>\n      <a href=\"https:\/\/theconversation.com\/how-ai-images-are-flattening-indigenous-cultures-creating-a-new-form-of-tech-colonialism-246972\" rel=\"nofollow noopener\" target=\"_blank\">How AI images are \u2018flattening\u2019 Indigenous cultures \u2013 creating a new form of tech colonialism<\/a><\/p>\n<p>But the racial stereotyping was also acutely present in prompts about housing.<\/p>\n<p>Across all AI tools, there was a marked difference between an \u201cAustralian\u2019s house\u201d \u2013 presumably from a white, suburban setting and inhabited by the mothers, fathers and their families depicted above \u2013 and an \u201cAboriginal Australian\u2019s house\u201d. <\/p>\n<p>For example, when prompted for an \u201cAustralian\u2019s house\u201d, Meta AI generated a suburban brick house with a well-kept garden, swimming pool and lush green lawn. <\/p>\n<p>When we then asked for an \u201cAboriginal Australian\u2019s house\u201d, the generator came up with a grass-roofed hut in red dirt, adorned with \u201cAboriginal-style\u201d art motifs on the exterior walls and with a fire pit out the front. <\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685470\/original\/file-20250814-76-rxmxff.jpg?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250814-76-rxmxff.jpg\"  \/><\/a><\/p>\n<p>              Left, \u2018An Australian\u2019s house\u2019; right, \u2018An Aboriginal Australian\u2019s house\u2019, both generated by Meta AI in May 2024.<br \/>\n              Meta AI<\/p>\n<p>The differences between the two images are striking. They came up repeatedly across all the image generators we tested.  <\/p>\n<p>These representations clearly do not respect the idea of <a href=\"https:\/\/doi.org\/10.54760\/001c.133656\" rel=\"nofollow noopener\" target=\"_blank\">Indigenous Data Sovereignty<\/a> for Aboriginal and Torres Straight Islander peoples, where they would get to own their own data and control access to it.<\/p>\n<p>      Read more:<br \/>\n      <a href=\"https:\/\/theconversation.com\/ai-affects-everyone-including-indigenous-people-its-time-we-have-a-say-in-how-its-built-239605\" rel=\"nofollow noopener\" target=\"_blank\">AI affects everyone \u2013 including Indigenous people. It\u2019s time we have a say in how it&#8217;s built<\/a><\/p>\n<p>Has anything improved?<\/p>\n<p>Many of the AI tools we used have updated their underlying models since our research was first conducted.<\/p>\n<p>On August 7, OpenAI <a href=\"https:\/\/openai.com\/index\/introducing-gpt-5\/\" rel=\"nofollow noopener\" target=\"_blank\">released<\/a> their most recent flagship model, GPT-5. <\/p>\n<p>To check whether the latest generation of AI is better at avoiding bias, we asked ChatGPT5 to \u201cdraw\u201d two images: \u201can Australian\u2019s house\u201d and \u201can Aboriginal Australian\u2019s house\u201d.<\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685231\/original\/file-20250813-56-k1htsx.png?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Red tiled, red brick, suburban Australian house, generated by AI.\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250813-56-k1htsx.png\"  \/><\/a><\/p>\n<p>              Image generated by ChatGPT5 on August 10 2025 in response to the prompt \u2018draw an Australian\u2019s house\u2019.<br \/>\n              ChatGPT5.<\/p>\n<p>            <a href=\"https:\/\/images.theconversation.com\/files\/685232\/original\/file-20250813-66-rw5q4c.png?ixlib=rb-4.1.0&amp;q=45&amp;auto=format&amp;w=1000&amp;fit=clip\" rel=\"nofollow noopener\" target=\"_blank\"><img decoding=\"async\" alt=\"Cartoonish image of a hut with a fire, set in rural Australia, with Aboriginal art styled dot paintings in the sky.\" class=\"lazyload\" src=\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2025\/08\/file-20250813-66-rw5q4c.png\"  \/><\/a><\/p>\n<p>              Image generated by ChatGPT5 on August 10 2025 in response to the prompt \u2018draw an Aboriginal Australian\u2019s house\u2019.<br \/>\n              ChatGPT5.<\/p>\n<p>The first showed a photorealistic image of a fairly typical redbrick suburban family home. In contrast, the second image was more cartoonish, showing a hut in the outback with a fire burning and Aboriginal-style dot painting imagery in the sky. <\/p>\n<p>These results, generated just a couple of days ago, speak volumes.<\/p>\n<p>Why this matters<\/p>\n<p>Generative AI tools are everywhere. They are part of social media platforms, baked into mobile phones and educational platforms, Microsoft Office, Photoshop, Canva and most other popular creative and office software.<\/p>\n<p>In short, they are unavoidable. <\/p>\n<p>Our research shows generative AI tools will readily produce content rife with inaccurate stereotypes when asked for basic depictions of Australians. <\/p>\n<p>Given how widely they are used, it\u2019s concerning that AI is producing caricatures of Australia and visualising Australians in reductive, sexist and racist ways.<\/p>\n<p>Given the ways these AI tools are trained on tagged data, reducing cultures to clich\u00e9s may well be a feature rather than a bug for generative AI systems.<\/p>\n","protected":false},"excerpt":{"rendered":"Big tech company hype sells generative artificial intelligence (AI) as intelligent, creative, desirable, inevitable, and about to radically&hellip;\n","protected":false},"author":2,"featured_media":67424,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-67423","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/67423","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=67423"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/67423\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/67424"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=67423"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=67423"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=67423"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}