A vision system aligned more closely with human perception \u2013 one that perhaps emphasizes shape, for instance \u2013 might still confuse the cat for another similarly shaped mammal, like a tiger; but it is unlikely to indicate an elephant.<\/p>\n
The kinds of mistakes an AI makes reveal how it organizes visual information, with potential limitations that become concerning in higher-stakes settings.<\/p>\n
Stickers and graffiti on a stop sign could serve as an adversarial attack, confusing AI in autonomous vehicles. Imagine an autonomous vehicle approaching a vandalized stop sign. While a human driver recognizes the sign from its shape and context, an AI that relies on pixel patterns may misclassify it, pushing the altered sign out of the category \u201csign\u201d altogether<\/a> and into a different group of images that it identifies as similar, such as a billboard, advertisement or other roadside object.<\/p>\n Together, these problems point to a misalignment between how humans perceive the visual world and how AI represents it. <\/p>\n We are experts in visual perception<\/a>, and we work at the intersection of human<\/a> and machine perception<\/a>. People organize visual input into objects, meaning and relationships shaped by experience and context. AI models don\u2019t organize visual information the same way. This key difference explains why AI sometimes fails in surprising ways.<\/p>\n Seeing objects, not features<\/p>\n Imagine that in front of you is a small, opaque object with both straight and curved edges. But you don\u2019t see those features; you just see your coffee mug.<\/p>\n Vision isn\u2019t a camera, passively recording the world. Instead, your brain rapidly turns the light your eyes absorb into objects you recognize and understand, organizing experience into structured mental representations<\/a>.<\/p>\n Researchers can understand how these representations are structured by examining how people judge similarity<\/a>. Your coffee mug is not like your computer, but it\u2019s similar to a glass of water despite differences in appearance. That judgment reflects how the mug is mentally represented: not just in terms of appearance, but also what the mug is used for and how it fits into everyday activities.<\/p>\n Very alike in how you use them; less similar in looks. Importantly, the mental organization of representations is flexible. Which aspects of an object stand out change with context and goals<\/a>. If packing a moving box, shape and size matter most, so your mug might be placed anywhere it fits. But when putting it away in a cupboard, it goes next to other drinkware. The mug hasn\u2019t changed, only the way it is organized in your mind.<\/p>\n Human visual perception is adaptive, driven by meaning and tied to how we interact with the world. <\/p>\n Aligning AI with humans<\/p>\n AI systems, however, organize visual input in fundamentally different ways than people \u2013 not because they are machines, but because of how narrowly they are trained. When an AI is trained to categorize a cat or an elephant, it only needs to learn which visual patterns lead to the correct label, not how those animals relate to each other or fit into the broader world.<\/p>\n In contrast, humans learn within a broader context. When we learn what an elephant is, we weave that representation into the tapestry of everything else we have learned: animals, size, habitats and more. Because AI is graded only on label accuracy, it can rely on shortcuts that work in training but sometimes fail in the real world<\/a>.<\/p>\n The issue of representational alignment<\/a> refers to whether AI organizes information in ways that resemble how people do. It\u2019s not to be confused with value alignment<\/a>, which refers to the challenge of making sure AI systems pursue outcomes and goals that humans intend.<\/p>\n Because human learning embeds new information into a web of prior knowledge, the relationships between new and existing concepts can be studied and measured. This means that representational alignment may be a solvable problem and a step toward addressing broader alignment challenges.<\/p>\n One approach to representational alignment focuses on building AI systems that behave like humans on psychological tasks, allowing researchers to compare representations directly. For example, if people judge a cat as more similar to a dog than to an elephant, the goal is to build AI models that arrive at those same judgments.<\/p>\n One promising technique<\/a> involves training AI on human similarity judgments<\/a> collected in the lab. In these studies, human participants might be shown three images and asked which two objects are more similar; for example, whether a mug is more like a glass or a bowl. Including this data during training encourages AI systems to learn how objects relate to one another, producing representations that better reflect how people understand the world.<\/p>\n Health care providers want AI systems that flag real issues, without a lot of misses or false positives. Alignment beyond vision<\/p>\n Representational alignment matters beyond vision systems<\/a>, and AI researchers are taking notice<\/a>. As AI increasingly supports high-stakes decisions, differences between how machines and humans represent the world will have real consequences, even when an AI system appears highly accurate<\/a>. For example, if an AI analyzing medical images learns to associate the source of an image or repeated image artifacts with disease rather than the real visual signs of the disease itself, that is obviously problematic.<\/p>\n AI doesn\u2019t necessarily need to process information exactly the way people think, but training AI using principles drawn from human perception and cognition \u2013 such as similarity, context and relational structure \u2013 can lead to safer, more accurate and more ethical systems.<\/p>\n","protected":false},"excerpt":{"rendered":"Even with no fur in frame, you can easily see that a photo of a hairless Sphynx cat…\n","protected":false},"author":2,"featured_media":535885,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[20],"tags":[256,254,255,64,63,105],"class_list":{"0":"post-535884","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-artificial-intelligence","8":"tag-ai","9":"tag-artificial-intelligence","10":"tag-artificialintelligence","11":"tag-au","12":"tag-australia","13":"tag-technology"},"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/535884","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=535884"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/535884\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/535885"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=535884"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=535884"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=535884"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}![\"red](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/03\/file-20260309-58-902y88.jpg\")
<\/a><\/p>\n
\n rick\/Flickr<\/a>, CC BY<\/a><\/p>\n![\"clear](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/03\/file-20260309-71-1egatg.jpg\")
<\/a><\/p>\n
\n Oscar Wong\/Moment via Getty Images<\/a><\/p>\n![\"view](\"https:\/\/www.newsbeep.com\/au\/wp-content\/uploads\/2026\/03\/file-20260309-71-5a2m3p.jpg\")
<\/a><\/p>\n
\n REB Images\/Connect Images via Getty Images<\/a><\/p>\n