{"id":623659,"date":"2026-10-07T20:32:10","date_gmt":"2026-10-07T20:32:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/nz\/623659\/"},"modified":"2026-10-07T20:32:10","modified_gmt":"2026-10-07T20:32:10","slug":"these-researchers-made-ai-drive-a-toyota-corolla-to-get-in-n-out","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/nz\/623659\/","title":{"rendered":"These Researchers Made AI Drive a Toyota Corolla to Get In-N-Out"},"content":{"rendered":"

Aditya Ramabadran, Simon Mahns, and Tobias Gessler, three AI engineers at a startup called Axiom<\/a>, recently fancied In-N-Out Burger for lunch.<\/p>\n

They weren\u2019t about to drive themselves, though. Sitting in a 2024 Toyota Corolla near the Bay Area restaurant\u2019s drive-thru lane, they opened a laptop and asked OpenAI\u2019s GPT-6 Astra<\/a> to take the wheel. They linked a chat interface to a server, which was connected to several windscreen-mounted cameras and the car\u2019s power steering system. A safety driver kept one foot above the brake, just in case.<\/p>\n

The AI model, which is normally tasked with generating text, code, and the odd image, slowly but surely navigated the vehicle up to the take-out window so they could collect their food.<\/p>\n

\u201cMaybe AGI is here after all,\u201d one of the engineers remarked, referring to artificial general intelligence<\/a>, the much-ballyhooed idea of machines that can match human intelligence.<\/p>\n

Self-driving cars<\/a> are nothing new, of course, but they\u2019re normally operated by algorithms specifically trained and engineered for the task. In this case, the operation came from a model designed to output text, and it happened on the fly, with no prior coaching by the trio. The fast-food stunt, as well as a number of other experiments<\/a>, suggest that language-based AI models are starting to gain a rudimentary but useful understanding of the physical world.<\/p>\n

Though nothing overtly alarming happened during the trio\u2019s lunchtime jaunt, they admit that putting a general-purpose model in charge of a fast-moving, two-ton hunk of steel is a high-stakes undertaking. As physical understanding improves, we could see AI models reach into the real world in impressive\u2014and perhaps dangerous\u2014new ways.<\/p>\n

Getting Physical<\/p>\n

Today\u2019s smartest models are incredibly good at answering complex questions and even performing some virtual tasks autonomously<\/a>, but their skills tend to be limited to the world of computers and the internet. Take these models into the real world and they quickly become befuddled. Despite claims that AGI has arrived<\/a>, AI companies evidently see physical reasoning as a yet-to-be-conquered frontier for AI.<\/p>\n

Some researchers have left big companies to found startups focused on solving physical reasoning. Andrew Dai, the CEO of one such outfit, called Elorian AI, previously worked as a researcher at Google DeepMind. He says better visual reasoning will open up a lot of new applications for AI, like systems that understand whether diners are enjoying their meal in a restaurant or robots capable of functioning in a home. Dai says robotics is a crucial test case for physical reasoning skills. \u201cIt\u2019s pretty essential for robotics,\u201d he says. \u201cYou can\u2019t really imagine home robotics without this.\u201d<\/p>\n

Elorian and Scale AI, a company that provides training data to big AI labs, recently developed a new benchmark<\/a>, Humanity\u2019s Sixth Sense, which measures models\u2019 ability to understand physical scenes.<\/p>\n","protected":false},"excerpt":{"rendered":"Aditya Ramabadran, Simon Mahns, and Tobias Gessler, three AI engineers at a startup called Axiom, recently fancied In-N-Out…\n","protected":false},"author":2,"featured_media":623660,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[6],"tags":[62108,6166,363,7705,564,7710,111,139,69,620,1503,145,5537],"class_list":["post-623659","post","type-post","status-publish","format-standard","has-post-thumbnail","category-technology","tag-ai-lab","tag-anthropic","tag-artificial-intelligence","tag-claude","tag-food","tag-grok","tag-new-zealand","tag-newzealand","tag-nz","tag-openai","tag-spacex","tag-technology","tag-xai"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/623659","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=623659"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/623659\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/623660"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=623659"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=623659"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=623659"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}