{"id":431681,"date":"2026-05-04T11:45:07","date_gmt":"2026-05-04T11:45:07","guid":{"rendered":"https:\/\/www.newsbeep.com\/ie\/431681\/"},"modified":"2026-05-04T11:45:07","modified_gmt":"2026-05-04T11:45:07","slug":"vuebuds-turn-wireless-earbuds-into-ai-vision-devices","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/ie\/431681\/","title":{"rendered":"VueBuds Turn Wireless Earbuds Into AI Vision Devices"},"content":{"rendered":"<p>Wireless earbuds are everywhere, yet they\u2019re still like tiny stage performers trapped in a single act,<\/p>\n<p>sound. Their small size and limited power keep them tuned to audio alone, preventing them from branching out into bigger roles.<\/p>\n<p>University of Washington researchers developed VueBuds, the first system to embed tiny cameras in commercial wireless earbuds, enabling users to converse with an AI model about whatever is in front of them.<\/p>\n<p>VueBuds are Bluetooth-enabled earpieces that take speedy, grainy black-and-white photos and then upload them to your phone. The artwork is a tiny on-device AI model that can answer questions about the images it sees in about a second. All processing is performed locally to protect privacy. Recording activates a light, and users can delete images immediately.<\/p>\n<p class=\"also\"><a href=\"https:\/\/www.techexplorist.com\/wireless-system-power-devices-inside-body\/14556\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">Wireless system to power devices inside the body<\/a><\/p>\n<p>Each VueBud is a Sony WF\u20111000XM3 that\u2019s been taught to \u201csee.\u201d<\/p>\n<p>UW professor and senior author Shyam Gollakota said, \u201cWe haven\u2019t seen most people adopt smart glasses or VR headsets, in part because a lot of people don\u2019t like wearing glasses, and they often come with privacy concerns, such as recording high-resolution video and processing it in the cloud. But almost everyone wears earbuds already, so we wanted to see if we could put visual intelligence into tiny, low-power earbuds, and also address privacy concerns in the process.\u201d<\/p>\n<p>High\u2011res cameras and endless video drain too much power for earbuds. So the team miniaturized vision into a \u201cgrain\u2011of\u2011rice\u201d camera that snaps quick, low\u2011res black\u2011and\u2011white stills, light enough for Bluetooth and battery to handle.<\/p>\n<p>By angling the cameras just 5\u201310\u00b0 outward, VueBuds capture nearly everything ahead, leaving only a small blind spot for objects closer than 20 cm, a distance people rarely use.<\/p>\n<p class=\"also\"><a href=\"https:\/\/www.techexplorist.com\/keeping-data-fresh-wireless-networks\/14597\/\" rel=\"nofollow noopener\" target=\"_blank\">Keeping data fresh for wireless networks<\/a><\/p>\n<p>They also learned to stitch the images of both earbuds into a single image, cutting response time to a single second and making the experience feel live.<\/p>\n<p>In trials with 74 people, VueBuds\u2019 low-resolution yet private still images performed as well as Ray-Ban Meta Glasses, powered by multiple clouds for non-private storage. If it were a translation task, users preferred VueBuds, while Ray\u2011Bans worked better for object counting.<\/p>\n<p>In another study with 16 testers, VueBuds reached 83\u201384% accuracy on everyday translation and object tasks, and 93% when identifying book titles and authors.<\/p>\n<p>Because they only capture grayscale images, VueBuds can\u2019t yet handle color\u2011based questions. The team hopes to add color cameras, though they require more power, and train specialized AI models for tasks like translation.<\/p>\n<p>\u201cThis study lets us glimpse what\u2019s possible just using a general-purpose language model and our wireless earbuds with cameras,\u201d Kim <a href=\"https:\/\/www.washington.edu\/news\/2026\/04\/14\/cameras-in-wireless-earbuds-vuebuds\/\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">said<\/a>. \u201cBut we\u2019d like to study the system more rigorously for applications like reading a book, for people who have low vision or are blind, for instance, or translating text for travelers.\u201d<\/p>\n<p class=\"reference\">Journal Reference:<\/p>\n<p>Maruchi Kim, Rasya Fawwaz, Zhi Yang Lim et al. VueBuds: Visual Intelligence with Wireless Earbuds. DOI: <a href=\"https:\/\/doi.org\/10.1145\/3772318.3791322\" target=\"_blank\" rel=\"noreferrer noopener nofollow\">10.1145\/3772318.3791322<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"Wireless earbuds are everywhere, yet they\u2019re still like tiny stage performers trapped in a single act, sound. Their&hellip;\n","protected":false},"author":2,"featured_media":431682,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[61,60,82],"class_list":["post-431681","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-ie","tag-ireland","tag-science"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/431681","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/comments?post=431681"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/posts\/431681\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media\/431682"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/media?parent=431681"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/categories?post=431681"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/ie\/wp-json\/wp\/v2\/tags?post=431681"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}