{"id":961371,"date":"2026-11-12T04:16:10","date_gmt":"2026-11-12T04:16:10","guid":{"rendered":"https:\/\/www.newsbeep.com\/au\/961371\/"},"modified":"2026-11-12T04:16:10","modified_gmt":"2026-11-12T04:16:10","slug":"researchers-track-whole-body-movement-with-just-a-smartwatch","status":"publish","type":"post","link":"https:\/\/www.newsbeep.com\/au\/961371\/","title":{"rendered":"Researchers track whole body movement with just a smartwatch"},"content":{"rendered":"<p>For the first time, researchers can track the movement of a person\u2019s entire body\u00a0with ultrasonic sound waves, using just an off-the-shelf smartwatch and a lightweight artificial intelligence model \u2013 all while ensuring privacy and efficiency.<\/p>\n<p>The new technology, called EchoMotion, was developed by Cornell\u2019s\u00a0<a href=\"https:\/\/www.scifilab.org\/\" rel=\"nofollow noopener\" target=\"_blank\">Smart Computer Interfaces for Future Interactions (SciFi) Lab<\/a>, directed by<a href=\"https:\/\/bowers.cornell.edu\/people\/cheng-zhang-0\" rel=\"nofollow noopener\" target=\"_blank\"> Cheng Zhang<\/a>, associate professor of information science in the Cornell Ann S. Bowers College of Computing and Information Science. It uses the built-in speaker and microphone on a commercial smartwatch to determine a person\u2019s body position using a sonar-like sensing system. Once EchoMotion is integrated into commercial wearables or virtual reality (VR) systems, it could be used for tracking workouts, daily activities and progress on physical rehabilitation.<\/p>\n<p>EchoMotion represents a scalable approach that can use AI to understand human behaviors in the real world, Zheng said.<\/p>\n<p>He presented the paper, \u201c<a href=\"https:\/\/dl.acm.org\/doi\/epdf\/10.1145\/3832001\" rel=\"nofollow noopener\" target=\"_blank\">EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing<\/a>,\u201d at the Association for Computing Machinery international joint conference on Pervasive and Ubiquitous Computing and International Symposium on Wearable Computing (UbiComp\/IWSC), Oct. 13 in Shanghai.<\/p>\n<p>Saif Mahmud, a Ph.D. candidate in the field of information science, demonstrates EchoMotion, a system for tracking body movements using an off-the-shelf smartwatch.<\/p>\n<p>\u201cThis is a very important jump for body tracking,\u201d said Saif Mahmud, doctoral student in the field of information science and lead author of the new research. Existing wearable devices use sensors such as accelerometers and gyroscopes that determine the movement of the device alone, he said. As a result, whole body tracking traditionally has required more complicated setups that may also include smartphones, earbuds or VR headsets.<\/p>\n<p>Some tracking systems also integrate cameras, but EchoMotion\u2019s use of sound waves offers multiple advantages. Acoustic signals preserve privacy for the wearer and the people around them \u2013 no need to set up a camera at the gym \u2013 and generate smaller amounts of data for easier and cheaper processing.<\/p>\n<p>\u201cWhile large language models, like ChatGPT, have been in the news, EchoMotion shows how very small models running on wearables have also revolutionized sensing in human-computer interaction,\u201d said co-author\u00a0<a href=\"https:\/\/infosci.cornell.edu\/people\/francois-guimbretiere\" rel=\"nofollow noopener\" target=\"_blank\">Fran\u00e7ois Guimbreti\u00e8re<\/a>, professor of information science in Cornell Bowers.<\/p>\n<p>The technology also saves on battery power and works with existing off-the-shelf watches. In the prototype, sensing drew about 12 milliwatts, roughly 40 times less than a wearable camera, and a 30-minute session on a Galaxy Watch 6 used only 5% to 6% of the battery.<\/p>\n<p>\u201cWe have made significant efforts in making EchoMotion work on commercial devices, so that the adoption can be very easy,\u201d Mahmud said.<\/p>\n<p>To develop the technology, the researchers initially created their own 3D-printed watch replica, which included a microphone and speaker pair on each side. The two speakers emit ultrasonic signals that surround a person in a sphere of inaudible sound waves. Then the two microphones pick up the echoes that bounce off the person\u2019s limbs as they move.<\/p>\n<p>The researchers collected echo patterns from 10 volunteers who wore the watch on their nondominant hand as they performed 18 exercises. Using that data, the researchers developed a deep learning model to translate those patterns into body movements. They measured accuracy by comparing the predicted positions of 12 joints, from head to ankles, with the body poses captured by cameras.<\/p>\n<p>Off-the-shelf smartwatches have only a single microphone and speaker pair, however, so they tested the EchoMotion system on an unmodified Samsung Galaxy Watch 6 with 15 new volunteers. When used by people new to the system, the average error for predicting the location of each joint was under four inches. A one-time, 12-minute calibration cut that error by more than one third, to about 2.4 inches.<\/p>\n<p>The same AI model, without any retraining, also worked on a Samsung Galaxy Watch 7 and a Google Pixel Watch 3.<\/p>\n<p>To see how EchoMotion performed beyond the lab, the researchers asked 10 new participants to wear a smartwatch as they did the 18 exercises in a small room, in a narrow hallway and next to a noisy road. Furniture and ambient noise did not interfere, but the system\u2019s performance suffered slightly in the hallway, due to echoes coming off of other people. Mahmud expects, however, that with more data \u2013 from thousands of users instead of dozens \u2013 their model will get better at interpreting a wearer\u2019s movements even in crowded environments, like the subway.<\/p>\n<p>Currently, the team is developing the technology for use in fitness tracking, so a personal fitness agent will be able to count a user\u2019s reps and even correct their form, for example, in a Bulgarian split squat. They are also exploring the use of EchoMotion in combination with first-person vision on smartglasses to efficiently track the objects that a person handles.<\/p>\n<p>\u201cIn the very near future, with wearables like smartwatches or smartglasses, a personal agent will write a description of your whole day \u2013 what you did, what you ate,\u201d Mahmud said. \u201cThis project enables the body tracking part of that vision.\u201d<\/p>\n<p>Co-authors on the study include Jiwan Kim of KAIST; Tianhong Catherine Yu, a doctoral student in the field of information science; Kenny Liang \u201924 and Vineet Parikh \u201920, M.S. \u201924.<\/p>\n<p>The research was supported by the National Science Foundation.<\/p>\n<p>Patricia Waldron is a writer for the Cornell Ann S. Bowers College of Computing and Information Science.<\/p>\n","protected":false},"excerpt":{"rendered":"For the first time, researchers can track the movement of a person\u2019s entire body\u00a0with ultrasonic sound waves, using&hellip;\n","protected":false},"author":2,"featured_media":961372,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[64,63,213,105],"class_list":["post-961371","post","type-post","status-publish","format-standard","has-post-thumbnail","category-gadgets","tag-au","tag-australia","tag-gadgets","tag-technology"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/961371","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/comments?post=961371"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/posts\/961371\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media\/961372"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/media?parent=961371"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/categories?post=961371"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/au\/wp-json\/wp\/v2\/tags?post=961371"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}