\n
![\"Hand](\"https:\/\/www.newsbeep.com\/uk\/wp-content\/uploads\/2026\/04\/hand-tracking-watch.png\" "\\"Hand"){kind=tracking}
The WatchHand device; Photo: Jason Koski\/Cornell University<\/p>\nSoon, your smartwatch could do much more than track your steps or display messages. Researchers at Cornell and KAIST in South Korea have found a way to turn an ordinary smartwatch into a high-tech controller with a system called \u201cWatchHand.\u201d<\/p>\n
The system uses the watch\u2019s built-in speaker and microphone to follow your hand movements as they happen. It sends out silent sound waves that reflect off your hand and return to the watch, letting the device know exactly what your fingers are doing. This works like micro-sonar for your wrist and doesn\u2019t need any extra bulky equipment.<\/p>\n
From Watch to Hand Tracker
\nThe WatchHand device; Photo: Jason Koski\/Cornell University<\/p>\n
Older hand-tracking devices are often too big and awkward to wear every day. WatchHand stands out because it uses technology already built into a regular Android watch<\/a>. An AI program on the watch listens to the sound wave echoes to create a 3D map of your hand\u2019s position.<\/p>\n \u201cWatchHand substantially lowers the barriers to hand-pose tracking,\u201d said Jiwan Kim, a doctoral student at KAIST and co-lead author. \u201cIf any device has a single speaker and microphone, our approach is applicable.\u201d<\/p>\n Since all the processing is done on the watch itself, your data stays private. The researchers tested the technology with 40 people and found it could accurately track finger movements and wrist turns, even in noisy places. Still, it has some limits. It doesn\u2019t work well if you\u2019re walking, and for now, it only works on Android<\/a>.<\/p>\n Typing In Thin Air<\/p>\n Researchers want to make using computers feel more natural. For example, you might tap your fingers to skip a song or move your hand to control a virtual mouse. This technology could also help people with limited mobility or those using VR headsets.<\/p>\n