2016 IEEE study<\/a> by robotics researchers Tom\u00e1\u0161 Feix and colleagues that categorizes common human grips based on form and intent\u2014Huet built a library of grab techniques for VR. This includes grips like corner, clump, cylinder, hilt, and wand\u2014each mapped to real-world use.\u00a0<\/p>\n“We looked at how people hold cups, phones, and tools,” he explained. “Every grip has a story\u2014a context\u2014and we wanted that reflected in VR.” He also coined internal terms like “closedness,” a 0-to-1 measure of how open or closed the player’s hand is to define when a grab occurs.\u00a0<\/p>\n
![\"A](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/02\/Grab_Release_Thresholds.gif\" "\\"A")
<\/p>\n
Image via Owlchemy Labs\/Google<\/p>\n
“Some players over-grab, some pose-match,” Huet said. “You have to balance both so things don’t feel sticky or slippery. It’s subtle math that ends up shaping how people play.”<\/p>\n
This systematization allowed the team to move beyond imitation toward consistency. “It’s fascinating research,” Covert noted. “Marc showed pictures of different hand poses people use when grabbing things \u2014 holding a phone versus holding a cup. It grounded our approach.”<\/p>\n
![\"A](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/02\/Grab_Techniques_1.png\" "\\"A")
<\/p>\n
Image via Owlchemy Labs\/Google<\/p>\n
The Approach<\/p>\n
1. Designing for Accessibility Through Simplicity<\/p>\n
Removing controllers didn’t just change the interface \u2014 it opened the door for more inclusive play.<\/p>\n
“One of our big considerations is one-handed players,” said Covert. “At one point, we had a two-handed twist-style pepper shaker, but that created accessibility concerns. So we added a shake alternative.”<\/p>\n
This philosophy carried through every mechanic. DDS introduced “snap points” for setting items down easily, freeing a player’s hand mid-task.<\/p>\n
“In the diner, the squeeze bottles have a threshold for how hard you need to squeeze,” said Emma Atkinson, Technical Designer. “But if that’s difficult, you can just tilt them and they’ll pour out.”<\/p>\n
Moving to hand tracking also meant removing unnecessary instruction. Instead of teaching players new button metaphors or gesture rules, the team focused on subtracting friction and trusting existing human intuition. Because people already know how to use their hands, many interactions could be learned simply by doing\u2014without prompts, overlays, or step-by-step tutorials.\u00a0<\/p>\n
Huet extended that philosophy to invisible design systems. “Accessibility isn’t always about menus or toggles,” he said. “Sometimes it’s about thresholds\u2014if a player’s range of motion is limited, we can scale the sensitivity so a smaller gesture still counts. The goal is to let everyone feel capable in VR.”<\/p>\n
That sensitivity scaling, originally built for testing, became a subtle yet powerful accessibility feature. “You don’t have to announce accessibility,” Huet added. “You can just design it in.”<\/p>\n
2. Creating Self-Haptics<\/p>\n
Without vibration motors or triggers, the team reimagined tactile feedback from the ground up.<\/p>\n
“The squishable UI buttons and keyboards give tactile feedback because your fingers touch each other,” Covert explained. “That’s what we call self-haptics. You feel yourself performing the action instead of relying on vibration.”<\/p>\n
Atkinson added, “You don’t want your hand to become the object\u2014you want to hold it. We try to minimize cognitive dissonance between what you see and what you feel.”<\/p>\n
Huet built on that idea technically, integrating collision physics that made contact feel grounded. “The raw hand data comes straight from the device,” he explained. “We then run physics updates to see where your virtual hand should be after impact. There’s a little tolerance\u2014enough to give you that \u2018hit’ feeling before it breaks through.”<\/p>\n
He described it as “letting physics fake haptics.” “You’re not feeling a vibration,” he said, “but when the virtual hand resists or stops, your brain fills in the feedback.”<\/p>\n
That philosophy\u2014turning embodiment itself into feedback\u2014became core to Owlchemy’s design lexicon, alongside “bubble pass,” the intuitive hand-to-hand object transfer system.<\/p>\n
3. Designing for Shared Gestures<\/p>\n
Early builds tried to make passing explicit: both players had to perform a synchronized \u2018handoff’ gesture. The team replaced it with what became the \u2018bubble pass’\u2014an idea from Tim Winsky, implemented by Systems Engineer Marc Huet\u2014where a thrown item hovers in front of the other player long enough to be grabbed. The result is more playful, and it teaches itself.<\/p>\n
Even during internal playtests, people discovered the new pass system and had that moment of joy when they figured it out on their own.<\/p>\n
The change was data-driven. “We added analytics to see how often players used the old passing system and found that almost no one was using it,” Covert said. “That told us it was time to rethink the design.”<\/p>\n
Huet’s grab system played an unseen role here too. “When you toss something, timing matters; milliseconds affect how real it feels,” he said. “So we built in what we call \u2018sticky’ and \u2018slippery’ release thresholds. It’s how you tell the difference between handing off a mug and throwing a beach ball.”<\/p>\n
His experiments revealed that velocity and openness need to respond to intent. “If you open your hand slowly, the object should linger. If you open fast, it should fly,” Huet explained. “Those little cues make shared gestures feel believable.” It also learns what \u2018I’m ready’ looks like: hand up, waiting. When it sees that, it helps the object meet the hand\u2014so catching feels intentional instead of accidental.<\/p>\n
4. Designing Around Technical Limits<\/p>\n
Hardware realities still present creative challenges. “When you point away from yourself with the sprayer, your hand can block the headset cameras, so it doesn’t always detect the motion,” Covert explained.<\/p>\n
Instead of seeing such limitations as setbacks, the team treats them as opportunities for innovation. “We’ve even talked about adding aerosol spray cans where you press the top with your index finger,” Covert added. “We don’t have support for that yet, but it’s on the wishlist.”<\/p>\n
Huet elaborated on those constraints: “Hand occlusion, lighting, tracking speed\u2014those are constant battles,” he said. “If a hand moves too fast or leaves the camera’s field of view, tracking breaks. So we design around that by keeping actions close, within this invisible box in front of you.”<\/p>\n
Environmental conditions also shape interaction design. Hand tracking behaves differently depending on lighting, camera visibility, and the underlying capabilities of the headset itself. In low-light or high-occlusion situations, tracking data can become noisy.\u00a0<\/p>\n
Why?\u00a0<\/p>\n
Well, not all systems compensate for that noise in the same way. Some systems include infrared illuminators to support hand tracking in low-light conditions, while others degrade faster as lighting drops.<\/p>\n
Rather than treating those moments as failure states, the team designed interactions to be forgiving by default: dropped objects recover, missed grabs self-correct, and small errors never cascade into frustration. The guiding principle was simple: Players should never feel punished by physics or hardware constraints.<\/p>\n
The Results<\/p>\n
Hand tracking didn’t just expand accessibility. It made play feel human.<\/p>\n
Players naturally gestured, waved, and improvised together. They learned by doing, not by reading.\u00a0<\/p>\n
“We almost don’t need to design new ways of doing things,” Covert said. “The closer we get to how people actually use their hands, the more natural the game feels.”<\/p>\n
Huet added, “Our success is when people stop noticing the system. When your virtual hand feels like your hand\u2014when you don’t think about grabbing, you just grab\u2014that’s when VR disappears and embodiment takes over.”<\/p>\n
Across development, the team’s iterative design language. Terms like self-haptics and bubble pass became shorthand for a culture of experimentation and discovery. “You could almost make a dictionary of the words we’ve made up,” Atkinson laughed. “It’s our own language.”<\/p>\n
For Owlchemy Labs, hand tracking reaffirmed its core philosophy: interactions should be instinctive, inclusive, and joyful.<\/p>\n
“We’re still improving our authoring tools,” Huet said. “But every iteration teaches us something new about how humans move\u2014and how to make VR move with them.”<\/p>\n
![\"Screenshot_Shift-Selection_.png\"](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/02\/Screenshot_Shift-Selection_.png\" "\\"Screenshot_Shift-Selection_.png\\"\/")
<\/p>\n
Image via Owlchemy Labs\/Google<\/p>\n
Key Takeaways<\/p>\n
Hand tracking is both interface and embodiment. Designing gestures means understanding how people feel feedback: not just how they perform it.<\/p>\n
Authoring meets procedural motion. Strong hand-tracking systems allow developers to lock poses when precision matters (i.e., picking up a cup one way) while still allowing motion to adapt to how players actually reach, slide, and settle into a grab. The mix of authorship and procedurality is a key aspect of our system many developers miss. They try to hard to do one or the other<\/p>\n
Accessibility improves when interaction simplifies. Removing hardware often clarifies rather than complicates the experience.<\/p>\n
Iteration is the constant. Every friction point (hand size, gesture mismatch, or camera occlusion) drives better design.<\/p>\n
Analytics close the loop. Observation, data, and playtesting inform every refinement.<\/p>\n
VR’s future is hands-on. Interaction and embodiment are no longer separate disciplines. They’re one and the same.<\/p>\n","protected":false},"excerpt":{"rendered":"Game Developer Deep Dives are an ongoing series with the goal of shedding light on specific design, art,…\n","protected":false},"author":2,"featured_media":277707,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19],"tags":[85,46,125,340,341,342],"class_list":["post-277706","post","type-post","status-publish","format-standard","has-post-thumbnail","category-virtual-reality","tag-il","tag-israel","tag-technology","tag-virtual-reality","tag-virtualreality","tag-vr"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/277706","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/comments?post=277706"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/posts\/277706\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media\/277707"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/media?parent=277706"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/categories?post=277706"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/il\/wp-json\/wp\/v2\/tags?post=277706"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
![\"Screenshots](\"https:\/\/www.newsbeep.com\/il\/wp-content\/uploads\/2026\/02\/Grab_Techniques.png\" "\\"Screenshots")
<\/p>\n