Gestures Design_2 -- Bare Hands interaction in Virtual Reality

Liang Men 19.04.2018

VR provides us with space, although it is virtual, it comes with a real sense of depth, which made the impossible becomes possible. We now have one more dimension, with which, more realistic and intuitive interactions could be designed and used. E.g. finger movements works like a cursor, and finger click perform the function of a mouse click. Gestures could be designed and used as triggers, similar to the mouse gestures (cf. CrxMouse). Considering instead of one mouse with 2 DOFs, we now have two hands, each hand has five fingers, each finger has 2 to 3 bones, every bone has 3 DOFs, a much bigger space for input/interaction design is available now. See all the 8 gestures designed and used in LeMos in Table 1. Here based on the experience of designing gestures for interaction in 54 Table 1: Gesture design in LeMo Type I and Type II (together referred as ”LeMos”), we propose 4 design implications for gesture design in VR: 

(1) Decide whether to use palm or finger movement as a trigger based on the interface size and the required accuracy. Finger moments provide better accuracy requires smaller movement range than palm movements, and thus might suit the need better when the the size trigger interface is small, and more accuracy required. E.g. LeMo type II has a larger size matrix, resulting in smaller buttons. Thus we chose to use click-by-index rather than tap-by-palm gesture (used in LeMo Type I), see Table 1.

(2) Choose the gesture Based on the intensity of uses, uses with higher frequency simpler gestures to easy the workload of interaction. Usually the most frequent use in the activity is the interaction that achieves the basic function of the interface. E.g. the basic interaction with a music interface in LeMo is add/or remove a note, so we chose finger-single-click/palm-single-tap to perform this function, see Table 1.

(3) Mimic the interactions that people are already familiar with, to ease the costs of learning and memory. E.g., in LeMo Type II, finger-single-click (a single click by the end of an index finger) is similar to a single click by mouse, pinch & stretch is similar to grabbing a physical object and stretching it in the real world, see Table 1.


Table 1: Gesture to generate objects



26 Nov 2018, on train from London to Durham, UK

References

CrxMouse. Effortless browser navigation with mouse gestures. https://chrome.google.com/webstore/detail/crxmouse-chrome-gestures/jlgkpaicikihijadgifklkbpdajbkhjo?hl=en. Accessed: 2018-18-09


________________________________________

以下为中文译文:

(准备中)



©2024 by Liang Men