Finger-Based Manipulation in Immersive Spaces and the Real World

Emmanuelle Chapoulie (1) , Theophanis Tsandilas (2) , Lora Oehlberg (3) , Wendy E. Mackay (4, 2) , George Drettakis (1)

1 GRAPHDECO - GRAPHics and DEsign with hEterogeneous COntent
2 LRI - Laboratoire de Recherche en Informatique
3 University of Calgary
4 EX-SITU - Extreme Interaction

Immersive environments that approximate natural interaction with physical 3D objects are designed to increase the user’s sense of presence and improve performance by allowing users to transfer existing skills and expertise from real to virtual environments. However, limitations of current Virtual Reality technologies, e.g., low-fidelity real-time physics simulations and tracking problems, make it difficult to ascertain the full potential of finger-based 3D manipulation techniques. This paper decomposes 3D object manipulation into the component movements, taking into account both physical constraints and mechanics. We fabricate five physical devices that simulate these movements in a measurable way under experimental conditions. We then implement the devices in an immersive environment and conduct an experiment to evaluate direct finger-based against ray-based object manipulation. The key contribution of this work is the careful design and creation of physical and virtual devices to study physics-based 3D object manipulation in a rigorous manner in both real and virtual setups.

Mots clés: Finger-based manipulation; Immersive Cube-like Displays; Real/virtual world comparison

Domaines: Synthèse d'image et réalité virtuelle [cs.GR]; Interface homme-machine [cs.HC]

Emmanuelle Chapoulie, Theophanis Tsandilas, Lora Oehlberg, Wendy E. Mackay, George Drettakis. Finger-Based Manipulation in Immersive Spaces and the Real World. IEEE Symposium on 3D User Interfaces (3DUI), Mar 2015, Arles, France. pp.8. ⟨hal-01114629⟩