Using the Userʼs Point of View for Interaction on Mobile Devices

Jérémie Francone (1) , Laurence Nigay (2)

1 LIG - Laboratoire d'Informatique de Grenoble
2 IIHM - Ingénierie de l’Interaction Homme-Machine

We study interaction modalities for mobile devices (smartphones and tablets) that rely on a camera-based head tracking. This technique defines new possibilities for input and output interaction. For output, by computing the position of the device according to the user's head, it is for example possible to realistically control the viewpoint on a 3D scene (Head-Coupled Perspective, HCP). This technique improves the output interaction bandwidth by enhancing the depth perception and by allowing the visualization of large workspaces (virtual window). For input, head movement can be used as a means of interacting with a mobile device. Moreover such an input modality does not require any additional sensor except the built-in front-facing camera. In this paper, we classify the interaction possibilities offered by head tracking on smartphones and tablets. We then focus on the output interaction by introducing several applications of HCP on both smartphones and tablets and by presenting the results of a qualitative user experiment.

Mots clés: Mobile Device; Interaction Modality; 3D Interface; Head-Coupled Perspective

Domaines: Interface homme-machine [cs.HC]

Jérémie Francone, Laurence Nigay. Using the Userʼs Point of View for Interaction on Mobile Devices. IHM 2011 - Conférence Francophone sur l'Interaction Homme-Machine, Oct 2011, Nice - Sophia Antipolis, France. pp.25-31, ⟨10.1145/2044354.2044360⟩. ⟨hal-00760343⟩