Pose Estimation for Augmented Reality: A Hands-On Survey

Eric Marchand (1) , Hideaki Uchiyama (2) , Fabien Spindler (1)

1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality
2 Kyushu University

Augmented reality (AR) allows to seamlessly insert virtual objects in an image sequence. In order to accomplish this goal, it is important that synthetic elements are rendered and aligned in the scene in an accurate and visually acceptable way. The solution of this problem can be related to a pose estimation or, equivalently, a camera localization process. This paper aims at presenting a brief but almost self-contented introduction to the most important approaches dedicated to vision-based camera localization along with a survey of several extension proposed in the recent years. For most of the presented approaches, we also provide links to code of short examples. This should allow readers to easily bridge the gap between theoretical aspects and practical implementations.

Mots clés: Index Terms—Survey; augmented reality; vision-based camera localization; pose estimation; PnP; SLAM; motion estimation; homography; keypoint matching; code examples

Domaines: Informatique [cs]

Eric Marchand, Hideaki Uchiyama, Fabien Spindler. Pose Estimation for Augmented Reality: A Hands-On Survey. IEEE Transactions on Visualization and Computer Graphics, 2016, 22 (12), pp.2633 - 2651. ⟨10.1109/TVCG.2015.2513408⟩. ⟨hal-01246370⟩