Photo-shoot localization of a mobile camera based on registered frame data of virtualized reality models

Koji Makita (1) , Takeshi Kurata (1) , Jun Nishida (1) , Tomoya Ishikawa (1) , Takashi Okuma (1) , Masakatsu Kourogi (1) , Thomas Vincent (2) , Laurence Nigay (2) , Jun Yamashita , Hideaki Kuzuoka

1 AIST - National Institute of Advanced Industrial Science and Technology
2 IIHM - Ingénierie de l’Interaction Homme-Machine

This paper presents a study of a method for estimating the position and orientation of a photo-shoot in indoor environments for augmented reality applications. Our proposed localization method is based on registered frame data of virtualized reality models, which are photos with known photo-shoot positions and orientations, and depth data. Because registered frame data are secondary product of modeling process, additional works are not necessary to create registered frame data especially for the localization. In the method, a photo taken by a mobile camera is compared to registered frame data for the localization. Since registered frame data are linked with photo-shoot position, orientation, and depth data, 3D coordinates of each pixel on the photo of registered frame data is available. We conducted experiments with employing five techniques of the estimation for comparative evaluations.

Domaines: Interface homme-machine [cs.HC]

Koji Makita, Takeshi Kurata, Jun Nishida, Tomoya Ishikawa, Takashi Okuma, et al.. Photo-shoot localization of a mobile camera based on registered frame data of virtualized reality models. Proceedings of the 2013 IEEE International Symposium on Mixed and Augmented Reality (ISMAR), 2013, Adelaide, SA, Autralia, pp.273-274, ⟨10.1109/ISMAR.2013.6671801⟩. ⟨hal-00953370⟩