An autonomous active vision system for complete and accurate 3D scene reconstruction

E. Marchand (1) , François Chaumette (1)

1 VISTA - Vision spatio-temporelle et active

We propose in this paper an active vision approach for performing the 3D reconstruction of static scenes. The perception-action cycles are handled at various levels: from the definition of perception strategies for scene exploration downto the automatic generation of camera motions using visual servoing. To perform the reconstruction, we use a structure from controlled motion method which allows an optimal estimation of geometrical primitive parameters. As this method is based on particular camera motions, perceptual strategies able to appropriately perform a succession of such individual primitive reconstructions are proposed in order to recover the complete spatial structure of the scene. Two algorithms are proposed to ensure the exploration of the scene. The former is an incremental reconstruction algorithm based on the use of a prediction/verification scheme managed using decision theory and Bayes nets. It allows the visual system to get a high level description of the observed part of the scene. The latter, based on the computation of new viewpoints ensures the complete reconstruction of the scene. Experiments carried out on a robotic cell have demonstrated the validity of our approach.

Domaines: Robotique [cs.RO]

E. Marchand, François Chaumette. An autonomous active vision system for complete and accurate 3D scene reconstruction. International Journal of Computer Vision, 1999, 32 (3), pp.171-194. ⟨inria-00352544⟩