Second order optimization of mutual information for real-time image registration

Amaury Dame (1) , Eric Marchand (1)

1 Lagadic - Visual servoing in robotics, computer vision, and augmented reality

In this paper we present a direct image registration approach that uses Mutual Information (MI) as a metric for alignment. The proposed approach is robust, real-time and gives an accurate estimation of a set of 2D motion parameters. MI is a measure of the quantity of information shared by signals. Although it has the ability to perform robust alignment with illumination changes, multi-modality and partial occlusions, few works propose MI-based applications related to spatio-temporal image registration or object tracking in image sequences due to some optimization problems that we will explain. In this work, we propose a new optimization method that is adapted to the MI cost function and gives a practical solution for real time tracking. We show that by refining the computation of the Hessian matrix and using a specific optimization approach, the registration results are far more robust and accurate than the existing solutions while the computation is cheaper. A new approach is also proposed to speed up the computation of the derivatives and keep an equivalent optimization efficiency. To validate the advantages of the proposed approach, several experiments are performed.

Domaines: Traitement du signal et de l'image [eess.SP]; Traitement du signal et de l'image [eess.SP]; Vision par ordinateur et reconnaissance de formes [cs.CV]

Amaury Dame, Eric Marchand. Second order optimization of mutual information for real-time image registration. IEEE Transactions on Image Processing, 2012, 21 (9), pp.4190-4203. ⟨10.1109/TIP.2012.2199124⟩. ⟨hal-00750528⟩