Automatic Inspection of Aeronautical Mechanical Assemblies by Matching the 3D CAD Model and Real 2D Images

Hamdi Ben Abdallah (1, 2) , Igor Jovančević (2) , Jean-José Orteu (1) , Ludovic Brèthes (2)

1 ICA - Institut Clément Ader
2 DIOTA

In the aviation industry, automated inspection is essential for ensuring quality of production. It allows acceleration of procedures for quality control of parts or mechanical assemblies. As a result, the demand of intelligent visual inspection systems aimed at ensuring high quality in production lines is increasing. In this work, we address a very common problem in quality control. The problem is verification of presence of the correct part and verification of its position. We address the problem in two parts: first, automatic selection of informative viewpoints before the inspection process is started (offline preparation of the inspection) and, second, automatic treatment of the acquired images from said viewpoints by matching them with information in 3D CAD models is launched. We apply this inspection system for detecting defects on aeronautical mechanical assemblies with the aim of checking whether all the subparts are present and correctly mounted. The system can be used during manufacturing or maintenance operations. The accuracy of the system is evaluated on two kinds of platform. One is an autonomous navigation robot, and the other one is a handheld tablet. The experimental results show that our proposed approach is accurate and promising for industrial applications with possibility for real-time inspection.

Mots clés: computer vision; manufacturing; maintenance; robotized inspection; augmented reality; handheld inspection; CAD model; matching 3D/2D; viewpoint selection; tracking

Domaines: Sciences de l'ingénieur [physics]

Hamdi Ben Abdallah, Igor Jovančević, Jean-José Orteu, Ludovic Brèthes. Automatic Inspection of Aeronautical Mechanical Assemblies by Matching the 3D CAD Model and Real 2D Images. Journal of Imaging, 2019, 5 (10), pp.81-110. ⟨10.3390/jimaging5100081⟩. ⟨hal-02320900v2⟩