Deformation Aware Augmented Reality for Craniotomy using 3D/2D Non-rigid Registration of Cortical Vessels

Nazim Haouchine (1, 2, 3) , Parikshit Juvekar (4, 2) , William M Wells Iii (2, 5) , Stéphane Cotin (1) , Alexandra Golby (3) , Sarah Frisken (2, 4)

1 MIMESIS - Computational Anatomy and Simulation for Medicine
2 HMS - Harvard Medical School [Boston]
3 Brigham and Women's Hospital [Boston]
4 BWH - Brigham & Women’s Hospital [Boston]
5 MIT - Massachusetts Institute of Technology

Intra-operative brain shift is a well-known phenomenon that describes non-rigid deformation of brain tissues due to gravity and loss of cerebrospinal fluid among other phenomena. This has a negative influence on surgical outcome that is often based on pre-operative planning where the brain shift is not considered. We present a novel brain-shift aware Augmented Reality method to align pre-operative 3D data onto the deformed brain surface viewed through a surgical microscope. We formulate our non-rigid registration as a Shape-from-Template problem. A pre-operative 3D wire-like deformable model is registered onto a single 2D image of the cortical vessels, which is automatically segmented. This 3D/2D registration drives the underlying brain structures, such as tumors, and compensates for the brain shift in sub-cortical regions. We evaluated our approach on simulated and real data composed of 6 patients. It achieved good quantitative and qualitative results making it suitable for neurosurgical guidance.

Domaines: Informatique [cs]

Nazim Haouchine, Parikshit Juvekar, William M Wells Iii, Stéphane Cotin, Alexandra Golby, et al.. Deformation Aware Augmented Reality for Craniotomy using 3D/2D Non-rigid Registration of Cortical Vessels. Medical Image Computing and Computer Assisted Intervention, Oct 2020, Lima, Peru. pp.735--744. ⟨hal-02876726v3⟩