Augmented Reality with Virtual Cerebral Aneurysms: A Feasibility Study

Objective: Advanced magnetic resonance imaging (MRI) acquisition methods such as 4D phase contrast magnetic resonance imaging (4D pcMRI) have found widespread applications in assessing hemodynamics in cerebral aneurysms. One of the goals is the identification of a hemodynamic scenario predictive of aneurysm rupture. Because of the technical complexity the 4D pcMRI technology, challenges exist in extracting and communicating the wealth of information contained in the MRI image data, in particular, to a multidisciplinary team of health professionals and basic scientists. Methods: Here we introduce a new resource in the form of a commercially available optical see-through head-mounted display, which allows augmenting the real world by computer-generated virtual objects. Results: An image processing algorithm was presented for integrating 3D surface models derived from 3D rotational angiography data, 3D time-of-flight MRI data, and 4D pcMRI data into the augmented reality environment. This new approach was successfully evaluated on blood flow data acquired before and after flow diverter treatment in 6 patients harboring a cerebral aneurysm. Conclusions: Augmented reality may become an additional means for visualizing complex medical data, in particular complex flows as illustrated here.