Holographic iRay: Exploring Augmentation for Medical Applications

Tian Xie, Mohammad M. Islam, Alan B. Lumsden, Ioannis A. Kakadiaris

Research output: Chapter in Book/Report/Conference proceedingConference contribution

11 Scopus citations

Abstract

A Holographic iRay prototype focusing on medical augmented reality is presented. The prototype is built using Microsoft HoloLens and Unity engine based on a previous iRay system built for iPad. A human subject is scanned using magnetic resonance imaging and the torso surface is pre-operatively segmented for 3D registration. The registration is performed using the iterative closest point algorithm between the pre-operative torso surface and the active torso surface mesh provided by the HoloLens spatial mapping and the gaze interaction. A scanning box is visualized at the gazing point to help the user select the targeting area. The pre-operative torso surface and the sampled active vertices within the scanning box are additionally overlaid in the box as the auxiliary information for guidance. Several simple interactions are designed to control the rendering of the inner organs after the registration. The experimental results demonstrate the potential of the Holographic iRay for medical applications.

Original languageEnglish (US)
Title of host publicationAdjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
EditorsWolfgang Broll, Holger Regenbrecht, Gerd Bruder, Myriam Servieres, Maki Sugimoto, J Edward Swan
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages220-222
Number of pages3
ISBN (Electronic)9780769563275
DOIs
StatePublished - Oct 27 2017
Event16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017 - Nantes, France
Duration: Oct 9 2017Oct 13 2017

Publication series

NameAdjunct Proceedings of the 2017 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017

Other

Other16th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2017
Country/TerritoryFrance
CityNantes
Period10/9/1710/13/17

Keywords

  • HMD
  • HoloLens
  • ICP
  • Markerless Registration
  • Medical AR
  • Spatial Mapping

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Media Technology
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Holographic iRay: Exploring Augmentation for Medical Applications'. Together they form a unique fingerprint.

Cite this