IRay: Mobile AR Using Structure Sensor

Ioannis A. Kakadiarias, Mohammad M. Islam, Tian Xie, Christophoros Nikou, Alan B. Lumsden

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Scopus citations

Abstract

Using depth information has become more popular in recent years, as it adds a new dimension to 2D camera views. We have developed a novel mobile application called iRay, which uses depth information to achieve highly accurate markerless registration on a mobile device for medical use. We use a Structure Sensor to capture depth information that is portable to iPad. Its SDK also provides SLAM data to track pose. ICP is applied to achieve highly accurate registration between the 3D surface of a human torso and a pre-scanned torso model. The experiments demonstrate our results under motion blur, partial occlusion, and small movements. This application has the potential to be used for medical education and intervention.

Original languageEnglish (US)
Title of host publicationAdjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016
EditorsEduardo Veas, Raphael Grasset, Tobias Langlotz, Alejandro Martin, Jose Martinez-Carranza, Maki Sugimoto
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages127-128
Number of pages2
ISBN (Electronic)9781509037407
DOIs
StatePublished - Jan 30 2017
Event15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016 - Merida, Yucatan, Mexico
Duration: Sep 18 2016Sep 23 2016

Publication series

NameAdjunct Proceedings of the 2016 IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016

Other

Other15th Adjunct IEEE International Symposium on Mixed and Augmented Reality, ISMAR-Adjunct 2016
Country/TerritoryMexico
CityMerida, Yucatan
Period9/18/169/23/16

Keywords

  • ICP
  • Markerless Registration
  • Medical AR
  • Mobile AR
  • Structure Sensor

ASJC Scopus subject areas

  • Computer Science Applications
  • Human-Computer Interaction
  • Media Technology
  • Computer Graphics and Computer-Aided Design

Fingerprint

Dive into the research topics of 'IRay: Mobile AR Using Structure Sensor'. Together they form a unique fingerprint.

Cite this