Semi-automatic initial registration for the Iray system: A user study

Tian Xie; Mohammad M. Islam; Alan B. Lumsden; Ioannis A. Kakadiaris

doi:10.1007/978-3-319-60928-7_3

Semi-automatic initial registration for the Iray system: A user study

Tian Xie, Mohammad M. Islam, Alan B. Lumsden, Ioannis A. Kakadiaris

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Scopus citations

Abstract

Simultaneous localization and mapping based augmented reality (AR) is trending in mobile AR applications. With the help of depth sensors, both accuracy and speed have improved. However, the method that performs the initial registration to align virtual objects with real scenery is not well developed, especially for some applications requiring very accurate registration (e.g., systems used in medical applications). For the iRay system, which is a mobile AR system using the Structure Sensor, we propose to use an iterative closest point algorithm to initially register the scanned mesh with the torso surface obtained pre-operatively, and then use SLAM to track pose. In this paper, a semi-automatic initial registration strategy is evaluated by a user study. This strategy is designed to help the user modify the selection of the 3D scanning area, so that the errors introduced by subjective differences can be reduced. The results indicate that the proposed strategy helps the users improve initial registration quality and reduces the average needed time.

Original language	English (US)
Title of host publication	Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings
Editors	Lucio Tommaso De Paolis, Antonio Mongelli, Patrick Bourdot
Publisher	Springer-Verlag
Pages	33-42
Number of pages	10
ISBN (Print)	9783319609270
DOIs	https://doi.org/10.1007/978-3-319-60928-7_3
State	Published - 2017
Event	4th International Conference on Augmented Reality, Virtual Reality, and Computer Graphics, AVR 2017 - Ugento, Italy Duration: Jun 12 2017 → Jun 15 2017

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	10325 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	4th International Conference on Augmented Reality, Virtual Reality, and Computer Graphics, AVR 2017
Country/Territory	Italy
City	Ugento
Period	6/12/17 → 6/15/17

Keywords

3D registration
Medical AR
Mobile AR
User study

ASJC Scopus subject areas

Theoretical Computer Science
General Computer Science

Access to Document

10.1007/978-3-319-60928-7_3

Cite this

Xie, T., Islam, M. M., Lumsden, A. B., & Kakadiaris, I. A. (2017). Semi-automatic initial registration for the Iray system: A user study. In L. T. De Paolis, A. Mongelli, & P. Bourdot (Eds.), Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings (pp. 33-42). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10325 LNCS). Springer-Verlag. https://doi.org/10.1007/978-3-319-60928-7_3

Semi-automatic initial registration for the Iray system: A user study. / Xie, Tian; Islam, Mohammad M.; Lumsden, Alan B. et al.
Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings. ed. / Lucio Tommaso De Paolis; Antonio Mongelli; Patrick Bourdot. Springer-Verlag, 2017. p. 33-42 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10325 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Xie, T, Islam, MM, Lumsden, AB & Kakadiaris, IA 2017, Semi-automatic initial registration for the Iray system: A user study. in LT De Paolis, A Mongelli & P Bourdot (eds), Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10325 LNCS, Springer-Verlag, pp. 33-42, 4th International Conference on Augmented Reality, Virtual Reality, and Computer Graphics, AVR 2017, Ugento, Italy, 6/12/17. https://doi.org/10.1007/978-3-319-60928-7_3

Xie T, Islam MM, Lumsden AB , Kakadiaris IA. Semi-automatic initial registration for the Iray system: A user study. In De Paolis LT, Mongelli A, Bourdot P, editors, Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings. Springer-Verlag. 2017. p. 33-42. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-319-60928-7_3

Xie, Tian ; Islam, Mohammad M. ; Lumsden, Alan B. et al. / Semi-automatic initial registration for the Iray system : A user study. Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings. editor / Lucio Tommaso De Paolis ; Antonio Mongelli ; Patrick Bourdot. Springer-Verlag, 2017. pp. 33-42 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d73c5c095ba442309f2d46223ce35a12,

title = "Semi-automatic initial registration for the Iray system: A user study",

abstract = "Simultaneous localization and mapping based augmented reality (AR) is trending in mobile AR applications. With the help of depth sensors, both accuracy and speed have improved. However, the method that performs the initial registration to align virtual objects with real scenery is not well developed, especially for some applications requiring very accurate registration (e.g., systems used in medical applications). For the iRay system, which is a mobile AR system using the Structure Sensor, we propose to use an iterative closest point algorithm to initially register the scanned mesh with the torso surface obtained pre-operatively, and then use SLAM to track pose. In this paper, a semi-automatic initial registration strategy is evaluated by a user study. This strategy is designed to help the user modify the selection of the 3D scanning area, so that the errors introduced by subjective differences can be reduced. The results indicate that the proposed strategy helps the users improve initial registration quality and reduces the average needed time.",

keywords = "3D registration, Medical AR, Mobile AR, User study",

author = "Tian Xie and Islam, {Mohammad M.} and Lumsden, {Alan B.} and Kakadiaris, {Ioannis A.}",

note = "Publisher Copyright: {\textcopyright} Springer International Publishing AG 2017.; 4th International Conference on Augmented Reality, Virtual Reality, and Computer Graphics, AVR 2017 ; Conference date: 12-06-2017 Through 15-06-2017",

year = "2017",

doi = "10.1007/978-3-319-60928-7_3",

language = "English (US)",

isbn = "9783319609270",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer-Verlag",

pages = "33--42",

editor = "{De Paolis}, {Lucio Tommaso} and Antonio Mongelli and Patrick Bourdot",

booktitle = "Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings",

}

TY - GEN

T1 - Semi-automatic initial registration for the Iray system

T2 - 4th International Conference on Augmented Reality, Virtual Reality, and Computer Graphics, AVR 2017

AU - Xie, Tian

AU - Islam, Mohammad M.

AU - Lumsden, Alan B.

AU - Kakadiaris, Ioannis A.

N1 - Publisher Copyright: © Springer International Publishing AG 2017.

PY - 2017

Y1 - 2017

N2 - Simultaneous localization and mapping based augmented reality (AR) is trending in mobile AR applications. With the help of depth sensors, both accuracy and speed have improved. However, the method that performs the initial registration to align virtual objects with real scenery is not well developed, especially for some applications requiring very accurate registration (e.g., systems used in medical applications). For the iRay system, which is a mobile AR system using the Structure Sensor, we propose to use an iterative closest point algorithm to initially register the scanned mesh with the torso surface obtained pre-operatively, and then use SLAM to track pose. In this paper, a semi-automatic initial registration strategy is evaluated by a user study. This strategy is designed to help the user modify the selection of the 3D scanning area, so that the errors introduced by subjective differences can be reduced. The results indicate that the proposed strategy helps the users improve initial registration quality and reduces the average needed time.

AB - Simultaneous localization and mapping based augmented reality (AR) is trending in mobile AR applications. With the help of depth sensors, both accuracy and speed have improved. However, the method that performs the initial registration to align virtual objects with real scenery is not well developed, especially for some applications requiring very accurate registration (e.g., systems used in medical applications). For the iRay system, which is a mobile AR system using the Structure Sensor, we propose to use an iterative closest point algorithm to initially register the scanned mesh with the torso surface obtained pre-operatively, and then use SLAM to track pose. In this paper, a semi-automatic initial registration strategy is evaluated by a user study. This strategy is designed to help the user modify the selection of the 3D scanning area, so that the errors introduced by subjective differences can be reduced. The results indicate that the proposed strategy helps the users improve initial registration quality and reduces the average needed time.

KW - 3D registration

KW - Medical AR

KW - Mobile AR

KW - User study

UR - http://www.scopus.com/inward/record.url?scp=85021205328&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85021205328&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-60928-7_3

DO - 10.1007/978-3-319-60928-7_3

M3 - Conference contribution

AN - SCOPUS:85021205328

SN - 9783319609270

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 33

EP - 42

BT - Augmented Reality, Virtual Reality, and Computer Graphics - 4th International Conference, AVR 2017, Proceedings

A2 - De Paolis, Lucio Tommaso

A2 - Mongelli, Antonio

A2 - Bourdot, Patrick

PB - Springer-Verlag

Y2 - 12 June 2017 through 15 June 2017

ER -

Semi-automatic initial registration for the Iray system: A user study

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this