A gesture- and head-based multimodal interaction platform for MR remote collaboration
Date
2019
Authors
Wang, P.
Zhang, S.
Bai, X.
Billinghurst, M.
Zhang, L.
Wang, S.
Han, D.
Lv, H.
Yan, Y.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
The International Journal of Advanced Manufacturing Technology, 2019; 105(7-8):3031-3043
Statement of Responsibility
Conference Name
Abstract
In this paper, we present a projector-based mixed reality (MR) remote collaborative system which enables remote users to collaboratively work on a physical task using gesture and head pointing (GHP). Using this platform, we studied the effects of GHP in a typical manufacturing use case. Our system supports natural and intuitive multimodal interaction based on GHP, and it can project the remote user's GHP into the local environment to enhance remote collaboration. Our prototype system was compared with an augmented reality (AR) condition (ANNOTATION), which is the most popular method currently for AR/MR remote collaboration. We found a significant difference between the ANNOTATION and GHP conditions in terms of performance. The GHP system significantly improved the collaborative experience (e.g., awareness of the user's attention),empathy (e.g., co-presence), and remote interaction. Moreover, we discuss the implications of this research and directions for future research.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2019 Springer-Verlag