The combination of visual communication cues in mixed reality remote collaboration
Date
2020
Authors
Kim, S.
Lee, G.
Billinghurst, M.
Huang, W.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
Journal on Multimodal User Interfaces, 2020; 14(4):321-335
Statement of Responsibility
Conference Name
Abstract
Many researchers have studied various visual communication cues (e.g. pointer, sketch, and hand gesture) in Mixed Reality remote collaboration systems for real-world tasks. However, the effect of combining them has not been so well explored. We studied the effect of these cues in four combinations: hand only, hand + pointer, hand + sketch, and hand + pointer + sketch, within the two user studies when a dependent view and independent view are supported respectively. In the first user study with the dependent view, the results showed that the hand gesture cue was the main visual communication cue and adding sketch cue to the hand gesture cue helped participants complete the task faster. In the second study with the independent view, the results showed that the hand gesture had an issue of local worker understanding remote expert’s hand gesture cue and the main visual communication cue was the pointer cue with fast completion time and high level of co-presence.
School/Discipline
Dissertation Note
Provenance
Description
Link to a related website: https://opus.lib.uts.edu.au/bitstream/10453/144637/2/jmui%202020.pdf, Open Access via Unpaywall
Access Status
Rights
Copyright 2020 Springer