Usability of cross-device interaction interfaces for augmented reality in physical tasks

Date

2024

Authors

Zhang, X.
He, W.
Billinghurst, M.
Liu, D.
Yang, L.
Feng, S.
Liu, Y.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Journal article

Citation

International Journal of Human-Computer Interaction, 2024; 40(9):2361-2379

Statement of Responsibility

Conference Name

Abstract

The shortcomings of established input methods for Augmented Reality (AR) head-mounted displays (HMDs) motivate us to investigate the use of AR HMDs with smartphones and smartwatches to improve AR interaction in physical tasks. However, it is unclear whether the cross-device interaction interfaces are efficient for AR systems on physical tasks because the physical tasks can break the interaction flow. In this work, we conducted a user study to explore this. The user study consists of three subtasks, respectively requiring one of the three representative user interface (UI) controls (buttons, sliders, or text input). We implemented them with mid-air gestures, a smartphone, and a smartwatch. We compared the three interfaces and found that the smartphone and the smartwatch interaction interfaces have greater usability, provide a better user experience, and have lower workloads than the mid-air gesture interface. However, there is no significant difference in terms of efficiency for simple interactions. We discuss the limitations of this research and directions for future work.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

Copyright 2022 Taylor & Francis Group, LLC

License

Grant ID

Call number

Persistent link to this record