Interaction with large ubiquitous displays using camera-equipped mobile phones

Date

2010

Authors

Jeon, S.
Hwang, J.
Kim, G.J.
Billinghurst, M.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Journal article

Citation

Personal and Ubiquitous Computing, 2010; 14(2):83-94

Statement of Responsibility

Conference Name

Abstract

In the ubiquitous computing environment, people will interact with everyday objects (or computers embedded in them) in ways different from the usual and familiar desktop user interface. One such typical situation is interacting with applications through large displays such as televisions, mirror displays, and public kiosks. With these applications, the use of the usual keyboard and mouse input is not usually viable (for practical reasons). In this setting, the mobile phone has emerged as an excellent device for nove interaction. This article introduces user interaction techniques using a camera-equipped hand-held device such as a mobile phone or a PDA for large shared displays. In particular, we consider two specific but typical situations (1) sharing the display from a distance and (2) interacting with a touch screen display at a close distance. Using two basic computer vision techniques, motion flow and marker recognition, we show how a camera-equipped hand-held device can effectively be used to replace a mouse and share, select, and manipulate 2D and 3D objects, and navigate within the environment presented through the large display.

School/Discipline

Dissertation Note

Provenance

Description

Link to a related website: https://ir.canterbury.ac.nz/bitstream/10092/5331/1/12627396_Billinghurst.pdf, Open Access via Unpaywall

Access Status

Rights

Copyright 2009 Springer-Verlag

License

Grant ID

Call number

Persistent link to this record