Poster: physically-based natural hand and tangible AR interaction for face-to-face collaboration on a tabletop

Date

2012

Authors

Piumsomboon, T.
Clark, A.
Umakatsu, A.
Billinghurst, M.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Conference item

Citation

IEEE Symposium on 3D User Interfaces, 2012, pp.155-156

Statement of Responsibility

Conference Name

2012 IEEE Symposium on 3D User Interfaces (3DUI) (4 Mar 2012 - 5 Mar 2012 : Costa Mesa, United States)

Abstract

In this paper, we present an AR framework that allows natural hand and tangible AR interaction for physically-based interaction and environment awareness to support face-to-face collaboration using Microsoft Kinect. Our framework comprises of six major components: (1) marker tracking (2) depth acquisition (3) image processing (4) physics simulation (5) communication and (6) rendering. The resulting augmented environment supports occlusion, shadows, and physically-based interaction of real and virtual objects. We propose three methods of natural hand representations including mesh-based, direct sphere substitution and variational optical flow. A tabletop racing game and AR Sandbox applications are created based on this framework, showing the application possibilities.

School/Discipline

Dissertation Note

Provenance

Description

Link to a related website: https://ir.canterbury.ac.nz/bitstream/10092/8669/1/12640001_Poster_%20Physically-based%20Natural%20Hand%20and%20Tangible%20AR%20Interaction.pdf, Open Access via Unpaywall

Access Status

Rights

Copyright 2012 IEEE

License

Grant ID

Call number

Persistent link to this record