3D natural hand interaction for AR applications

Date

2008

Authors

Lee, M.
Green, R.
Billinghurst, M.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Conference paper

Citation

Proceedings of the 23rd International Conference Image and Vision Computing New Zealand, 2008, pp.1-6

Statement of Responsibility

Conference Name

23rd International Conference Image and Vision Computing New Zealand (IVCNZ) (26 Nov 2008 - 28 Nov 2008 : Christchurch, New Zealand)

Abstract

In this paper we describe a computer vision-based 3D hand tracking system for a multimodal augmented reality (AR) interface. We have developed a 3D vision-based natural hand interaction method. This consists of four steps: (1) skin colour segmentation, (2) feature point finding, (3) hand direction calculation, and (4) simple collision detection based on a short finger ray for interaction between the userpsilas hand and augmented objects. The resulting fingertip tracking accuracy varied from 3 mm to 20 mm depending on the distance between the userpsilas hand and the stereo camera. We describe how this hand tracking is applied in three AR applications which merge gesture and speech input.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

Copyright 2008 IEEE

License

Grant ID

Call number

Persistent link to this record