3D in-world telepresence with camera-tracked gestural interaction
Date
2016
Authors
Champion, E.M.
Qiang, L.
Lacet, D.
Dekker, A.
Editors
Catalano, C.E.
Luca, L.
Luca, L.
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Eurographics Workshop on Graphics and Cultural Heritage, GCH 2016, 2016 / Catalano, C.E., Luca, L. (ed./s), pp.119-122
Statement of Responsibility
Conference Name
Eurographics Workshop on Graphics and Cultural Heritage, GCH 2016 (5 Oct 2016 - 7 Oct 2016 : Genova, Italy)
Abstract
While many education institutes use Skype, Google Chat or other commercial video-conferencing applications, these applications are not suitable for presenting architectural or urban design or archaeological information, as they don't integrate the presenter with interactive 3D media. Nor do they allow spatial or component-based interaction controlled by the presenter in a natural and intuitive manner, without needing to sit or stoop over a mouse or keyboard. A third feature that would be very useful is to mirror the presenter's gestures and actions so that the presenter does not have to try to face both audience and screen. To meet these demands we developed a prototype camera-tracking application using a Kinect camera sensor and multi-camera Unity windows for teleconferencing that required the presentation of interactive 3D content along with the speaker (or an avatar that mirrored the gestures of the speaker). Cheaply available commercial software and hardware but coupled with a large display screen (in this case an 8 meter wide curved screen) allows participants to have their gestures, movements and group behavior fed into the virtual environment either directly or indirectly. Allowing speakers to present 3D virtual worlds remotely located audiences while appearing to be inside virtual worlds has immediate practical uses for teaching and long-distance collaboration.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
Copyright 2016 The Author(s)