An empirical study of non-rigid surface feature matching of human from 3D video
Date
2010
Authors
Doshi, A.
Starck, J.
Hilton, A.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Journal article
Citation
Journal of Virtual Reality and Broadcasting, 2010; 7(3):1-20
Statement of Responsibility
Conference Name
Abstract
This paper presents an empirical study of affine invariantfeature detectors to perform matching on video sequencesof people with non-rigid surface deformation.Recent advances in feature detection and wide baselinematching have focused on static scenes. Videoframes of human movement capture highly non-rigiddeformation such as loose hair, cloth creases, skinstretching and free flowing clothing. This study evaluatesthe performance of six widely used feature detectorsfor sparse temporal correspondence on singleview and multiple view video sequences. Quantitativeevaluation is performed of both the number of featuresdetected and their temporal matching against andwithout ground truth correspondence. Recall-accuracyanalysis of feature matching is reported for temporalcorrespondence on single view and multiple view sequencesof people with variation in clothing and movement.This analysis identifies that existing feature detectionand matching algorithms are unreliable for fast movement with common clothing.