Challenges of ground truth evaluation of multi-target tracking
Files
(Restricted Access)
Date
2013
Authors
Milan, A.
Schindler, K.
Roth, S.
Editors
Advisors
Journal Title
Journal ISSN
Volume Title
Type:
Conference paper
Citation
Proceedings, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2013: pp.735-742
Statement of Responsibility
Anton Milan, Konrad Schindler, Stefan Roth
Conference Name
IEEE Conference on Computer Vision and Pattern Recognition Workshops (2013 : Portland, Oregon)
Abstract
Evaluating multi-target tracking based on ground truth data is a surprisingly challenging task. Erroneous or ambiguous ground truth annotations, numerous evaluation protocols, and the lack of standardized benchmarks make a direct quantitative comparison of different tracking approaches rather difficult. The goal of this paper is to raise awareness of common pitfalls related to objective ground truth evaluation. We investigate the influence of different annotations, evaluation software, and training procedures using several publicly available resources, and point out the limitations of current definitions of evaluation metrics. Finally, we argue that the development an extensive standardized benchmark for multi-target tracking is an essential step toward more objective comparison of tracking approaches.
School/Discipline
Dissertation Note
Provenance
Description
Access Status
Rights
© 2013 IEEE