HCVRD: A benchmark for large-scale human-centered visual relationship detection

Date

2018

Authors

Zhuang, B.
Wu, Q.
Shen, C.
Reid, I.
Van Den Hengel, A.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Conference paper

Citation

Proceedings of the ... AAAI Conference on Artificial Intelligence. AAAI Conference on Artificial Intelligence, 2018, pp.7631-7638

Statement of Responsibility

Bohan Zhuang, Qi Wu, Chunhua Shen, Ian Reid, Anton van den Hengel

Conference Name

AAAI Conference on Artificial Intelligence (AAAI) (2 Feb 2018 - 7 Feb 2018 : New Orleans)

Abstract

Visual relationship detection aims to capture interactions between pairs of objects in images. Relationships between objects and humans represent a particularly important subset of this problem, with implications for challenges such as understanding human behavior, and identifying affordances, amongst others. In addressing this problem we first construct a large-scale human-centric visual relationship detection dataset (HCVRD), which provides many more types of relationship annotations (nearly 10K categories) than the previous released datasets. This large label space better reflects the reality of human-object interactions, but gives rise to a long-tail distribution problem, which in turn demands a zero-shot approach to labels appearing only in the test set. This is the first time this issue has been addressed. We propose a webly-supervised approach to these problems and demonstrate that the proposed model provides a strong baseline on our HCVRD dataset.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

Copyright © 2018, Association for the Advancement of Artificial Intelligence (www.aaai.org). All rights reserved.

License

Grant ID

Published Version

Call number

Persistent link to this record