Learning a hybrid similarity measure for image retrieval

Files

RA_hdl_79474.pdf (9.83 MB)
  (Restricted Access)

Date

2013

Authors

Wu, J.
Shen, H.
Li, Y.
Xiao, Z.
Lu, M.
Wang, C.

Editors

Advisors

Journal Title

Journal ISSN

Volume Title

Type:

Journal article

Citation

Pattern Recognition, 2013; 46(11):2927-2939

Statement of Responsibility

Jun Wu, Hong Shen, Yi-Dong Li, Zhi-Bo Xiao, Ming-Yu Lu and Chun-Li Wang

Conference Name

Abstract

Learning similarity measure from relevance feedback has become a promising way to enhance the image retrieval performance. Existing approaches mainly focus on taking short-term learning experience to identify a visual similarity measure within a single query session, or applying long-term learning methodology to infer a semantic similarity measure crossing multiple query sessions. However, there is still a big room to elevate the retrieval effectiveness, because little is known in taking the relationship between visual similarity and semantic similarity into account. In this paper, we propose a novel hybrid similarity learning scheme to preserve both visual and semantic resemblance by integrating short-term with long-term learning processes. Concretely, the proposed scheme first learns a semantic similarity from the users' query log, and then, taking this as prior knowledge, learns a visual similarity from a mixture of labeled and unlabeled images. In particular, unlabeled images are exploited for the relevant and irrelevant classes differently and the visual similarity is learned incrementally. Finally, a hybrid similarity measure is produced by fusing the visual and semantic similarities in a nonlinear way for image ranking. An empirical study shows that using hybrid similarity measure for image retrieval is beneficial, and the proposed algorithm achieves better performance than some existing approaches. © 2013 Elsevier Ltd.

School/Discipline

Dissertation Note

Provenance

Description

Access Status

Rights

© 2013 Elsevier Ltd. All rights reserved.

License

Grant ID

Call number

Persistent link to this record