Evaluating implicit judgments from image search clickthrough data

Simple item page
dc.contributor.authorSmith, G.
dc.contributor.authorBrien, C.
dc.contributor.authorAshman, H.
dc.date.issued2012
dc.description.abstractThe interactions of users with search engines can be seen as implicit relevance feedback by the user on the results offered to them. In particular, the selection of results by users can be interpreted as a confirmation of the relevance of those results, and used to reorder or prioritize subsequent search results. This collection of search/result pairings is called clickthrough data, and many uses for it have been proposed. However, the reliability of clickthrough data has been challenged and it has been suggested that clickthrough data are not a completely accurate measure of relevance between search term and results. This paper reports on an experiment evaluating the reliability of clickthrough data as a measure of the mutual relevance of search term and result. The experiment comprised a user study involving over 67 participants and determines the reliability of image search clickthrough data, using factors identified in previous similar studies. A major difference in this work to previous work is that the source of clickthrough data comes from image searches, rather than the traditional text page searches. Image search clickthrough data were rarely examined in prior works but has differences that impact the accuracy of clickthrough data. These differences include a more complete representation of the results in image search, allowing users to scrutinize the results more closely before selecting them, as well as presenting the results in a less obviously ordered way. The experiment reported here demonstrates that image clickthrough data can be more reliable as a relevance feedback measure than has been the case with traditional text-based search. There is also evidence that the precision of the search system influences the accuracy of click data when users make searches in an information-seeking capacity.
dc.description.statementofresponsibilityGavin Smith, Chris Brien, Helen Ashman
dc.identifier.citationJournal of the Association for Information Science and Technology, 2012; 63(12):2451-2462
dc.identifier.doi10.1002/asi.22742
dc.identifier.issn1532-2882
dc.identifier.issn1532-2890
dc.identifier.orcidBrien, C. [0000-0003-0581-1817]
dc.identifier.urihttp://hdl.handle.net/2440/108291
dc.language.isoen
dc.publisherWiley Online Library
dc.rights© 2012 ASIS&T
dc.source.urihttps://doi.org/10.1002/asi.22742
dc.subjectRelevance; web mining
dc.titleEvaluating implicit judgments from image search clickthrough data
dc.typeJournal article
pubs.publication-statusPublished

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
RA_hdl_108291.pdf
Size:
447.06 KB
Format:
Adobe Portable Document Format
Description:
Restricted Access
Download

Collections

Computer Science publications