Please use this identifier to cite or link to this item: https://hdl.handle.net/2440/109133
Citations
Scopus Web of Science® Altmetric
?
?
Type: Journal article
Title: Web video event recognition by semantic analysis from ubiquitous documents
Author: Yu, L.
Yang, Y.
Huang, Z.
Wang, P.
Song, J.
Shen, H.
Citation: IEEE Transactions on Image Processing, 2016; 25(12):5689-5701
Publisher: IEEE
Issue Date: 2016
ISSN: 1057-7149
1941-0042
Statement of
Responsibility: 
Litao Yu, Yang Yang, Zi Huang
Abstract: In recent years, the task of event recognition from videos has attracted increasing interest in multimedia area. While most of the existing research was mainly focused on exploring visual cues to handle relatively small-granular events, it is difficult to directly analyze video content without any prior knowledge. Therefore, synthesizing both the visual and semantic analysis is a natural way for video event understanding. In this paper, we study the problem of Web video event recognition, where Web videos often describe large-granular events and carry limited textual information. Key challenges include how to accurately represent event semantics from incomplete textual information and how to effectively explore the correlation between visual and textual cues for video event understanding. We propose a novel framework to perform complex event recognition from Web videos. In order to compensate the insufficient expressive power of visual cues, we construct an event knowledge base by deeply mining semantic information from ubiquitous Web documents. This event knowledge base is capable of describing each event with comprehensive semantics. By utilizing this base, the textual cues for a video can be significantly enriched. Furthermore, we introduce a two-view adaptive regression model, which explores the intrinsic correlation between the visual and textual cues of the videos to learn reliable classifiers. Extensive experiments on two real-world video data sets show the effectiveness of our proposed framework and prove that the event knowledge base indeed helps improve the performance of Web video event recognition.
Keywords: Video event recognition; event knowledge base; two-view adaptive regression
Rights: © 2016 IEEE
DOI: 10.1109/TIP.2016.2614136
Grant ID: http://purl.org/au-research/grants/arc/DP130103252
http://purl.org/au-research/grants/arc/FT120100718
ZYGX2014Z007
ZYGX2015J055
Appears in Collections:Aurora harvest 8
Electrical and Electronic Engineering publications

Files in This Item:
There are no files associated with this item.


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.