Please use this identifier to cite or link to this item:
https://hdl.handle.net/2440/121689
Citations | ||
Scopus | Web of Science® | Altmetric |
---|---|---|
?
|
?
|
Type: | Journal article |
Title: | Order-aware convolutional pooling for video based action recognition |
Author: | Wang, P. Liu, L. Shen, C. Shen, H.T. |
Citation: | Pattern Recognition, 2019; 91:357-365 |
Publisher: | Elsevier |
Issue Date: | 2019 |
ISSN: | 0031-3203 1873-5142 |
Statement of Responsibility: | Peng Wang, Lingqiao Liu, Chunhua Shen, Heng Tao Shen |
Abstract: | Most video based action recognition approaches create the video-level representation by temporally pooling the features extracted at every frame. The pooling methods they adopt, however, usually completely or partially ignore the dynamic information contained in the temporal domain, which may undermine the discriminative power of the resulting video representation since the video sequence order could unveil the evolution of a specific event or action. To overcome this drawback and explore the importance of incorporating the temporal order information, in this paper we propose a novel temporal pooling approach to aggregate the frame-level features. Inspired by the capacity of Convolutional Neural Networks (CNN) in making use of the internal structure of images for information abstraction, we propose to apply the temporal convolution operation to the frame-level representations to extract the dynamic information. However, directly implementing this idea on the original high-dimensional feature will result in parameter explosion. To handle this issue, we propose to treat the temporal evolution of the feature value at each feature dimension as a 1D signal and learn a unique convolutional filter bank for each 1D signal. By conducting experiments on three challenging video-based action recognition datasets, HMDB51, UCF101, and Hollywood2, we demonstrate that the proposed method is superior to the conventional pooling methods. |
Keywords: | Action recognition; convolutional neural network; temporal pooling |
Rights: | © 2019 Elsevier Ltd. All rights reserved. |
DOI: | 10.1016/j.patcog.2019.03.002 |
Published version: | http://dx.doi.org/10.1016/j.patcog.2019.03.002 |
Appears in Collections: | Aurora harvest 8 Computer Science publications |
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.