Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: Cross-convolutional-layer pooling for image recognition
Author: Liu, L.
Shen, C.
van den Hengel, A.
Citation: IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016; 39(11):2305-2313
Publisher: IEEE
Issue Date: 2016
ISSN: 0162-8828
Statement of
Lingqiao Liu, Chunhua Shen, Anton van den Hengel
Abstract: Recent studies have shown that a Deep Convolutional Neural Network (DCNN) trained on a large image dataset can be used as a universal image descriptor and that doing so leads to impressive performance for a variety of image recognition tasks. Most of these studies adopt activations from a single DCNN layer, usually the fully-connected layer, as the image representation. In this paper, we proposed a novel way to extract image representations from two consecutive convolutional layers: one layer is utilized for local feature extraction and the other serves as guidance to pool the extracted features. By taking different viewpoints of convolutional layers, we further develop two schemes to realize this idea. The first one directly uses convolutional layers from a DCNN. The second one applies the pre-trained CNN on densely sampled image regions and treats the fully-connected activations of each image region as convolutional layer feature activations. We then train another convolutional layer on top of that as the pooling-guidance convolutional layer. By applying our method to three popular visual classification tasks, we find our first scheme tends to perform better on the applications which need strong discrimination on lower-level visual patterns while the latter excels in the cases that require discrimination on category-level patterns. Overall, the proposed method achieves superior performance over existing ways of extracting image representations from a DCNN. In addition, we also apply cross-layer pooling for image retrieval and propose schemes to reduce the computational cost. The experimental result suggests that the proposed method can also lead to promising results for the image retrieval task.
Keywords: Convolutional networks; deep learning; pooling; fine-grained object recognition
Rights: © 2016 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See for more information.
DOI: 10.1109/TPAMI.2016.2637921
Grant ID:
Appears in Collections:Aurora harvest 3
Computer Science publications

Files in This Item:
File Description SizeFormat 
RA_hdl_104884.pdfRestricted Access476.72 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.