Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Conference paper
Title: Indices matter: Learning to index for deep image matting
Author: Lu, H.
Dai, Y.
Shen, C.
Xu, S.
Citation: Proceedings / IEEE International Conference on Computer Vision. IEEE International Conference on Computer Vision, 2019, vol.2019-October, pp.3265-3274
Publisher: IEEE
Issue Date: 2019
Series/Report no.: IEEE International Conference on Computer Vision
ISBN: 9781728148038
ISSN: 1550-5499
Conference Name: IEEE/CVF International Conference on Computer Vision (ICCV) (27 Oct 2019 - 2 Nov 2019 : Seoul, South Korea)
Statement of
Hao Lu, Yutong Dai, Chunhua Shen, Songcen Xu
Abstract: We show that existing upsampling operators can be unified using the notion of the index function. This notion is inspired by an observation in the decoding process of deep image matting where indices-guided unpooling can often recover boundary details considerably better than other upsampling operators such as bilinear interpolation. By viewing the indices as a function of the feature map, we introduce the concept of ‘learning to index’, and present a novel index-guided encoder-decoder framework where indices are self-learned adaptively from data and are used to guide the pooling and upsampling operators, without extra training supervision. At the core of this framework is a flexible network module, termed IndexNet, which dynamically generates indices conditioned on the feature map. Due to its flexibility, IndexNet can be used as a plug-in applying to almost all off-the-shelf convolutional networks that have coupled downsampling and upsampling stages. We demonstrate the effectiveness of IndexNet on the task of natural image matting where the quality of learned indices can be visually observed from predicted alpha mattes. Results on the Composition-1k matting dataset show that our model built on MobileNetv2 exhibits at least 16:1% improvement over the seminal VGG-16 based deep matting baseline, with less training data and lower model capacity. Code and models have been made available at:
Keywords: Indexes; Interpolation; Task analysis; Decoding; Semantics; Image resolution; Deconvolution
Rights: © 2019 IEEE
DOI: 10.1109/ICCV.2019.00336
Appears in Collections:Aurora harvest 8
Computer Science publications

Files in This Item:
File Description SizeFormat 
hdl_126124.pdfAccepted version3.16 MBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.