Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Journal article
Title: Discriminative training of deep fully connected continuous CRFs with task-specific loss
Author: Liu, F.
Lin, G.
Shen, C.
Citation: IEEE Transactions on Image Processing, 2017; 26(5):2127-2136
Publisher: IEEE
Issue Date: 2017
ISSN: 1057-7149
Statement of
Fayao Liu, Guosheng Lin, and Chunhua Shen
Abstract: Recent works on deep conditional random fields (CRFs) have set new records on many vision tasks involving structured predictions. Here, we propose a fully connected deep continuous CRF model with task-specific losses for both discrete and continuous labeling problems. We exemplify the usefulness of the proposed model on multi-class semantic labeling (discrete) and the robust depth estimation (continuous) problems. In our framework, we model both the unary and the pairwise potential functions as deep convolutional neural networks (CNNs), which are jointly learned in an end-to-end fashion. The proposed method possesses the main advantage of continuously valued CRFs, which is a closed-form solution for the maximum a posteriori (MAP) inference. To better take into account the quality of the predicted estimates during the cause of learning, instead of using the commonly employed maximum likelihood CRF parameter learning protocol, we propose task-specific loss functions for learning the CRF parameters. It enables direct optimization of the quality of the MAP estimates during the learning process. Specifically, we optimize the multi-class classification loss for the semantic labeling task and the Tukey's biweight loss for the robust depth estimation problem. Experimental results on the semantic labeling and robust depth estimation tasks demonstrate that the proposed method compare favorably against both baseline and state-of-the-art methods. In particular, we show that although the proposed deep CRF model is continuously valued, with the equipment of task-specific loss, it achieves impressive results even on discrete labeling tasks.
Keywords: Continuous conditional random field (CRFs); deep convolutional neural networks (CNN); depth estimation; semantic labelling
Rights: © 2017 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission. See for more information.
RMID: 0030069992
DOI: 10.1109/TIP.2017.2675166
Appears in Collections:Computer Science publications

Files in This Item:
There are no files associated with this item.

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.