Weakly-supervised structured output learning with flexible and latent graphs using high-order loss functions

dc.contributor.authorCarneiro, G.
dc.contributor.authorPeng, T.
dc.contributor.authorBayer, C.
dc.contributor.authorNavab, N.
dc.contributor.conference2015 IEEE International Conference on Computer Vision (ICCV 2015) (11 Dec 2015 - 18 Dec 2015 : Santiago, CHILE)
dc.date.issued2015
dc.description.abstractWe introduce two new structured output models that use a latent graph, which is flexible in terms of the number of nodes and structure, where the training process minimises a high-order loss function using a weakly annotated training set. These models are developed in the context of microscopy imaging of malignant tumours, where the estimation of the number and proportion of classes of microcirculatory supply units (MCSU) is important in the assessment of the efficacy of common cancer treatments (an MCSU is a region of the tumour tissue supplied by a microvessel). The proposed methodologies take as input multimodal microscopy images of a tumour, and estimate the number and proportion of MCSU classes. This estimation is facilitated by the use of an underlying latent graph (not present in the manual annotations), where each MCSU is represented by a node in this graph, labelled with the MCSU class and image location. The training process uses the manual weak annotations available, consisting of the number of MCSU classes per training image, where the training objective is the minimisation of a high-order loss function based on the norm of the error between the manual and estimated annotations. One of the models proposed is based on a new flexible latent structure support vector machine (FLSSVM) and the other is based on a deep convolutional neural network (DCNN) model. Using a dataset of 89 weakly annotated pairs of multimodal images from eight tumours, we show that the quantitative results from DCNN are superior, but the qualitative results from FLSSVM are better and both display high correlation values regarding the number and proportion of MCSU classes compared to the manual annotations.
dc.description.statementofresponsibilityGustavo Carneiro, Tingying Peng, Christine Bayer, Nassir Navab
dc.identifier.citationProceedings / IEEE International Conference on Computer Vision. IEEE International Conference on Computer Vision, 2015, vol.2015 International Conference on Computer Vision, ICCV 2015, pp.648-656
dc.identifier.doi10.1109/ICCV.2015.81
dc.identifier.isbn9781467383912
dc.identifier.issn1550-5499
dc.identifier.orcidCarneiro, G. [0000-0002-5571-6220]
dc.identifier.urihttp://hdl.handle.net/2440/107543
dc.language.isoen
dc.publisherIEEE
dc.relation.granthttp://purl.org/au-research/grants/arc/DP140102794
dc.relation.ispartofseriesIEEE International Conference on Computer Vision
dc.rights© 2015 IEEE
dc.source.urihttp://dx.doi.org/10.1109/iccv.2015.81
dc.subjectTumors, training, manuals, cancer, support vector machines, microscopy, computer vision
dc.titleWeakly-supervised structured output learning with flexible and latent graphs using high-order loss functions
dc.typeConference paper
pubs.publication-statusPublished

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
RA_hdl_107543.pdf
Size:
1.89 MB
Format:
Adobe Portable Document Format
Description:
Restricted Access