Simultaneous monocular 2D segmentation, 3D pose recovery and 3D reconstruction

Simple item page
dc.contributor.authorPrisacariu, V.
dc.contributor.authorSegal, A.
dc.contributor.authorReid, I.
dc.contributor.conferenceComputer Vision (2012 : Daejeon, Korea)
dc.contributor.editorLee, K.
dc.contributor.editorMatsushita, Y.
dc.contributor.editorRehg, J.
dc.contributor.editorHu, Z.
dc.date.issued2013
dc.description.abstractWe propose a novel framework for joint 2D segmentation and 3D pose and 3D shape recovery, for images coming from a single monocular source. In the past, integration of all three has proven difficult, largely because of the high degree of ambiguity in the 2D - 3D mapping. Our solution is to learn nonlinear and probabilistic low dimensional latent spaces, using the Gaussian Process Latent Variable Models dimensionality reduction technique. These act as class or activity constraints to a simultaneous and variational segmentation – recovery – reconstruction process. We define an image and level set based energy function, which we minimise with respect to 3D pose and shape, 2D segmentation resulting automatically as the projection of the recovered shape under the recovered pose. We represent 3D shapes as zero levels of 3D level set embedding functions, which we project down directly to probabilistic 2D occupancy maps, without the requirement of an intermediary explicit contour stage. Finally, we detail a fast, open-source, GPU-based implementation of our algorithm, which we use to produce results on both real and artificial video sequences.
dc.description.statementofresponsibilityVictor Adrian Prisacariu, Aleksandr V. Segal, and Ian Reid
dc.identifier.citation11th Asian Conference on Computer Vision, Daejeon, Korea, November 5-9, 2012 / K. M. Lee, Y. Matsushita, J. M. Rehg, Z. Hu (eds.):593-606
dc.identifier.doi10.1007/978-3-642-37331-2_45
dc.identifier.isbn9783642373305
dc.identifier.issn0302-9743
dc.identifier.issn1611-3349
dc.identifier.orcidReid, I. [0000-0001-7790-6423]
dc.identifier.urihttp://hdl.handle.net/2440/80268
dc.language.isoen
dc.publisherSpringer-Verlag
dc.publisher.placeBerlin Heidelberg
dc.rights© Springer-Verlag Berlin Heidelberg 2013
dc.source.urihttps://doi.org/10.1007/978-3-642-37331-2_45
dc.titleSimultaneous monocular 2D segmentation, 3D pose recovery and 3D reconstruction
dc.typeConference paper
pubs.publication-statusPublished

Files

Collections

Computer Science publications