Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Full metadata record
DC FieldValueLanguage
dc.contributor.authorGarg, R.-
dc.contributor.authorRoussos, A.-
dc.contributor.authorAgapito, L.-
dc.identifier.citationInternational Journal of Computer Vision, 2013; 104(3):286-314-
dc.description.abstractThis paper addresses the problem of non-rigid video registration, or the computation of optical flow from a reference frame to each of the subsequent images in a sequence, when the camera views deformable objects. We exploit the high correlation between 2D trajectories of different points on the same non-rigid surface by assuming that the displacement of any point throughout the sequence can be expressed in a compact way as a linear combination of a low-rank motion basis. This subspace constraint effectively acts as a trajectory regularization term leading to temporally consistent optical flow. We formulate it as a robust soft constraint within a variational framework by penalizing flow fields that lie outside the low-rank manifold. The resulting energy functional can be decoupled into the optimization of the brightness constancy and spatial regularization terms, leading to an efficient optimization scheme. Additionally, we propose a novel optimization scheme for the case of vector valued images, based on the dualization of the data term. This allows us to extend our approach to deal with colour images which results in significant improvements on the registration results. Finally, we provide a new benchmark dataset, based on motion capture data of a flag waving in the wind, with dense ground truth optical flow for evaluation of multi-frame optical flow algorithms for non-rigid surfaces. Our experiments show that our proposed approach outperforms state of the art optical flow and dense non-rigid registration algorithms.-
dc.description.statementofresponsibilityRavi Garg, Anastasios Roussos, Lourdes Agapito-
dc.publisherSpringer US-
dc.rights© The Author(s) 2013-
dc.titleA variational approach to video registration with subspace constraints-
dc.typeJournal article-
Appears in Collections:Aurora harvest 2
Electrical and Electronic Engineering publications

Files in This Item:
File Description SizeFormat 
hdl_87054.pdfPublished version2.77 MBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.