Please use this identifier to cite or link to this item:
Scopus Web of Science® Altmetric
Type: Conference paper
Title: 3-D Modeling from Concept Sketches of Human Characters with Minimal User Interaction
Author: Johnston, A.
Carneiro, G.
Ding, R.
Velho, L.
Citation: Proceedings of 2015 International Conference on Digital Image Computing: Techniques and Applications, 2015, pp.1-8
Publisher: IEEE
Issue Date: 2015
ISBN: 9781467367950
Conference Name: 2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2015) (23 Nov 2015 - 25 Nov 2015 : Adelaide, AUSTRALIA)
Statement of
Adrian Johnston, Gustavo Carneiro, Ren Ding, Luiz Velho
Abstract: We propose a new methodology for creating 3-D models for computer graphics applications from 2-D concept sketches of human characters using minimal user interaction. This methodology will facilitate the fast production of high quality 3-D models by non-expert users involved in the development process of video games and movies. The workflow starts with an image containing the sketch of the human character from a single viewpoint, in which a 2-D body pose detector is run to infer the positions of the skeleton joints of the character. Then the 3-D body pose and camera motion are estimated from the 2-D body pose detected from above, where we take a recently proposed methodology that works with real humans and adapt it to work with concept sketches of human characters. The final step of our methodology consists of an optimization process based on a sampling importance re-sampling method that takes as input the estimated 3-D body pose and camera motion and builds a 3-D mesh of the body shape, which is then matched to the concept sketch image. Our main contributions are: 1) a novel adaptation of the 3-D from 2-D body pose estimation methods to work with sketches of humans that have non-standard body part proportions and constrained camera motion; and 2) a new optimization (that estimates a 3-D body mesh using an underlying low-dimensional linear model of human shape) guided by the quality of the matching between the 3-D mesh of the body shape and the concept sketch. We show qualitative results based on seven 3-D models inferred from 2-D concept sketches, and also quantitative results, where we take seven different 3-D meshes to generate concept sketches, and use our method to infer the 3-D model from these sketches, which allows us to measure the average Euclidean distance between the original and estimated 3-D models. Both qualitative and quantitative results show that our model has potential in the fast production of 3-D models from concept sketches.
Keywords: Solid modeling, cameras, shape, optimization, production, estimation, three-dimensional displays
Rights: © 2015 IEEE
DOI: 10.1109/DICTA.2015.7371212
Appears in Collections:Aurora harvest 3
Computer Science publications

Files in This Item:
File Description SizeFormat 
  Restricted Access
Restricted Access915.9 kBAdobe PDFView/Open

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.