3-D Modeling from Concept Sketches of Human Characters with Minimal User Interaction

Simple item page
dc.contributor.authorJohnston, A.
dc.contributor.authorCarneiro, G.
dc.contributor.authorDing, R.
dc.contributor.authorVelho, L.
dc.contributor.conference2015 International Conference on Digital Image Computing: Techniques and Applications (DICTA 2015) (23 Nov 2015 - 25 Nov 2015 : Adelaide, AUSTRALIA)
dc.date.issued2015
dc.description.abstractWe propose a new methodology for creating 3-D models for computer graphics applications from 2-D concept sketches of human characters using minimal user interaction. This methodology will facilitate the fast production of high quality 3-D models by non-expert users involved in the development process of video games and movies. The workflow starts with an image containing the sketch of the human character from a single viewpoint, in which a 2-D body pose detector is run to infer the positions of the skeleton joints of the character. Then the 3-D body pose and camera motion are estimated from the 2-D body pose detected from above, where we take a recently proposed methodology that works with real humans and adapt it to work with concept sketches of human characters. The final step of our methodology consists of an optimization process based on a sampling importance re-sampling method that takes as input the estimated 3-D body pose and camera motion and builds a 3-D mesh of the body shape, which is then matched to the concept sketch image. Our main contributions are: 1) a novel adaptation of the 3-D from 2-D body pose estimation methods to work with sketches of humans that have non-standard body part proportions and constrained camera motion; and 2) a new optimization (that estimates a 3-D body mesh using an underlying low-dimensional linear model of human shape) guided by the quality of the matching between the 3-D mesh of the body shape and the concept sketch. We show qualitative results based on seven 3-D models inferred from 2-D concept sketches, and also quantitative results, where we take seven different 3-D meshes to generate concept sketches, and use our method to infer the 3-D model from these sketches, which allows us to measure the average Euclidean distance between the original and estimated 3-D models. Both qualitative and quantitative results show that our model has potential in the fast production of 3-D models from concept sketches.
dc.description.statementofresponsibilityAdrian Johnston, Gustavo Carneiro, Ren Ding, Luiz Velho
dc.identifier.citationProceedings of 2015 International Conference on Digital Image Computing: Techniques and Applications, 2015, pp.1-8
dc.identifier.doi10.1109/DICTA.2015.7371212
dc.identifier.isbn9781467367950
dc.identifier.orcidCarneiro, G. [0000-0002-5571-6220]
dc.identifier.urihttp://hdl.handle.net/2440/107542
dc.language.isoen
dc.publisherIEEE
dc.rights© 2015 IEEE
dc.source.urihttps://doi.org/10.1109/dicta.2015.7371212
dc.subjectSolid modeling, cameras, shape, optimization, production, estimation, three-dimensional displays
dc.title3-D Modeling from Concept Sketches of Human Characters with Minimal User Interaction
dc.typeConference paper
pubs.publication-statusPublished

Files

Original bundle
Now showing 1 - 1 of 1
No Thumbnail Available
Name:
RA_hdl_107542.pdf
Size:
915.9 KB
Format:
Adobe Portable Document Format
Description:
Restricted Access
Download

Collections

Computer Science publications