Open Access

Image-Based 3D Face Modeling System

EURASIP Journal on Advances in Signal Processing20052005:271406

https://doi.org/10.1155/ASP.2005.2072

Received: 31 December 2003

Published: 15 August 2005

Abstract

This paper describes an automatic system for 3D face modeling using frontal and profile images taken by an ordinary digital camera. The system consists of four subsystems including frontal feature detection, profile feature detection, shape deformation, and texture generation modules. The frontal and profile feature detection modules automatically extract the facial parts such as the eye, nose, mouth, and ear. The shape deformation module utilizes the detected features to deform the generic head mesh model such that the deformed model coincides with the detected features. A texture is created by combining the facial textures augmented from the input images and the synthesized texture and mapped onto the deformed generic head model. This paper provides a practical system for 3D face modeling, which is highly automated by aggregating, customizing, and optimizing a bunch of individual computer vision algorithms. The experimental results show a highly automated process of modeling, which is sufficiently robust to various imaging conditions. The whole model creation including all the optional manual corrections takes only 2 3 minutes.

Keywords and phrases

3D face modeling image-based system facial feature detection generic head model shape deformation synthesized texture

Authors’ Affiliations

(1)
School of Information and Communication Engineering, Inha University
(2)
Computing Lab, Samsung Advanced Institute of Technology
(3)
Graphics and Media Lab, Department of Computational Mathematics and Cybernetics, Moscow State University

Copyright

© Park et al. 2005