Skip to main content
  • Research Article
  • Open access
  • Published:

A Novel Face Segmentation Algorithm from a Video Sequence for Real-Time Face Recognition


The first step in an automatic face recognition system is to localize the face region in a cluttered background and carefully segment the face from each frame of a video sequence. In this paper, we propose a fast and efficient algorithm for segmenting a face suitable for recognition from a video sequence. The cluttered background is first subtracted from each frame, in the foreground regions, a coarse face region is found using skin colour. Then using a dynamic template matching approach the face is efficiently segmented. The proposed algorithm is fast and suitable for real-time video sequence. The algorithm is invariant to large scale and pose variation. The segmented face is then handed over to a recognition algorithm based on principal component analysis and linear discriminant analysis. The online face detection, segmentation, and recognition algorithms take an average of 0.06 second on a 3.2 GHz P4 machine.


  1. Yang M-H, Kriegman DJ, Ahuja N: Detecting faces in images: a survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 2002,24(1):34-58. 10.1109/34.982883

    Article  Google Scholar 

  2. Vezhnevets V, Sazonov V, Andreeva A: A survey on pixel-based skin color detection techniques. Proceedings of the International Conference on Computer Graphics (GRAPHICON '03), September 2003, Moscow, Russia 85–92.

    Google Scholar 

  3. Wren CR, Azarbayejani A, Darrell T, Pentland AP: Pfinder: real-time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence 1997,19(7):780-785. 10.1109/34.598236

    Article  Google Scholar 

  4. Stauffer C, Grimson WEL: Adaptive background mixture models for real-time tracking. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '99), June 1999, Fort Collins, Colo, USA 2: 246–252.

    Article  Google Scholar 

  5. Turk M, Pentland A: Eigenfaces for recognition. Journal of Cognitive Neuroscience 1991,3(1):71-86. 10.1162/jocn.1991.3.1.71

    Article  Google Scholar 

  6. Belhumeur PN, Hespanha JP, Kriegman DJ: Eigenfaces vs. Fisherfaces: recognition using class specific linear projection. Proceedings of the 4th European Conference on Computer Vision (ECCV '96), April 1996, Cambridge, UK 1: 45–58.

    Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to R. Srikantaswamy.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Srikantaswamy, R., Sudhaker Samuel, R.D. A Novel Face Segmentation Algorithm from a Video Sequence for Real-Time Face Recognition. EURASIP J. Adv. Signal Process. 2007, 051648 (2007).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: