Skip to main content

Real-Time Adaptive Foreground/Background Segmentation

Abstract

The automatic analysis of digital video scenes often requires the segmentation of moving objects from a static background. Historically, algorithms developed for this purpose have been restricted to small frame sizes, low frame rates, or offline processing. The simplest approach involves subtracting the current frame from the known background. However, as the background is rarely known beforehand, the key is how to learn and model it. This paper proposes a new algorithm that represents each pixel in the frame by a group of clusters. The clusters are sorted in order of the likelihood that they model the background and are adapted to deal with background and lighting variations. Incoming pixels are matched against the corresponding cluster group and are classified according to whether the matching cluster is considered part of the background. The algorithm has been qualitatively and quantitatively evaluated against three other well-known techniques. It demonstrated equal or better segmentation and proved capable of processing PAL video at full frame rate using only 35%–40% of a GHz Pentium 4 computer.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Darren E. Butler.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and Permissions

About this article

Cite this article

Butler, D.E., Bove, V.M. & Sridharan, S. Real-Time Adaptive Foreground/Background Segmentation. EURASIP J. Adv. Signal Process. 2005, 841926 (2005). https://doi.org/10.1155/ASP.2005.2292

Download citation

Keywords and phrases

  • video segmentation
  • background segmentation
  • real-time video processing