Skip to content


  • Research Article
  • Open Access

Spatio-Temporal Video Object Segmentation via Scale-Adaptive 3D Structure Tensor

EURASIP Journal on Advances in Signal Processing20042004:672709

  • Received: 29 January 2003
  • Published:


To address multiple motions and deformable objects' motions encountered in existing region-based approaches, an automatic video object (VO) segmentation methodology is proposed in this paper by exploiting the duality of image segmentation and motion estimation such that spatial and temporal information could assist each other to jointly yield much improved segmentation results. The key novelties of our method are (1) scale-adaptive tensor computation, (2) spatial-constrained motion mask generation without invoking dense motion-field computation, (3) rigidity analysis, (4) motion mask generation and selection, and (5) motion-constrained spatial region merging. Experimental results demonstrate that these novelties jointly contribute much more accurate VO segmentation both in spatial and temporal domains.

Keywords and phrases

  • video object segmentation
  • 3D structure tensor
  • rigidity analysis

Authors’ Affiliations

School of Electrical and Electronic Engineering, Nanyang Technological University, Nanyang Avenue, Singapore, 639798, Singapore


© Wang and Ma 2004