Skip to main content

A Vision Chip for Color Segmentation and Pattern Matching

Abstract

A 128(H) 64(V) RGB CMOS imager is integrated with region-of-interest selection, RGB-to-HSI transformation, HSI-based pixel segmentation, (36bins 12bits)-HSI histogramming, and sum-of-absolute-difference (SAD) template matching. Thirty-two learned color templates are stored and compared to each image. The chip captures the R, G, and B images using in-pixel storage before passing the pixel content to a multiplying digital-to-analog converter (DAC) for white balancing. The DAC can also be used to pipe in images for a PC. The color processing uses a biologically inspired color opponent representation and an analog lookup table to determine the Hue (H) of each pixel. Saturation (S) is computed using a loser-take-all circuit. Intensity (I) is given by the sum of the color components. A histogram of the segments of the image, constructed by counting the number of pixels falling into 36 Hue intervals of 10 degrees, is stored on a chip and compared against the histograms of new segments using SAD comparisons. We demonstrate color-based image segmentation and object recognition with this chip. Running at 30 fps, it uses 1 mW. To our knowledge, this is the first chip that integrates imaging, color segmentation, and color-based object recognition at the focal plane.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Ralph Etienne-Cummings.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Etienne-Cummings, R., Pouliquen, P. & Lewis, M.A. A Vision Chip for Color Segmentation and Pattern Matching. EURASIP J. Adv. Signal Process. 2003, 407169 (2003). https://doi.org/10.1155/S1110865703302021

Download citation

  • Received:

  • Revised:

  • Published:

  • DOI: https://doi.org/10.1155/S1110865703302021

Keywords

  • focal plane image processing
  • object recognition
  • color histogramming
  • CMOS image sensor
  • vision chip
  • VLSI color image processor