Open Access

Video Enhancement and Dynamic Range Control of HDR Sequences for Automotive Applications

  • Stefano Marsi1Email author,
  • Gaetano Impoco1,
  • Anna Ukovich1,
  • Sergio Carrato1 and
  • Giovanni Ramponi1
EURASIP Journal on Advances in Signal Processing20072007:080971

https://doi.org/10.1155/2007/80971

Received: 16 March 2006

Accepted: 13 May 2007

Published: 27 June 2007

Abstract

CMOS video cameras with high dynamic range (HDR) output are particularly suitable for driving assistance applications, where lighting conditions can strongly vary, going from direct sunlight to dark areas in tunnels. However, common visualization devices can only handle a low dynamic range, and thus a dynamic range reduction is needed. Many algorithms have been proposed in the literature to reduce the dynamic range of still pictures. Anyway, extending the available methods to video is not straightforward, due to the peculiar nature of video data. We propose an algorithm for both reducing the dynamic range of video sequences and enhancing its appearance, thus improving visual quality and reducing temporal artifacts. We also provide an optimized version of our algorithm for a viable hardware implementation on an FPGA. The feasibility of this implementation is demonstrated by means of a case study.

[12345678910111213141516171819202122232425262728293031]

Authors’ Affiliations

(1)
Image Processing Laboratory (IPL), Department of Electrical and Electronics Engineering (DEEI), University of Trieste

References

  1. NeuriCam s.p.a : NC1802 Pupilla, 640 x 480 CMOS high-dynamic range optical sensor. 2002.Google Scholar
  2. Kodak : Kodak KAC-9619 CMOS image sensor.Google Scholar
  3. Ohtsuki H, Nakanishi K, Mori A, Sakai S, Yachi S, Timmers W: 18.1-inch XGA TFT-LCD with wide color reproduction using high power LED-backlighting. Proceedings of Society for Information Display International Symposium, 2002, San Jose, Calif, USA 1154-1157.Google Scholar
  4. Seetzen H, Heidrich W, Stuerzlinger W, et al.: High dynamic range display systems. ACM Transactions on Graphics 2004,23(3):760-768. 10.1145/1015706.1015797View ArticleGoogle Scholar
  5. Seetzen H, Whitehead L, Ward G: A high dynamic range display using low and high resolution modulators. Proceedings of Society for Information Display International Symposium, May 2003, San Jose, Calif, USA 1450-1453.Google Scholar
  6. Impoco G, Marsi S, Ramponi G: Adaptive reduction of the dynamics of HDR video sequences. Proceedings of IEEE International Conference on Image Processing (ICIP '05), September 2005, Genoa, Italy 1: 945-948.Google Scholar
  7. Land EH, McCann JJ: Lightness and retinex theory. Journal of the Optical Society of America 1971,61(1):1-11. 10.1364/JOSA.61.000001View ArticleGoogle Scholar
  8. Ashikhmin M: A tone mapping algorithm for high contrast images. Proceedings of the 13th Eurographics Workshop on Rendering (EGRW '02), June 2002, Pisa, Italy 145-156.Google Scholar
  9. Durand F, Dorsey J: Fast bilateral filtering for the display of high-dynamic-range images. Proceedings of the 29th International Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH '02), July 2002, San Antonio, Tex, USA 257-266.View ArticleGoogle Scholar
  10. Fattal R, Lischinski D, Werman M: Gradient domain high dynamic range compression. ACM Transactions on Graphics 2002,21(3):249-256.View ArticleGoogle Scholar
  11. Marsi S, Ramponi G, Carrato S: Image contrast enhancement using a recursive rational filter. Proceedings of IEEE International Workshop on Imaging Systems and Techniques (IST '04), May 2004, Stresa, Italy 29-34.Google Scholar
  12. Pal C, Szeliski R, Uyttendaele M, Jojic N: Probability models for high dynamic range imaging. Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR '04), June-July 2004, Washington, DC, USA 2: 173-180.Google Scholar
  13. Pattanaik SN, Yee H: Adaptive gain control for high dynamic range image display. Proceedings of the 18th Spring Conference on Computer Graphics (SCCG '02), April 2002, Budmerice, Slovakia 83-87.View ArticleGoogle Scholar
  14. Reinhard E, Stark M, Shirley P, Ferwerda J: Photographic tone reproduction for digital images. Proceedings of the 29th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '02), July 2002, San Antonio, Tex, USA 267-276.View ArticleGoogle Scholar
  15. Rizzi A, Gatta C, Marini D: From Retinex to Automatic Color Equalization: issues in developing a new algorithm for unsupervised color equalization. Journal of Electronic Imaging 2004,13(1):75-84. 10.1117/1.1635366View ArticleGoogle Scholar
  16. Tumblin J, Turk G: LCIS: a boundary hierarchy for detail-preserving contrast reduction. Proceedings of the 26th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '99), August 1999, Los Angeles, Calif, USA 83-90.View ArticleGoogle Scholar
  17. Hines G, Rahman Z-U, Jobson D, Woodell G: DSP implementation of the retinex image enhancement algorithm. Visual Information Processing XIII, April 2004, Orlando, Fla, USA, Proceedings of SPIE 5438: 13-24.View ArticleGoogle Scholar
  18. Monobe Y, Yamashita H, Kurosawa T, Kotera H: Dynamic range compression preserving local image contrast for digital video camera. IEEE Transactions on Consumer Electronics 2005,51(1):1-10. 10.1109/TCE.2005.1405691View ArticleGoogle Scholar
  19. Artusi A, Bittner J, Wimmer M, Wilkie A: Delivering interactivity to complex tone mapping operators. Proceedings of the 14th Eurographics Workshop on Rendering (EGRW '03), June 2003, Leuven, Belgium 38-44.Google Scholar
  20. Pattanaik SN, Tumblin J, Yee H, Greenberg DP: Time-dependent visual adaptation for fast realistic image display. Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00), July 2000, New Orleans, La, USA 47-54.View ArticleGoogle Scholar
  21. Kang SB, Uyttendaele M, Winder S, Szeliski R: High dynamic range video. ACM Transactions on Graphics 2003,22(3):319-325. 10.1145/882262.882270View ArticleGoogle Scholar
  22. Krawczyk G, Myszkowski K, Seidel H-P: Perceptual effects in real-time tone mapping. Proceedings of the 21st Spring Conference on Computer Graphics (SCCG '05), May 2005, Budmerice, Slovakia 195-202.View ArticleGoogle Scholar
  23. Ledda P, Santos LP, Chalmers A: A local model of eye adaptation for high dynamic range images. Proceedings of the 3rd International Conference on Computer Graphics, Virtual Reality, Visualisation and Interaction in Africa (AFRIGRAPH '04), November 2004, Stellenbosch, South Africa 151-160.View ArticleGoogle Scholar
  24. Ramsey SD, Johnson JT III, Hansen C: Adaptive temporal tone mapping. Proceedings of the 7th IASTED International Conference on Computer Graphics and Imaging, August 2004, Kauai, Hawaii, USA 124-128.Google Scholar
  25. Wang H, Raskar R, Ahuja N: High dynamic range video using split aperture camera. Proceedings of the 6th IEEE Workshop on Omnidirectional Vision (OM-NIVIS '05), October 2005, Beijing, China 83-90.Google Scholar
  26. Bennett EP, McMillan L: Video enhancement using per-pixel virtual exposures. Proceedings of the 32nd International Conference on Computer Graphics and Interactive Techniques (ACM SIGGRAPH '05), July-August 2005, Los Angeles, Calif, USA 845-852.Google Scholar
  27. Andrade LCG, Campos MFM, Carceroni RL: A video-based support system for nighttime navigation in semi-structured environments. Proceedings of the 17th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI '04), October 2004, Curitiba, PR, Brazil 178-185.View ArticleGoogle Scholar
  28. Kavadias S, Dierickx B, Scheffer D, Alaerts A, Uwaerts D, Bogaerts J: A logarithmic response CMOS image sensor with on-chip calibration. IEEE Journal of Solid-State Circuits 2000,35(8):1146-1152. 10.1109/4.859503View ArticleGoogle Scholar
  29. NeuriCam s.p.a. Ethercam NC51XX seriesGoogle Scholar
  30. Jobson D, Rahman Z-U, Woodell G: A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image Processing 1997,6(7):965-976. 10.1109/83.597272View ArticleGoogle Scholar
  31. http://www.xilinx.com/ise/optional_prod/system_generator.htm

Copyright

© Stefano Marsi et al. 2007

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.