- Research Article
- Open access
- Published:
Wavelet Video Denoising with Regularized Multiresolution Motion Estimation
EURASIP Journal on Advances in Signal Processing volume 2006, Article number: 072705 (2006)
Abstract
This paper develops a new approach to video denoising, in which motion estimation/compensation, temporal filtering, and spatial smoothing are all undertaken in the wavelet domain. The key to making this possible is the use of a shift-invariant, overcomplete wavelet transform, which allows motion between image frames to be manifested as an equivalent motion of coefficients in the wavelet domain. Our focus is on minimizing spatial blurring, restricting to temporal filtering when motion estimates are reliable, and spatially shrinking only insignificant coefficients when the motion is unreliable. Tests on standard video sequences show that our results yield comparable PSNR to the state of the art in the literature, but with considerably improved preservation of fine spatial details.
References
Brailean JC, Kleihorst RP, Efstratiadis S, Katsaggelos AK, Lagendijk RL: Noise reduction filters for dynamic image sequences: a review. Proceedings of IEEE 1995, 83(9):1272–1292. 10.1109/5.406412
Arce GR: Multistage order statistic filters for image sequence processing. IEEE Transactions on Signal Processing 1991, 39(5):1146–1163. 10.1109/78.80969
Kim J, Woods JW: Spatio-temporal adaptive 3-D Kalman filter for video. IEEE Transactions on Image Processing 1997, 6(3):414–424. 10.1109/83.557351
Chang SG, Yu B, Vetterli M: Spatially adaptive wavelet thresholding with context modeling for image denoising. IEEE Transactions on Image Processing 2000, 9(9):1522–1531. 10.1109/83.862630
Pizurica A, Zlokolica V, Philips W: Combined wavelet domain and temporal video denoising. Proceedings of IEEE Conference on Advanced Video and Signal Based Surveillance (AVSS '03), July 2003, Miami, Fla, USA 334–341.
Ozkan MK, Sezan MI, Tekalp AM: Adaptive motion-compensated filtering of noisy image sequences. IEEE Transactions on Circuits and Systems for Video Technology 1993, 3(4):277–290. 10.1109/76.257217
Brailean JC, Katsaggelos AK: Simultaneous recursive displacement estimation and restoration of noisy-blurred image sequences. IEEE Transactions on Image Processing 1995, 4(9):1236–1251. 10.1109/83.413168
Kivanc Mihcak M, Kozintsev I, Ramchandran K, Moulin P: Low-complexity image denoising based on statistical modeling of wavelet coefficients. IEEE Signal Processing Letters 1999, 6(12):300–303. 10.1109/97.803428
Pizurica A, Philips W, Lemahieu I, Acheroy M: A joint inter- and intrascale statistical model for Bayesian wavelet based image denoising. IEEE Transactions on Image Processing 2002, 11(5):545–557. 10.1109/TIP.2002.1006401
Portilla J, Strela V, Wainwright MJ, Simoncelli EP: Image denoising using scale mixtures of Gaussians in the wavelet domain. IEEE Transactions on Image Processing 2003, 12(11):1338–1351. 10.1109/TIP.2003.818640
van Roosmalen PMB, Westen SJP, Lagendijk RL, Biemond J: Noise reduction for image sequences using an oriented pyramid thresholding technique. Proceedings of IEEE International Conference on Image Processing (ICIP '96), September 1996, Lausanne, Switzerland 1: 375–378.
Selesnick IW, Li KY: Video denoising using 2D and 3D dual-tree complex wavelet transforms. Wavelets: Applications in Signal and Image Processing X, August 2003, San Diego, Calif, USA, Proceedings of SPIE 5207: 607–618.
Mallat S, Zhong S: Characterization of signals from multiscale edges. IEEE Transactions on Pattern Analysis and Machine Intelligence 1992, 14(7):710–732. 10.1109/34.142909
Rosenfeld A, Kak A: Digital Picture Processing. Acadamic Press, New York, NY, USA; 1982.
Malfait M, Roose D: Wavelet-based image denoising using a Markov random field a priori model. IEEE Transactions on Image Processing 1997, 6(4):549–565. 10.1109/83.563320
Zhang Y-Q, Zafar S: Motion-compensated wavelet transform coding for color video compression. IEEE Transactions on Circuits and Systems for Video Technology 1992, 2(3):285–296. 10.1109/76.157160
Zan J, Ahmad MO, Swamy MNS: New techniques for multi-resolution motion estimation. IEEE Transactions on Circuits and Systems for Video Technology 2002, 12(9):793–802. 10.1109/TCSVT.2002.803225
Besag J: On the statistical analysis of dirty pictures. Journal of the Royal Statistical Society, Series B 1986, 48(3):259–302.
Liu J, Moulin P: Image denoising based on scale-space mixture modeling of wavelet coefficients. Proceedings of IEEE International Conference on Image Processing (ICIP '99), October 1999, Kobe, Japan 1: 386–390.
Pizurica A, Philips W, Lemahieu I, Acheroy M: A versatile wavelet domain noise filtration technique for medical imaging. IEEE Transactions on Medical Imaging 2003, 22(3):323–331. 10.1109/TMI.2003.809588
Donoho DL, Johnstone IM: Ideal spatial adaptation by wavelet shrinkage. Biometrika 1994, 81(3):425–455. 10.1093/biomet/81.3.425
Zlokolica V, Philips W: Motion- and detail-adaptive denoising of video. IS&T/SPIE 16th Annual Symposium on Electronic Imaging: Image Processing: Algorithms and Systems III, January 2004, San Jose, Calif, USA, Proceedings of SPIE 5298: 403–412.
Bednar J, Watt T: Alpha-trimmed means and their relationship to median filters. IEEE Transactions on Acoustics, Speech, & Signal Processing 1984, 32(1):145–153. 10.1109/TASSP.1984.1164279
Cocchia F, Carrato S, Ramponi G: Design and real-time implementation of a 3-D rational filter for edge preserving smoothing. IEEE Transactions on Consumer Electronics 1997, 43(4):1291–1300. 10.1109/30.642398
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Jin, F., Fieguth, P. & Winger, L. Wavelet Video Denoising with Regularized Multiresolution Motion Estimation. EURASIP J. Adv. Signal Process. 2006, 072705 (2006). https://doi.org/10.1155/ASP/2006/72705
Received:
Revised:
Accepted:
Published:
DOI: https://doi.org/10.1155/ASP/2006/72705