Impulse Noise Filtering Using Robust Pixel-Wise S-Estimate of Variance
© V. Crnojević and N. I. Petrović. 2010
Received: 31 December 2009
Accepted: 8 April 2010
Published: 16 May 2010
A novel method for impulse noise suppression in images, based on the pixel-wise S-estimator, is introduced. The S-estimator is an alternative for the well-known robust estimate of variance MAD, which does not require a location estimate and hence is more appropriate for asymmetric distributions, frequently encountered in transient regions of the image. The proposed computationally efficient modification of a robust S-estimator of variance is successfully utilized in iterative scheme for impulse noise filtering. Another novelty is that the proposed iterative algorithm has automatic stopping criteria, also based on the pixel-wise S-estimator. Performances of the proposed filter are independent of the image content or noise concentration. The proposed filter outperforms all state-of-the-art filters included in a large comparison, both objectively (in terms of PSNR and MSSIM) and subjectively.
Corruption by the impulse noise is a frequent problem which appears in digital images. It occurs as a consequence of transmission errors, timing problems in analog-to-digital conversion, or damaged pixel elements in image sensors . Regardless of its origin, the impulse noise has two important aspects: only certain parts of the image pixels are corrupted by the noise and the intensities of contaminated pixels are significantly different from the other noise-free pixels in their neighborhoods. These properties can easily make any kind of subsequent processing, such as segmentation, edge detection, or object recognition, difficult or even impossible. Therefore, the suppression of the impulse noise is usually a required preprocessing step.
The major issue in impulse noise suppression is to satisfy two opposing requests. The corrupted pixels should be filtered whereas the image details have to be preserved. This task is exceptionally difficult because even the smallest amount of noise impulses which are not detected and filtered causes significant deterioration of image quality due to the nature of impulse noise. There have been proposed a large number of filtering techniques for removal of impulse noise. The classical approach is based on using median or its modifications . These space-invariant methods are applied uniformly throughout the whole image, that is, apart from the noisy pixels, they unnecessarily change the noise-free pixels and impair image details. Most of the modern impulse noise filters utilize the solution based on switching scheme . The noisy pixels are detected first and filtered whereas the noise-free pixels are left intact. Thus, this approach is space variant, and it is proven to be effective in preserving image details.
The impulse noise detection is usually performed by comparison of some robust statistics calculated in a local neighborhood to the corresponding fixed or adaptively calculated thresholds. A plethora of the algorithms has been developed which uses this approach, for example, switching median (SM) filter , three-state median (TSM) filter , multistate median (MSM) , adaptive center weighted median (ACWM) filter , state-dependent rank-order mean (SDROM) filter , progressive switching median (PSM) filter , conditional signal-adaptive median (CSAM) filter , pixel-wise MAD (PWMAD) filter , threshold boolean filter (TBF) , and so forth. The detectors of the previous filters are constructed heuristically, but it is also possible to use previous knowledge and machine learning techniques in order to find an optimal decision rule. Genetic programming is utilized in GP [12–14] filters, and neural networks are employed in improved adaptive impulsive noise suppression (IAINS) filter .
The other popular approach relies on fuzzy logic. Impulse noise detection in fuzzy-based techniques models ambiguities between noisy impulses and image structures in order to preserve image details [16–18]. Further enhancement of the fuzzy techniques is achieved by combining them with neural networks into neurofuzzy systems .
Robust statistics play a central role in impulse detection, being capable of producing correct estimates in the presence of unreliable data. The most frequently used statistics are the median and its variants such as center-weighted median. Nevertheless, robust statistics based on absolute differences are proven to be successful. The trilateral filter  was the first one which employed rank-ordered absolute difference (ROAD) statistics. Effective modifications are given by the rank-ordered logarithmic difference (ROLD) detector  and rank-ordered-relative difference (RORD) detector . A slightly different technique, which is also based on absolute differences but makes use of directional information, is employed in the directional weighted median (DWM) filter .
After the detection of noisy impulses, selective, space-variant estimation is applied. The classical approach is based on the utilization of robust estimates of location, but recently an edge-preserving regularization method emerged as an alternative. This method was applied for the first time in the detail-preserving variational method (DPVM) . However, it was applied uniformly for all the pixels in the image, which resulted in relatively moderate results. This estimation method showed much better results when it was combined with the impulse detection scheme in the adaptive center-weighted median with edge-preserving regularization: (ACWM-EPR) filter  or ROLD-EPR filter .
In this paper we concentrate on denoising images corrupted by the mixture of salt-and-pepper and random-valued impulse noises. It has already been shown with the DUMMY filter  that detection of pure salt-and-pepper impulse noises is almost a trivial problem. Therefore, improvements in salt-and-pepper noise filtering are directed either toward efficient implementation, like in a decision-based algorithm (DBA) filter  or toward better estimation, implemented by a fuzzy impulse noise detection and reduction method (FIDRM) , switching-based adaptive weighted mean (SAWM) filter , and the edge-preserving (EP) filter . The more challenging impulse noise model is the random-valued model, and the filters designed to remove it are, in general, capable of treating salt-and-pepper noise as well. However, there exist some filters for which that is not the case [13, 20]. Therefore, it is an important property of impulse noise filters that they are capable of suppressing both types of noise equally well. In order to evaluate the overall performance of impulse noise filters, the mixed impulse noise model was proposed in . The same impulse noise model is used in this paper.
In Section 2 the assumed noise model is described. Section 3 introduces a pixel-wise S-estimate of variance, and in Section 4 the proposed method for impulse noise suppression based on usage of this robust estimate is presented. The results are given in Section 5.
2. Noise Model
where and denote noise impulses generated according to random-valued and salt-and-pepper impulse noises, respectively. A noise-free image pixel at location is symbolized by . If and are the minimum and maximum values from the dynamic range of pixel values in the image, then and . In this way, half of the noisy pixels are corrupted by the random-valued impulse noise and the other half by salt-and-pepper noise. The reason for using the mixed impulse noise model is twofold. Firstly, the mixed impulse noise model is more realistic than existing models. The impulse noise is a result of disturbances caused by noise signals with random amplitudes. The amplitude of the noise signal can fall either into the dynamic range or out of that range. If it is out of the range, the corrupted pixel in the resulting noisy image will be saturated to the maximal or minimal value of the dynamic range, and that situation corresponds to the salt-and-pepper model. Alternatively, if the impulse noise is within the dynamic range, it will appear as random-valued impulse noise in the noisy image. Secondly, it is expected from the high-quality impulse noise filter to perform well in the presence of both salt-and-pepper and random-valued models. Since the filters should handle both impulse noise types equally, it is reasonable to choose a percent ratio for testing. Accordingly, the mixed impulse noise model represents the model which is suitable for proper evaluation of the impulse noise filters.
3. Pixel-Wise S-estimate
where , is the sample containing elements. Firstly, for each the inner median of is calculated. This yields a new sample of elements, and their median (the outer median) gives the final estimate S. A beneficial property of the S-estimate is that it does not rely on a calculation of the location estimate, and consequently it produces an accurate estimate of variance for nonsymmetric sample distributions, that is, the image regions containing edges. The major drawback of the S-estimate is its computational complexity. For a sample of elements, it is necessary to calculate the median exactly times. This could be a serious problem in image processing, where the size of the sample is usually the square of the filtering window dimension and it should be calculated for each pixel.
where is high median value, which is the order statistic of rank . Since the differences are calculated with respect to the central pixel, MAd is calculated on the set for the sake of more efficient implementation.
4. Proposed Method
The same recursive approach is used when and values are calculated. Instead of the input values , the initial estimates are always used if they are already calculated. The initial estimates are later replaced by final estimates obtained by edge-preserving regularization. The details about the final estimation are given in Section 4.2.
We denote the proposed detection scheme PWS detector since the noise classifier is based on PWS and MAd statistics, but MAd is actually calculated within the calculation of PWS. The detector parameters and are determined experimentally. Parameter defines the slope of the classification line in the PWS/MAd plane, defined by (7), whereas defines the offset from the origin. It has been found through experimentation with images having 8 bits per pixel that the optimal value of should be in the range . In our simulations we set it to be constant in every iteration and to be at the middle of this range, that is, . On the other hand, the slope parameter should change throughout the iterations. In the beginning it should be in the range and it should become smaller in subsequent iterations, in order to become less conservative and allow detection of more noise. We reduce this parameter for a constant factor in each iteration . These parameters are very robust and produce satisfactory results for different noise levels and different images.
It has been experimentally verified that the proposed detection procedure is robust to the variation of parameters and . However, the quality of the output is mainly influenced by the optimal number of iterations , because iterative filtering has to be stopped before it starts to severely destroy image details. This issue is discussed and handled by the algorithm described in Section 4.3.
The last parameter, which is the only one that actually has to be set manually, is the window size , defined in (3). We follow the rules given in : if the noise ratio is higher than , we use window; otherwise the window of the size is applied. This yields satisfactory performance in most cases.
Many space-variant filtering methods designed for suppression of the impulse noise use estimators based on the median and its derivatives. We utilize this kind of estimate just as a first approximation during the iterative impulse detection. The final estimate is found by replacing the noisy pixels with values found through the procedure of edge-preserving regularization (EPR) similar to . We combine the proposed PWS detector with edge-preserving regularization and denote it as PWS-EPR filter.
similarly as in , where Note that in contrast to  or  the functional in (12) contains only a regularization term and not the data term. This is because the data are fitted exactly for the uncorrupted pixels, while for the corrupted pixels it is expected that the difference between observed end estimated values will be large due to the nature of the impulse noise.
A global minimization of the functional is very difficult. Therefore, we apply the optimization procedure for each pixel separately and repeat the procedure iteratively across the whole image until the process converges to the stable solution. Since the edge-regularization potential function is strictly convex, we perform the local optimization by Brent optimization method . The same convergence criteria as in  are applied.
4.3. Stopping Criteria
The important issue which is common for iterative filtering approaches is to determine the optimal number of iterations. Most of the state-of-the-art algorithms set that parameter to some fixed value which gives satisfactory results in most cases [14, 21, 25] or set it according to noise concentration [20, 23]. Still, this is a challenging problem because the optimal number of iterations usually depends on both image content and noise concentration. The proposed PWS-EPR filter in each iteration calculates the PWS estimate of the variance, and this is utilized to determine the stopping criteria for the iterative filtering.
The performance of the proposed PWS-EPR filter was compared to a number of state-of-the-art impulse noise filters. The experiments were conducted on standard test images and for different concentrations of mixed impulse noise. The parameters of the PWS-EPR filter were set to the constant experimentally found values as explained in Section 4. The only parameter which needs to be tuned with respect to the noise level is the window size used by the detector. It is set to be when noise concentration % and otherwise. The other parameters were set as follows: , , and . In all experiments, the parameters were kept constant, that is, they were not tuned for a particular image or noise level. The optimal number of iterations is calculated dynamically, as explained in Section 4.3.
Filtering results in PSNR (dB) for images corrupted with mixed impulse noise.
Filtering results in MSSIM for images corrupted with mixed impulse noise.
This paper has two major contributions. Firstly, we introduced a pixel-wise S-estimator as an effective and computationally efficient robust estimator of variance that can be successfully utilized in an iterative scheme for mixed impulse noise filtering. In addition, we developed a novel method for determining the optimal number of filtering iterations, also based on the pixel-wise S-estimator. The proposed PWS-EPR filter outperforms other filters included in the comparison, both objectively (in terms of PSNR and MSSIM) and subjectively. Further improvements of the proposed filter are possible since the linear classifier used for noise detection is a rather simple solution. The utilization of a quadratic classifier instead which could provide better separation of noisy and noise-free pixels should further reduce the number of iterations, increase the detector accuracy, and improve the overall filtering performance.
- Gonzalez RC, Woods RE: Digital Image Processing. Prentice Hall, Upper Saddle River, NJ, USA; 2002.Google Scholar
- Pitas I, Venetsanopoulos AN: Order statistics in digital image processing. Proceedings of the IEEE 1992, 80(12):1893-1921. 10.1109/5.192071View ArticleGoogle Scholar
- Sun T, Neuvo Y: Detail-preserving median based filters in image processing. Pattern Recognition Letters 1994, 15(4):341-347. 10.1016/0167-8655(94)90082-5View ArticleGoogle Scholar
- Chen T, Ma K-K, Chen L-H: Tri-state median filter for image denoising. IEEE Transactions on Image Processing 1999, 8(12):1834-1838. 10.1109/83.806630View ArticleGoogle Scholar
- Chen T, Wu HR: Space variant median filters for the restoration of impulse noise corrupted images. IEEE Transactions on Circuits and Systems II 2001, 48(8):784-789. 10.1109/82.959870View ArticleMATHGoogle Scholar
- Chen T, Wu HR: Adaptive impulse detection using center-weighted median filters. IEEE Signal Processing Letters 2001, 8(1):1-3. 10.1109/97.889633View ArticleGoogle Scholar
- Abreu E, Lightstone M, Mitra SK, Arakawa K: A new efficient approach for the removal of impulse noise from highly corrupted images. IEEE Transactions on Image Processing 1996, 5(6):1012-1025. 10.1109/83.503916View ArticleGoogle Scholar
- Wang Z, Zhang D: Progressive switching median filter for the removal of impulse noise from highly corrupted images. IEEE Transactions on Circuits and Systems II 1999, 46(1):78-80. 10.1109/82.749102View ArticleGoogle Scholar
- Pok G, Liu J-C, Nair AS: Selective removal of impulse noise based on homogeneity level information. IEEE Transactions on Image Processing 2003, 12(1):85-92. 10.1109/TIP.2002.804278View ArticleGoogle Scholar
- Crnojević V, Šenk V, Trpovski Ž: Advanced impulse detection based on pixel-wise MAD. IEEE Signal Processing Letters 2004, 11(7):589-592. 10.1109/LSP.2004.830117View ArticleGoogle Scholar
- Aizenberg I, Butakoff C, Paliy D: Impulsive noise removal using threshold boolean filtering based on the impulse detecting functions. IEEE Signal Processing Letters 2005, 12(1):63-66.View ArticleGoogle Scholar
- Petrović N, Crnojević V: Impulse noise detection based on robust statistics and genetic programming. In Advanced Concepts for Intelligent Vision Systems, Lecture Notes in Computer Science. Volume 3708. Springer, Berlin, Germany; 2005:643-649. 10.1007/11558484_81View ArticleGoogle Scholar
- Petrović NI, Crnojević VS: Evolutionary tree-structured filter for impulse noise removal. In Advanced Concepts for Intelligent Vision Systems, Lecture Notes in Computer Science. Volume 4179. Springer, Berlin, Germany; 2006:103-113. 10.1007/11864349_10View ArticleGoogle Scholar
- Petrović NI, Crnojević V: Universal impulse noise filter based on genetic programming. IEEE Transactions on Image Processing 2008, 17(7):1109-1120.MathSciNetView ArticleGoogle Scholar
- Sa PK, Majhi B: An improved adaptive impulsive noise suppression scheme for digital images. International Journal of Electronics and Communications 2010, 64(4):322-328. 10.1016/j.aeue.2009.01.005View ArticleGoogle Scholar
- Schulte S, Witte VD, Nachtegael M, der Weken DV, Kerre EE: Fuzzy random impulse noise reduction method. Fuzzy Sets and Systems 2007, 158(3):270-283. 10.1016/j.fss.2006.10.010MathSciNetView ArticleGoogle Scholar
- Yildirim MT, Baştürk A, Yųksel ME: Impulse noise removal from digital images by a detail-preserving filter based on type-2 fuzzy logic. IEEE Transactions on Fuzzy Systems 2008, 16(4):920-928.View ArticleGoogle Scholar
- Chen H-C, Wang W-J: Efficient impulse noise reduction via local directional gradients and fuzzy logic. Fuzzy Sets and Systems 2009, 160(13):1841-1857. 10.1016/j.fss.2008.11.020MathSciNetView ArticleMATHGoogle Scholar
- Yüksel ME: A hybrid neuro-fuzzy filter for edge preserving restoration of images corrupted by impulse noise. IEEE Transactions on Image Processing 2006, 15(4):928-936.View ArticleGoogle Scholar
- Garnett R, Huegerich T, Chui C, He W: A universal noise removal algorithm with an impulse detector. IEEE Transactions on Image Processing 2005, 14(11):1747-1754.View ArticleGoogle Scholar
- Dong Y, Chan RH, Xu S: A detection statistic for random-valued impulse noise. IEEE Transactions on Image Processing 2007, 16(4):1112-1120.MathSciNetView ArticleGoogle Scholar
- Yu H, Zhao L, Wang H: An efficient procedure for removing random-valued impulse noise in images. IEEE Signal Processing Letters 2008, 15: 922-925.View ArticleGoogle Scholar
- Dong Y, Xu S: A new directional weighted median filter for removal of random-valued impulse noise. IEEE Signal Processing Letters 2007, 14(3):193-196.View ArticleGoogle Scholar
- Nikolova M: A variational approach to remove outliers and impulse noise. Journal of Mathematical Imaging and Vision 2004, 20(1-2):99-120.MathSciNetView ArticleGoogle Scholar
- Chan RH, Hu C, Nikolova M: An iterative procedure for removing random-valued impulse noise. IEEE Signal Processing Letters 2004, 11(12):921-924. 10.1109/LSP.2004.838190View ArticleGoogle Scholar
- Srinivasan KS, Ebenezer D: A new fast and efficient decision-based algorithm for removal of high-density impulse noises. IEEE Signal Processing Letters 2007, 14(3):189-192.View ArticleGoogle Scholar
- Schulte S, Nachtegael M, Witte VD, der Weken DV, Kerre EE: A fuzzy impulse noise detection and reduction method. IEEE Transactions on Image Processing 2006, 15(5):1153-1162.View ArticleGoogle Scholar
- Zhang X, Xiong Y: Impulse noise removal using directional difference based noise detector and adaptive weighted mean filter. IEEE Signal Processing Letters 2009, 16(4):295-298.MathSciNetView ArticleGoogle Scholar
- Chen P-Y, Lien C-Y: An efficient edge-preserving algorithm for removal of salt-and-pepper noise. IEEE Signal Processing Letters 2008, 15: 833-836.View ArticleGoogle Scholar
- Rousseeuw PJ, Croux C: Alternatives to the median absolute deviation. Journal of the American Statistical Association 1993, 88(424):1273-1283. 10.2307/2291267MathSciNetView ArticleMATHGoogle Scholar
- Charbonnier P, Blanc-Féraud L, Aubert G, Barlaud M: Deterministic edge-preserving regularization in computed imaging. IEEE Transactions on Image Processing 1997, 6(2):298-311. 10.1109/83.551699View ArticleGoogle Scholar
- Chan RH, Ho C-W, Nikolova M: Salt-and-pepper noise removal by median-type noise detectors and detail-preserving regularization. IEEE Transactions on Image Processing 2005, 14(10):1479-1485.View ArticleGoogle Scholar
- Brent RP: Algorithms for Minimization without Derivatives. Prentice Hall, Englewood Cliffs, NJ, USA; 1973.MATHGoogle Scholar
- Chan RH, Ho C-W, Nikolova M: Convergence of Newton's method for a minimization problem in impulse noise removal. Journal of Computational Mathematics 2004, 22(2):168-177.MathSciNetMATHGoogle Scholar
- Wang Z, Bovik AC, Sheikh HR, Simoncelli EP: Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing 2004, 13(4):600-612. 10.1109/TIP.2003.819861View ArticleGoogle Scholar
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.