Transient noise reduction in speech signal with a modified long-term predictor
© Choi and Kang; licensee Springer. 2011
Received: 23 March 2011
Accepted: 30 December 2011
Published: 30 December 2011
This article proposes an efficient median filter based algorithm to remove transient noise in a speech signal. The proposed algorithm adopts a modified long-term predictor (LTP) as the pre-processor of the noise reduction process to reduce speech distortion caused by the nonlinear nature of the median filter. This article shows that the LTP analysis does not modify to the characteristic of transient noise during the speech modeling process. Oppositely, if a short-term linear prediction (STP) filter is employed as a pre-processor, the enhanced output includes residual noise because the STP analysis and synthesis process keeps and restores transient noise components. To minimize residual noise and speech distortion after the transient noise reduction, a modified LTP method is proposed which estimates the characteristic of speech more accurately. By ignoring transient noise presence regions in the pitch lag detection step, the modified LTP successfully avoids being affected by transient noise. A backward pitch prediction algorithm is also adopted to reduce speech distortion in the onset regions. Experimental results verify that the proposed system efficiently eliminates transient noise while preserving desired speech signal.
Keywordsspeech enhancement transient noise reduction long-term prediction median filter
Reducing noise from noise-corrupted speech is essential for communication or recording devices. Spectral subtractive noise reduction algorithms have been widely developed under the assumption that input noise is stationary or slowly varying [1–3]. Therefore, the linear filtering methods cannot remove transient noise easily which has abruptly varying characteristic [4–6]. In general, transient noise is generated by tapping a recording device or an object near it. Since transient noise randomly occurs in time and has a time-varying unknown impulse response, the characteristic of the noise is not easy to estimate. In other words, both the occurrence time and the impulse response of transient noise are unpredictable. The good thing is that transient noise usually is a fast varying signal with short duration and high amplitude thus its activity is relatively easy to detect [4–8].
Transient noise can be removed by utilizing a nonlinear filter such as a median filter or a power limiter [4–7, 9]. The nonlinear power limiter suppresses input segments which have enormous magnitude compared to a pre-assigned value. Since it only cuts down the high amplitude portion of transient noise, some noise component still remains in the output. Moreover, if transient noise is added to speech, determining the amount of the signal power reduction is difficult because the level of the speech waveform varies rapidly. Consequently, the power limiter is not efficient to eliminate transient noise in speech [5, 7, 9]. A median filter is a signal dependent filter which removes the fast varying components while preserving slowly varying components of the input signal [4, 6, 7, 10]. The median filter does not require any pre-defined threshold during the filtering process. Since the median filter only preserves the slowly varying components of input signal, however, it may distort the characteristic of fast varying region of speech, i.e., around pitch epoch. Therefore, an additional pre-processing step to keep the speech characteristic before applying the median filter is needed. For example, a short-term linear prediction (STP) filter and a long-term prediction (LTP) filter which are parametric approaches to model speech signal can be utilized as a pre-processor . The purpose of the pre-processor is passing transient noise components but keeping speech information by utilizing the speech modeling filter not to be affected by the median filtering afterwards.
Typical speech modeling methods such as STP and LTP are good candidates for the pre-processing module. The STP filter represents the short-term characteristic of speech, and the LTP filter does the long-term periodic components. If the STP or the LTP filter extracts all speech components from input and leaves all transient noise components in the residual signal, the median filter may be successfully applied to remove the transient noise at the residual signal. It has been reported that applying both STP and LTP to speech is effective to represent the characteristic of the speech [10–12].
After removing transient noise from the residual signal, the speech component extracted by the STP filter or the LTP filter should be re-synthesized. Please note that the pre-filter should not keep the characteristic of transient noise not to bring any residual noise. In general, transient noise lasts for the certain amount of time, e.g., up to 50 ms, and has short-term correlation. Therefore, the STP filter which models the short-term characteristic of signal is not appropriate for our purpose. On the contrary, transient noise component which generally has short duration would not affect an LTP result [7, 8, 10, 11, 13].
NCC between transient noise and residual signals.
Residual after STP analysis
Residual after LTP analysis
The LTP filter generally searches the most similar signal segment to the current signal segment within a pre-defined search range [11, 12]. If transient noise component exists in the search range, however, a transient noise segment in the current frame can be predicted by the other transient noise in the search range. In such case, the LTP filter models the characteristic of the transient noise and brings residual noise in synthesized speech. Another problem of the conventional LTP method is that the LTP filter cannot preserve pitch information at the onset and the transition region of speech because a reference pitch does not exists. As a result, the conventional LTP method needs to be modified to accurately model the pitch related speech component without being affected by transient noise. To solve the first problem on having transient noise component within a pitch search interval, we need to skip the transient noise region while searching a reference pitch. However, skipping the transient noise region occasionally results in failure in the pitch prediction when the transient noise is located where the reference pitch exists. Therefore, we extend the pitch search range to cover multiple pitch periods. The pitch estimation problem at the onset and the transition region of speech can be solved by adopting a look-ahead memory and a backward pitch estimation method. The modified LTP significantly reduces the residual noise in an enhanced signal and successfully reconstructs desired speech after the transient noise reduction.
The rest of this article is organized as follows. In the following section, the median filter for removing transient noise is briefly described. The conventional LTP method which is generally used for speech coding is given in Section 3. The transient noise reduction system with the modified LTP method is proposed in Section 4. Experimental results and conclusions are followed in Sections 5 and 6, respectively.
2 Median filtering for transient noise reduction
where T k defines the occurrence time of the k th transient noise. h k (n) and g k (n) denote the impulse response and the amplitude of the k th transient noise, respectively. Note that T k , h k (n), and g k (n) are unpredictable in general.
where med w [x(n)] defines the median filtering operator of which output is the median value of input samples from x(n - w) to x(n + w). The length of the median filter, 2w + 1, should be long enough to cover the length of transient noise . H T (n) in Eq. (3) denotes the detection flag of transient noise presence which becomes one when the noise exists and vice versa. It can be determined by comparing the time-domain energy, the frequency-domain energy, or the cross-correlation of input signal [4, 6, 15, 16]. For example, a time-frequency domain transient noise detector proposed in  shows 99.3% of detection accuracy while making only 1.49% of false-alarm. Employing the transient noise detection result, the median filter can be applied only to the noise presence region. However, the speech distortion still exists in the region where the median filtering is performed.
3 Conventional long-term predictor
The nonlinear waveform suppression filter, e.g., the median filter, not only reduces noise but also distorts speech. Especially, the fast varying component in speech such as pitch epoch are notably removed during the median filtering. Therefore, an additional step is needed to preserve the pitch component before removing the noise.
Note that the synthesis process is an iterative method thus the quality of the currently synthesized speech segment depends on the quality of the previous pitch. In other words, the pitch synthesis error at the previous frame can be propagated to the next frame .
4 Proposed algorithm
The proposed algorithm employs the LTP as a pre-processor of the median filter, but note that the STP filter which is usually used in speech analysis systems is not utilized because the STP filter may model not only speech component but also the characteristic of transient noise. As a result, applying the STP filter results in the residual noise to the re-synthesized speech after the noise reduction [7, 8, 10].
The conventional LTP method predicts a speech segment by utilizing a previous speech segment at one pitch period before [10–12]. Unlike the STP filter, the LTP filter is not affected by the short-term characteristic of transient noise. However, the LTP filter also models transient noise component if the transient noise exists within the search range of the pitch lag. One way of reducing the problem is to skip the transient noise region while searching the pitch lag. Note also that, the conventional LTP method cannot estimate pitch at the onset or the transition region of vowel because the reference pitch segment does not exists. The proposed method utilizes look-ahead samples to predict the current speech segment more accurately thus it becomes more appropriate for preserving the speech component in transient noise environment.
In this section, we firstly propose the transient noise reduction system based on the median filter which utilizes the LTP as a pre-processor. The proposed system adopts a non-predictive speech synthesis method thus the error caused by the median filter is not propagated to future speech samples. In Section 4.2, the modified LTP method is proposed to efficiently estimate speech component while not being affected by transient noise.
4.1 Median filter by utilizing the LTP with non-predictive pitch synthesis
4.2 Non-causal pitch estimation without being affected by transient noise
If the sum of H T (m - τ, l) with any τ where 0 ≤ m ≤ M - 1 is bigger than zero, the system skips the τ while searching the pitch period because some of x(m - τ, l) with the τ may contain transient noise component. The method in Eq. (13) is helpful for reducing the residual noise in the synthesized speech because the LTP employing the pitch lag detector in Eq. (13) does not preserve transient noise even when the transient noise exists in the search range of the pitch lag.
However, if we adopt the method in Eq. (13), the pitch of the current frame cannot be estimated when transient noise exists at the location of the previous pitch. To save the pitch more efficiently, we need to expand the pitch search range so that the range contains multiple candidate pitches. Note that we do not need to find an exact pitch period, but we should find the most similar pitch to the current pitch. If the previous pitch is contaminated by transient noise, pitch epoch that is located at farther from the current frame can be an alternative candidate of the current pitch. In the proposed system, we set τmin and τmax to about 2.5 ms and 36 ms, respectively. It is twice as wide as the range of usual pitch searching range, which includes at least two pitches [11, 12].
The proposed method detects the pitch lag which is the best estimation of the current pitch among previous samples, τmin ≤ τ ≤ τmax, and future samples, -τmax ≤ τ ≤·-τmin, while skipping samples that include transient noise component. Referring the future pitch for the pitch estimation improves the capability of preserving speech information, However, the system delay increases somehow due to the look-ahead memory.
5 Performance evaluation
To evaluate the performance of the proposed system, we apply it to recorded speech signals which contain transient noise. Every speech signals and transient noise signals are recorded in real environment, separately. The transient noise signals are acquired by using mobile recoding devices while clicking buttons on the recording devices or tapping the body of the recording devices. We add the transient noise segments to the random points of time of the speech signals. More than one hundred transient noise sequences are added to eight sentences of speech signals. Speech database is recorded by four male and four female speakers, and the total length of the speech signals is about sixteen seconds. The sampling frequency of the speech is 8 kHz. Since the transient noise is recorded in real environment, additive background noise such as fan noise is also included in the recoded noise signal. In other words, the test signals contain clean speech, transient noise, and background noise. The signal-to-noise ratio (SNR) between the desired speech and the background noise is around 15 dB.
The median filter and the LTP filter are applied only at transient noise presence region by utilizing the hand-marked result of the noise presence. However, the transient noise presence region can be detected by measuring the time- or the frequency-domain energy of the input signal with a certain threshold [4, 15, 16]. Experimental results utilizing the transient noise detector proposed in  are almost same as results with the hand-marked noise detection result shown in this article. The length of the median filter, 2w + 1, used for the experiments is 101 samples, and the frame size for the LTP, M, is 32 samples. The minimum and the maximum bounds of the pitch lag search range, τmin, τmax, is 20 and 143 samples for the conventional pitch lag detection in Eq. (5), and the maximum bound is doubled to 286 samples for the modified pitch lag detectors in Eqs. (13) and (14). The maximum bound of the pitch gain, g p max, is set to 1.2. The interpolation of the cross-correlation for the pitch lag detection is performed to find a fractional pitch period. As a result, the resolution of the pitch lag, τ p (l), is the triple of the sampling frequency . Note that the LTP performance can be degraded by background noise. Therefore, an optimally modified minimum mean-square error log-spectral amplitude (OM-LSA) estimator with an improved minima controlled recursive averaging (IMCRA) noise estimator is applied to remove background noise before the transient noise reduction process [17–19]. Since the OM-LSA estimator and the IMCRA noise estimator are designed to remove only stationary noise, they do not affect the transient noise.
where Em,l, E m , and E l define the mean of whole samples, a frame, and all frames, respectively. Similarly, E f represents the mean of frequency bins in a frame. S(f, l) and Y (f, l) denote the frequency responses of desired speech and system output, respectively.
Objective quality evaluation results of enhanced signals.
STP and LTP
LTP with Eq. (5)
LTP with Eq. (13)
LTP with Eq. (14)
Objective quality evaluation results of enhanced signals measured only in speech presence region.
STP and LTP
LTP with Eq. (5)
LTP with Eq. (13)
LTP with Eq. (14)
The experimental results given in Tables 2 and 3 verify that utilizing the STP filter before the transient noise reduction is not good for preserving speech because it models transient noise component thus it brings the residual noise problem in the synthesized signal. Oppositely, utilizing only the LTP filter before the median filtering preserves only speech component. Consequently, the median filter can successfully remove transient noise while not distorting the speech. If we discard transient noise presence region during the pitch lag estimation process given in Eq. (13), the residual noise in the enhanced speech becomes much smaller than the system with the conventional LTP. Both the SSNR and the LSD are improved by utilizing the LTP with the modified pitch lag detector in Eq. (13). Sometimes it cannot estimate the pitch component correctly when the transient noise is located at the onset or the transition region of the vowel. However, the pitch estimation problem in the onset and the transition region can be solved by adopting the proposed non-causal LTP method. The results with the non-causal pitch lag estimation, "LTP with Eq. (14)", show the best performance in all objective quality measurements because of improved pitch modeling accuracy.
The results with and without the OM-LSA estimator show same tendency. When the background noise exists, the speech modeling accuracy of the LTP filter is degraded by the background noise. However, the LTP analysis and synthesis process does not amplify the background noise component because the LTP method prevents the over-estimating of the signal. Since the pitch prediction gain is restricted to a certain constant, e.g., 1.2, the synthesized signal does not become much larger than the input . The results utilizing the OM-LSA estimator show much higher objective scores because the background noise reduction process improves the output quality and pitch estimation efficiency. Though the proposed system works well even when background noise exists as shown in Tables 2 and 3, we recommend to remove the background noise before the LTP analysis and the transient noise reduction process.
PESQ scores without background noise reduction.
STP and LTP
PESQ scores with background noise reduction.
STP and LTP
If we do not utilize the OM-LSA estimator before the transient noise reduction, the background noise somewhat disturbs the pitch estimation process thus the output quality improvement by adopting the modified LTP methods, i.e., Eqs. (13) and (14), is not enough as given in Table 4. On the contrary, the PESQ scores utilizing the modified LTP methods are notably improved when the background noise is removed before the LTP analysis because the accuracy of the LTP methods depends on input SNR. As a result, the PESQ scores utilizing the modified LTP methods become close to 3 which indicates that the output quality is in a perceptually fair category.
We have proposed a system for reducing transient noise in speech signal. The proposed system utilizes a modified LTP filter as the pre-processor of the noise reduction filter to protect speech information from being removed while performing a noise reduction process. The conventional LTP sometimes models the information of transient noise thus it increases the amount of the residual noise. The modified LTP method proposed in this article is effective to preserve and restore speech information in transient noise presence regions while not being affected by the transient noise component. The non-causal way of the LTP further improves the pitch modeling accuracy thus it effectively recovers desired speech after the noise reduction process. Objective quality measurements and PESQ score verified the superiority of the proposed method. Since the LTP process only preserves the pitch component, the consonant of speech can be distorted when transient noise exists in the region. Especially, the burst of plosive speech is somewhat reduced when the median filter is applied to the burst region. However, the characteristic of plosive sound including the burst remains after the median filtering because the filter length is short enough. In other words, only the amplitude of the consonant is reduced and its characteristic is not much distorted. Consequently, the distortion of plosive speech does not degrade the intelligibility and perceptual quality of the speech.
- Boll SF: Suppression of acoustic noise in speech using spectral subtraction. IEEE Trans Acoust Speech Signal Process 1979, ASSP-27: 569-571.Google Scholar
- Ephraim Y, Malah D: Speech enhancement using a minimum mean-square error short-time spectral amplitude estimator. IEEE Trans Acoust Speech Signal Process 1984, ASSP-32: 1109-1121.View ArticleGoogle Scholar
- Loizou PC: Speech enhancement, Theory and practice. CRC Press, Boca Raton, FL; 2007.Google Scholar
- Kasparis T, Lane J: Suppression of impulsive disturbaces from audio signals. Electron Lett 1993,29(22):1926-1927. 10.1049/el:19931282View ArticleGoogle Scholar
- Kim SR, Efron A: Adaptive robust impulse noise filtering. IEEE Trans Signal Process 1995,43(8):1855-1866. 10.1109/78.403344View ArticleGoogle Scholar
- Kauppinen I: Methods for detecting impulsive noise in speech and audio signals. Proc IEEE Int Conf on Digital Signal Process 2002, 2: 967-970.Google Scholar
- Vaseghi SV: Advanced Digital Signal Processing and Noise Reduction. 2nd edition. John Wiley & Sons, Ltd, Chinchester, UK; 2000.Google Scholar
- Talmon R, Cohen I, Gannot S: Speech enhancement in transient noise environment using diffusion filtering. Proc IEEE Int Conf on Acoust, Speech, Signal Process 2010, 4782-4785.Google Scholar
- Efron AJ, Jeen H: Detection in impulsive noise based on robust whitening. IEEE Trans Signal Process 1994,42(6):1572-1576. 10.1109/78.286980View ArticleGoogle Scholar
- Choi MS, Kang HG: Transient noise reduction in speech signal utilizing a long-term predictor. J Acoust Soc Korea, in press.Google Scholar
- Kondoz AM: Digital Speech - Coding for Low Bit Rate Communication Systems. John Wiley & Sons, Ltd, Chinchester, UK; 1994.Google Scholar
- ITU-T: ITU-T recommendataion G.729. 1996.Google Scholar
- Quatieri TF: Discrete-Time Speech Signal Processing. Prentice Hall, Inc., Upper Saddle River, NJ; 2001.Google Scholar
- Papoulis A, Pillai SU: Probability, Random Variables and Stochastic Processes. 4th edition. McGraw Hill, New York; 2002.Google Scholar
- Beh J, Kim K, Ko H: Noise estimation for robust speech enhancement in transient noise environment. Proc KSCSP 2007 2007, 35-36.Google Scholar
- Choi MS, Shin HS, Hwang YS, Kang HG: Time-frequency domain impulsive noise detection system in speech signal. J Acoust Soc Korea 2011,30(2):73-79.View ArticleGoogle Scholar
- Cohen I: Optimal speech enhancement under signal presence uncertainty using log-spectral amplitude estimator. IEEE Signal Process Lett 2002,9(4):113-116. 10.1109/97.1001645View ArticleGoogle Scholar
- Cohen I: Noise spectrum estimation in adverse environments: improved minima controlled recursive averaging. IEEE Trans Speech Audio Process 2003,11(5):446-475.View ArticleGoogle Scholar
- Cohen I, Berdugo B: Speech enhancment for non-stationary noise environments. Signal Process 2001, 81: 2403-2418. 10.1016/S0165-1684(01)00128-1View ArticleGoogle Scholar
- Benesty J, Makino S, Chen J: Speech Enhancement. Springer, Berlin; 2005.Google Scholar
- ITU-T: ITU-T Recommendation P.862. Perceptual evaluation of speech quality (PESQ), an objective method for end-to-end speech quality assesment of narrowband telephone networks and speech codecs; 2001.Google Scholar
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.