Study on adaptive compressed sensing & reconstruction of quantized speech signals

Abstract

Compressed sensing (CS) is a rising focus in recent years for its simultaneous sampling and compression of sparse signals. Speech signals can be considered approximately sparse or compressible in some domains for natural characteristics. Thus, it has great prospect to apply compressed sensing to speech signals. This paper is involved in three aspects. Firstly, the sparsity and sparsifying matrix for speech signals are analyzed. Simultaneously, a kind of adaptive sparsifying matrix based on the long-term prediction of voiced speech signals is constructed. Secondly, a CS matrix called two-block diagonal (TBD) matrix is constructed for speech signals based on the existing block diagonal matrix theory to find out that its performance is empirically superior to that of the dense Gaussian random matrix when the sparsifying matrix is the DCT basis. Finally, we consider the quantization effect on the projections. Two corollaries about the impact of the adaptive quantization and nonadaptive quantization on reconstruction performance with two different matrices, the TBD matrix and the dense Gaussian random matrix, are derived. We find that the adaptive quantization and the TBD matrix are two effective ways to mitigate the quantization effect on reconstruction of speech signals in the framework of CS.

1 Introduction

In recent years, compressed sensing (CS)[1–4] has been a new and popular paradigm of signal acquisition and compression in applied science and engineering such as image processing, wireless communication, magnetic resonance imaging (MRI) and so on. In contrast with the conventional Nyquist sampling theorem, CS theory demonstrates that a sparse signal can be exactly recovered through far fewer projections, providing that the sensing matrix is highly incoherent with the sparsifying matrix.

As an important branch of signal processing, speech signal processing has achieved a considerable development in past decades. In addition, the application of CS theory to the field of speech signal processing is becoming a rising research focus. In[5, 6], the sparsity of the residual excitation is utilized to construct sparsifying matrices for voiced speech signals. However, in the aforementioned two literatures, the sparsifying matrix constructed using the impulse response for voiced speech is impractical for its dependence on the currently reconstructed signal itself. Therefore, a codebook of impulse response vectors generated from the training speech data is proposed as the sparsifying matrix in[5].

This work also constructs an adaptive sparsifying matrix for voiced speech based on the quasi-periodicity during voiced segments. And this adaptive sparsifying matrix is a kind of symmetric cyclic matrix which is generated on the basis of the long term prediction. Therefore, this adaptive sparsifying matrix is dependent on the previously reconstructed signal instead of the current signal.

Then, a kind of CS matrix called two-block diagonal (TBD) matrix is constructed for voiced speech signals. The concentration inequality of the TBD matrix is simply demonstrated in Section 4. Subsequently, we can find that the TBD matrix satisfies the restricted isometry property (RIP)[7] according to a theorem in[8].

The third key point of this work to be discussed is quantization. It is well known that analog signals should be sampled, quantized and then encoded before transmission. Thus, quantization of CS projections is of great importance. The distortion rate performance and some measures to mitigate the impact of quantization noise on reconstruction have been considered in[9–15]. In this paper, we apply uniform scalar quantization to the measurements of the speech signal and quantitatively show that how adaptive quantization affects the reconstruction quality compared with the nonadaptive quantization. In addition, we find that the TBD matrix is more robust to the quantization noise than the dense Gaussian matrix based on the fact that the TBD matrix can effectively restricted the impact of quantization noise on reconstruction of speech signals.

The rest of the paper is organized as follows. In Section 2, we briefly review the principle of CS. Section 3 presents the construction of an adaptive sparsifying matrix for voiced speech signals. In Section 4, a sensing matrix is constructed for voiced speech signals. And in Section 5, the effect of quantization of projections on reconstruction is discussed. Section 6 then concludes our work.

2 Compressed sensing background

Supposed that a vectorx={\left[\begin{array}{cccc}\hfill x\left(1\right)\hfill & \hfill x\left(2\right)\hfill & \hfill \cdots \hfill & \hfill x\left(N\right)\hfill \end{array}\right]}^T can be represented as a linear combination of some basis vectors {ϕ₁ ϕ₂  ⋅ ⋅ ⋅  ϕ _N  }, we have

x=\Psi \theta ={\displaystyle {\sum }_{i=1}^N{\varphi }_i}\theta \left(i\right)

(1)

where Ψ = [φ₁φ₂ ⋅ ⋅ ⋅ φ _N ] and\theta ={\left[\begin{array}{cccc}\hfill \theta \left(1\right)\hfill & \hfill \theta \left(2\right)\hfill & \hfill \cdots \hfill & \hfill \theta \left(N\right)\hfill \end{array}\right]}^T. If the number of nonzero entries of θ which can be represented as{‖\theta ‖}_{l_0} satisfies

{‖\theta ‖}_{l_0}\le K

(2)

x is considered to be K-sparse with respect to Ψ. Then Ψ is called a sparsifying matrix.

And a matrix Φ ∈ R^M × N can be employed to project a N-dimensional vector onto a M-dimensional subspace. Then, we can acquire a low-dimensional vector y and we have

y=\Phi x=\Phi \Psi \theta =A\theta

(3)

where Φ is called the sensing matrix and A is named the CS matrix. It is required that the CS matrix must satisfy certain conditions for effective reconstruction of the coefficient vector θ. And RIP is a sufficient condition for effective reconstruction. In the following, we firstly recall the definition of restricted isometry constant.

Definition 1 (Restricted isometry constant) ([7, 16]). The restricted isometry constant δ _K of matrix A is defined as the smallest quantity such that

\left(1-{\delta }_K\right){‖\theta ‖}_{l_2}^2\le {‖\mathit{{\rm A}}\theta ‖}_{l_2}^2\le \left(1+{\delta }_K\right){‖\theta ‖}_{l_2}^2

(4)

holds for all K-sparse vectors. And the matrix A is said to satisfy K-order RIP with prescribed constant δ _K .

Although Eq. (3) is ill-conditioned, it is demonstrated in[16] that as

(5)

we can find the exact solution for K-sparse vector θ from

\mathit{\text{min}}{‖\theta ‖}_{l_1}\text{s.t}.y=\mathit{{\rm A}}\theta

(6)

which is called BP algorithm[17].

When the measurement vector is corrupted by bounded noise and can be represented as

y=A\theta +t

(7)

we can employ the basis pursuit denoising (BPDN) algorithm[17]

\mathit{\text{min}}{‖\theta ‖}_{l_1}.s.t.{‖y-A\theta ‖}_{l_2}\le \epsilon

(8)

to achieve effective reconstruction, where ε is an upper bound of l₂-norm of the noise vector t. A theorem introducing the reconstruction performance of BPDN algorithm in detail is presented in Section 5 which is firstly formulated in[16].

Another kind of reconstruction algorithms are named greedy pursuit algorithms including orthogonal matching pursuit (OMP)[18], subspace pursuit (SP)[19], stagewise orthogonal matching pursuit (StOMP)[20], regularized orthogonal matching pursuit (ROMP)[21] and sparsity adaptive matching pursuit (SAMP)[22].

3 Sparsity and sparsifying matrix of speech signals

Speech signals, because of their natural characteristics such as the rich frequency components, cannot meet the definition of exact sparsity in a strict sense. And speech signals can only be regarded as compressible with a lot of nonzero but small coefficients in some basis like DCT. It is known that sparsity of signals is the precondition of CS. Thus, in the following, we firstly construct an adaptive sparsifying matrix for voiced segments.

3.1 Sparsifying matrix and sparsity of voiced speech

The sparsity of voiced speech has some bearing on its quasi-periodicity. In conventional speech signal coding system, the long-term prediction is always used to minimize the mean-square error between the predicted and the true values of voiced speech signals[23]. Supposing that a voiced segment includes several pitch periods (the reciprocal of vibration frequency of vocal cords) and x _i and x_{i+ 1} denote the vectors of the i^th period and the (i+1)^th period respectively, according to the principle of long-term prediction, we have

\begin{array}{l}{x}_{i+1}\left(n\right)\approx \beta \left(-1\right)x_i\left(n-T+1\right)+\beta \left(0\right)x_i\left(n-T\right)\hfill \\ +\beta \left(1\right)x_i\left(n-T-1\right)\left(n=iT,iT+1,\cdots \left(i+1\right)T-1\right)\end{array}

(9)

where T denotes the number of samples in a pitch period, namely, pitch period. In terms of the quasi-periodicity of voiced speech, some assumptions are made below.

As for the first point and the last point in the (i+1)^th period, we have x_i + 1(i T) ≈ β(−1)x _i ((i − 1)T + 1) + β(0)x _i ((i − 1)T) + β(1)x _i ((i − 1)T − 1) and

\begin{array}{l}{x}_{i+1}\left(\left(i+1\right)T-1\right)\approx \beta \left(-1\right)x_i\left(iT\right)+\beta \left(0\right)x_i\left(iT-1\right)\hfill \\ +\beta \left(1\right)x_i\left(iT-2\right)\text{.}\end{array}

However, the time-domain range of x _i is from (i − 1)T to i T − 1. Therefore, in the duration of x _i , we make artificially x _i ((i − 1)T − 1) and x _i (i T) in Eq. (9) equal to x _i (i T − 1) and x _i ((i − 1)T) and then we have

\left[\begin{array}{c}\hfill x_{i+1}\left(iT\right)\hfill \\ \hfill x_{i+1}\left(iT+1\right)\hfill \\ \hfill x_{i+1}\left(iT+2\right)\hfill \\ \hfill ⋮\hfill \\ \hfill x_{i+1}\left(\left(i+1\right)T-1\right)\hfill \end{array}\right]\approx \left[\begin{array}{cccc}\hfill x_i\left(\left(i-1\right)T\right)\hfill & \hfill x_i\left(\left(i-1\right)T+1\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(iT-1\right)\hfill \\ \hfill x_i\left(\left(i-1\right)T+1\right)\hfill & \hfill x_i\left(\left(i-1\right)T+2\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(\left(i-1\right)T\right)\hfill \\ \hfill x_i\left(\left(i-1\right)T+2\right)\hfill & \hfill x_i\left(\left(i-1\right)T+3\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(\left(i-1\right)T+1\right)\hfill \\ \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill \\ \hfill x_i\left(iT-1\right)\hfill & \hfill x_i\left(\left(i-1\right)T\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(iT-2\right)\hfill \end{array}\right]\left[\begin{array}{c}\hfill \beta \left(0\right)\hfill \\ \hfill \beta \left(-1\right)\hfill \\ \hfill 0\hfill \\ \hfill ⋮\hfill \\ \hfill \beta \left(1\right)\hfill \end{array}\right]

(10)

Furthermore, in terms of Eq. (10), we establish that

\Psi =\left[\begin{array}{ccccc}\hfill x_i\left(\left(i-1\right)T\right)\hfill & \hfill x_i\left(\left(i-1\right)T+1\right)\hfill & \hfill x_i\left(\left(i-1\right)T+2\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(iT-1\right)\hfill \\ \hfill x_i\left(\left(i-1\right)T+1\right)\hfill & \hfill x_i\left(\left(i-1\right)T+2\right)\hfill & \hfill x_i\left(\left(i-1\right)T+3\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(\left(i-1\right)T\right)\hfill \\ \hfill x_i\left(\left(i-1\right)T+2\right)\hfill & \hfill x_i\left(\left(i-1\right)T+3\right)\hfill & \hfill x_i\left(\left(i-1\right)T+4\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(\left(i-1\right)T+1\right)\hfill \\ \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill \\ \hfill x_i\left(iT-1\right)\hfill & \hfill x_i\left(\left(i-1\right)T\right)\hfill & \hfill x_i\left(\left(i-1\right)T+1\right)\hfill & \hfill \cdots \hfill & \hfill x_i\left(iT-2\right)\hfill \end{array}\right]

(11)

\beta ={\left[\begin{array}{ccccc}\hfill \beta \left(0\right)\hfill & \hfill \beta \left(-1\right)\hfill & \hfill 0\hfill & \hfill \cdots \hfill & \hfill \beta \left(1\right)\hfill \end{array}\right]}^T

(12)

and

x_{i+1}\approx \Psi \beta

(13)

Thus, the vector β is called the coefficient vector of x_{i+ 1} with respect to the adaptive sparsifying matrix Ψ and we have

{‖\beta ‖}_{l_0}=3.

(14)

It is obvious that x_i+ 1 is approximately sparse with respect to the matrix Ψ defined in Eq. (11) which is composed of components of x _i . Thus, at the decoder, the recovered signal of the current pitch period can be used to constitute a sparsifying matrix for the signal of next pitch period.

As the adaptive sparsifying matrix Ψ is a real symmetric cyclic matrix, we can get its eigenvalues[24] which are denoted by λ _m (m = 0, 1 ⋯ T − 1). We define

f\left(z\right)={\displaystyle {\sum }_{l=0}^{T-1}{x}_i\left(\left(i-1\right)T+l\right)}{z}^l

(15)

and

\omega =e^{j\frac{2\pi }{T}}

(16)

Supposed that T is even, we have

{\lambda }_0=f\left(1\right)

(17)

{\lambda }_m=\left|f\left({\omega }^m\right)\right|\left(m=1,2\cdots \frac{T}{2}-1\right)

(18)

{\lambda }_m=-\left|f\left({\omega }^{m-\frac{T}{2}+1}\right)\right|\left(m=\frac{T}{2},\frac{T}{2}+1,\cdots T-2\right)

(19)

and

{\lambda }_{T-1}=f\left(-1\right)

(20)

Otherwise, when T is odd, we have

{\lambda }_0=f\left(1\right)

(21)

{\lambda }_m=\left|f\left({\omega }^m\right)\right|\left(m=1,2\cdots \frac{T-1}{2}\right)

(22)

and

{\lambda }_m=-\left|f\left({\omega }^{m-\frac{T-1}{2}}\right)\right|\left(m=\frac{T-1}{2}+1,\frac{T-1}{2}+2,\cdots T-1\right)\text{.}

(23)

Moreover, we can recall the DFT transform of x _i which can be expressed asX_i\left(k\right)={\displaystyle \sum _{l=0}^{T-1}{x}_i\left(\left(i-1\right)T+l\right){\omega }^{-lk}}. Then we can obtain the relation between the eigenvalues of the adaptive sparsifying matrix Ψ and the spectrum of the signal x _i . When T is even, we have

{\lambda }_m=\left|X_i\left(m\right)\right|\left(m=1,2\cdots \frac{T}{2}-1\right)

(24)

and

{\lambda }_m=-\left|X_i\left(m-\frac{T}{2}+1\right)\right|\left(m=\frac{T}{2},\frac{T}{2}+1,\cdots T-2\right)

(25)

And when T is odd, we have

{\lambda }_m=\left|X_i\left(m\right)\right|\left(m=1,2\cdots \frac{T-1}{2}\right)

(26)

and

\begin{array}{l}{\lambda }_m=-\left|X_i\left(m-\frac{T-1}{2}\right)\right|\hfill \\ \times \left(m=\frac{T-1}{2}+1,\frac{T-1}{2}+2,\cdots T-1\right)\end{array}

(27)

And we define

g={\lambda }_0{\lambda }_{T-1}\prod _{m=1}^{T-2}{\lambda }_m

(28)

Moreover, if g ≠ 0, the adaptive sparsifying matrix Ψ defined in Eq. (11) is invertible.

Although this adaptive sparsifying matrix is not a canonical basis in a conventional sense, it has two advantages. On the one hand, as an adaptive sparsifying matrix which is constructed by the recovered signal, the decoder doesn’t need additional storage space and at the encoder it is not necessary to spend time attaining the training data to construct the codebook and to transmit it to the decoder such as the approach proposed in[5]. On the other hand, the approximate sparsity of speech signals with respect to this adaptive sparsifying matrix is superior to the DCT basis, which can be verified by the comparison of reconstruction performance between the adaptive sparsifying matrix and the DCT basis in the subsection 3.3.

3.2 Sparsity of unvoiced speech signals

The transform coefficients based on the spectral characteristics of unvoiced speech signals are nearly uniformly distributed in the frequency domain with no obvious decay. Consequently, the sparsity of unvoiced speech signal with respect to the DCT basis is undesirable. Furthermore, we have not found a satisfactory sparsifying matrix for unvoiced speech signals. Therefore, the usual practice in the framework of CS is to apply the scheme to entire speech signals and not to distinguish voiced speech signals and unvoiced speech signals in advance. Moreover, we find that the overall performance has not been greatly influenced, which can be verified by the simulation results in the following subsection. The reason is that the proportion of voiced speech is more than seventy percent and voiced speech bears dominating information of speech. Certainly, it is of great significance for us to seek to construct a basis or a redundant dictionary for unvoiced speech signals, which is the focus of our future work.

3.3 Simulation

Some simulation results are illustrated in this subsection to show the performance of the adaptive sparsifying matrix. The testing speech signals are sampled at 16K Hz with the length of a frame N=320. There are 152 frames including 135 frames of voiced speech and 17 frames of unvoiced speech. And the sensing matrix used in this section is the dense Gaussian random matrix whose entries are i.i.d Gaussian random variables with mean zero and variance\frac{1}{M}. And BP algorithm is used in this subsection to achieve reconstruction of speech signals.

It should be pointed out that the first pitch period in each frame is recovered with respect to the DCT basis. Moreover, the following pitch periods are compressed with the same compression rate and at the decoder we achieve reconstruction with respect to the adaptive sparsifying matrix. The compression rate is defined as

u=\frac{M}{N}

(29)

Moreover, it is necessary for us to distinguish the compression rate denoted as u _f for the first pitch period and the compression rate denoted as u _s for the following periods. Thus, we have

u_f=\frac{M_f}{N}

(30)

and

u_s=\frac{M_s}{N}

(31)

where M _f and M _s represent the number of measurements for the first period and the following ones respectively. Moreover, it is required that

u_f\ge u_s

(32)

for mitigating error propagation.

The measure used to evaluate the reconstruction performance is signal to noise ratio (SNR) which is defined as

\text{SNR}=10{\mathit{\text{log}}}_{10}\frac{{‖x‖}_{l_2}^2}{{‖x-x^{*}‖}_{l_2}^2}

(33)

where x^* is the reconstructed signal vector.

As the adaptive sparsifying matrix is constructed according to the quasi-periodicity of voiced speech, it is necessary for us to analyze the reconstruction performance of the different types of voiced speech signals. We make an analysis of the testing speech signals and identify three types of voiced speech signals which are shown in Figure 1a, Figure 2a and Figure 3a. There are 41 frames, 21frames and 18 frames of voiced speech signals similar to the first type, the second type and the third type of voiced speech respectively in the testing speech signals. Figure 1b, Figure 2b and Figure 3b show the average compression rate for the above three types of voiced speech signals.

Figure 1

Waveform of the first type of voiced speech signals and average compression rate: (a) Waveform of the first type of voiced speech signals. (b) Average compression rate with different values of u _f and u _s .

Figure 2

Waveform of the second type of voiced speech signals and average compression rate: (a) Waveform of the second type of voiced speech signals. (b) Average compression rate with different values of u _f and u _s .

Figure 3

Waveform of the third type of voiced speech signals and average compression rate: (a) Waveform of the third type of voiced speech signals. (b) Average compression rate with different values of u _f and u _s .

Moreover, it is illustrated in Figure 4, Figure 5 and Figure 6 the comparison of reconstruction qualities for the above three different types of voiced speech signals between the adaptive sparsifying matrix and the DCT basis. Figure 4a, Figure 5a and Figure 6a show average SNR of each pitch period with different compression rates with respect to the adaptive sparsifying matrix and the DCT basis. And Figure 4b, Figure 5b and Figure 6b show average SNR of each frame.

Figure 4

Average SNR of voiced speech signals whose waveforms are similar to that in Figure1(a): (a) Average reconstruction SNR of pitch periods with different values of u _f and u _s . (b) Average reconstruction SNR of frames with different values of u _f and u _s . ASM in the figure stands for adaptive sparsifying matrix.

Figure 5

Average SNR of voiced speech signals whose waveforms are similar to that in Figure 2a. (a) Average reconstruction SNR of pitch periods with different values of f u and s u. (b) Average reconstruction SNR of frames with different values of f u and s u.

Figure 6

Average SNR of voiced speech signals whose waveforms are similar to that in Figure 3a. (a) Average reconstruction SNR of pitch periods with different values of f u and s u. (b) Average reconstruction SNR of frames with different values of f u and s u.

Regardless of the types of pitch periods, when u _s  ≤ 0.5, the reconstruction performance of the adaptive sparsifying matrix is far better than that of DCT. But when u _s  > 0.5, the adaptive sparsifying matrix and the DCT basis have similar performance for the first type and third type of voiced speech. However, for the second type of voiced speech, the reconstruction performance of the adaptive sparsifying matrix is slightly worse than that of the DCT basis. The reason is that with the great attenuation of the amplitude, the quasi-periodicity of the second type of voiced speech is undesirable.

Figure 7 illustrates the average reconstruction performance of all the voiced speech signals in the testing speech signals. It is obvious that the adaptive sparsifying matrix can achieve better reconstruction performance for voiced speech than the DCT basis with u _s  ≤ 0.5. However, it is obvious in Figure 7 that the reconstruction performance of voiced speech signals with respect to the adaptive sparsifying matrix is slightly worse than that of the DCT basis with u _s  = 0.7. The reason is that the approximate sparsity of the adaptive sparsifying matrix is far better than that of the DCT basis but the whole approximation accuracy of the adaptive sparsifying matrix is slightly worse than that of the DCT basis.

Figure 7

Average SNR of all the voiced speech signals in the testing speech signals: (a) Average reconstruction SNR of pitch periods with different values of u _f and u _s . (b) Average reconstruction SNR of frames with different values of u _f and u _s . ASM in the figure stands for adaptive sparsifying matrix.

Finally, we apply the adaptive sparsifying matrix to the entire speech signals including voiced speech and unvoiced speech and illustrate the reconstruction performance in Figure 8. Compared with Figure 7, we found out the performance in this case just degrades slightly.

Figure 8

Average SNR of the entire speech signals: (a) Average reconstruction SNR of pitch periods with different values of u _f and u _s . (b) Average reconstruction SNR of frames with different values of u _f and u _s . ASM in the figure stands for adaptive sparsifying matrix.

4 Sensing matrix for speech signals

4.1 Two-block diagonal matrix

A sufficient condition for successful reconstruction of a sparse vector from undersampled measurements is that the CS matrix satisfies RIP with a required constant. It has been shown in some literatures that a dense Gaussian random matrix whose entries are i.i.d. random variables drawn according to normal distribution with mean zero and variance\frac{1}{M} [1, 2, 8 ] satisfies RIP with high probability.

In this section, a sensing matrix is constructed according to the characteristics of voiced speech signals. In [25–29], a kind of structured random matrix called block diagonal matrix is applied to achieve CS in wireless communication and image processing. In[25, 26], a lot of identical blocks are used to construct a block diagonal matrix as a sensing matrix for image processing with no proof of its property to meet RIP. From a view of information theory,[27] proposes the block diagonal matrix for natural images also with no proof of its property to meet RIP. In addition,[28, 29] present RIP for block diagonal matrices.

However, in this work, a specific block diagonal matrix with just two different blocks called two-block diagonal (TBD) matrix is constructed for voiced speech signals and a simple proof of its RIP is given although some proofs of RIP for block diagonal matrices have been given in[28, 29].

As we know, the spectral energy of voiced speech signals is concentrated in low-frequency domain and decays rapidly. Thus, the high-frequency coefficients of a voiced speech signal in DCT domain are much sparser than the low-frequency coefficients. In the following, the definition of the TBD matrix is stated.

Definition 2 (TBD matrix) A matrix Α ∈ R^M × N is defined as the TBD matrix endowed with the following structure

\mathit{{\rm A}}=\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]

(34)

where{\Phi }_1\in R^{M_1\times N_1} is a Gaussian random matrix whose entries are i.i.d. random variables drawn according to normal distribution with mean zero and variance\frac{1}{M_1} and{\Phi }_2\in R^{M_2\times N_2} is also a Gaussian random matrix whose entries are i.i.d. random variables drawn according to normal distribution with mean zero and variance\frac{1}{M_2}.

In line with this characteristic, a matrix\Phi =\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]{\Psi }^T is constructed as a sensing matrix for voiced speech signals, where Ψ^T is the transpose of an orthonormal basis. In addition, it is required that

M_1\ge M_2

(35)

M_1+M_2=M

(36)

and

N_1+N_2=N

(37)

And then we have

y=\Phi x=\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]{\Psi }^{T}x=\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]\theta =\mathit{{\rm A}}\theta

(38)

where θ = Ψ^Tx. We just need to prove that A satisfies RIP.

Lemma 1 (Concentration inequality of TBD matrix) Suppose that the matrix A is a TBD matrix defined in definition 2. Then, the matrix obeys the concentration inequality with the prescribed constant δ

P\left(\left|{‖\mathit{{\rm A}}\theta ‖}_{l_2}^2-{‖\theta ‖}_{l_2}^2\right|\ge \delta {‖\theta ‖}_{l_2}^2\right)\le 2e^{-MC\left(\delta \right)}

(39)

where C(δ) is a constant depending on δ.

The proof of Lemma 1 can be found in Appendix. In order to prove that the TBD matrix satisfies RIP, a theorem in literature[8] is first recalled.

Theorem 1 ([8]) Suppose that a CS matrix A satisfies the concentration inequality. If

K\le c_{1}M/\mathit{\text{log}}\left(N/K\right)

(40)

the matrix A satisfies the K-order RIP with the prescribed constant δ with probability\ge 1-2e^{-c_{2}M}, where c₁ and c₂ are constants depending on δ.

Therefore, in light of Lemma 1 and theorem 1, it suffices to show that the TBD matrix A satisfies RIP. In fact, the TBD matrix can also be employed as the CS matrix when the sparsifying matrix is the adaptive sparsifying matrix in Section 3. The reason is that the coefficient vector β with respect to the adaptive sparsifying matrix in Eq. (12) also exhibits similar concentration characteristic to the DCT coefficients. However, it is inappropriate to employ the adaptive sparsifying matrix and the TBD matrix simultaneously in CS system. Firstly, the adaptive sparsifying matrix must be orthonormalized in this case, which undoubtedly increase the computational complexity of the CS system. Secondly, more parameters need to be adjusted. The last but not the least, the TBD matrix cannot considerably improve the reconstruction performance with respect to the adaptive sparsifying matrix for the extremely compressible coefficient vector β and limited approximation accuracy. Thus, we employ the DCT basis as the sparsifying matrix for speech signals in Section 4 and Section 5.

4.2 Simulation

The testing speech signals used in the experiments of this subsection are the same as in Section 3. The BP algorithm is also employed in this subsection to achieve reconstruction. At first, we define

u_l=\frac{M_1}{N}and{u}_h=\frac{M_2}{N}

(41)

and then we have

u=u_l+u_{h}and{u}_l\ge u_h

(42)

In this subsection, we firstly compare the reconstruction performance between the TBD matrix and the dense Gaussian random matrix with respect to the adaptive sparsifying matrix. Figure 9a and Figure 9b show the average SNR of pitch periods and frames respectively for the TBD matrix and the dense Gaussian random matrix in the case of the adaptive sparsifying matrix. It is obvious in Figure 9 that the TBD matrix cannot bring about desirable improvement on the reconstruction performance with respect to the adaptive sparsifying matrix. Therefore, we focus on the reconstruction performance when TBD matrix is used as the CS matrix with respect to the DCT basis.

Figure 9

Comparsion of average SNR between the TBD matrix and the dense Gaussian matrix: (a) Average reconstruction SNR of pitch periods of voiced speech signals with respect to the adaptive sparsifying matrix. (b) Average reconstruction SNR of frames of voiced speech signals with respect to the adaptive sparsifying matrix.

Figure 10a shows the comparison of average SNR of 135 frames of voiced speech signals between the TBD matrix and dense Gaussian random matrix when the sparsifying matrix is the DCT basis. It is obvious that the performance of the TBD matrix with the right values of u _l and u _h is much better than that of the dense Gaussian random matrix especially when the value of overall compression rate u is relatively small.

Figure 10

Comparison of average SNR between the TBD matrix and the dense Gaussian matrix: (a) Average reconstruction SNR of voiced speech signals when the sparsifying matrix is the DCT basis. (b) Average reconstruction SNR of the entire speech signals when the sparsifying matrix is the DCT basis.

Figure 10b demonstrates the comparison of average SNR of the entire testing speech signals between the TBD matrix and the dense Gaussian random matrix. Although the overall reconstruction performance degrades slightly, the TBD matrix with right values of u _l and u _h still performs much better than the dense Gaussian random matrix.

More importantly, as the TBD matrix can restrict the impact of quantization noise on reconstruction of speech signals, it can attain better reconstruction performance than the dense Gaussian matrix when the measurements are quantized, which is described in details in the next section.

5 Quantization effect on speech signals with compressed sensing

5.1 Quantization of speech signals in the framework of CS

In this paper, we apply CS to speech signals to achieve efficient compression. However, we still need to quantify the projections before transmission. At first, we should analyze the distribution of the projections. When the sensing matrix is the dense Gaussian random matrix, we have

y=\Phi x={\displaystyle {\sum }_{i=1}^{N}x\left(i\right){\varphi }_i}

(43)

where=\left[\begin{array}{cccc}\hfill {\varphi }_1\hfill & \hfill {\varphi }_2\hfill & \hfill \cdots \hfill & \hfill {\varphi }_N\hfill \end{array}\right]=\left[\begin{array}{cccc}\hfill {\varphi }_{1,1}\hfill & \hfill {\varphi }_{1,2}\hfill & \hfill \cdots \hfill & \hfill {\varphi }_{1,N}\hfill \\ \hfill {\varphi }_{2,1}\hfill & \hfill {\varphi }_{2,2}\hfill & \hfill \cdots \hfill & \hfill {\varphi }_{2,N}\hfill \\ \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill & \hfill ⋮\hfill \\ \hfill {\varphi }_{M,1}\hfill & \hfill {\varphi }_{M,2}\hfill & \hfill \cdots \hfill & \hfill {\varphi }_{M,N}\hfill \end{array}\right]\text{.}

And then, we can obtain

y\left(k\right)={\displaystyle {\sum }_{i=1}^{N}x\left(i\right){\varphi }_{k,i}}\left(k=1,2\cdots M\right)

(44)

where ϕ_k,i is the i.i.d. Gaussian random variable with mean zero and variance\frac{1}{M}. Thus, y(k) is a random variable independently drawn by the normal distribution with

E\left(y\left(k\right)\right)=0

(45)

D\left(y\left(k\right)\right)=\frac{1}{M}{\displaystyle {\sum }_{i=1}^N{\left(x\left(k\right)\right)}^2=\frac{1}{M}{‖x‖}_{l_2}^2}

(46)

However, when the CS matrix is the TBD matrix, we have

y=\mathit{{\rm A}}\theta =\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]\left[\begin{array}{c}\hfill {\theta }_1\hfill \\ \hfill {\theta }_2\hfill \end{array}\right]

(47)

where{\Phi }_1=\left[\begin{array}{cccc}\hfill {\varphi }_1^1\hfill & \hfill {\varphi }_2^1\hfill & \hfill \cdots \hfill & \hfill {\varphi }_{N_1}^1\hfill \end{array}\right] and{\Phi }_2=\left[\begin{array}{cccc}\hfill {\varphi }_1^2\hfill & \hfill {\varphi }_2^2\hfill & \hfill \cdots \hfill & \hfill {\varphi }_{N_2}^2\hfill \end{array}\right] are both dense Gaussian random matrices. Thus, we have

y\left(k\right)={\displaystyle {\sum }_{i=1}^{N_1}{\varphi }_{k,i}^1{\theta }_1\left(i\right)}\left(k=1,2\cdots M_1\right)

(48)

and

y\left(k\right)={\displaystyle {\sum }_{i=1}^{N_2}{\varphi }_{k,i}^2{\theta }_2\left(i\right)}\left(k=M_1+1,M_1+2,\cdots M_1+M_2\right)

(49)

Then y(k) is also an independent Gaussian random variable with

E\left(y\left(k\right)\right)=0\left(k=1,2\cdots M_1+M_2\right)

(50)

D\left(y\left(k\right)\right)=\frac{1}{M_1}{‖{\theta }_1‖}_{l_2}^2\left(k=1,2\cdots M_1\right)

(51)

and

D\left(y\left(k\right)\right)=\frac{1}{M_2}{‖{\theta }_2‖}_{l_2}^2\left(k=M_1+1,M_2+1,\cdots M_1+M_2\right)

(52)

We apply uniform scalar quantization to the projections. In[30], an analysis of the noise power generated by the uniform scalar quantization when the input signal meets the Gaussian distribution has been carried out and a table for the optimal values of finite quantization range for different quantization levels is provided, which contributes to our following analysis on adaptive quantization.

Speech signals are a kind of time-variant signals and it is possible for the energy of different segments to show great changes. Furthermore, in an expectation sense, the energy of measurement vector is equal to that of the signal vector. Therefore, it is necessary to implement adaptive quantization to the projections. In the following, the effect of adaptive quantization on reconstruction performance is discussed in the framework of CS.

As we know, the noise of uniform scalar quantizer is induced by quantization and saturation. Let ∆ denote the quantization interval, Q denote the number of quantization intervals and σ _i denote the standard deviation of the projection of the i^th frame of voiced speech. [−mσ _i , mσ _i ] is the quantization range for the i^th frame. And when the quantization is adaptive, [−mσ_i + 1, mσ_i + 1] is the quantization range for the (i + 1)^th frame. Otherwise, when the quantizer is fixed, in the convenience of analysis, [−mσ _i , mσ _i ] is used as the quantization range for the (i + 1)^th frame. In other words, the nonadaptive quantization is used in the fixed quantizer. And EN _a denotes the noise power for the adaptive quantizer and EN _f denotes the noise power for the fixed quantizer. Hence, for adaptive quantizer, we have

\Delta =\frac{2m{\sigma }_{i+1}}{Q}

(53)

and

\begin{array}{l}E{N}_a=\frac{{\Delta }^2}{12}(1-2{\int }_m^{+\infty }\frac{1}{\sqrt{2\pi }}{e}^{-\frac{t^2}{2}}dt)\hfill \\ +2(\left(m^2+1\right){\sigma }_{i+1}^2{\int }_m^{+\infty }\frac{1}{\sqrt{2\pi }}{e}^{-\frac{t^2}{2}}dt-\frac{m{\sigma }_{i+1}^2}{\sqrt{2\pi }}{e}^{-\frac{m^2}{2}})\end{array}

(54)

For a fixed quantizer, we have

\Delta =\frac{2m{\sigma }_i}{Q}

(55)

and

\begin{array}{l}E{N}_f=\frac{{\Delta }^2}{12}\left(1-2{\displaystyle {\int }_{m\frac{{\sigma }_i}{{\sigma }_{i+1}}}^{+\infty }\frac{1}{\sqrt{2\pi }}{e}^{-\frac{t^2}{2}}dt}\right)\hfill \\ +2\left({\sigma }_{i+1}^2\left(1+\frac{m^2{\sigma }_i^2}{{\sigma }_{i+1}^2}\right){\displaystyle {\int }_{m\frac{{\sigma }_i}{{\sigma }_{i+1}}}^{+\infty }\frac{1}{\sqrt{2\pi }}{e}^{-\frac{t^2}{2}}dt}\right.\\ -\frac{m{\sigma }_i{\sigma }_{i+1}}{\sqrt{2\pi }}{e}^{-\frac{m^2{\sigma }_i^2}{2{\sigma }_{i+1}^2}})\end{array}

(56)

From Eq. (56), it is clear that the noise power of a fixed quantizer depends not only on the variance of the current frame but also depends on the ratio of the variances of the successive two frames.

Theorem 2 ([16]): Suppose that θ is an approximately sparse vector in R^N. Assuming that the 2K-order restricted isometry constant of the CS matrix satisfies

(57)

the solution θ^* to Eq. (8) obeys

{‖{\theta }^{*}-\theta ‖}_{l_2}\le C_1\epsilon +C_2\frac{{‖\theta -{\theta }_K‖}_{l_1}}{\sqrt{K}}

(58)

where C₁ and C₂ are constants depending on δ_2K.

For an adaptive quantizer, the reconstruction SNR is written as SNR _a , and for a fixed quantizer, the reconstruction SNR is written as SNR _f . In the following, two corollaries about the impact of the adaptive quantization on reconstruction performance are derived in this paper. In this paper, we focus on the effect of quantization noise. Therefore, in the two corollaries below, we assume that{‖\theta -{\theta }_K‖}_{l_1} extends to zero.

Corollary 1: Suppose that x is a voiced speech signal vector and the sparsifying matrix is an orthonormal basis Ψ. Provided that the sensing matrix is the dense Gaussian random matrix whose entries are i.i.d. Gaussian variables with mean 0 and variance\frac{1}{M}, there exist a constant C _q so that the reconstruction SNR for an adaptive quantizer with the value of quantization level Q to be 32 obeys

{\text{SNR}}_{\text{a}}\ge 24.792-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q

(59)

Assuming that\frac{{\sigma }_i}{{\sigma }_{i+1}}=1.25, then the reconstruction SNR for a fixed quantizer with the value of Q to be 32 obeys

{\text{SNR}}_f\ge 23.656-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q

(60)

Assuming that\frac{{\sigma }_i}{{\sigma }_{i+1}}=0.75, then the reconstruction SNR for a fixed quantizer with the value of Q to be 32 obeys

{\text{SNR}}_f\ge 20.8067-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q

(61)

Corollary 2: Suppose that x is a voiced speech signal vector and the sparsifying matrix is the DCT basis. Provided that the CS matrix is the TBD matrix and u _l and u _h are defined as in Eq. (41), there exist a constant C_p so that the reconstruction SNR for an adaptive quantizer with the value of Q to be 32 obeys

{\text{SNR}}_a\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(3.317\times {10}^{-3}{u}_l+2.738\times {10}^{-3}{u}_h\right)}

(62)

Assuming that\frac{{\sigma }_i}{{\sigma }_{i+1}}=1.25, then the reconstruction SNR for a fixed quantizer with the value of Q to be 32 obeys

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(4.39\times {10}^{-3}{u}_l+4.2775\times {10}^{-3}{u}_h\right)}

(63)

Assuming that\frac{{\sigma }_i}{{\sigma }_{i+1}}=0.75, then the reconstruction SNR for a fixed quantizer with value of Q to be 32 obeys

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(8.305\times {10}^{-3}{u}_l+1.534\times {10}^{-3}{u}_h\right)}

(64)

5.2 Simulation

The testing speech signals used in experiments of this subsection are also the same as that in Section 3. The sparsifying matrix used in this section is the DCT basis. And we employ the BPDN algorithm to achieve reconstruction in this subsection. The measure of performance evaluation is also the average SNR.

At first, we analyze the performance of adaptive quantization compared with the nonadaptive quantization for both the TBD matrix and the dense Gaussian random matrix in the framework of CS. We fixed the value of Q to be 32. Figure 11a illustrates the quantization effect on voiced speech signals of the testing speech signals. And Figure 11b illustrates the quantization effect on the entire testing speech signals. It is obvious that the adaptive quantization can greatly improve the reconstruction performance compared with the nonadaptive quantization. Moreover, we can find out from Figure 11 that the performance of TBD matrix with u _h  = 0.05 is superior to the dense Gaussian random matrix for both the adaptive quantization and nonadaptive quantization. The reason is that the TBD matrix is more robust to quantization noise based on the fact the TBD matrix can effectively restrict the impact of quantization on speech signals.

Figure 11

Average reconstruction SNR of adaptive quantization and nonadaptive quantization: (a) Average reconstruction SNR of voiced speech signals with respect to the TBD matrix and dense Gaussian matrix in the case of adaptive quantization and nonadaptive quantization. (b) Average reconstruction SNR of the entire testing speech signals with respect to the TBD matrix and dense Gaussian matrix in the case of adaptive quantization and nonadaptive quantization.

In the following, we focus on the adaptive quantization effect on reconstruction of speech signals with different quantization levels. Figure 12a, Figure 12b, Figure 13a and Figure 13b show the average reconstruction SNR of voiced speech signals with the quantization level Q to be 8, 16, 32 and 64 respectively when the adaptive quantization is applied to the projections in the case of TBD matrices and the dense Gaussian matrix. On the one hand, the reconstruction performance in the case of adaptive quantization improves with the increase of the quantization level. On the other hand, with right values of u _l and u _h , TBD matrix performs much better than the dense Gaussian random matrix confronted with the quantization noise regardless of the quantization level. In addition, Figure 14a, Figure 14b, Figure 15a and Figure 15b show the average reconstruction SNR of entire speech signals with the quantization level Q to be 8, 16, 32 and 64 respectively. And the above findings also hold for the entire speech signals including voiced and unvoiced speech signals. Thus, we can conclude that the adaptive quantization and the TBD matrix can effectively mitigate the impact of quantization noise on reconstruction in the framework of CS.

Figure 12

Average SNR of adaptive quantization of voiced speech signals with different quantization levels: (a) Q =8. (b) Q =16

Figure 13

Average SNR of adaptive quantization of voiced speech signals with different quantization levels: (a) Q =32. (b) Q =64.

Figure 14

Average SNR of adaptive quantization of entire speech signals with different quantization levels: (a) Q =8. (b) Q =16.

Figure 15

Average SNR of adaptive quantization of entire speech signals with different quantization levels: (a) Q =32. (b) Q= 64.

6 Conclusions

This paper demonstrates the potential of applying CS to speech signals especially voiced speech signals. From the viewpoint of long-term prediction, we analyze the sparsity of voiced speech signals and construct an adaptive sparsifying matrix. Moreover, a CS matrix called TBD matrix is constructed in terms of the spectral characteristics of voiced speech signals. Finally, the distribution of the projections is analyzed to carry out quantization. And the reconstruction performance of the adaptive quantization and nonadaptive quantization is studied. In addition, under the adaptive quantization, the reconstruction qualities of TBD matrix and the dense Gaussian matrix are empirically compared with different quantization bits. Therefore, we find that the TBD matrix and the adaptive quantization can effectively mitigate the quantization effect on reconstruction of speech signals in the framework of CS.

Appendix

Proof of Lemma 1 Let\theta =\left[\begin{array}{c}\hfill {\theta }_1\hfill \\ \hfill {\theta }_2\hfill \end{array}\right] where θ₁ and θ₂ are also column vectors. Then, we have

\mathit{{\rm A}}\theta =\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]\theta =\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]\left[\begin{array}{c}\hfill {\theta }_1\hfill \\ \hfill {\theta }_2\hfill \end{array}\right]=\left[\begin{array}{c}\hfill {\Phi }_1{\theta }_1\hfill \\ \hfill {\Phi }_2{\theta }_2\hfill \end{array}\right]

(65)

and

{‖\mathit{{\rm A}}\theta ‖}_{l_2}^2={‖{\Phi }_1{\theta }_1‖}_{l_2}^2+{‖{\Phi }_2{\theta }_2‖}_{l_2}^2

(66)

As Φ₁ is an M₁ × N₁ Gaussian matrix whose entries are i.i.d. random variables drawn according to normal distribution with mean zero and variance\frac{1}{M_1} and Φ₂ is an M₂ × N₂ Gaussian matrix whose entries are i.i.d. random variables drawn according to normal distribution with mean zero and variance\frac{1}{M_2}, we establish

E\left({‖{\Phi }_1{\theta }_1‖}_{l_2}^2\right)={‖{\theta }_1‖}_{l_2}^2

(67)

and

E\left({‖{\Phi }_2{\theta }_2‖}_{l_2}^2\right)={‖{\theta }_2‖}_{l_2}^2

(68)

Hence, we have

E\left({‖\mathit{{\rm A}}\theta ‖}_{l_2}^2\right)={‖{\theta }_1‖}_{l_2}^2+{‖{\theta }_2‖}_{l_2}^2={‖\theta ‖}_{l_2}^2

(69)

Moreover, it is proved in[31] and[32] that

P\left(\left|{‖{\Phi }_1{\theta }_1‖}_{l_2}^2-{‖{\theta }_1‖}_{l_2}^2\right|\ge \delta {‖{\theta }_1‖}_{l_2}^2\right)\le 2e^{-\frac{M_1{\delta }^2}{8}}

(70)

and

P\left(\left|{‖{\Phi }_2{\theta }_2‖}_{l_2}^2-{‖{\theta }_2‖}_{l_2}^2\right|\ge \delta {‖{\theta }_2‖}_{l_2}^2\right)\le 2e^{-\frac{M_2{\delta }^2}{8}}

(71)

Therefore, we have

P\left(-\delta {‖{\theta }_1‖}_{l_2}^2\le {‖{\Phi }_1{\theta }_1‖}_{l_2}^2-{‖{\theta }_1‖}_{l_2}^2\le \delta {‖{\theta }_1‖}_{l_2}^2\right)\ge 1-2e^{-\frac{M_1{\delta }^2}{8}}

(72)

and

P\left(-\delta {‖{\theta }_2‖}_{l_2}^2\le {‖{\Phi }_2{\theta }_2‖}_{l_2}^2-{‖{\theta }_2‖}_{l_2}^2\le \delta {‖{\theta }_2‖}_{l_2}^2\right)\ge 1-2e^{-\frac{M_2{\delta }^2}{8}}

(73)

Then, it suffice to show that

\begin{array}{l}P\left(\left\{\left|{‖{\Phi }_1{\theta }_1‖}_{l_2}^2-{‖{\theta }_1‖}_{l_2}^2\right|\le \delta {‖{\theta }_1‖}_{l_2}^2\right\}\right.\hfill \\ \cap \left\{\left|{‖{\Phi }_2{\theta }_2‖}_{l_2}^2-{‖{\theta }_2‖}_{l_2}^2\right|\le \delta {‖{\theta }_2‖}_{l_2}^2\right\})\ge 1-2e^{-\frac{M_1{\delta }^2}{8}}-2e^{-\frac{M_2{\delta }^2}{8}}\end{array}

(74)

We can use the union bound to show that

\begin{array}{l}P\left(\left|{‖\mathit{{\rm A}}\theta ‖}_{l_2}^2-{‖\theta ‖}_{l_2}^2\right|\ge \delta {‖\theta ‖}_{l_2}^2\right)\le P\left(\left\{\left|{‖{\Phi }_1{\theta }_1‖}_{l_2}^2-{‖{\theta }_1‖}_{l_2}^2\right|\right.\right.\hfill \\ \ge \delta {‖{\theta }_1‖}_{l_2}^2\left\}\cup \left.\left\{\left|{‖{\Phi }_2{\theta }_2‖}_{l_2}^2-{‖{\theta }_2‖}_{l_2}^2\right|\ge \delta {‖{\theta }_2‖}_{l_2}^2\right\}\right)\right.\\ \le P\left(\left|{‖{\Phi }_1{\theta }_1‖}_{l_2}^2-{‖{\theta }_1‖}_{l_2}^2\right|\ge \delta {‖{\theta }_1‖}_{l_2}^2\right)\\ +P\left(\left|{‖{\Phi }_2{\theta }_2‖}_{l_2}^2-{‖{\theta }_2‖}_{l_2}^2\right|\ge \delta {‖{\theta }_2‖}_{l_2}^2\right)\le 2e^{-\frac{M_1{\delta }^2}{8}}+2e^{-\frac{M_2{\delta }^2}{8}}\end{array}

(75)

There is certainly a constant C(δ) > 0 for δ ∈ (0, 1) so that

e^{-\frac{M_1{\delta }^2}{8}}+e^{-\frac{M_2{\delta }^2}{8}}=e^{-MC\left(\delta \right)}

(76)

which yields that

C\left(\delta \right)=-\frac{\mathit{log}\left(e^{-\frac{M_1{\delta }^2}{8}}+e^{-\frac{M_2{\delta }^2}{8}}\right)}{M}

(77)

Thus, we can conclude that

P\left(\left|{‖\mathit{{\rm A}}\theta ‖}_{l_2}^2-{‖\theta ‖}_{l_2}^2\right|\ge \delta {‖\theta ‖}_{l_2}^2\right)\le 2e^{-MC\left(\delta \right)}

(78)

Proof of Corollary 1 The class X of interest is a finite set of objects x which are voiced segments. Denote then

X=\left\{x_k:x_k\text{is}\text{the}{k}^{\text{th}}\text{frame}\text{of}\text{voiced}\text{speech}\text{signals}\right\}\text{.}

(79)

When the sensing matrix is the dense Gaussian random matrix, the projection vector of the (i + 1)^th frame of voiced speech signal x_i + 1 is denoted by y_i + 1 and then

y_{i+1}=\Phi x_{i+1}\text{.}

(80)

In terms of Eq. (45) and Eq. (46), the entries of y_i + 1 are i.i.d. Gaussian random variables with mean 0 and variance\frac{1}{M}{‖x_{i+1}‖}_{l_2}^2. And the quantization vector of y_i + 1 is denoted by

{\widehat{y}}_{i+1}=y_{i+1}+e_{i+1}=\Phi x_{i+1}+e_{i+1}

(81)

wheree_{i+1}={\left[\begin{array}{cccc}\hfill e_{i+1}\left(1\right)\hfill & \hfill e_{i+1}\left(2\right)\hfill & \hfill \cdots \hfill & \hfill e_{i+1}\left(M\right)\hfill \end{array}\right]}^T is the quantization error vector of the (i + 1)^th frame. The quantization error vectors for all the voiced segments in X can be represented by a matrix\bar{e}=\left[\begin{array}{cccc}\hfill e_1\hfill & \hfill e_2\hfill & \hfill \cdots \hfill & \hfill e_{\left|X\right|}\hfill \end{array}\right] where |X| denotes the cardinality of the set X. When Q = 32, according to the results in[30], m = 2.9. Then for an adaptive quantizaer, in light with Eq. (54), we have,

E\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=3.317\times {10}^{-3}{\sigma }_{i+1}^2\left(k=1,2\cdots M\right)

(82)

and

E\left({‖e_{i+1}‖}_{l_2}^2\right)=ME\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=3.317\times {10}^{-3}M{\sigma }_{i+1}^2\text{.}

(83)

We can find a subset in X denoted by V that can be represented as

V=\left\{k:{‖x_k‖}_{l_2}^2={‖x_{i+1}‖}_{l_2}^2,x_k\in X\right\}\text{.}

(84)

Let ε > 0 and we have

{\epsilon }^2=\underset{j\in V}{\text{sup}}{‖e_j‖}_{l_2}^2\text{.}

(85)

There exist a constant C _a such that

{\epsilon }^2=C_{a}E\left({‖e_{i+1}‖}_{l_2}^2\right)

(86)

As{‖e_{i+1}‖}_{l_2}^2\le {\epsilon }^2, we have

{‖e_{i+1}‖}_{l_2}^2\le C_{a}E\left({‖e_{i+1}‖}_{l_2}^2\right)

(87)

In this paper, we are just concerned with the impact of quantization on reconstruction. Therefore, we assume that{‖\theta -{\theta }_K‖}_{l_1} extends to zero. While the voiced speech signal is compressible with respect to an orthonormal basis, we have

\begin{array}{l}{‖x_{i+1}-x_{i+1}^{*}‖}_{l_2}^2={‖\Psi \left({\theta }_{i+1}-{\theta }_{i+1}^{*}\right)‖}_{l_2}^2\hfill \\ ={‖{\theta }_{i+1}-{\theta }_{i+1}^{*}‖}_{l_2}^2\le 3.317\times {10}^{-3}{C}_1^2{C}_{a}M{\sigma }_{i+1}^2\end{array}

(88)

where x_i + 1* = Ψθ_i + 1* and θ_i + 1* is the solution to

\mathit{\text{min}}{‖{\theta }_{i+1}‖}_{l_1}\text{s.t}{‖{\widehat{y}}_{i+1}-\Phi \Psi {\theta }_{i+1}‖}_{l_2}\le \epsilon \text{.}

(89)

Therefore,

\begin{array}{l}{\text{SNR}}_a\ge 10{\mathit{\text{log}}}_{10}\left(\frac{M{\sigma }_{i+1}^2}{3.317\times {10}^{-3}{C}_1^2{C}_{a}M{\sigma }_{i+1}^2}\right)\hfill \\ =24.792-10{\mathit{\text{log}}}_{10}\left(C_1^2{C}_a\right)\text{.}\end{array}

(90)

However, for a fixed quantizer, when\frac{{\sigma }_i}{{\sigma }_{i+1}}=1.25, according to Eq. (56), we establish

E\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=4.309\times {10}^{-3}{\sigma }_{i+1}^2\text{.}

(91)

Then, we have

E\left({‖e_{i+1}‖}_{l_2}^2\right)=ME\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=4.309\times {10}^{-3}M{\sigma }_{i+1}^2\text{.}

(92)

Let ε₁ > 0 and we have

{\epsilon }_1^2=\underset{j\in V}{\mathit{\text{sup}}}{‖e_j‖}_{l_2}^2\text{.}

(93)

There exist a constantC_{f_1} so that

{\epsilon }_1^2=C_{f_1}E\left({‖e_{i+1}‖}_{l_2}^2\right)=4.309\times {10}^{-3}{C}_{f_1}M{\sigma }_{i+1}^2

(94)

Then we have

\begin{array}{l}{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\left(\frac{M{\sigma }_{i+1}^2}{4.309\times {10}^{-3}{C}_1^2{C}_{f_1}M{\sigma }_{i+1}^2}\right)\hfill \\ =23.656-10{\mathit{\text{log}}}_{10}\left(C_1^2{C}_{f_1}\right)\end{array}

(95)

Similarly, when\frac{{\sigma }_i}{{\sigma }_{i+1}}=0.75, we have

E\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=8.305\times {10}^{-3}{\sigma }_{i+1}^2

(96)

Thus, we can establish that

\begin{array}{l}{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\left(\frac{M{\sigma }_{i+1}^2}{8.305\times {10}^{-3}{C}_1^2{C}_{f_2}M{\sigma }_{i+1}^2}\right)\hfill \\ =20.8067-10{\mathit{\text{log}}}_{10}\left(C_1^2{C}_{f_2}\right)\end{array}

(97)

LetC_q=\mathit{\text{max}}\left(C_a,C_{f_1},C_{f_2}\right) and then we obtain

{\text{SNR}}_a\ge 24.792-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q\text{.}

When\frac{{\sigma }_i}{{\sigma }_{i+1}}=1.25, we have

{\text{SNR}}_f\ge 23.656-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q\text{.}

When\frac{{\sigma }_i}{{\sigma }_{i+1}}=0.75, we have

{\text{SNR}}_f\ge 20.8067-10{\mathit{\text{log}}}_{10}{C}_1^2{C}_q\text{.}

Proof of Corollary 2 When the CS matrix is the TBD matrix, then we have

y_{i+1}=\mathit{{\rm A}}{\theta }_{i+1}=\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]{\theta }_{i+1}=\left[\begin{array}{cc}\hfill {\Phi }_1\hfill & \hfill 0\hfill \\ \hfill 0\hfill & \hfill {\Phi }_2\hfill \end{array}\right]\left[\begin{array}{c}\hfill {\theta }_{i+1,1}\hfill \\ \hfill {\theta }_{i+1,2}\hfill \end{array}\right]

where θ_i + 1 is the coefficient vector of x_i + 1 with respect to DCT. In terms of Eqs. (50), (51), (52), denote then

{\sigma }_{i+1,1}^2=\frac{1}{M_1}{‖{\theta }_{i+1,1}‖}_{l_2}^2

(98)

and

{\sigma }_{i+1,2}^2=\frac{1}{M_2}{‖{\theta }_{i+1,2}‖}_{l_2}^2\text{.}

(99)

Moreover, according to the characteristic of the voiced segments, σ_i + 1,1 ≫ σ_i + 1,2. As an adaptive quantizer, [−mσ_i + 1,1, mσ_i + 1,1] is used as the quantization range of the (i + 1)^th projection vector y_i + 1 and\Delta =\frac{2m{\sigma }_{i+1,1}}{Q}. In light with Eq. (54), for an adaptive quantizer, we have

\begin{array}{l}E\left({\left(e_{i+1}\left(k\right)\right)}^2\right)=3.317\hfill \\ \times {10}^{-3}{\sigma }_{i+1,1}^2\left(k=1,2\cdots M_1\right)\end{array}

(100)

And in terms of Eq. (56), we have

\begin{array}{l}E\left({\left(e_{i+1}\left(k\right)\right)}^2\right)\approx \frac{{\Delta }^2}{12}=2.738\hfill \\ \times {10}^{-3}{\sigma }_{i+1,1}^2(k=M_1+1,M_1\\ +2,\cdots M_1+M_2)\end{array}

(101)

and

\begin{array}{l}E\left({‖e_{i+1}‖}_{l_2}^2\right)=M_{1}E\left({\left(e_{i+1}\left(M_1\right)\right)}^2\right)\hfill \\ +M_{2}E\left({\left(e_{i+1}\left(M_1+M_2\right)\right)}^2\right)\\ =3.317\times {10}^{-3}{M}_1{\sigma }_{i+1,1}^2\\ +2.738\times {10}^{-3}{M}_2{\sigma }_{i+1,1}^2\end{array}

(102)

We can find a subset in X denoted by V that can be represented as

\begin{array}{l}V=\left\{k:{‖{\theta }_{k,1}‖}_{l_2}^2={‖{\theta }_{i+1,1}‖}_{l_2}^2,{‖{\theta }_{k,2}‖}_{l_2}^2={‖{\theta }_{i+1,2}‖}_{l_2}^2,\right.\hfill \\ {\theta }_k\text{is\hspace{0.17em}the\hspace{0.17em}DCT\hspace{0.17em}coefficients\hspace{0.17em}vector\hspace{0.17em}of}{x}_k,x_k\in X\}\end{array}

(103)

We define that{\epsilon }^2=\underset{j\in V}{\text{sup}}{‖e_j‖}_{l_2}^2\text{.} There exist a constant C _b such that

{\epsilon }^2=C_{b}E\left({‖e_{i+1}‖}_{l_2}^2\right)

(104)

Therefore, we establish

{‖e_{i+1}‖}_{l_2}^2\le C_{b}E\left({‖e_{i+1}‖}_{l_2}^2\right)

(105)

As stated in corollary 1, we extend{‖\theta -{\theta }_K‖}_{l_1} to zero. Thus, we establish{‖x_{i+1}-x_{i+1}^{*}‖}_{l_2}^2={‖\Psi \left({\theta }_{i+1}-{\theta }_{i+1}^{*}\right)‖}_{l_2}^2={‖{\theta }_{i+1}-{\theta }_{i+1}^{*}‖}_{l_2}^2\le C_1^2{C}_b\left(3.317\times {10}^{-3}{M}_1{\sigma }_{i+1,1}^2+2.738\times {10}^{-3}{M}_2{\sigma }_{i+1,1}^2\right) where θ_i + 1^* is the solution to

\mathit{min}{‖{\theta }_{i+1}‖}_{l_1}\text{s.t}.{‖{\widehat{y}}_{i+1}-\mathit{{\rm A}}{\theta }_{i+1}‖}_{l_2}\le \epsilon

(106)

and then we have

x_{i+1}^{*}=\Psi {\theta }_{i+1}^{*}\text{.}

(107)

Then, we have

\begin{array}{l}{\text{SNR}}_a\ge 10{\mathit{\text{log}}}_{10}\hfill \\ \frac{M_1{\sigma }_{i+1,1}^2+M_2{\sigma }_{i+1,2}^2}{C_1^2{C}_b\left(3.317\times {10}^{-3}{M}_1{\sigma }_{i+1,1}^2+2.738\times {10}^{-3}{M}_2{\sigma }_{i+1,1}^2\right)}\\ \ge 10{\mathit{\text{log}}}_{10}\\ \frac{M_1{\sigma }_{i+1,1}^2}{C_1^2{C}_b\left(3.317\times {10}^{-3}{M}_1{\sigma }_{i+1,1}^2+2.738\times {10}^{-3}{M}_2{\sigma }_{i+1,1}^2\right)}\\ =10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_b\left(3.317\times {10}^{-3}{u}_l+2.738\times {10}^{-3}{u}_h\right)}\end{array}

(108)

Moreover, for a fixed quantizer, when\frac{{\sigma }_{i,1}}{{\sigma }_{i+1,1}}=0.75, we can prove in the same way that there exist a constantC_{f_3} so that

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_{f_3}\left(8.305\times {10}^{-3}{u}_l+1.534\times {10}^{-3}{u}_h\right)}\text{.}

(109)

And when\frac{{\sigma }_{i,1}}{{\sigma }_{i+1,1}}=1.25, we can prove in the same way that there exist a constantC_{f_4} so that

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_{f_4}\left(4.39\times {10}^{-3}{u}_l+4.2775\times {10}^{-3}{u}_h\right)}

(110)

LetC_p=\mathit{\text{max}}\left(C_{b,}{C}_{f_3},C_{f_4}\right), and then we can conclude that

{\text{SNR}}_a\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(3.317\times {10}^{-3}{u}_l+2.738\times {10}^{-3}{u}_h\right)}\text{.}

When\frac{{\sigma }_{i,1}}{{\sigma }_{i+1,1}}=0.75, we have

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(8.305\times {10}^{-3}{u}_l+1.534\times {10}^{-3}{u}_h\right)}\text{.}

When\frac{{\sigma }_{i,1}}{{\sigma }_{i+1,1}}=1.25, we have

{\text{SNR}}_f\ge 10{\mathit{\text{log}}}_{10}\frac{u_l}{C_1^2{C}_p\left(4.39\times {10}^{-3}{u}_l+4.2775\times {10}^{-3}{u}_h\right)}\text{.}