Skip to main content

Linear IC detectors for low to medium SNR ill-conditioned communication systems with unknown noise variance

Abstract

In this paper, we introduce two new linear parallel interference cancellation (LPIC) detectors that are suitable for low to medium signal-to-noise ratio ill-conditioned communication systems and do not require knowledge of the noise variance but perform close to the linear minimum mean square error detector, which needs such information. Particularly, we focus in this work on fast linear parallel interference cancellation detectors that are asymptotically equivalent to the steepest descent and conjugate gradient algorithms, respectively, and show that they exhibit a spectral filtering property and semi-convergence behavior. Consequently, a deterministic stopping rule to stop the LPIC iterations that is independent of the noise level (known as the L-curve method) is investigated and tested. Simulation results are presented to support our theoretical findings.

1. Introduction

The capacity of the third-generation cellular systems and optical networks using optical CDMA (OCDMA) technology is mainly limited by the multi-access interference (MAI) [1]. Other systems suffer from other types of interference such as the inter-carrier interference (ICI) in orthogonal frequency division multiple access (OFDMA) and inter-antenna interference (IAI) in multiinput multioutput (MIMO) systems, just to name a few [1].

In 4G and beyond wireless communication systems, the problem of interference is becoming of increasing importance because cells are getting smaller and condensed (i.e., femto-cells) and new technologies that cause additional interference are introduced. For example, relay nodes are proposed to increase coverage and allow cooperative communication; however, they also bring additional interference into the network [2].

To combat these different types of interferences, various interference cancellation and multiuser detection algorithms are proposed. Multiuser detectors (MUDs) are mainly introduced to reduce the effect of interference in wireless/wired systems and consequently to boost the system capacity and throughput. Many multiuser detectors were developed in the literature and have found applications in various wireless/wired systems such as OCDMA, MIMO-OFDM, and MIMO-UWB, just to name a few [15]; however, due to the fact that the capacity of CDMA systems is essentially limited by MAI, a large part of the literature of MUDs focused on systems based on the CDMA technology.

The decorrelating detector is an effective multiuser detector to eliminate interference. It is also an important building block for nonlinear multiuser detectors. It enjoys several desirable features such as: (1) complete removal of interference and (2) independence of noise level information. The latter is very important in situations where the estimation of the noise variance is not possible or not accurate. This is the case where the noise term includes in addition to thermal noise, other types of background noise such as co-channel interference which may change significantly with time/frequency (particularly in frequency-hopping systems) and its variance can be considered as unknown to the receiver [6, 7].

However, the decorrelating detector suffers from two drawbacks: (1) Its relatively high computational complexity which is of the order of O(N 3) [1], where N in the dimension of the system's cross-correlation matrix and (2) noise enhancement effect. Therefore, the challenge is to maintain the advantages of the decorrelating detector and overcome its deficiencies, that is, to lower its computational complexity and combat the noise enhancement effect but without requiring the knowledge of the noise variance, like the linear minimum mean square error (LMMSE) detector.

Recent results reported in [8] proved the semi-convergence behavior of the conventional linear parallel interference cancellation (LPIC) detector and showed that early stopping rules can be used to combat the noise enhancement effect. They used the Morozov discrepancy rule to stop the LPIC iterations prior to final convergence in order to avoid noise magnification. However, the conventional LPIC detector is very slow and may require a very large number of stages to converge especially for ill-conditioned communication systems. Moreover, the Morozov discrepancy rule requires the noise level information and therefore cannot be used in many practical settings.

Building up on these results, a twofold approach is proposed in this work to overcome the drawbacks of the decorrelator detector cited above. First, we employ fast linear interference cancellation detectors to reduce its computational complexity, and then, we make use of an early stopping technique (known as the L-curve method) that does not require noise level information to reduce the noise enhancement effect [9]. Up to our knowledge, this is the first work that investigates the possible use of these early stopping rules that do not require noise level information in the communication field. Preliminary results are promising and suggest that more improvements and extensions can be made.

The organization of this paper is as follows: in Section 2, a simplified system model of the OFDMA uplink that will be used throughout this work is briefly described. In Section 3, the decorrelator detector's solution is analyzed and some of the regularization techniques that are used to overcome its drawbacks are detailed. Section 4 briefly describes the fast LPIC detectors and shows their spectral filtering property. Section 5 analyzes the semi-convergence behavior of the LPIC detector and then investigates the L-curve stopping rule and shows how it can be applied to the LPIC detector. Section 6 supports the theoretical findings by a number of simulations. Finally, Section 7 concludes the paper with some results and recommendations.

2. System model

For illustration purposes only and similar to [8], we consider an uplink OFDMA system where K users transmit simultaneously over a Rayleigh fading channel using quadrature phase-shift keying (QPSK). Particularly, we consider in this work the effect of ICI due to the misalignment of the carrier frequencies and to the Doppler shifts of different users such as in the uplink of the mobile WIMAX (IEEE 802.16 Wireless MAN standard) [10]. This is depicted in Figure 1.

Figure 1
figure 1

Typical uplink OFDMA channel.

In this work, we consider the interleaved subcarrier allocation scheme because it is well known that this scheme suffers the most from ICI compared to other subcarrier allocation schemes [11].

An OFDM symbol consisting of N u samples with sampling time T u where N u is the total number of data samples is transmitted using N orthogonal subcarriers. Without loss of generality, we assume that the total number of subcarriers of the IFFT matrix Ψ with elements Ψ n u , n = 1 N u e j 2 π n u n N u , 1 ≤ n u  ≤ N u , and 1 ≤ n ≤ N is divided equally among all users; therefore, the total number of subcarriers per user is N k  = N/K.

Based on Figure 1, the received signal r(m) at the m th OFDM symbol is expressed in vector–matrix form as:

r m = Ψ ˜ H m Ab m + n m = Ψ ˜ ˜ m b m + n m ,
(1)

where

  • Ψ ˜ = Ψ 1 1 , N k Ε is a combination of the IFFT matrix Ψ and the normalized carrier frequency offset (NCFO) matrix E. Here, and  denote the Schur and Kronecker products, respectively, and 1 1 , N k denotes a 1-by-N k vector of ones. The NCFO matrix can be partitioned as Ε = ϵ 1 ϵ 2 ϵ k ϵ K , where the vector ϵ k is given by ϵ k = e j 2 π ϵ k N u e j 2 π 2 ϵ k N u e j 2 π n u ϵ k N u e j 2 π N u ϵ k N u T , where ϵ k  = Δf k f is the NCFO of the k th user and Δf is the subcarrier spacing.

  • H(m) is the matrix of Rayleigh fading coefficients and it is given by: H m = diag H 1 m H 2 m H n k m H N k m , where H n k m = diag h 1 , n k m h 2 , n k m h k , n k m h K , n k m .

  • A is the matrix of amplitudes and it is given by: A = diag A 1 A 2 A n k A N k , where A n k = diag a 1 , n k a 2 , n k a k , n k a K , n k . It is used to weight the signals of different users with different powers to simulate near-far scenarios.

  • b(m) is the vector of transmitted data symbols and it can be partitioned as: b m = b 1 m b 2 m b n k m b N k m T , where b k m = b 1 , n k m b 2 , n k m b k , n k m b K , n k m .

  • n(m) is an N-length vector of independently and identically distributed additive white Gaussian noise samples with zero mean and variance ρ 2.

And finally, the combination Ψ ˜ ˜ m = Ψ ˜ H m A is the system matrix and it results from the multiplication of the IFFT, the NCFO, the channel gain, and power weighting matrices, respectively. To simplify the notations, we drop in all subsequent equations the OFDM symbol index m from all matrices and vectors used in Equation (1).

3. Regularization techniques for combating the noise enhancement effect

The decorrelator detector (known also as the zero-forcing detector) is a fundamental detector that allows complete removal of the interference, and it results from solving the following least square minimization problem:

b * : min b N r Ψ ˜ ˜ b 2 2
(2)

which yields

y DEC = Ψ ˜ ˜ r = Ψ ˜ ˜ H Ψ ˜ ˜ 1 Ψ ˜ ˜ H r ,
(3)

where Ψ ˜ ˜ is the pseudo-inverse of the system matrix Ψ ˜ ˜ and Ψ ˜ ˜ H Ψ ˜ ˜ is the ICI matrix.

Using the singular value decomposition (SVD), the system matrix Ψ ˜ ˜ can be decomposed as:

Ψ ˜ ˜ = V H ,
(4)

where U and V are the N-by-N and N-by-N unitary matrices that represent the left and right singular vectors of Ψ ˜ ˜ , respectively, and Σ is an N-by-N diagonal matrix with elements σ k , 1 ≤ n ≤ N that represent the singular values of Ψ ˜ ˜ . In addition, the unitary matrices U and V can be partitioned as U = u 1 u 2 u n u N and U = v 1 v 2 v n v N , respectively. Therefore, Equation (3) can be written in terms of the SVD of Ψ ˜ ˜ as:

y DEC = Ψ ˜ ˜ r = V Σ 1 U H r = n N u n H r σ n v n .
(5)

Consequently, its norm can be written as:

y DEC 2 = n N u n H r σ n 2 .
(6)

It is clear from Equation (6) that as long as u n H r < σ n for large n, the norm of y DEC will not go unbounded. This is what is known as the Picard condition [12]; however, due to the contamination of the received signal with noise, the Fourier coefficients u n H r do not decay monotonically to zero, instead they settle at certain level ρ while the singular values decay to zero. Therefore, all singular values below ρ contribute to the noise enhancement effect.

To get rid of the small singular values that may cause the violation of the discrete Picard condition, the decorrelator detector's solution is modified by introducing a filtering matrix F such that:

y REG = n N f n u n H r σ n v n = VF Σ 1 U H r ,
(7)

where y REG is the regularized solution and F is an N-by-N diagonal matrix with elements f n , satisfying:

f n 1 if σ n is large 0 if σ n is small , 1 n N .
(8)

Consequently, these factors filter out solution components pertaining to small singular values.

The most straightforward regularization technique is known as the truncated SVD (TSVD) and is given by [13]:

y TSVD = n n ' u n H r σ n v n .
(9)

Therefore, the filter factors for this regularization scheme can be expressed as:

f n 1 if n n ' 0 if n > n ' , 1 n N .
(10)

This regularization technique is known also as spectral cutting technique and relies on cutting off all solution components under a certain threshold determined by the discrete regularization parameter n’.

Another regularization scheme is known as the Tikhonov regularization technique, and it relies on modifying the least square minimization problem in Equation (2) by penalizing solutions of large norm, that is, [13]:

b * : min b N r Ψ ˜ ˜ b 2 2 + η 2 b 2 2 ,
(11)

where η is the regularization parameter that determines the amount of penalization the solution norm undergoes. The rationale behind this is that from one side we want to make the residual small as in the conventional least squares, but at the same time, we want to obtain meaningful solutions and exclude those with large norms as they are usually contaminated with noise. Fortunately, Equation (11) has a closed form solution and is given by:

y Tik = Ψ ˜ ˜ H Ψ ˜ ˜ + η 2 I 1 Ψ ˜ ˜ H r .
(12)

Note that if the regularization parameter is equal to the noise level ρ, then the Tikhonov solution equals to the linear minimum mean square error (LMMSE) solution. The filter factors of the Tikhonov regularization scheme are given by:

f n = σ n 2 σ n 2 + η 2 1 if σ n η 0 if σ n η , 1 n N .
(13)

The filter factors of the Tikhonov regularization scheme behaves like a smooth low pass filter of the solution terms damping solution components pertaining to singular values less than η. The filter factors of the TSVD and the Tikhonov regularization schemes are depicted in Figure 2.

Figure 2
figure 2

Filter factors of the Tikhonov and TSVD regularization methods.

Another category of regularization methods is regularization by early stopping [13], that is, apply an iterative method to the least square problem of Equation (2) and stop the iterations prior to convergence. This is motivated by the fact that for ill-conditioned systems, linear iterative methods exhibit a semi-convergence property and tend to generate good solutions at early iterations but after a certain number of iterations, the noise starts dominating the solution and the performance of the iterative method worsens.

Many linear interference cancellation schemes have been shown to be equivalent to certain iterative methods [1], and therefore, they tend to have the same semi-convergence behavior for ill-conditioned systems. Therefore, linear IC detectors equipped with efficient early stopping mechanisms that do not require the noise level information can be used to implement a low-complexity decorrelating detector that resists noise amplification without requiring knowledge of the noise level. In the following, we focus on the LPIC detector and use it as an iterative regularizing scheme to achieve two simultaneous objectives: low-complexity and resistance to noise enhancement.

4. Intrinsic regularization property of the LPIC detector

The LPIC detector is an effective scheme for the low-complexity approximation of the decorrelator/LMMSE detector [8]. The conventional LPIC detector is asymptotically equivalent to the Jacobi iterative method [1], and therefore, it inherits its slow convergence behavior. Faster LPIC detectors based on faster iterative methods such as the steepest descent and the conjugate gradient methods are now introduced. The residual norm steepest descent (RNSD) and conjugate gradient least squares (CGLS) methods belong to a class of iterative techniques known as non-stationary iterative methods where the weighting factor changes from one stage to another [14], that is:

y p + 1 = y p + ω p d p ,
(14)

where ω p is the step size and d p is the search direction.

For RNSD, the search direction is equal to the residual error and is given by: d p = e p = Ψ ˜ ˜ H r Ψ ˜ ˜ y p while the weighting factor is determined as:

ω p = d p H d p d p H Ψ ˜ ˜ H Ψ ˜ ˜ d p .
(15)

For the CGLS method, the initial search direction d 0 is set to the residual error, that is, d 0 = e 0 = Ψ ˜ ˜ H r Ψ ˜ ˜ y 0 , and then, we proceed as:

ω p = e p H Ψ ˜ ˜ H Ψ ˜ ˜ e p d p H Ψ ˜ ˜ H Ψ ˜ ˜ d p
(16)

and

y p + 1 = y p + ω p d p .
(17)

Then, we update e p and d p as:

e p + 1 = e p ω p Ψ ˜ ˜ d p
(18)

and

d p + 1 = Ψ ˜ ˜ H e p + 1 + β p + 1 d p ,
(19)

where

β p + 1 = e p + 1 H Ψ ˜ ˜ H Ψ ˜ ˜ e p + 1 e p H Ψ ˜ ˜ H Ψ ˜ ˜ e p .
(20)

To determine the filter factors of the RNSD, it can be shown without loss of generality that if y 0 = 0, then y p can be written in the following form [14]:

y p + 1 = T p SD Ψ ˜ ˜ H Ψ ˜ ˜ Ψ ˜ ˜ H r ,
(21)

where the polynomial T p SD is defined as:

T p SD θ = T p 1 SD θ + ω p 1 θ T p 1 SD θ
(22)

and T 1 SD θ = 0 .

Substituting Ψ ˜ ˜ = V H into Equation (21), we obtain

y p + 1 = VF Σ 1 U H r = n = 1 N σ n 2 T p SD σ n 2 u n H r σ n v n ,
(23)

where F is N-by-N diagonal matrix with elements f p+1, n given by:

f p + 1 , n = σ n 2 T p SD σ n 2 , 1 n N .
(24)

Following the same approach used for the RNSD, the filter factors of the CGLS can be found as:

f p + 1 , n = σ n 2 T p CG σ n 2 , 1 n N ,
(25)

where the polynomial T p CG for the CGLS is defined as:

T p CG θ = 1 ω p θ + ω p β p 1 ω p 1 T p 1 CG θ ω p β p 1 ω p 1 T p 2 CG θ + ω p
(26)

and T 1 CG θ = 0 and

T 0 CG θ = ω 0

Finally, the average BER of the LPIC detector based on the RNSD/CGLS iterative methods is given by (see Appendix for derivation):

P b p = 1 N n = 1 N 1 2 N 1 all b b n = 1 Q g p , n H Ψ ˜ ˜ b ρ g p , n H g p , n ,
(27)

where G p H = T p SD Ψ ˜ ˜ H Ψ ˜ ˜ Ψ ˜ ˜ H for the LPIC detector based on the RNSD and G p H = T p CG Ψ ˜ ˜ H Ψ ˜ ˜ Ψ ˜ ˜ H for the LPIC detector based on the CGLS and G p  = [g p,1 g p,2g p,n g p,N ].

5. Semi-convergence behavior of the LPIC detector and early stopping using the L-curve method

The LPIC detector exhibits a semi-convergence property where it reaches a BER that is better than that achieved at final convergence. This phenomenon has been studied in more detail in [8]. Interested readers are referred to [8] for more details. For our case, the semi-convergence property of the proposed detectors is illustrated in Figure 3. For the simulation parameters, we set the carrier frequency to 3.5 GHz, signal-to-noise ratio (SNR) to 13 dB, N to 128, and K to 4 with frequency offsets (ε 1 = −0.35, ε 2 = 0.38, ε 3 = 0.36, ε 4 = −0.39) and speeds 80, 120, 90, and 100 km/h, respectively.

Figure 3
figure 3

Semi-convergence behavior of the LPIC detector.

It is clear that the two detectors, that is, the one equivalent to the RNSD method (RNSD-LPIC) and the one equivalent to the CGLS method (CGLS-LPIC), exhibit a semi-convergence behavior where they reach their minimum average BER at 10 and 45 stages, respectively, and converge to the decorrelator detector's solution.

The RNSD-LPIC detector exhibits a slower convergence behavior and wide flat minimum while the CGLS-LPIC detector exhibits faster convergence and a narrow minimum.

It is difficult to analyze the semi-convergence behavior using the average BER; nevertheless, we can calculate the mean square error between the decision variable of the LPIC detector at stage (p + 1), y p+1 and the vector of the transmitted data symbols b, that is:

MSE y p + 1 = Ε y p + 1 b 2 2 = Ε VF Σ 1 U H b + n V Σ 1 U H b 2 2 = Ε Σ 1 F I U H b 2 2 + Ε Σ 1 F U H n 2 2 = n = 1 N f p + 1 , n 1 2 u n H b 2 σ n 2 + ρ 2 n = 1 N f p + 1 , n 2 σ n 2 = b Ε y p + 1 2 2 squared bias + Ε y p + 1 Ε y p + 1 2 2 variance
(28)

It can be seen that the MSE can be decomposed into two components: the bias (also known as the data error) and the variance (also known as the noise error). The data error is caused by using a modified inverse of the ICI matrix Ψ ˜ ˜ H Ψ ˜ ˜ instead of the true inverse whereas the noise error is caused by the noise enhancement effect. It is evident from Equation (28) that if F I, the data error is small but the noise error is large due to the noise enhancement effect; however, if F 0, the noise error is small but the data error is large, and as a result, the solution is heavily damped and a large part of it is lost.

Therefore, a proper choice of the filtering matrix F should balance between the data and noise errors. Because the amount of filtering introduced by the filtering matrix is proportional to the stage index p, a proper stopping rule needs to be devised. Many stopping rules have been developed in the literature but roughly they can be classified into three broad techniques [9]:

  • Methods requiring the knowledge of the exact noise level.

  • Methods requiring the knowledge of the approximate noise level.

  • Methods not requiring the knowledge of the noise level.

Due to the fact that we are assuming the absence of the noise level information, we neglect the first two categories and focus on the last one. Under this category, the most known stopping rule technique is the L-curve method [15]. This method has been used successfully in many areas such as spectroscopy, seismography, and medical imaging. The L-curve method exhibits some desirable features such as:

  • Does not need the noise level information. This is important for communication systems where this information is not always available or it is not accurate.

  • Works well under colored Gaussian noise. This is important when the additive white Gaussian noise assumption in communication systems is violated, or it becomes colored because of some signal processing operations such as matched filtering.

This method intends to balance between two conflicting goals: minimizing the residual error norm and keeping the solution norm small. Careful inspection reveals that the norm of the residual error r Ψ ˜ ˜ y p 2 declines sharply at early stages, and then, it flattens while the solution norm y p 2 increases sharply at early stages and then it flattens. Consequently, if we plot the residual error norm versus the solution norm, we obtain an L-shaped curve with usually a distinct corner that splits the curve into two separate regions as shown in Figure 4.

Figure 4
figure 4

The L-curve for the LPIC detector.

Noting that the residual and the solution norms can be written in terms of the filtering factors as [13]:

r Ψ ˜ ˜ y p 2 2 = n = 1 N 1 f p , n u n H r 2
(29)

and

y p 2 2 = n = 1 N f p , n u n H r σ n 2 ,
(30)

respectively. It is clear that if f p,n  ≈ 1 (at early stages), we are in the upper part of the curve. A small change in f p,n leads to a larger change in f p , n 2 than in (1 − f p,n )2; hence, we expect y p 2 to change the most in this region, i.e., we expect the curve to be steep. On the other hand, if f p,n  ≈ 0 (at late stages), we are in the lower part of the curve. A small change in f p,n leads to a larger change in (1 − f p,n )2 than in f p , n 2 ; hence, we expect r Ψ ˜ ˜ y p 2 to change the most in this region, i.e., we expect the curve to be flat here.

The two regions, that is, the vertical and horizontal, are dominated by two types of errors: data error and noise error, respectively. The corner formed by the conjunction of these two regions balances between the data and noise errors, and therefore, the stage index corresponding to this corner is selected as the best regularization parameter that compromises between data and noise errors.

Many algorithms have been devised to find the corner of the L-curve [16]. The most common technique is known as the maximum curvature method. It consists of choosing the stage index that maximizes the following function:

p opt = arg max 1 p P ρ p ' ' η p ' ρ p ' η p ' ' ρ p ' 2 + η p ' 2 3 2 = κ p ,
(31)

where η(p) = y p 2 and ρ p = r Ψ ˜ ˜ y p 2 and denotes differentiation with respect to the regularization parameter p.

The authors in [17] suggested plotting the residual norm versus the stage index p and noticed that this curve usually exhibits an L-curve shape as well. For this curve, one should find the stage index that maximizes the following simplified function:

p opt = arg max 1 p P ρ p ' ' ρ p ' 2 + 1 3 2 = κ p .
(32)

In order to implement the above stopping rule, we have to evaluate the norm of the residual error for each OFDM symbol a certain number of stages till the L-shaped curve is obtained and calculate the curvature information to ultimately determine the optimal stopping stage. This is too expensive in practice and consequently, another alternative should be sought. Fortunately, simulation results reveal that the optimal stage index p opt is insensitive to variations in the condition number of system matrix and is almost constant from one OFDM symbol to another, and therefore, it is sufficient to obtain p opt for a few OFDM symbols (practically in the range of 10 to 100 OFDM symbols) and then average it and use it for the rest of the OFDM symbols. This works well in practice and costs only a marginal addition to the overall LPIC computational complexity.

Another problem with the LPIC detector based on the CGLS is that the norm of the residual error r Ψ ˜ ˜ y p 2 behaves erratically for very ill-conditioned systems [14] where the norm of the residual error may increase occasionally and causes the maximum curvature detector to mistakenly detect the maximum curvature at the wrong stage index. To overcome this problem, we exploit the fact that the residual error decay exponentially and therefore can be fitted by a decaying exponential. The resulting exponentially fitted curve is used instead in computing the maximum curvature and hence the optimal stage index. This method proved to be efficient in combating the erratic behavior of the residual error norm of the LPIC detector based on the CGLS.

Lastly, the L-curve method has obviously some limitations as discussed in [15]. The main one is that the regularized solution does not converge to the true solution as the noise variance vanishes to zero. Therefore, in our application, we expect that the LPIC detector equipped with the L-curve stopping rule will work well for only a certain range of SNRs. Fortunately, this range covers low and medium SNRs where the noise enhancement effect is most prominent. More insight about this issue is given in the simulation results.

6. Computational complexity

The computational complexity of the basic LPIC detector with fixed step size used in [8] and the ones proposed here exhibit a computational complexity in the order of O(N 2), namely the conjugate gradient based LPIC detector needs 4 N 2 +8 N-1 cflopsa per iteration and the steepest descent based LPIC detector needs 4 N 2 +6 N-1 cflops per iteration, and finally, the conventional LPIC detector requires 2 N 2 +2 N + 1 cflops per iteration. Even though the conjugate gradient based LPIC detector exhibits a slightly higher computational complexity per iteration compared to the other detectors, it however needs the least number of iterations; this is why it is the mostly used iterative method in practice.

Since early stopping methods, whether they require the noise variance information or not can be applied to any LPIC detector, we evaluate in the following the computational complexity of the L-curve early stopping rule and compare it to that proposed in [8] (known as the Morozov early stopping rule).

The L-curve method requires the following operations with the following computational complexity:

  1. 1.

    Norm calculation of η(p) = y p 2: 2 N cflops.

  2. 2.

    Norm calculation of ρ p = r Ψ ˜ ˜ y p 2 2 N cflops.

  3. 3.

    Curvature information of κ(p): 2p-3 flops.

  4. 4.

    Obtaining the index of the maximum curvature: p opt = arg max 1 p P ρ p ' ' ρ p ' 2 + 1 3 2 = κ p : p flops.

    Total complexity for M symbols (M in practice is between 10 to 100) is: 4MN cflops +3 M(p-1) flops.

    On the other hand, the Morozov stopping rule relies mainly on the estimation of the noise variance. A typical noise variance estimation algorithm used in wireless communication systems and specifically within the context of spectrum sensing [18], solves a yule-walker set of equations using Levinson-Durbin algorithm and needs a complexity of 2MN 2 cflops [19].

    It is clear from the above expressions that the computational complexity of the L-curve early stopping method is less than that of Morozov early stopping method by an order of magnitude. Therefore, in terms of computational complexity, using the L-curve, early stopping method is much cheaper than using the Morozov early stopping method.

7. Simulation results

In the following, we evaluate the performance of the LPIC detector equipped with the L-curve stopping rule and based on the residual norm steepest descent and conjugate gradient least squares, respectively (which are referred to by RNSD-LPIC and CGLS-LPIC detectors, for conciseness).

First, we show how the L-curve method works. For this reason, we plot the norm of the residual error of both the RNSD-LPIC and CGLS-LPIC detectors for one OFDM symbol versus the stage index p, and we plot also its curvature using Equation (32). We set the carrier frequency to 3.5 GHz, SNR to 5 dB, N to 128, and K to 4 with frequency offsets (ε 1 = −0.35, ε 2 = 0.38, ε 3 = 0.36, ϵ 4 = −0.39) and speeds 80, 120, 90, and 100 km/h, respectively.

While a unique peak can be distinguished for the curvature of the residual's norm of the RNSD-LPIC detector as depicted in Figure 5, this is not the case with CGLS-LPIC detector. As shown in Figure 6, the residual's norm of the CGLS-LPIC detector exhibits an erratic behavior at later stages where it fluctuates and introduces wrong peaks in the curvature curve resulting in wrong stage index calculation using the L-curve method. To overcome this phenomenon, the norm of the residual error is fitted with a decaying exponential of the form: a 1 + a 2 e a 3 p . It is clear now that the L-curve method can be used without any pitfall and a unique peak is obtained from the curvature information. In all subsequent simulations, we consider RNSD-LPIC and CGLS-LPIC detectors in which the norm of the residual error is fitted with the decaying exponential stated above.

Figure 5
figure 5

The (a) residual's norm and (b) its curvature of the RNSD-LPIC detector.

Figure 6
figure 6

The (a) residual's norm and (b) its curvature of the CGLS-LPIC detector.

In Figures 7, 8, and 9, the sensitivity of the L-curve method with respect to the condition number of the system matrix (which varies with the time varying fading channel) is evaluated for different SNRs. The same parameters used in Figures 5 and 6 are used here as well except for the SNRs where the SNR is fixed to 1, 10, 20, and 30 dB, respectively. In addition, the L-curve technique is used over 5,000 consecutive OFDM symbols and the histogram of the stage indices of the RNSD-LPIC and CGLS-LPIC detectors are plotted in Figures 8 and 9, respectively.

Figure 7
figure 7

Channel condition number versus the OFDM symbol.

Figure 8
figure 8

Histogram of the stopping stage index for SNR = (a) 1 dB, (b) 10 dB, (c) 20 dB, and (d) 30 dB.

Figure 9
figure 9

Histogram of the stopping stage index for SNR = (a) 1 dB, (b) 10 dB, (c) 20 dB, and (d) 30 dB.

As depicted in Figure 7, the condition number of the system matrix varies from one OFDM symbol to another and it is dependent on the fading channels of the different users. It can be seen that the condition number of the system matrix varies largely in magnitude where it can go from 103 to 106.

As depicted in Figures 8 and 9, it is clear that the stopping stage determined by the L-curve method for both the RNSD-LPIC and CGLS-LPIC detectors is almost fixed with respect to the condition number variations of the system matrix over 5,000 OFDM symbol (see Figure 7) for each SNR. Consequently, it is sufficient to evaluate the stopping stage index for a few OFDM symbols (say 100 OFDM symbol) and then get the average stopping stage index and use it for the subsequent OFDM symbols. This is a very important result as it allows avoiding the calculation of the stopping stage for every OFDM symbol and thus renders this scheme very efficient in terms of computational complexity.

It also is clear that the stopping stage is almost constant on average with increasing SNR while in principle, it should increase. This is one of the deficiencies of the L-curve method, and it is due to the fact that the L-curve method is not a converging stopping rule, in the sense that the solution obtained using the L-curve method does not converge to the true solution if the noise variance vanishes to zero.

The L-curve method is somewhat sensitive to the size of the system matrix determined by the number of subcarriers N. To illustrate this fact, we plot the histogram of the stage indices determined by the L-curve method over 5,000 OFDM symbols for two values of the subcarriers N, that is N = 8 and N = 32, respectively. We can see from Figures 10 and 11 that the most dominant stage index for N = 8 is four stages while the most dominant stage index for N = 32 is five stages. In addition, we have seen previously from Figures 8 and 9 that for N = 128, the most dominant stage index is six stages which indicates that the most dominant stage index increases with the number of subcarriers N.

Figure 10
figure 10

Histogram of the stopping stage index for N= 8.

Figure 11
figure 11

Histogram of the stopping stage index for N= 32

This suggests that the stopping stage determined using the L-curve method should be updated whenever the total number of subcarriers N in the system changes, for example, if one user needs a higher data rate and is assigned a higher number of subcarriers, or if one user enters or leaves the system, etc.

In Figure 12, we evaluate the convergence behavior of both the RNSD-LPIC and the CGLS-LPIC detectors equipped by the L-curve stopping rule by varying the stage index p and assessing its average BER performance. For comparison purposes, we simulate also the decorrelator (DEC) and the LMMSE (LMMSE) detectors. We use the same simulation parameters as in Figures 5 and 6 but we set the SNR to 13 dB. One can see the semi-convergence behavior of both the RNSD-LPIC and the CGLS-LPIC detectors and how the detectors equipped with the L-curve method stop at six or seven stages and yield an average BER that is between that of the decorrelator and LMMSE detectors yet they do not require any information about the noise variance.

Figure 12
figure 12

Convergence behavior of the RNSD-LPIC and the CGLS-LPIC detectors equipped by the L-curve stopping rule.

Figure 13 illustrates the average BER performance versus the SNR of the RNSD-LPIC and the CGLS-LPIC detectors equipped by the L-curve stopping rule. It is clear that the RNSD-LPIC detector performs better than the decorrelator detector if the SNR is less than 15 dB and the CGLS-LPIC detector performs better than the decorrelator detector if the SNR is less than 16 dB. This suggests that the L-curve method can be used only for low to medium SNRs; fortunately, these regions suffer the most from the noise enhancement effect, and therefore, this deficiency of the L-curve method is not serious.

Figure 13
figure 13

Average BER versus SNR performance of the RNSD-LPIC and CGLS-LPIC detectors equipped by the L-curve stopping rule.

8. Conclusion

In this work, we introduced new linear interference cancellation detectors for low to medium SNR ill-conditioned communication systems that perform close to the LMMSE detector though they do not require the knowledge of the noise variance information. These linear IC detectors are based on early an stopping rule known as the L-curve method. Simulation results indicate that these detectors are insensitive to both the condition number of the system matrix and SNR and can work well up to SNR of 16 dB.

Appendix

In the following, we develop the average BER of the RNSD-LPIC and CGLS-LPIC detectors.

The QPSK scheme can be seen as two superimposed BPSK channels, these channels are orthogonal to each other and do not mutually interfere; therefore, the BER of QPSK scheme is simply the same as that of the BPSK scheme, and it is enough to conduct the BER probability analysis using the real or imaginary part only. In this derivation, we consider the real part of the decision vector y p .

The vectors y p and b can be decomposed as y p  = [y p,1 y p,2y p,n y p,N ]T and b = [b 1 b 2b n b N ]T; therefore, the real part of the n th element of the vector y p can be written as:

y p , n = g p , n H r = g p , n H Ψ ˜ ˜ b + n ,
(33)

where n is a vector of AWGN I.I.D samples of zero mean and variance ρ 2. By using the total probability theorem, we can write.

P b n b n = P b n = 1 , y p , n < 0 + P b n = 1 , y p , n > 0 = P b n = 1 P y p , n < 0 | b n = 1 + P b n = 1 P y p , n > 0 | b n = 1 = 1 2 P y p , n < 0 | b n = 1 + 1 2 P y p , n > 0 | b n = 1 = P y p , n < 0 | b n = 1 ,
(34)

thus

P b n b n = P g p , n H Ψ ˜ ˜ b + n < 0 | b n = 1 = P g p , n H n < g p , n H Ψ ˜ ˜ b | b n = 1 .
(35)

Due to the symmetry of the Gaussian (Normal) function, we have

P g p , n H n < g p , n H Ψ ˜ ˜ b | b n = 1 = P g p , n H n > g p , n H Ψ ˜ ˜ b | b n = 1 ,
(36)

hence

P b n b n = P g p , n H n > g p , n H Ψ ˜ ˜ b | b n = 1 = Q g p , n H Ψ ˜ ˜ b E g p , n H n var g p , n H n .
(37)

We have

E g p , n H n = 0
(38)

and

var g p , n H n = E g p , n H n g p , n H n H = E g p , n H n n H g p , n = σ 2 g p , n H g p , n ,
(39)

thus

P b n b n = Q g p , n H Ψ ˜ ˜ b E g p , n H n var g p , n H n = Q g p , n H Ψ ˜ ˜ b ρ g p , n H g p , n .
(40)

Conditioning over all interfering bits, the probability of error can be written as:

P b p , n = b 1 1 , 1 b j 1 , 1 j n b N 1 , 1 Q g p , n H Ψ ˜ ˜ b ρ g p , n H g p , n = 1 2 N 1 all b b n = 1 Q g p , n H Ψ ˜ ˜ b ρ g p , n H g p , n .
(41)

Averaging over all subcarriers, we obtain

P b p = 1 N n = 1 N 1 2 N 1 all b b n = 1 Q g p , n H Ψ ˜ ˜ b ρ g p , n H g p , n .
(42)

Endnote

acflop states for any complex addition, complex subtraction, complex multiplication, or complex division.

References

  1. Honig ML: Advances in multiuser detection. Hoboken, NJ: Wiley Series in Telecommunications and Signal Processing; 2009.

    Book  Google Scholar 

  2. Peng Z, Xu Z, Furong W, Xu X, Lai T: A relay assignment algorithm with interference mitigation for cooperative communication, in WCNC. Budapest 2009, 5–8: 1286-1291.

    Google Scholar 

  3. Hou SW, Ko CC: Intercarrier interference suppression for OFDMA uplink in time- and frequency-selective fading channels. IEEE. Tran. Vehicular. Technol. 2009, 58(6):2741-2754.

    Article  Google Scholar 

  4. Takanashi M, Nishimura T, Ogawa Y, Ohgane T: MIMO-UWB systems with parallel interference canceller using timing control scheme in LOS environments. IEEE. Wireless. Commun. Netw. Conf. (2007) 1599-1603. Kowloon, 11–15 March 2007

  5. Mrabet H, Dayoub I, Attia R, Haxha S: Performance improving of OCDMA system using 2-D optical codes with optical SIC receiver. J. Lightwave. Technol. 2009, 27(21):4744-4753.

    Article  Google Scholar 

  6. Axell E, Larsson EG: Optimal and sub-optimal spectrum sensing of OFDM signals in known and unknown noise variance. IEEE. J. Select. Areas. Commun. 2011, 29(2):290-304.

    Article  Google Scholar 

  7. Larsson EG, Thobaben R, Wang G: On diversity combining with unknown channel state information and unknown noise variance. Proc. of IEEE Wireless Communications and Networking Conference (WCNC) Sydney, 18–21 April 2010

  8. Abdelouahab B, Alshebeili SA: Regularization property of linear interference cancellation detectors. EURASIP. J. Adv. Signal. Proc. 2012, 2012: 145.

    Article  Google Scholar 

  9. Hamarik U, Palm R: On rules for stopping the conjugate gradient type methods in ill-posed problems. Math. Model. Anal. 2007, 12(1):61-70.

    Article  MathSciNet  MATH  Google Scholar 

  10. IEEE Standard for Local and Metropolitan area networks Part 16, Air interface for fixed and mobile broadband wireless access systems amendment 2: physical and medium access control layers for combined fixed and mobile operation in licensed bands, 802nd edn. Piscataway, NJ: The Institute of Electrical and Electronics Engineering, Inc. Std. IEEE; 2006.

  11. Hashemizadeh SK, Saeedi-Sourck H, Omid MJ: Sensitivity analysis of interleaved OFDMA system uplink to carrier frequency offset. In 2011 IEEE 22nd International Symposium on Personal Indoor and Mobile Radio Communications. Toronto, ON; 2011:1631-1635.

    Chapter  Google Scholar 

  12. Thamban NM: Linear operator equations: approximation and regularization. Singapore: World. Sci. Publ. Co.; 2009.

    MATH  Google Scholar 

  13. Hansen C: Rank-deficient and discrete ill-posed problems: numerical aspects of linear inversion. Philadelphia, PA: Society for Industrial and Applied Mathematics; 1998:403-6.

    Book  Google Scholar 

  14. Nagy J, Palmer K: Steepest descent, CG and iterative regularization of ill-posed problems. BIT 2003, 43: 1003-1017.

    Article  MathSciNet  MATH  Google Scholar 

  15. Hansen PC: The L-curve and its use in the numerical treatment of inverse problems. Comput. Inverse. Prob. Electrocard. 2000, 2: 1-24.

    Google Scholar 

  16. Hansen PC, Jensen TK, Rodriguez G: An adaptive pruning algorithm for the discrete L-curve criterion. J. Comput. Appl. Math. 2006, 198(2):483-492.

    Article  MathSciNet  MATH  Google Scholar 

  17. Qu P, Zhong K, Zhang B, Wang J, Shen GX: Convergence behavior of iterative SENSE reconstruction with non-Cartesian trajectories. Magn. Reson. Med. 2005, 54(4):1040-5.

    Article  Google Scholar 

  18. Joshi DR, Popescu DC, Dobre OA: Adaptive spectrum sensing with noise variance estimation for dynamic cognitive radio systems. In CISS 2010. Princeton, NJ; 2010:1-5.

    Google Scholar 

  19. Golub GH, Van Loan CF: Matrix computations. 4th edition. Baltimore, MD: The Johns Hopkins University Press; 2013.

    MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Abdelouahab Bentrcia.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Bentrcia, A., Alshebeili, S.A. Linear IC detectors for low to medium SNR ill-conditioned communication systems with unknown noise variance. EURASIP J. Adv. Signal Process. 2013, 180 (2013). https://doi.org/10.1186/1687-6180-2013-180

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1687-6180-2013-180

Keywords