- Research
- Open access
- Published:

# Adaptive reconfigurable V-BLAST type equalizer for cognitive MIMO-OFDM radios

*EURASIP Journal on Advances in Signal Processing*
**volume 2015**, Article number: 8 (2015)

## Abstract

An adaptive channel shortening equalizer design for multiple input multiple output-orthogonal frequency division multiplexing (MIMO-OFDM) radio receivers is considered in this presentation. The proposed receiver has desirable features for cognitive and software defined radio implementations. It consists of two sections: MIMO decision feedback equalizer (MIMO-DFE) and adaptive multiple Viterbi detection. In MIMO-DFE section, a complete modified Gram-Schmidt orthogonalization of multichannel input data is accomplished using sequential processing multichannel Givens lattice stages, so that a Vertical Bell Laboratories Layered Space Time (V-BLAST) type MIMO-DFE is realized at the front-end section of the channel shortening equalizer. Matrix operations, a major bottleneck for receiver operations, are accordingly avoided, and only scalar operations are used. A highly modular and regular radio receiver architecture that has a suitable structure for digital signal processing (DSP) chip and field programable gate array (FPGA) implementations, which are important for software defined radio realizations, is achieved. The MIMO-DFE section of the proposed receiver can also be reconfigured for spectrum sensing and positioning functions, which are important tasks for cognitive radio applications. In connection with adaptive multiple Viterbi detection section, a systolic array implementation for each channel is performed so that a receiver architecture with high computational concurrency is attained. The total computational complexity is given in terms of equalizer and desired response filter lengths, alphabet size, and number of antennas. The performance of the proposed receiver is presented for two-channel case by means of mean squared error (MSE) and probability of error evaluations, which are conducted for time-invariant and time-variant channel conditions, orthogonal and nonorthogonal transmissions, and two different modulation schemes.

## 1 Introduction

The fundamental problem in the design of future wireless communication systems is to reliably and efficiently transmit and receive information signals over imperfect channels using substantially high data rates. One successful approach adopted in several wireless standards such as digital audio broadcasting (DAB), digital video broadcasting (DVB-T), local area networking (LAN), and metropolitan area networking (MAN) is orthogonal frequency division multiplexing (OFDM) in which the entire bandwidth is divided into several narrow subbands so that the frequency response over each individual subband is relatively flat, and each subband channel occupies only a small fraction of the original bandwidth. Nevertheless, OFDM-based wireless communication systems can support peak rates of 54 Mbps at most, which is not enough to cover services the providers offer nowadays. Throughputs far beyond 54 Mbps can be provided when multiple input multiple output (MIMO) system approach is applied especially in a rich scattering environment [1,2]. Hence, the combination of OFDM and MIMO technologies [3,4] constitutes the basis for next-generation wireless communication systems such as IEEE 802.11n for wireless local area networks (WLAN), IEEE 802.16e for MAN, and evaluation of higher generational cellular systems.

The performance achieved through MIMO technology also entails a considerable increase in signal processing complexity in receiver, and there exists a major challenge in designing low-complexity receivers for multichannel wireless systems. A significant development for MIMO communications is the proposition of V-BLAST architecture [5], and two important areas of research on V-BLAST receivers are reduction of complexity, i.e., avoidance of matrix inversions, and extension to broadband implementation. Consequently, the recent research such as [6-8] focused on reducing the complexity of V-BLAST receiver architectures for frequency selective channels by developing efficient matrix inversion operations.

An important problem in realizing OFDM system designs, however, is the appendage of a cyclic prefix (CP) with a length at least equal to the channel length to each block of *N* IFFT coefficients, and this application may not be adequate in case the length of CP, *ξ*, is large relative to the data length, *N*, so that the channel throughput is reduced by a factor *N*/(*N*+*ξ*). In addition, information about the channel length may not even be available in some cases. Accordingly, it is desired to design systems that guarantee a certain amount of throughput, i.e., *N*/(*N*+*ξ*)≅1, in all possible channel conditions. An elegant solution to this problem is to implement a time domain equalizer to shorten the channel memory and hence reduce the CP overhead [9].

A recent development in the design of next-generation wireless communication systems is the cognitive radio, built on a software radio, which functions as an intelligent system that is aware of its environment and uses the methodology of understanding-by-building to learn from the environment and adapt to statistical variations in the input stimuli in order to establish reliable communication by efficient utilization of the radio spectrum [10]. The concept of software radio on the other hand relies on the development of DSP technology, that is flexible, reconfigurable, and reprogrammable by software to adapt to an environment where there are multiple services, standards, and frequency bands [11]. Correspondingly, the infrastructure in a software radio system is generally required to use reconfigurable VLSI hardware components such as DSP chip sets [12], FPGAs [13], embedded processors [14], and even general purpose processors [15].

A typical cognitive radio cycle includes spectrum sensing, analysis, reasoning, and adaptation to new operating parameter steps [16]. The cognitive radio can detect the availability of a portion of frequency band through spectrum sensing and analysis steps [17]. During the reasoning step, it determines the optimum operating parameters, so that no harmful interference to other users of the spectrum is generated due to its transmission. In the adaptation step, the radio switches to transmission and reception mode using its reconfigurability and reprogrammability property and tunes its operating parameters according to its best response strategy. Another emerging requirement for cognitive radios is location and environment awareness that involves modeling the capabilities of human beings and bats for realization of advanced and autonomous location and environment awareness features [18]. Adaptive positioning, determining the coordinates of a cognitive radio in space, is a step towards realization of accurate location awareness in cognitive radios. The author has recently proposed a spectrum estimation method in [19] and a range estimation method in [20] that are suitable for spectrum sensing and positioning functions of cognitive radios, respectively. In this paper, we focus on the reception mode of operation of cognitive MIMO-OFDM radios and propose a new minimum MSE channel shortening equalizer design, which consists of adaptive fron-tend MIMO-DFE and multiple Viterbi detection sections.

The optimum solution for the channel shortening equalization problem can be found using one of these constraints: (1) unit tap constraint and (2) unit energy constraint; and the performances under these two criteria were compared for single input single output (SISO) and MIMO channel shortening equalization in [21,22], respectively. Since the findings in these papers show that the unit energy constrained channel shortener equalization resulted in better performance, we have used unit energy constraint for the MIMO channel shortening optimization problem under consideration in this paper. Accordingly, the contributions of the paper can be stated as follows: (1) the proposed equalizer has a front-end MIMO-DFE as opposed to the MIMO feed forward equalizer (MIMO-FFE) in [22], (2) a modified version of sequential processing multichannel lattice stages (SPMLSs) [23] is utilized in the design of front-end MIMO-DFE and a complete modified Gram-Schmidt orthogonalization of multichannel input data, which avoids matrix inversions, enables scalar only operations and contributes to the flexibility, reconfigurability, and reprogrammability of the receiver, is attained, (3) the proposed equalizer can be viewed as a V-BLAST receiver for frequency selective channels, (4) spectrum sensing or range estimation can be accomplished at no cost by simply reconfiguring the front-end MIMO-DFE as multichannel spectral analysis or positioning filter as shown in [19,20], respectively, and (5) a detailed computational complexity and performance analysis is presented. The first contribution is important from the perspective of interference removal and, by means of that, error performance, whereas the second one is considered the key since matrix inversion is a major bottleneck in the design of embedded receiver architectures that increases computational complexity [24]. The third one is relevant since the receiver operations of a V-BLAST system can be considered as performing Gram-Schmidt orthogonalization [25], whereby inter-symbol interference (ISI) as well as inter-channel interference (ICI) effects are suppressed. The fourth contribution is crucial from the point of view of cognitive radio operation cycle, so that the filter structure of MIMO-DFE can be reused for spectrum sensing and range estimation functions of cognitive radio, and finally, a comparative computational complexity and performance analysis of the proposed equalizer with respect to the other benchmark equalizers such as MIMO-DFE, MIMO-FFE, and multichannel Viterbi equalizer (VE), has been provided, which to the best of the author’s knowledge, does not exist in the literature.

Various MIMO-DFEs for MIMO ISI channels have been proposed in the literature [26-28] after the introduction of the finite length MIMO-DFE in [29], and it has been delineated by Ginis and Cioffi in [30] that DFE is the basic principle behind the BLAST detection algorithm. Very recently, a QR decomposition-based MIMO-DFE has been presented by Wang et al. in [31]. In QR decomposition approaches, the Q matrix is implicitly formed and then used to compute the R matrix; whereas in the Gram-Schmidt approach, the inverse of the R is implicitly formed and then used to compute the Q matrix. As a consequence of this fact, Regalia and Bellanger showed in [32] that there exists a duality between QR and lattice methods and the possibility of combining elements of both approaches to obtain new hybrid algorithms. With respect to developing these hybrid algorithms, Ling showed in [33] that an orthogonal Givens rotation-based algorithm algebraically coincides with the recursive modified Gram-Schmidt-based lattice algorithm in [34]. In accordance with this perspective, we modify the SPMLS using Givens rotation-based lattice algorithms of [33] on the structure of the SPMLS, so that a sequential processing multichannel Givens lattice stage (SPMGLS) is obtained. SPMLSs are known for their modular, order-recursive, and regular structure as we previously used them in the decision feedback equalization of nonlinear communication channels in [35]. Additionally, good numerical properties are incurred by the use of Givens rotation-based lattice algorithms.

Subsequent to Givens lattice realization of the front-end MIMO-DFE, we perform a systolic array implementation of multiple adaptive Viterbi detectors [36], thereby a highly concurrent receiver structure is obtained. A two-channel (2×2) problem is considered in this presentation due to the ease of explanation and space limitations in developing the method. However, it is considered straightforward to apply the method to any number of channels, i.e., to massive MIMO implementations for next-generation wireless systems [37], at the expense of increased complexity. Even though the complete orthogonality and thereby the suppression of ISI and ICI is accomplished in the minimum mean square error sense for any number of transmit and receive antennas, the performance achieved in terms of MSE as well as in the probability of error will depend on how much the channel is ill-conditioned.

The organization of this paper is as follows. In Section 1, the adaptive multichannel channel shortening equalization optimization problem is introduced. In Section 1, we describe the adaptive multiple Viterbi detection section of the proposed equalizer. The computational complexity computations are treated in Section 1. In Section 1, we present the experimental results, and finally, Section 1 is concerned with the discussion of results and conclusions. (∙) ^{∗} represents the complex conjugate of (∙). (∙) ^{T}, and (∙) ^{H} stands for the transpose and the Hermitian transpose of (∙), respectively. The variables *m*, *i*, and *n* are global while all other variables are local. The variable *m* represents the stage number while *i* and *n* are the time indexes related to data and coefficients, respectively, till we equate them in Section 1 to have a single time index.

## 2 Optimization problem statement

We consider the discrete-time baseband equivalent 2×2 channel shortening equalization problem depicted in Figure 1, where the number of transmitters (*M*
_{
T
}) and receivers (*M*
_{
R
}) is assumed equal, so that the number of antennas (*M*) is *M*=*M*
_{
T
}=*M*
_{
R
}=2. Note that the *k*th baseband channel in Figure 1 models the effects of serial-to-parallel (S/P) and parallel-to-serial (P/S) conversions, the addition and removal of CP, the IDFT and DFT operations, and the physical baseband channel itself as delineated in Figure 2. Accordingly, the input signal to the *k*th receiver can be expressed as the sum of transmitted signals corrupted by ISI, ICI, and the noise:

in which *h*
_{
ℓ,k
}(*n*) is the impulse response of the channel between the *ℓ*th transmitter and the *k*th receiver, whereas *x*
_{
ℓ
}(*n*) is the transmitted sequence, and *μ*
_{
ℓ,k
} is the memory of channel *h*
_{
ℓ,k
}(*n*). Accordingly, *h*
_{
ℓ,k
}(*n*) for *ℓ*≠*k* constitute ICI, and the elements of *h*
_{
ℓ,k
}(*n*) for *ℓ*=*k* and *μ*
_{
ℓ,k
}≠0 amount to ISI. *u*
_{
k
}(*n*) denotes the *k*th channel noise.

In the adaptive two-channel channel shortening equalizer design problem, the objective is to find an exponentially windowed, least squares (LS) solution for the coefficients of the *k*th adaptive DFE and the corresponding *k*th adaptive desired impulse response (ADIR) filter that minimizes the *k*th cost function:

at each time instant *n*, where *k*=1,2 and *β* is the exponential weighting factor. Herein, the error signal, \({e^{k}_{n}}(i)\), is given by:

The *k*th desired signal, \({d_{n}^{k}}(i)\), at the output of the *k*th ADIR is expressed as:

whereas the estimate of *k*th desired signal, \(\hat {d}_{n}^{k}(i)\), in training mode of operation, is equal to the output signal of the *k*th DFE:

and it is identical to the delayed output signal of the *k*th DFE:

in decision directed mode. Note that \( {N^{d}_{k}} \) in (4) and \( {N^{f}_{k}} \) and \( {N^{b}_{k}} \) in Equations (5) and (6) are the length of the *k*th ADIR filter, and the lengths of feed forward and feedback sections of the *k*th DFE, respectively, whereas \(\left ({N^{d}_{k}}-1\right) \), \(\left ({N^{f}_{k}}-1\right)\), and \(\left ({N^{b}_{k}}-1\right)\) are the corresponding filter and equalizer memories. Accordingly, \(\overline {D}_{k}\) is the delay experienced by the output signal of *k*th DFE, \({z^{k}_{n}}(i)\), during the Viterbi processing. The input signal (\(\bar {x}_{k}(i)\)) to the feedback section and to the *k*th ADIR filter in Equations (4),(5), and (6) equals to the delayed *k*th channel input signal in training mode (\(\bar {x}_{k}(i)=x_{k}(i-D_{k})\)), while it is equal to the *k*th detected signal in decision directed mode of operation of the receiver (\( \bar {x}_{k}(i)=\hat {x}_{k}(i)\)). Herein, *D*
_{
k
} represents the delay experienced by the *k*th input signal, *x*
_{
k
}(*i*), through the corresponding channel during the training mode of operation.

Subsequently, we define the input vector to the *k*th DFE, **y**
_{
k
}(*i*), at time instant *i*, as:

and the corresponding coefficient vector, **p**
_{
k
}(*n*), at time instant *n*, as:

The input vector to the *k*th ADIR filter at time instant *i* and its coefficient vector at the time instant *n* are also defined as:

and

Note that we assume, without loss of generality, that \( {N^{b}_{k}} \leq {N^{f}_{k}}\) for the *k*th DFE.

The main concern of the exponentially weighted LS problem under consideration is thus to find, at each time *n*, the *k*th optimal coefficient vectors, **p**
_{
k
}(*n*) and **w**
_{
k
}(*n*), that would minimize the cost function:

which can be expressed in matrix form as follows:

Herein, \( \mathbf {R}_{y_{k} y_{k}}(n)\) is the \(\left ({N^{f}_{k}} + {N^{b}_{k}}\right) \times \left ({N^{f}_{k}} + {N^{b}_{k}}\right)\) correlation matrix of **y**
_{
k
}(*i*), which is given by:

\(\mathbf {R}_{\bar {x}_{k} y_{k}}(n)\) is the \( {N^{d}_{k}} \times \left ({N^{f}_{k}} + {N^{b}_{k}}\right)\) cross-correlation matrix of \(\bar {\mathbf {x}}_{k}(n)\) and **y**
_{
k
}(*n*), which can be expressed as:

and \( \mathbf {R}_{\bar {x}_{k} \bar {x}_{k}}(n)\) is the \({N^{d}_{k}} \times {N^{d}_{k}}\) autocorrelation matrix of the *k*th ADIR filter input data vector \(\bar {\mathbf {x}}_{k}(i)\), and is found by:

Note that \( \mathbf {R}_{\bar {x}_{k} y_{k}}(n) \triangleq \mathbf {R}^{H}_{y_{k} \bar {x}_{k}}(n).\) Subsequently, the *k*th optimal coefficient vector for the equalizer is determined by differentiating *J*
_{
k
}(*n*) with respect to **p**
_{
k
}(*n*), setting the derivative to zero, and solving for **p**
_{
k
}(*n*):

In order to find a solution for the optimal coefficient vector of the *k*th ADIR filter, we substitute Equation (16) back into the cost function in Equation (12) and attain the following quadratic form in **w**
_{
k
}(*n*):

Then, the expression enclosed by square brackets in Equation (17), a symmetric \( {N^{d}_{k}} \times {N^{d}_{k}}\) matrix, is defined as:

so that the cost function in Equation (17) can be restated as:

In minimizing the expression in Equation (19), a unit energy constraint, \( \mathbf {w}^{H}_{k}(n)\mathbf {w}_{k}(n)=1 \), is applied to the *k*th ADIR filter coefficients to avoid the trivial null equalizer solution [21], and the following Lagrangian expression is formed:

After taking the derivative of the expression in (20) and equating to zero, we get:

which shows that the optimal *k*th ADIR coefficient vector \(\mathbf {w}^{\text {opt}}_{k}(n)\) and *λ* are the unit magnitude eigenvector and eigenvalue of the matrix \(\widetilde {\mathbf {R}}_{\bar {x}_{k}y_{k}}(n)\), respectively. If the expression on the righthand side of Equation (21) is substituted for \( \widetilde {\mathbf {R}}_{\bar {x}_{k}y_{k}}(n)\mathbf {w}_{k}(n)\) in Equation (19) and also \( \mathbf {w}^{H}_{k}(n)\) in Equation (19) is replaced with \(\mathbf {w}^{H\text {opt}}_{k}(n)\), then the minimum cost can be stated as follows:

which demonstrates that the cost function is minimized by choosing \(\mathbf {w}^{\text {opt}}_{k}(n)\) to be equal to the eigenvector of the matrix \(\widetilde {\mathbf {R}}_{\bar {x}_{k}y_{k}}\) and that the corresponding eigenvalue *λ* is the minimum eigenvalue of the matrix \(\widetilde {\mathbf {R}}_{\bar {x}_{k}y_{k}}\) and is represented with *λ*
_{min}. Consequently, the optimal coefficient vectors for the *k*th equalizer and the *k*th ADIR filter, \(\mathbf {p}^{\text {opt}}_{k}(n)\) and \(\mathbf {w}^{\text {opt}}_{k}(n)\), are given by Equations (16) and (21), respectively.

### 2.1 V-BLAST type MIMO-DFE

We would like to use a V-BLAST type design approach for the front-end filter of the proposed equalizer, and we also require the design of a single, multichannel, and compact equalizer structure, so that two separate equalizers and direct evaluations as in (16) are avoided, and the same filter can be reconfigured as spectral analysis or positioning filter. These objectives can be accomplished by considering the equivalence of V-BLAST and modified Gram-Schmidt orthogonalization operations, and therefore by completely orthogonalizing the two-channel input data of DFE using SPMGLSs, which provide scalar only operations, good numerical properties as well as modularity, regularity, order recursiveness, and reconfigurability to the solution of equalization problem under consideration. Hereupon, we present the modifications we propose to make in SPMLSs so as to obtain SPMGLSs and then the design of front-end multichannel DFE using SPMGLSs.

### 2.2 SPMGLS

A SPMGLS has a block structure as shown in Figure 3, and the input signal vectors to a SPMGLS are defined as follows: the input forward prediction error vector:

the backward prediction error vector:

and the estimation error vector:

The elements of input forward and backward prediction error vectors in Equations (23) and (24) are orthogonalized by using self-orthogonalization processors (SOPs), which are triangular-shaped processors in Figure 3. The outputs of SOPs are the orthogonalized forward prediction error vector:

and the orthogonalized backward prediction error vector:

The elements of \(\hat {\mathbf {f}}_{\ell -1}(i)\) are fed into a forward prediction reference-orthogonalization processor (ROP) in order to predict the elements of **b**
_{
ℓ−1}(*i*−1) and to produce the stage output back prediction error vector **b**
_{
ℓ
}(*i*). The elements of \(\hat {\mathbf {b}}_{\ell -1}(i)\) are fed into a ROP to perform *p*-channel joint process estimation and to produce the stage output estimation error vector **e**
_{
ℓ
}(*i*). Subsequently, the elements of \(\hat {\mathbf {b}}_{\ell -1}(i)\) are delayed and are also fed into another ROP to obtain the stage output forward prediction error vector **f**
_{
ℓ
}(*i*).

There are two types of processing cells, single and double circular processors, in a SPMGLS as in the original SPMLS in [23]. Nevertheless, we change the processing equations implemented in these processing cells with the equations of the square root version of the Givens algorithm in [33]. The interconnections and signals propagating through these processing cells are shown in Figure 4. The processing cells symbolized with a double circle, which are also called boundary (angle computer) cells, perform the following equations:

From Equations (28),(29), and (30), it can be shown that the parameters *c*(*i*) and *s*(*i*) satisfy the equation:

The connection between the input, *γ*
_{in}(*i*), and output, *γ*
_{out}(*i*), likelihood variables is defined as:

On the other hand, the processing cells symbolized with a single circle, which are called internal (rotator) cells, perform the following equations:

and

Accordingly, Equations (31), (33), and (34) can be combined into:

where

with |**Q**(*i*)|=1, so that it performs Givens plane rotation in a complex plane, and thereby the stability of Givens algorithm is guaranteed.

### 2.3 Sequential givens lattice orthogonalization

The V-BLAST processing is made possible by utilizing SPMGLSs in the design of MIMO-DFE, so that the number of channels at different sections of the proposed multichannel lattice DFE is different due to the sequential processing nature of SPMGLSs. Therefore, we carry out the exponentially weighted LS optimization problem by taking into consideration each of these sections separately and assume that the proposed equalizer is comprised of three cascaded equalizers, which are two-channel, three-channel, and four-channel lattice sections; and we use a different index for each section while using *m* to indicate a stage in the whole equalizer. Henceforth, we focus on the case \({N^{f}_{1}}={N^{f}_{2}}\) as it brings out the essential ideas without unduly complicating the development and loss of generality.

In order to sequentially solve the exponentially weighted LS optimization problem under consideration, we first organize the elements of input signal vectors **y**
_{1}(*i*)=[*y*
_{1}(*i*),…,*y*
_{1}(*i*−*ℓ*+1)]^{T} and **y**
_{2}(*i*)= [*y*
_{2}(*i*),…,*y*
_{2}(*i*−*ℓ*+1)]^{T}, according to the natural ordering of SPMGLSs as:

and input to two-channel stages for which the stage number *m* has a range of values given by \( 0 < m \leq \left ({N^{f}_{1}}-{N^{b}_{1}}\right)\).

Accordingly, we redefine Equations (13) and (14) using this new data vector as follows:

and

where *k*=1,2. The orthogonalization of input data using SPMGLSs corresponds to the transformation of (38) and (39) into:

and

respectively. Here, **Ω**
_{
ℓ
}(*n*) is the 2*ℓ*×2*ℓ* lower triangular transformation matrix and is realized stage-by-stage using 2×2 lower triangular transformation matrices:

whose diagonal elements are all equal to unity at time instant *n*, and \(\hat {\kappa }_{\ell }(n)\) is the reflection coefficient computed at the single circular cell in the triangular shaped self-orthogonalization processor of the *ℓ*th two-channel SPMGLS. Then, the lattice joint process estimation coefficients are computed by means of:

where \(\mathbf {\Theta }_{\ell _{k}}(n)\) represents the *k*th row of the 2×2*ℓ* lattice joint process estimation reflection coefficient matrix **Θ**
_{
ℓ
}(*n*) which is also sequentially computed stage-by-stage using 2×2 joint process estimation coefficient matrices:

in which \(\bar {\mathbf {\kappa }}_{\ell,_{k,j}}(n)\) is the *j*th reflection coefficient related to the estimation of the *k*th desired signal, and it is computed at the (*k*,*j*)th single circular cell of the square shaped reference-orthogonalization processor related to joint process estimation at the *ℓ*th two-channel SPMGLS. Note that the matrix inversion operation in Equation (16) is transformed into a simple scalar inversion operation in (43) due to the diagonal nature of **Ξ**
_{
ℓ
}(*n*).

After the processing of input signals by two-channel lattice stages, the first estimation error signal, \(\bar {x}_{1}(i) =e_{1}(i)\), which corresponds to the detected and fed back signal of the first channel, is incorporated at the \(\left ({N^{f}_{1}}-{N^{b}_{1}} + 1\right)th\) stage as the third channel. Accordingly, we expand the optimization problem by organizing the elements of the input data vectors *y*
_{1}(*i*)=[*y*
_{1}(*i*),…,*y*
_{1}(*i*−*α*+1)]^{T}, *y*
_{2}(*i*) = [*y*
_{2}(*i*),…,*y*
_{2}(*i*−*α*+1)]^{T}, and \(\mathbf {x}_{1}(i)\,=\,\left [\bar {x}_{1}(i-1),\ldots \right.\), \(\left.\bar {x}_{1}(i-\alpha +1)\right ]^{T}\) as follows:

and input to the three-channel lattice section, where the stage number (*m*) takes values in the range given by \(\left ({N^{f}_{1}}-{N^{b}_{1}}\right) < m \leq \left ({N^{f}_{2}}-{N^{b}_{2}}\right)\). Subsequently, we solve the optimization problem in (43) once again with the new input vector, in which case **Ω**
_{
α
}(*n*) and **Θ**
_{
α
}(*n*) are the 3*α*×3*α* lower triangular transformation and the 3×3*α* lattice joint process estimation coefficient matrices, respectively. **Ω**
_{
α
}(*n*) is computed sequentially by means of 3×3 lower triangular transformation matrices, **L**
_{
α
}(*n*) and **Θ**
_{
α
}(*n*), and is similarly realized stage-by-stage making use of 3×3 joint process estimation coefficient matrices, **Δ**
_{
α
}(*n*), at time instant *n*.

Finally, the optimization problem is expanded one more time with the inclusion of the second estimation error signal, \(\bar {x}_{2}(i) =e_{2}(i)\), which is related to the detected and fed back signal of the second channel, and this time, the elements of input data vectors **y**
_{1}(*i*)=[*y*
_{1}(*i*),…,*y*
_{1}(*i*−*𝜗*+1)]^{T}, **y**
_{2}(*i*)= [*y*
_{2}(*i*),…,*y*
_{2}(*i*−*𝜗*+1)]^{T}, \(\bar {\mathbf {x}}_{1}(i)=\left [\bar {x}_{1}(i-1),\ldots, \bar {x}_{1}(i-\vartheta +1)\right ]^{T}\), and \(\bar {\mathbf {x}}_{2}(i)=\left [\bar {x}_{2}(i-1),\ldots,\bar {x}_{2}(i-\vartheta +1)\right ]^{T}\) are organized as:

where the stage number (*m*) is in the range given by \(\left ({N^{f}_{2}}-{N^{b}_{2}}\right) < m \leq {N^{f}_{2}}\) due to four-channel processing. Similar to two-channel and three-channel cases, we solve the optimization problem in (43) using the new data vector in Equation (46), in which case **Ω**
_{
𝜗
}(*n*) and **Θ**
_{
𝜗
}(*n*) are 4*𝜗*×4*𝜗* lower triangular transformation, and 4×4*𝜗* joint process estimation error coefficient matrices at the time instant *n*, respectively. Similar to previous cases, these matrices are computed stage-by-stage by the use of 4×4 lower triangular transformation matrices, **L**
_{
𝜗
}(*n*), and 4×4 joint process estimation error coefficient matrices, **Δ**
_{
𝜗
}(*n*), at time instant *n*, respectively.

### 2.4 Computation of error order updates

Due to the sequential nature of the proposed lattice structure, we carry out the multichannel error order update task by taking into consideration two-channel, three-channel, and four-channel sections separately, and therefore we assume that the filter is comprised of three cascaded filters as described in the previous subsection. The prediction and joint state estimation errors for the end of the observation interval *n*=*i* at the output of the *ℓ*th order two-channel equalizer section, where \( 0 < m \leq \left ({N^{f}_{1}}-{N^{b}_{1}}\right)\), can be stated in terms of lattice parameters and the (*ℓ*−1)th order prediction errors as follows:

and

where the lower triangular and square coefficient matrices are generated in triangular-shaped self-orthogonalization and square-shaped reference-orthogonalization processors in a two-channel SPMGLS as previously defined in Equations (42) and (44). The joint process estimation error updates are accordingly given as:

We then multiply the lower triangular and square coefficient matrices in Equations (47), (48), and (49), and make the following definitions:

and

in order to obtain compact versions of the Equations (47), (48), and (49) as follows:

and

The development of prediction and joint process estimation error order updates from (*α*−1)th order to *α*th for the three-channel section, where the stage number (*m*) takes values in the range given by \(\left ({N^{f}_{1}}-{N^{b}_{1}}\right) < m \leq \left ({N^{f}_{2}}-{N^{b}_{2}}\right)\), is carried out in a similar fashion to the two-channel section, and they can be expressed in compact form with the following equations:

and

where

and

The prediction and joint process estimation error order update equations from (*𝜗*−1)th order to *𝜗*th order for the four-channel section, where the stage number (*m*) is in the range given by \(\left ({N^{f}_{2}}-{N^{b}_{2}}\right) < m \leq {N^{f}_{2}}\), can be derived by following a similar procedure to two- and three-channel sections, and 4×1 error order update matrices can be subsequently obtained with 4×4 lower triangular and square coefficient matrices.

### 2.5 Matrix visualization

In order to visualize the cascading and functioning of two-channel, three-channel, and four-channel sections as a single equalizer, we provide a matrix representation of sequential Givens lattice orthogonalization by considering \(\left ({N^{f}_{1}},{N^{b}_{1}}\right)=(13,7)\) and \(\left ({N^{f}_{2}},{N^{b}_{2}}\right)=(13,2)\) DFEs for the first and second channels, and also organizing the elements of input data vectors **y**
_{1}(*n*)=[*y*
_{1}(*n*),*y*
_{1}(*n*−1),…,*y*
_{1}(*n*−11),*y*
_{1}(*n*−12)]^{T}, **y**
_{2}(*n*)=[*y*
_{2}(*n*),*y*
_{2}(*n*−1),…,*y*
_{2}(*n*−11),*y*
_{2}(*n*−12)]^{T}, \(\mathbf {x}_{1}(n)=\left [\bar {x}_{1}(n-1),\ldots, \bar {x}_{1}(n-6) \right ]^{T} \), and \(\mathbf {x}_{2}(n)=\left [\bar {x}_{2}(n-1)\right ]^{T}\) as columns of a matrix:

by taking into consideration different numbers of parameters in the feed forward and feedback channels and shifting properties of input data. This matrix helps us to visualize the orthogonalization process, and thus to draw a diagram of the four channel DFE structure under consideration as in Figure 5. Note that the elements of the first and second rows are related to the input signals of the first and the second channels of the DFE under consideration, while the third and fourth rows are associated with the detected and fed back signals. Lattice orthogonalization begins with the elements of the first two rows using two-channel sequential lattice processing stages until the first fed back channel is incorporated as the new channel at a transitional stage, which is the \(\left ({N^{f}_{1}} - {N^{b}_{1}} + 1\right)\)th stage. Then, the orthogonalization continues with three-channel lattice stages until the fourth channel, which is related to the detected and fed back signal of the second channel, is taken into the process at another transitional stage, which is the \(\left ({N^{f}_{2}} - {N^{b}_{2}} + 1\right)\)th stage, and so the orthogonalization of input data finalizes with four-channel stages when the mean squared estimation error performance requirements are met, and thereby the *k*th desired signal, *d*
^{k}(*n*), is sequentially estimated using self-orthogonalized backward prediction error signals as follows:

Here, the first and second summations represent the estimation accomplished by the two-channel and three-channel sections, respectively, and the third summation is connected with the four-channel estimation section. In each section, \(\bar {\kappa }_{m,k,j}(n)\) represents the *j*th estimation reflection coefficient at the *m*th stage related to the *k*th channel as defined in the previous subsection, and \(\hat {b}^{j}_{m-1}(i) \) represents the *j*th element of the self-orthogonalized backward prediction error signal vector, \(\hat {\mathbf {b}}_{m-1}(i)\), at the input of the *m*th stage. The self-orthogonalized backward prediction error vector, \(\hat {\mathbf {b}}_{m-1}(i) \), is produced by the lower triangular transformation of the input backward prediction error vector, **b**
_{
m−1}(*i*), using **L**
_{
m
}(*n*), and this operation is accomplished at the triangular shaped self-orthogonalization processor (related to forward prediction) of the *m*th SPMGLS. Note that the sizes of vectors, \(\hat {\mathbf {b}}_{m-1}(i) \) and **b**
_{
m−1}(*i*), and matrix, **L**
_{
m
}(*n*), at different sections of the proposed lattice equalizer are as follows: 2×1 and 2×2 in two-channel section, 3×1 and 3×3 in three-channel section, and 4×1 and 4×4 in four-channel section, respectively.

## 3 Adaptive multiple systolic Viterbi detection

In order to achieve an all systolic equalizer architecture, we propose to use the systolic array processor approach in [36] for the design and implementation of Viterbi detection, so that a high degree of computational concurrency is obtained by operating simultaneously and in synchronization with the rest of equalizer circuitry. Accordingly, the most computationally intensive operation in the Viterbi detection of sent data is related to the comparator metric, and a systolic computation of this metric is accomplished by multiply and accumulate operations:

for *υ* branches leading from states at time instant *i* − 1 to each state at time instant *i* as illustrated in Figure 6. Herein, *υ* stands for the alphabet size, \(\text {OSMI}^{j}_{k}\) and \(\text {STMO}^{j}_{k}\) represent old survivor state metric input (OSMI) and state metric output (STMO) for the *j*th branch leading to the state constituted by the vector \(\left [\!x_{k}(i\,-\,1) x_{k}(i\,-\,2) \! \ldots x_{k}(i\,-\,{N^{d}_{k}}\,+\,1)\!\right ]\) related to the *k*th channel of equalizer, and \({z_{n}^{k}}(i)\) is the *k*th equalizer output as given in (5). Note that the elements of coefficient vector **c**
_{
k
}(*i*):

are computed as:

where **w**
_{
k
} represents the coefficient vector for the *k*th ADIR filter as defined in (10). Note that a processing element (PE) of the systolic array in Figure 6 is symbolized with a circled PE, and the memory of computation cycle is designated as \(L=3{N^{d}_{k}}-3\) for the ease of illustration.

## 4 Computational complexity

The computational complexity can be calculated by considering two main sections of the proposed channel shortening equalizer. The first section implements the MIMO-DFE while the second one is related to the Viterbi processing. The number of operations required for the MIMO-DFE can be calculated by thinking about the number of operations per stage and the number of stages. The number of operations for a single SPMGLS with two, three, and four channels have been computed by making use of complexity calculations in [23] and [33] as 84,171, and 288, respectively. There are \(\left ({N^{f}_{1}}-{N^{b}_{1}}\right)\) stages in two-channel section, and thereby the number of required operations for this section sums up to \(84 \ \left ({N^{f}_{1}}-{N^{b}_{1}}\right)\). Similarly, the number operations for three and four channel sections are calculated as \(171 \left ({N^{b}_{1}}\,-\,{N^{b}_{2}}\right)\) and \(288\, {N^{b}_{2}}\), respectively. Therefore, the total number of operations for the MIMO-DFE in Figure 5 becomes \(84{N^{f}_{1}} \!+ 87{N^{b}_{1}} \!+ 117{N^{b}_{2}} \).

The complexity calculation for systolic Viterbi section can be accomplished as follows. The total number of processing elements in the systolic array that implements Viterbi processing per channel is given as \( \upsilon \times {N^{d}_{k}} \) in [36]. Each element in this array performs one addition and one multiplication, which are counted together as one operation. Then, the total number of operations for the systolic implementation of *M* Viterbi detectors are calculated as \( M \times \upsilon \times {N^{d}_{k}} \). Accordingly, the total computational complexity for the proposed equalizer taking into account both MIMO-DFE and multiple Viterbi detector sections becomes \(84{N^{f}_{1}} + 87{N^{b}_{1}} + 117{N^{b}_{2}} + M \upsilon {N^{d}_{k}} \).

We compare the computational complexity of the proposed channel shortening equalizer using a front-end feed forward equalizer (CSFFE) and a front-end decision feedback equalizer (CSDFE) with those of VE in Figures 7, 8, and 9. When generating the complexity curves, we assumed that \(N^{f}={N^{f}_{1}}={N^{f}_{2}}\) and \(N^{d}={N^{d}_{k}}=3\) for both CSFFE and CSDFE and additionally \(N_{b}={N^{b}_{1}}={N^{b}_{2}} = 0.25 \times \ N^{f}\) for CSDFE and *N*
^{b}=1 for CSFFE. The computational complexity for VE is calculated by taking into account the most computationally demanding operation, i.e., comparative metric calculation, and is given as *M*×(4*μ*+3)×*υ*
^{μ−1} [38], where each channel from transmitter to receiver is assumed to have a memory of *μ*. In Figure 7, we plotted the complexity curves when *M*=2, *υ*=2, and *μ*=4,8,16. It shows that the proposed method is not computationally advantageous when the channel memory (*μ*=4) is two times the ADIR filter memory (*N*
^{d}−1=2). However, the complexity of the proposed method becomes advantageous regardless of feed forward filter length (*N*
^{f}) used when the channel memory is four times the ADIR filter memory and far more beneficial when the channel memory is eight times the ADIR filter memory. Figure 8 displays that the computational advantage of the proposed method comparing to VE becomes more attractive when the alphabet size is increased from *υ*=2 to *υ*=4 even for the channel memory values of *μ*=4,8; and Figure 9 demonstrates that the computational advantage becomes less pronounced when the number of antennas increases from *M*=2 to 4.

The computational complexity vs. the number of antennas analysis has also been carried out due to the recent interest in massive MIMO for next-generation wireless systems [37]. We would like to point out that the computational complexities of CSDFE and CSFFE are larger than DFE and FFE, respectively, by an amount of *M*×*υ*×*N*
^{d}, assuming \(N^{d}={N^{d}_{k}}, \forall k\). In this analysis, we assumed that \(N^{f}={N^{f}_{k}}=12, \forall k\), \(N^{b}={N^{b}_{k}} = 0.25 \ \times \ N^{f}\), and \(N^{b}={N^{b}_{k}}=1\), ∀*k*. In Figure 10, the computational complexity vs. number antennas curves for CSDFE, CSFFE, DFE, and FFE when *υ*=256 and *N*
_{
d
}−1=8, and *M* is increasing from 0 and to 150, are presented. For smaller values of *υ* and *N*
_{
d
}−1, the difference between the computational complexities of CSDFE and DFE or CSFFE and FFE, respectively, is minor, and the curves of CSDFE and DFE or CSFFE and FFE can not be discriminated, which implies that the performance increase by the implementation of CSDFE instead of DFE or CSFFE instead of FFE, respectively, is achieved at the expense of almost negligible computational complexity cost, as will be clearer in the next section. In Figure 11, we compare the computational complexity of the proposed method with those of VE when the channel memory values of *μ*=4,8, and 16 are used, the alphabet size is *υ*=2, the ADIR memory is assumed as *N*
_{
d
}−1=2, and *M* is increasing from 0 to 150. Finally, we repeat the same comparison in Figure 12 for *υ*=4 in order to demonstrate the effect of using larger alphabet size. Figure 11 shows that the proposed method is computationally advantageous comparing to VE when channel memory is larger than eight (*μ*>8), and in Figure 12, it can be seen that the computational complexity advantage of the proposed method improves when the alphabet size is increased from *υ*=2 to *υ*=4, and the proposed method becomes less complex comparing to VE even when *μ*=8.

## 5 Experimental results

The performance of the proposed receiver was investigated by means of MSE and probability of error simulations. In these evaluations, we considered linear time-invariant channels with spectral nulls as well as time-varying channels. The following channel impulse response matrices were defined in order to be used in simulations that demonstrate performance of the proposed equalizer:

where *δ*(*n*) represents the dirac delta function, and the channel impulse response *h*
_{
a
}(*n*) is defined as \(h_{a}(n)=\sum _{j=0}^{4} a_{j} \delta (n-j)\), which has spectral nulls and a large eigenvalue spread (*χ*=1317.65). Herein, the channel coefficients have been taken from [39], and are given by:

with \(\sum _{j=0}^{4}{a_{j}^{2}}=1\). Note that eigenvalue spread (*χ*) was determined by using the method described in [40], assuming a feed forward equalizer with a memory of *N*
^{f}−1=18, and a noise variance of 0.001. The time-varying channel impulse response is defined as \(h_{b}(n)=\sum _{j=0}^{4} b_{j}(n)\delta (n-j)\), where *b*
_{
j
}(*n*) represents the *j*th time-variant attenuation factor, generated independently using the improved version of Jakes’ Rayleigh fading model in [41] by assuming a data rate of 100 kbytes/s and doppler shifts of *f*
_{
D
}=50 Hz and *f*
_{
D
}=10 Hz ; *b*
_{
j
}(*n*) is also normalized such that \(\sum _{j=0}^{4}{b_{j}^{2}}(n)=1\) for all *n*. By choosing the same channel for both direct and indirect channels, we demonstrate the performance under such a severe distortion situation that both ISI and ICI are significant, and therefore, the use of DFE is justified. On the other hand, we could have generated a longer channel with the same spectral characteristics (or eigenvalue spread), in which case we would not be able to benchmark the performance with those of VE, as the simulation of VE becomes computationally cumbersome for longer channels. Note that *ρ* represents the gain factor for the effect of ICI and takes values between 0 and 1. In this presentation, we consider two values of the gain factor, *ρ*=0 and *ρ*=1, which correspond to completely orthogonal and nonorthogonal transmissions, respectively [42].

In the simulations for the performance evaluation of the proposed method (CSDFE/CSFFE) with respect to FFE, DFE, and VE, and also in the simulations for the performance comparison of the proposed method when different ADIR filter memories are used, the input signal *x*(*n*) applied to the channel was made of uniformly distributed bipolar \((+/-) 1/\sqrt {2}\) random numbers because of relative simplicity it provided in simulations. Note that the uniformly distributed bipolar random numbers represent BPSK modulation supported by the IEEE 802.11*n* WLAN standard [43]. In order to account for the modulations that are both in the IEEE 802.11*n* WLAN and IEEE 802.16*e* MAN standards and to demonstrate the effect of higher modulation on probability of error performance, we also performed CSFFE/CSDFE simulations by using the input signal made of uniformly distributed random numbers taking values from (1/2+*i*/2,−1/2+*i*/2,−1/2−*i*/2,1/2−*i*/2), which represents QPSK modulation (\(i=\sqrt {-1}\)), and compared against the performance results of the proposed method for BPSK modulation in both time-invariant and time-variant channel cases. Moreover, we assume the complete knowledge of time-invariant channel and the knowledge of time-variant channel memory in VE and adaptive Viterbi equalizer (AVE) performance evaluations, respectively. On the other hand, the proposed method does not need any information about channel; however, if information about channel is already available and an evaluation on the badness of channel can be carried out, the result of this evaluation can used to determine the ADIR filter memories of the proposed equalizer so as to improve the performance.

The channel noise signal was additive white Gaussian noise (AWGN) with zero mean and is uncorrelated with the input signal. The received signal-to-noise ratio (SNR) per each channel of the receiver is defined as:

where \(\sigma _{n_{k}}^{2}\) is the variance of AWGN for the *k*th channel. Accordingly, SNRs for all channels of the receiver are equal, and the system SNR is defined as SNR=SNR_{
k
} for *k*=1,2. The exponential weighting factors were 0.99 and 1.0 for the front-end equalizer and ADIR filter, respectively, when the channel was time-invariant. In time-varying channel case, they were assumed as 0.975 and 1 in order to better track the signal. The probability of error evaluations were conducted using 4×10^{5} samples so that 2×10^{5} samples per channel were used, and the simulations were carried out in training mode of receiver operation. The delays (*D*
_{
k
}) for the desired signals in this mode of operation were assumed equal (*D*=*D*
_{
k
}) for *k*=1,2, and D was chosen so as to minimize MSE; that is, *D*=(*N*
^{f}−1+*ℵ*−1)/2 when only front-end FFE is utilized, *D*=(*N*
^{f}−1+*N*
^{b}−1+*ℵ*−1)/2 when only front-end DFE is implemented, *D*=(*N*
^{f}−1+*ℵ*−1)/2−*N*
^{d}+1 for CSFFE, and *D*=(*N*
^{f}−1+*N*
^{b}−1+*ℵ*−1)/2−*N*
^{d}+1 for CSDFE. Note that the memories of feed forward and feedback sections of DFEs, ADIR filters, and channel impulse responses for *k*=1,2 were assumed equal, i.e., \(N^{f}-1={N_{k}^{f}}-1\), \( N^{b}-1={N_{k}^{b}}-1\), \( N^{d}-1={N_{k}^{d}}-1\), and *ℵ*−1=*ℵ*
_{
k
}−1. The noise variance per channel during MSE simulations was 0.001.

### 5.1 Time-invariant channel

The objective of simulations with the channel matrix **h**
_{1}(*n*) is to display the performance of the proposed CSDFE with respect to CSFFE, FFE, DFE, and VE. In the simulations, we have taken into account the modularity and regularity properties of SPMGLSs and started simulations with FFE; after observing the performance, we altered the equalizer to CSFFE, then we added new SPMGLSs to alter the equalizer to DFE, subsequently to CSDFE. The memory of FFE (*N*
^{f}−1) was 18, while the memory of feedback channels (*N*
^{b}−1) for DFE was 4, and the memory of ADIR (*N*
^{d}−1) filter was 2.

In Figure 13, we present the MSE performance of the proposed equalizer when orthogonal transmission is used, i.e., *ρ*=0, and also compare its performance to those of CSFFE, FFE, and DFE together with the performance for the channel matrix **h**
_{2}(*n*). In Figure 14, we provide the corresponding probability of error performance for orthogonal transmission and compare the performance of CSDFE with those of CSFFE, FFE, DFE, VE, and with the performance for the channel matrix **h**
_{2}(*n*). It can be seen in these figures that the performance of CSDFE is better than those of CSFFE, FFE, and DFE, respectively. It also has the closest probability of error performance to that of VE. Note that neither MSE nor probability of error performances for the channel matrix **h**
_{2}(*n*) with *ρ*=0 change with the use of different equalizers, CSDFE, CSFFE, DFE, or FFE, since this channel matrix with *ρ*=0 does not include ISI and ICI components. Figures 15 and 16, on the other hand, display MSE and probability of error comparisons when *ρ*=1, and also provide comparison with respect to the performance of DFE when the channel matrix **h**
_{2}(*n*) is used, since the channel matrix **h**
_{2}(*n*) with *ρ*=1 does not have ISI components.

The effect of ICI on the performance of CSDFE and CSFFE can seen by comparing MSE values between Figures 13 and 15 and by collating probability of error values between Figures 14 and 16. It can be deduced from these comparisons that the performance improvement that can achieved by the combination of CSDFE and orthogonal transmission is far more beneficial than using CSFFE with orthogonal transmission. Furthermore, Figures 17 and 18 show the performance improvement that can be achieved by using an ADIR filter memory (*N*
^{d}−1) of 3 instead of 2 for both CSFFE and CSDFE in *ρ*=0 and *ρ*=1 cases, respectively.

In order to investigate the effect of channel memory for a given ADIR filter memory on the performance of the proposed method, we generated channels with longer impulse responses than that of *h*
_{
a
}(*n*), nevertheless, we made sure that these channels have exactly the same spectral characteristics or eigenvalue spread with *h*
_{
a
}(*n*). We then produced the corresponding channel matrices using the same channel impulse responses for direct and indirect paths as in **h**
_{1}(*n*) and repeated the aforementioned experiments and found out that the performance was not different from the ones displayed in Figures 13, 14, 15, 16, 17, and 18. Consequently, it can be said that, the eigenvalue spread of channel, not the memory as the channel shortener name implies, determines the performance of the proposed equalizer.

Subsequently, we examine the effect of using a higher modulation scheme on the probability of error performance of the proposed method, and in Figures 19 and 20, we present the performance degradation caused by switching modulation from BPSK to QPSK in orthogonal and nonorthogonal transmission cases, respectively.

### 5.2 Time-variant channel

Our objective in the simulations using the channel matrix **h**
_{3}(*n*) is to present the performance of the proposed equalizer under two different time-varying channel conditions. Figure 21 presents the MSE performance results when *f*
_{
D
}=50 Hz and provides comparisons between CSFFE and CSDFE when *ρ*=1 and *ρ*=0. In Figure 22, we show the corresponding probability of error performances. Note that the probability of error values of CSFFE for *ρ*=1 and *ρ*=0 saturate approximately at SNR =25 dB to 2×10^{−2} and 1.5×10^{−2}, respectively, the probability of error values of CSDFE, on the other hand, saturate approximately at SNR =27 dB to 10^{−3} and 6.3×10^{−4}, which are closer to the probability of error values of AVE when *ρ*=0, that converges to approximately 23.4×10^{−5} at SNR =23 dB.

The second experiment under time-variant channel conditions was carried out using a lower doppler frequency so that the effect of doppler frequency on the equalizer performance can be demonstrated. When we compare the MSE performance results in Figure 23 with those of Figure 21, which is related to the MSE performance for *f*
_{
D
}=50 Hz, we see that the MSE performances of CSFFE for *ρ*=1 and *ρ*=0 when *f*
_{
D
}=50 Hz are 1.33 and 1.22 times, respectively, higher than those of CSFFE when *f*
_{
D
}=10 Hz. The same comparison for CSDFE yields that the MSE performances when *f*
_{
D
}=50 Hz are 2 and 2.85 times higher for *ρ*=0 and *ρ*=1, respectively, than the MSE performances when *f*
_{
D
}=10 Hz. Similar evaluations can be done for the probability of error performances, and it can be seen in Figure 24 that the probability of error curves of CSFFE for *ρ*=0 and *ρ*=1 cases saturate to lower values than those of CSFFE in Figure 22. On the other hand, whereas probability of error curves of CSDFE for *ρ*=0 and *ρ*=1 in Figure 22 reach to the probability of error value of 10^{−2} at SNRs of 14 and 17 dB, respectively, they converge to the same probability of error value at approximately 3.5 dB lower SNRs, i.e., at 10.5 and 13.5 dB in Figure 24.

We have performed two more probability of error simulations for the time-variant channel case using *f*
_{
D
}=50 Hz, the first of which was related to the performance improvement that can be gained by using an ADIR filter memory (*N*
^{d}−1) of 3 instead of 2. Accordingly, Figures 25 and 26 depict the achieved performance improvement for both CSFFE and CSDFE in *ρ*=0 and *ρ*=1 cases. The second simulation was for the effect of using QPSK modulation instead of BPSK, and Figures 27 and 28 therefore render the probability of error performance comparison when using QPSK modulation instead of BPSK in *ρ*=0 and *ρ*=1 cases, respectively.

It can be seen in these figures that the performance improvement attainable through orthogonal transmission under time-variant channel conditions is not as significant as time-invariant channel conditions.

## 6 Conclusions

A V-BLAST type channel shortening equalizer design for cognitive MIMO-OFDM radios has been presented. The V-BLAST property for frequency-selective channels is realized by completely orthogonalizing the input data using SPMGLSs, so that a systolic MIMO-DFE is accomplished at the front-end of the proposed channel shortening equalizer. Accordingly, ISI and ICI effects are suppressed due to completely orthogonalizing nature of the receiver structure. A systolic array implementation of multiple adaptive Viterbi detectors is also utilized in order to realize a channel shortening equalizer with high degree of computational concurrency. The matrix inversions, which are significant bottlenecks in receiver design, are avoided, scalar only operations are enabled. A highly modular, regular, order-recursive, and simple receiver architecture, which is suitable for the DSP chip- and FGPA-based signal processing implementations of MIMO-OFDM wireless communication systems, is obtained.

Spectrum sensing and positioning functions, important tasks for cognitive radios, can be accomplished at no cost by simply reconfiguring the front-end MIMO-DFE filter as spectral analysis and positioning filters, respectively. These properties make the proposed equalizer a good candidate for software defined cognitive radio receiver realizations of MIMO-OFDM systems.

The computational complexity of the proposed equalizer has been provided by separately taking into account the MIMO-DFE and multiple adaptive Viterbi detector sections. Then, the total complexity was compared to the complexity of VE for different channel and ADIR filter memories and different alphabet and antenna sizes.

The performance has been supplied in terms of MSE and probability of error analysis for orthogonal and nonorthogonal transmissions under time-invariant and time-variant channel conditions using two different modulation schemes, and it has been demonstrated that desirable performance results can be attained particularly under time-invariant channel conditions when orthogonal transmission and BPSK modulation is used together with CSDFE implementation. It has been also shown that the performance of a CSDFE is between those of Viterbi and DFEs under time-invariant as well as time-variant channel conditions.

It has been revealed that the channel shortener equalizer is indeed a reduced complexity Viterbi equalizer with its ADIR filter memory functioning as a trade-off parameter between performance and complexity for a given channel matrix. Another important property of the proposed equalizer is that it does not need channel information.

## References

GJ Foschini, MJ Gans, On limits of wireless communications in a fading environment when using multiple antennas.Wireless Pers. Commun. 6(3), 311–335 (1998). doi:10.1023/A:1008889222784.

GG Raleigh, JM Cioffi, Spatio-temporal coding for wireless communication. IEEE Trans. Commun. 46(3), 357–366 (1998). doi:10.1109/26.662641.

JR GL Stüber, SW Barry, YG Mclaughlin, MA Li, TG Ingram, Pratt, Broadband MIMO-OFDM wireless communications. Proc. IEEE. 92(2), 271–294 (2004). doi:10.1109/JPROC.2003.821912.

H Bölcskei, Advances in smart antennas - MIMO-OFDM wireless systems : basics, perspectives, and challenges. IEEE Wireless Commun. 13(4), 31–37 (2006). doi:10.1109/MWC.2006.1678163.

PW Wolniansky, GJ Foschini, GD Golden, RA Valenzuela, in

*Proceedings of URSI Int. Symp. Signals, Systems and Electronics*. V-BLAST: an architecture for realizing very high data rates over the rich-scattering wireless channel (IEEE,Pisa, 1998), pp. 295–300. doi:10.1109/ISSSE.1998.738086.Q Liu, L Yang, in

*Proceedings of the 2004 IEEE Joint Conf. 10th Asia-Pacific Conf. Commun., and 5th Int. Symp. Multi-Dimensional Mobile Commun*, 1. A simplified method for V-BLAST detection in MIMO OFDM communication (IEEE, 2004), pp. 30–33. doi:10.1109/APCC.2004.1391645.W Bei, Z Qi, in

*Proceedings of the IEEE 4th Int.Conf. Wireless Commun. Netw. and Mobile Comput. (WiCOM’08)*. A low complex V-BLAST detection algorithm for MIMO-OFDM system (IEEE,Dalian, 2008), pp. 1–4. doi:10.1109/WiCom.2008.386.L Ma, K Dickson, J McAllister, J McCanny, QR decomposition-based matrix inversion for high performance embedded MIMO receivers. IEEE Trans. Signal Process. 59(4), 1858–1867 (2011). doi:10.1109/TSP.2011.2105485.

RK Martin, CR Johnson, Adaptive equalization: transitioning from single-carrier to multicarrier systems. IEEE Signal Process. Mag. 22(6), 108–122 (2005). doi:10.1109/MSP.2005.1550193.

S Haykin, Cognitive radio: brain-empowered wireless communications. IEEE J. Sel. Areas Commun. 23(2), 201–220 (2005). doi:10.1109/JSAC.2004.839380.

M Dillinger, K Madani, N Alonistioti,

*Software Defined Radio: Architectures, Systems and Functions*(John Wiley and Sons, England, 2003).O Anjum, T Ahonen, F Garzia, J Nurmi, C Brunelli, H Berg, State of the art baseband DSP platforms for software defined radio: a survey.EURASIP. J. Wirel. Commun. Netw. 2011, 5 (2011). doi:10.1186/1687–1499-2011-5.

K He, L Crockett, R Stewart, Dynamic reconfiguration technologies based on FPGA in software defined radio system. J. Signal Process. Syst. 69(1), 75–85 (2012). doi:10.1007/s11265-011-0646-2.

J Im, M Cho, Y Jung, Y Jung, J Kim, A low-power and low-complexity baseband processor for MIMO-OFDM WLAN systems. J. Signal Process. Syst. 68(1), 19–30 (2012). doi:10.1007/s11265-010-0570-x.

AP Vinod, E M-K Lai, A Omondi, Special issue on signal processing for software defined radio handsets. J. Signal Process. Syst. 62(2), 113–115 (2011). doi:10.1007/s11265-009-0428-2.

B Wang, RJ Ray Liu, Advances in cognitive radio networks: a survey. IEEE J. Sel. Topics Signal Process. 5(1), 5–23 (2011). doi:10.1109/JSTSP.2010.2093210.

E Axell, G Leus, EG Larsson, HV Poor, Spectrum sensing for cognitive radio: state-of-the-art and recent advances. IEEE Signal Process. Mag. 29(3), 101–116 (2012). doi:10.1109/MSP.2012.2183771.

H Celebi, H Arslan, Enabling location and environment awareness in cognitive radios. Computer Commun. 31, 1114–1125 (2008). 10.1016/j.comcom.2008.01.006.

MT Ozden, Adaptive multichannel sequential lattice prediction filtering method for ARMA spectrum estimation in subbands. EURASIP J. Adv. Signal Process. 2013, 9 (2013). doi:10.1186/1687-6180-2013-9.

MT Ozden, in

*Proceedings of the 2014 IEEE/ION Position, Location, and Navigation Symposium (PLANS 2014)*. Adaptive multichannel sequential lattice prediction filtering method for range estimation in cognitive radios, (2014), pp. 426–433. doi:10.1109/PLANS.2014.6851400.N Al-Dhahir, JM Cioffi, Efficiently computed reduced-parameter input-aided MMSE equalizers for ML detection: a unified approach. IEEE Trans. Inf. Theory. 42(3), 903–915 (1996). doi:10.1109/18.490553.

N Al-Dhahir, FIR channel-shortening equalizers for MIMO ISI channels. IEEE Trans. Commun. 49(2), 213–218 (2001). doi:10.1109/26.905867.

F Ling, JG Proakis, A generalized multichannel least squares lattice algorithm based on sequential processing stages. IEEE Trans. Acoust. Speech Signal Process. 32(2), 381–389 (1984). doi:10.1109/TASSP.1984.1164325.

J Ma, GY Li, BH Juang, Signal processing in cognitive radio. Proc. IEEE. 97(5), 805–823 (2009). doi:10.1109/JPROC.2009.2015707.

GJ Foschini, Layered space-time architecture for wireless communications in a fading environment when using multielement antennas. Bell. Labs. Tech. J. 1(2), 41–59 (1996). doi:10.1002/bltj.2015.

A Lozano, C Papadias, Layered space-time receivers for frequency-selective wireless channels. IEEE Trans. Commun. 50(1), 65–73 (2002). doi:10.1109/26.975751.

Y Jiang, J Li, WW Hager, Uniform channel decomposition for MIMO communications. IEEE Trans. Signal Process. 53(11), 4283–4294 (2005). doi:10.1109/TSP.2005.857052.

R Merched, NR Yousef, Fast techniques for computing finite-length MIMO MMSE decision feedback equalizers. IEEE Trans. Signal Process. 54(2), 701–711 (2006). doi:10.1109/TSP.2005.861900.

N Al-Dhahir, AH Sayed, The finite length multi-input multi-output MMSE-DFE. IEEE Trans. Signal Process. 48(10), 2921–2936 (2000). doi:10.1109/78.869048.

G Ginis, JM Cioffi, On the relation between V-BLAST and the GDFE. IEEE Commun. Lett. 5(9), 364–366 (2001). doi:10.1109/4234.951378.

J Wang, Y Jiang, GE Sobelman, Iterative computation of FIR MIMO MMSE-DFE with flexible complexity-performance tradeoff. IEEE Trans. Signal Process. 61(9), 2394–2404 (2013). doi:10.1109/TSP.2013.2245325.

PA Regalia, MG Bellanger, On the duality between fast QR methods and lattice methods in least squares adaptive filtering. IEEE Trans. Signal Process. 39(4), 879–891 (1991). doi:10.1109/78.80910.

F Ling, Givens rotation based least squares lattice and related algorithms. IEEE Trans. Signal Process. 39(7), 1541–1551 (1991). doi:10.1109/78.134393.

F Ling, D Manolakis, JG Proakis, A recursive modified Gram-Schmidt algorithm for least-squares estimation. IEEE Trans Acoust. Speech Signal Process. 34(4), 829–835 (1986). doi:10.1109/TASSP.1986.1164877.

MT Ozden, AH Kayran, Adaptive multichannel decision feedback equalization for Volterra type nonlinear communication channels. AEU - Int. J. Electron. Commun. 62(6), 430–437 (2008). doi:10.1016/j.aeue.2007.06.005.

JD Provence, SC Gupta, Systolic arrays for Viterbi processing in communication systems with a time-dispersive channel. IEEE Trans. Commun. 36(10), 1148–1156 (1988). doi:10.1109/26.7532.

E Larsson, O Edfors, F Tufvesson, ML Marzetta, Massive MIMO for next generation wireless systems. IEEE Commun. Mag. 52(2), 186–195 (2014). 10.1109/MCOM.2014.6736761.

HC Myburgh, JC Olivier, Low complexity MLSE equalization in highly dispersive Rayleigh fading channels.EURASIP. J. Adv. Signal Process. 2010(1), 874874 (2010). doi:10.1155/2010/874874.

JG Proakis,

*Digital Communications*(McGraw-Hill, New York, 2000).S Haykin,

*Adaptive Filter Theory*, 4th edn (Prentice-Hall, New Jersey, 2001).Y Rosa Zheng, C Xiao, Simulation models with correct statistical properties for Rayleigh fading channels. IEEE Trans. Commun. 51(6), 920–928 (2003). doi:10.1109/TCOMM.2003.813259.

W Zhang, X-G Xia, KB Letaief, Space-time/frequency coding for MIMO-OFDM in next generation broadband wireless systems. IEEE Wireless Commun. 14(3), 32–43 (2007). doi:10.1109/MWC.2007.386610.

AF Molisch,

*Wireless Communications*, 2nd edn (John Wiley and Sons, UK, 2011).

## Acknowledgements

The author is grateful to the Editor Prof. Costas Berberitis and anonymous reviewers for their useful comments.

## Author information

### Authors and Affiliations

### Corresponding author

## Additional information

### Competing interests

The author declares that he has no competing interests.

## Rights and permissions

**Open Access** This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (https://creativecommons.org/licenses/by/4.0), which permits use, duplication, adaptation, distribution, and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

## About this article

### Cite this article

Ozden, M.T. Adaptive reconfigurable V-BLAST type equalizer for cognitive MIMO-OFDM radios.
*EURASIP J. Adv. Signal Process. * **2015**, 8 (2015). https://doi.org/10.1186/s13634-015-0199-9

Received:

Accepted:

Published:

DOI: https://doi.org/10.1186/s13634-015-0199-9