 Research Article
 Open Access
 Published:
Constellation Design for Widely Linear Transceivers
EURASIP Journal on Advances in Signal Processing volume 2010, Article number: 176587 (2010)
Abstract
Constellation design has been previously addressed by assuming that there is a linear equalizer at the receiver side. However, the widely linear equalizer is well known to outperform the linear one with no significant complexity increase; we derive optimum and suboptimum techniques for constellation design in presence of such an equalizer. The proposed techniques adapt the circularity properties of the transmitted signals to the specific channel to be equalized; their performance analysis shows that also the simplest suboptimum procedure provides significant improvements over a fixedconstellation scheme.
1. Introduction
Constellation design has been previously addressed by assuming that there is a linear equalizer at the receiver side. In early works (see, e.g., [1, 2]), the optimization of a twodimensional constellation in order to minimize the symbol error rate (SER) was first addressed with reference to the transmission over a nondispersive channel affected by additive noise.
The advantage provided by the constellations with two degrees of freedom (such as quadrature amplitude modulation (QAM)) over the ones with one degree of freedom (such as phaseshiftkeying (PSK), and pulse amplitude modulation (PAM)) was shown [1], and a proper mapping (based on a gradientdescent procedure) of the information bits into points of a twodimensional constellation was proposed [2]. However, the adoption of an additivenoise nondispersive channel model allows one to consider the constellation mapping independently of the equivalent channel. On the other hand, an amount of literature (e.g., [3–7]) refers to the optimization of the transmitter and/or the receiver without including the choice of the constellation in the optimization procedure. In fact, many existing transceiver processing techniques are optimized (according to a chosen criterion) by only exploiting knowledge of the statistics of the information symbol sequence.
This paper addresses the constellation design under the assumption that the transmitter is fixed (i.e., by considering an equivalent channel representing the transmitter and the channel) and a widely linear (WL) minimum mean square error (MMSE) equalizer is employed at the receiver side [8–14].
The WL filtering generalizes the conventional linear filtering and allows one to achieve a power reduction of the additive noise and interferences at the equalizer output, and therefore a performance gain, by exploiting the statistical redundancy possibly exhibited by a rotationally variant transmitted (and/or received) signal. For such a reason, the adoption of the WL equalization has frequently been confined to the transmission of onedimensional constellations (see, e.g., [3, 15–17] and references therein) since the advantage of using the WL filtering (instead of the linear one) is maximum for onedimensional constellation. Twodimensional constellations (especially highorder ones) are often preferred to onedimensional constellations (in presence of a linear receiver) in order to maximize the minimum distance between the constellation points [1]. However, WL linear filtering provides no performance advantage over linear one when the chosen constellation and the additive noise are circularly symmetric. For such a reason, we consider the optimization both over circularly symmetric and over rotationally variant constellations without any assumption about the circularity properties of the additive noise. In fact, the noncircularity of the constellation is introduced in order to exploit the presence of the WL receiver but it also provides a disadvantage in terms of the minimum distance between the constellation points.
When both the effects are accounted for, the optimum degree of noncircularity of the constellation becomes dependent on the specific channel impulse response. Therefore, we address the constellation design under the assumption that the channel state information (CSI) is available and we propose a CSIdependent symbol mapping that optimizes the performance of the WL MMSE receiver. Symbol mapping is adapted by using a feedback channel (between the receiver and the transmitter) carrying information about the optimum constellation. Moreover, suboptimum strategies are proposed in order to reduce both the amount of information to be transmitted on the feedback channel and the computational complexity of the optimization procedure.
The paper is organized as follows. Section 2 introduces the system model, recalls the MMSE equalizer structure and analyzes how its performance depends on the amount of pseudocorrelation of the transmitted signal. Section 3 addresses the constellation design in the presence of the WL MMSE equalizer by generalizing the results in [2] to the case where the additive disturbance (noise plus interference) is rotationally variant. Section 4 reports the results of simulation experiments mainly aimed at showing the performance advantages provided by the constellation adaptation procedures. Finally, Section 5 provides the conclusions and the final remarks.
Notation 1.
The following notations are adopted throughout the paper. is the imaginary unit, the superscripts , , and denote the complexconjugate, the transpose and the Hermitian transpose, respectively, is the statistical expectation, is the Kronecker delta, is the identity matrix of size , is the vector/matrix with all zero entries (the size is omitted for brevity), denotes the th entry of the vector , denotes the entry of the matrix , denotes the th column of , and are the real and the imaginary part, respectively, denotes the norm with , and, finally, is the transform of .
2. The FIR MMSE Equalizer
In this section, we introduce the considered system model; then, we derive the WL MMSE feedforwardbased equalizer and we study the variations of the achieved MMSE versus the pseudocorrelation of the transmitted signal. Such an analysis will be useful in Section 3 to address the constellation design for MMSE receivers.
2.1. System Model
Let us consider the following finiteimpulseresponse (FIR) basebandequivalent noisy communication channel
where the transmitted symbols are independent identically distributed (i.i.d.) zeromean random variables drawn from the complexvalued constellation whose (finite) order determines the bit rate ( bits per symbol) of the uncoded system part. With no loss of generality, we assume that and , that is, the transmitted available power is unit, and that exhibits a possibly nonnull pseudocorrelation , such that (if , then the correlation matrix of the random vector will be positive semidefinite); note that the noncircularity of consists in the difference between the power of the inphase component and the quadrature one and in the correlation between them. Such assumption allows one to consider both the conventional circularly symmetric constellations (), such as PSK and square QAM with , and the rotationally variant constellations, such as the wellknown PAM () and its rotated version (for which it exists such that is realvalued and, consequently, ), nonsquare QAM (with since a different power is allocated to the inphase and quadrature components). The timeinvariant FIR channel impulse response of memory is assumed to be known at the receiver side. Finally, the additive noise , whose power is assumed known at the receiver, is modeled as zeromean complexvalued widesense stationary timeuncorrelated and independent of the useful signal. The additive disturbance is not assumed circularly symmetric because it may include the effects of onedimensional cochannel interferences.
At the receiver side, the feedforwardbased equalization is performed by processing the block of received samples which, in a matrix notation, can be written as follows:
According to the previous assumptions, the following correlation and pseudocorrelation matrices can be written as
where is the (possibly) nonnull noise pseudocorrelation (if , then the noise is circularly symmetric).
2.2. FeedforwardBased MMSE Equalizer
Since the transmitted sequence and consequently the received one in (1) can be rotationally variant, we adopt a widely linear receiver in order to exploit the statistical redundancy exhibited by the received signal. Note that such a choice improves the performance since the linear equalizers are a subset of the WL equalizers; their performances coincide only in the presence of circularly symmetric signals [10]. Therefore, we resort to the two FIR filters and that process the received vector and its complex conjugate version , respectively. The optimum filters and minimizing the mean square error are given by [16, 18]
where denotes the th column of and the processing delay has to be chosen in order to optimize the performance. For notational simplicity, in (4) and (5) we have omitted the dependence of and on . Let us point out that when , that is, the transmitted symbols are drawn from a circularly symmetric constellation, = 0 and, therefore, the WL MMSE equalizer degenerates into the conventional linear MMSE equalizer. Another special case is represented by the scenario where a realvalued constellation is adopted. In fact, since , and the WL MMSE equalizer becomes , that is, it is implemented by extracting the inphase component of the linear equalizer , which does not coincide, however, with the linear MMSE equalizer.
Since the optimum equalizer and, hence, its performance depends on the pseudocorrelation of the transmitted signal, let us analyze the dependence on of the MMSE. To this end, denote with the error measured at the output of the WL MMSE equalizer for given values of and . It can be easily shown that
Since is the MMSE at the outputs of both the WL MMSE equalizer and the linear MMSE equalizer in the presence of a circularly symmetric constellation, represents the MMSE gain achieved by properly choosing the pseudocorrelation of the transmitted constellation. When , that is, the noise is circularly symmetric, depends on instead of and its (first) derivative with respect to can be written as
Since and are positive semidefinite, one has and, hence, increasing the degree of noncircularity of the transmitted signal improves the MMSE. For such a reason, the use of a realvalued transmitted sequence together with a WL MMSE equalizer corresponds to the optimum choice as far as the MMSE is adopted as the performance measure. On the other hand, when , the variations of with respect to depend on the specific values of the channel impulse response and the noise statistics.
3. Constellation Design
The present section addresses the design of the order constellation with fixed (under the assumption that the WL MMSE equalizer is used) and it is organized as follows. In Section 3.1, we address the optimum constellation design for the WL MMSE receiver by extending the results of [2] to the case of additive rotationally variant disturbance. In Section 3.2, we propose a suboptimum strategy based on the rhombic transformation of a given constellation. Such a strategy allows one to reduce both the computational complexity of the optimization procedure and the amount of information required at the transmitting side in order to adapt the constellation.
The results in the previous section allow one to state that, by using a realvalued constellation () instead of a complexvalued nonredundant () one, a performance gain can be achieved in terms of the MMSE at the equalizer output. On the other hand, not always an MSE gain provided by the WL equalizer leads to a SER gain [19]. In fact, for a fixed expended average energy per bit, the reduction of the minimum distance between the constellation points, due to the adoption of onedimensional constellations rather than twodimensional ones (e.g., when we adopt the PAM rather than the QAM) leads to a potential increase in the SER. Therefore, we address the constellation design minimizing the SER at the WL MMSE equalizer output by accounting for its rotationally variant properties.
In the literature (e.g., [2, 20]), most of the constellations employed by the transmission stage are circularly symmetric (), while statistically redundant constellations are confined to the realvalued ones. Moreover, in [2], with reference to the transmission over a time nondispersive channel () affected by circularly symmetric noise, a procedure for constellation optimization has been proposed, showing also that, for large signaltonoise ratios (SNR), the performance of the conventional QAM maximumlikelihood (ML) receiver is invariant with respect to rhombic transformations of the complex plane. However, it is important to point out that a rhombic transformation of a circular constellation makes it rotationally variant and, for some values of (e.g., ), the procedure in [2] provides a rotationally variant constellation. On the other hand, the WL equalizer is equivalent to the linear equalizer over the nondispersive channel considered in [2] and, therefore, optimizing the circularity degree of the constellation does not provide any performance advantage. On the other hand, when a timedispersive channel is considered, the WL MMSE equalizer is sensitive to the rotationally variant properties of the transmitted signal and, therefore, we propose a transceiver structure (see Figure 1) where (i) the transmitter can switch between the available constellations of order ; (ii) the WL MMSE receiver accounts for the CSI and informs the transmitter, by means of a feedback channel, about which constellation has to be adopted to minimize the SER.
The use of a feedback channel in order to improve the bitrate could also be exploited for choosing the constellation size rather than its circularity degree when the signaltonoise ratio of each channel realization is not previously known. For example, the problem of the constellation choice has been addressed in [21, 22] with reference to the discrete multitone (DMT) transceiver and to multipleinput multipleoutput transceiver, respectively. The two parameters of the constellations (size and circularitydegree) could also be jointly optimized by generalizing the procedures here proposed.
3.1. Constellation Optimization in the Presence of Gaussian Rotationally Variant Noise
In order to optimize over the constellation choice we need to first derive a performance analysis of the considered equalizer. Approximated evaluations of the performance of the WL receiver are available in [11] for a QAM constellation and in [3] for a PAM constellation in the presence of a PAM cochannel interference. Moreover, such performance analysis is generalized in [9] for IIR WL filters. Here, we derive an approximation of the equalizer performance suited for successive optimization over transmitter constellation.
With no loss of generality, assume that and rewrite the output of the FIR equalizer as follows:
where is the transmitted symbol drawn from the complexvalued constellation with and , and is the residual disturbance that includes the intersymbol interference and the noise terms after the WL equalizer filtering. The circularly symmetric model for the additive disturbance is inadequate since the output of a WL filter is, in general, rotationally variant. Therefore, we model as rotationally variant, that is, , , and . Moreover, in order to make the constellation design analytically tractable, we approximate as Gaussian. For the sake of clarity, let us note that, if symbols and noise are circularly symmetric (), then the additive disturbance and the equalizer output will be circularly symmetric too; on the other hand, if is rotationally variant, then will be rotationally variant too, but nothing can be stated about the circularity properties of also when .
The sample is the input of the decision device which performs the symbolbysymbol ML detection of the transmitted symbol. By defining the following eigenvalue decomposition (the dependence on at the righthandside is omitted for simplicity):
with being the eigenvector matrix and having on the diagonal the eigenvalues, it can be verified that the pairwise error probability [20], that is, the probability of transmitting and deciding (at the receiver) in favor of when the transmission system uses only and , is given by
where denotes + where and , and, for and ,
When , and analogously for and . By utilizing (11), assuming that the symbols are equally probable, and resorting to both the union bound and Chernoff bound techniques, the SER is upperbounded as follows:
and, therefore, the optimum constellation can be approximated with the solution of the following problem:
Unfortunately, it is difficult to find the closedform expression of the solution of such an optimization problem. For such a reason, we propose to find a local solution by means of numerical algorithms (e.g., a projected gradient method). To this aim, we can exploit the gradient of with respect to , while we resort to numerical approximation of the gradient with respect to since it is difficult to obtain its analytical expression.
Before proceeding, let us discuss the property of the locally optimum constellation for a fixed . The th component of the gradient of is given by
By zeroing the gradient of the Lagrangian
one has that the locally optimum satisfies the following equation:
with
Condition (17) generalizes the result of [2] to the case of rotationally variant (i.e., or ) and with a constrained pseudocorrelation. (.) In fact, (17) with (i.e., no constraint is imposed on the pseudocorrelation) requires that is proportional to the weighted sum (with weights ) of , , as found in [2]. For the sake of clarity, let us note that the procedure proposed in [2] does not allow one to exploit the potential advantage of a rotationally variant constellation when the WL MMSE receiver is employed. For example, when a linear MMSE equalizer is employed for in high signaltonoise ratio, the minimum of the SER is equivalently achieved [2] by both the conventional 4QAM constellation and the rhombic constellations with the same perimeter, that is, the perimeter of the largest convex polygon consisting of the lines (see [1] for further details). On the other hand, when a WL MMSE equalizer is employed, a rhombic constellation, which is rotationally variant, is not equivalent to the conventional 4QAM since the achieved MMSE is dependent on as shown in (8).
3.2. A Suboptimum Procedure Based on Rhombic Transformations
In this section, we propose a suboptimum constellationdesign procedure for the WL MMSE equalizer. The method is based on the exploitation of a rhombic transformation that operates on a circularly symmetric constellation making it rotationally variant. Such a transformation depends on two parameters and allows one to control the pseudocorrelation of the obtained constellation; consequently, the optimization procedure is simplified since the SER in (13) is a function of only two parameters, instead of parameters.
Assume that is a unitpower circularlysymmetric complexvalued constellation and define the complexvalued constellation as follows:
or, more compactly (the compact expression is introduced for notation simplicity whereas the matrix form is utilized to understand the physical meaning),
with and . When (), is stretched along the inphase (quadrature) component and it becomes onedimensional for ; when , a correlation between and is introduced and for , even if it is twodimensional, can be reduced to a onedimensional constellation by a simple rotation. For symmetry, in the following we consider only the positive values of and . It is easily verified that, if is drawn from , then
The method proposed here assumes that the informationbearing symbol sequence, say , is drawn from a fixed constellation (e.g., the optimum constellation provided by [2]) whereas the possibly rotationally variant channel input is obtained by resorting to the zeromemory precoding defined by the rhombic transformation (19). Clearly, such a strategy is suboptimum since it assumes that the channel input can be drawn from only those constellations resulting from a rhombic transformation of the chosen . However, the main advantages of such a method in comparison with the optimum one are

(1)
the huge reduction of the computational complexity of the constellation optimization procedure when ; in fact, the SER becomes a function of only two variables ( and ), regardless of the constellation order ;

(2)
the reduced implementation complexity of the transmitter stage; in fact, the symbolmapping is implemented by means of the linear transformation (19);

(3)
the decrease of the information amount to be transmitted on the feedback channel; in fact, only the values of two parameters (instead of ) have to be sent to the transmitter.
According to such a choice, the constellation optimization is carried out by solving the minimization problem
with
where denotes , denotes − , and denotes + − − − , and where (23) follows from (13) and (19), and the dependence of the disturbance parameters on has been replaced by the dependence on and . Since finding the closedform expression of and is a difficult problem, here we propose to approximate with a function, say , whose minimization can be carried out by evaluating it only over a very limited set of points. In the sequel, such an approximation is derived for a QAM constellation , though it can be analogously determined for denser constellations.
First, we approximate the cost function (23) by assuming that the components of the residual disturbance are uncorrelated, that is, . By means of some tedious but simple algebra operations, it can be shown that is lower bounded by
where
where denotes and denotes . Since the righthand side of (24) is minimized by large values of , we propose to approximate the solution of (22) with the following one:
where is the curve corresponding to the maximum value of for a fixed (or, equivalently, to the maximum value of for a fixed ). Of course, the restriction to leads to a significant decrease in the computational complexity. Let us point out that, interestingly, such a restricted optimization procedure accounts for the possible transmission of the conventional 4PAM: in fact, it can be easily verified that when , .
This also suggests an extreme simplification obtained by choosing just between the 4PAM and 4QAM constellation (twochoice procedure), that is, one can resort to an architecture that switches between the 4QAM and the 4PAM constellations according to the following rule:
Three remarks about the suboptimum procedure (26) follow.
Remark 1.
The results carried out here with reference to the QAM constellation can be easily generalized to higherorder constellations. More specifically, the SERbound approximations (analogous to the one in (24)) can be obtained by assuming that the inner summation in (23) is restricted to those constellation points closest to the th one. Moreover, it can be shown that the conventional square QAM constellations (with ) can be transformed by (19) into the conventional uniform PAM. Note, however, that such a property is not satisfied by the constellations of any order; for example, as also shown in Section 4, when using the rectangular QAM (see Figure 2(g)) the rhombic transformation allows one to obtain the nonuniform PAM reported in Figure 2(i).
Remark 2.
The optimum transmission strategy proposed here requires that the receiver sends on the feedback channel the whole optimum constellation. If the suboptimum procedure is used, the transmitter architecture can be simplified. In fact, a unique symbol mapper for the alphabet is needed and the constellation is adapted by adjusting the zeromemory WL filter (19). Unfortunately, the main disadvantage in terms of the computational complexity of the receiver remains the adaptation of the decision mechanism for the constellation .
Remark 3.
When the proposed suboptimum strategy is used, the channel input is obtained by performing a zeromemory WL filtering of the informationbearing sequence . For such a reason, it is reasonable to consider an alternative receiver structure that performs the WL MMSE equalization of the received signal in order to estimate , instead of . After some matrix manipulations, it can be verified that such WL MMSE equalizer is the cascade of the WL MMSE equalizer in (4) and (5) and the WL zeromemory filter performing the inverse of the transformation (19) (note that (19) is not invertible for every value of and , e.g., when a realvalued constellation is adopted (), however, in such a case, an ad hoc inverse transformation can be easily defined). This allows one to use a unique symbol demapper and the standard decision mechanism for the constellation . The MMSE achieved by such a structure is
It can be easily shown that (a) if , then , unless , and (b) since . Such results show that the minimumdistance decision based on the WL MMSE estimation of outperforms the (computationally simpler) minimumdistance decision based on the WL MMSE estimation of .
4. Numerical Results
In this section, we present the results of simulation experiments aimed at assessing the performance improvements achievable by the proposed constellationoptimization procedures. In all the experiments, we assume that () the noise sequence at the output of the channel is zeromean white Gaussian complexvalued circularly symmetric with variance , that is, ; () the decision delay is optimized; () the SER has been estimated by stopping the simulation after 100 errors occur; () each sample at the output of the WL filter is the input of the decision device that performs the symbolbysymbol ML detection of the transmitted symbol.
4.1. Fixed Channel
In this section, we compare the performances of the constellation design procedures (26) and (14) in terms of SER. In our simulations, we solve (26) by means of an exhaustive search over and : note that in our search we consider , so we consider a finite number of points. On the other hand, we resort to the constrained gradientbased algorithm for solving (14). Since the cost function (13) exhibits local minima, 1000 starting points have been randomly generated according to a uniform distribution. Due to the amount of time required by the computer simulations to determine the solution of (14), we consider, as in [16], the transmission over a twotap channel affected by an additive circularly symmetric white Gaussian noise with variance . In our experiments, we have addressed the optimization of the constellation when and for different values of , , and .
Let us first plot in Figure 2 some of the optimum constellations obtained during our simulations when solving the optimization problem (14) over the considered channel model; moreover, we plot the suboptimum constellation utilized to implement our suboptimum strategy and the PAM constellation obtained by applying to it the rhombic transformation. As in [2], we have found many local optima, some of them were rotated version of the constellations of Figure 2 while others appeared as their rhombic transformation. For the locally optimum constellation set includes the conventional QAM () and PAM (), as well as the QAM subject to a rhombic transformation (); note that such constellations can be obtained by means of a rhombic transformation of the conventional QAM (as also shown in Section 3.2), which has been utilized to implement our suboptimum strategy when . For , the optimum constellation set includes the noncircular QAM found by Foschini et al. (), one of the conventional QAM scheme () called "17" 8QAM [2], the PAM () and the noncircular QAM scheme that we call noncircular 8QAM. In the following, in order to implement the rhombictransformationbased constellationoptimization strategy, we resort to the rectangular QAM; we remember that, unlike QAM, such a scheme cannot be transformed into the conventional uniform PAM, but in the nonoptimum nonuniform PAM (the optimality of uniform PAM over additive white Gaussian noise has been shown in [23]).
In Figure 3, with reference to the case , we have set and we have plotted the SERs achieved by both the suboptimum strategy (26) and the optimum strategy (14) versus , for and for different values of (); moreover, for each point of Figure 3, the constellation typically obtained by the optimum procedure is specified by the letter used to denote it in Figure 2. The results show that the two strategies have the same performance: more specifically, both strategies switch to the PAM when and outperform the conventional nonadaptive transceiver employing the QPSK modulation jointly with the linear MMSE receiver. Note also that as , the chosen value of does not affect the performance.
In the next experiments, we have addressed the constellation optimization when ; more specifically, in Figures 4 and 5 we have considered the transmission over when and , respectively. Figure 4 reports the SER achieved by both the suboptimum strategy and the optimum strategy versus for and . The optimum strategy provides performance gain over the nonadaptive transceiver employing the conventional rectangular 8QAM by using the "17" 8QAM and the noncircular 8QAM for smaller values of , and, as , by using the 8PAM. In such a case, the performance difference between the suboptimum strategy and the optimum one is important, especially for large values of , since the suboptimum one employs the nonuniform 8PAM. Such a result was expected since, when increases, the optimum strategy can exploit a number of degrees of freedom significantly larger than the suboptimum strategy.
Finally, we observe that, when , an architecture switching between the QAM and the PAM can provide a good tradeoff between performance and complexity. Instead, when , the transceiver should switch among the Foschini&All, the noncircular QAM and the PAM.
4.2. Random Channel
In the following simulations, we assume that the channel has memory and its taps are randomly generated according to a complexvalued circularlysymmetric zeromean white Gaussian process with unit variance (i.e., and ); the WL MMSE equalizer has taps; the results have been averaged over 500 independent channel realizations. We compare the performances achieved by four architectures: (I) the OPTimumbased architecture (OPTbased) that selects and in order to minimize the symbol error rate (i.e., , instead of ); (II) the QAMbased architecture adopting the conventional circularly symmetric 4QAM constellation; (III) the PAMbased architecture utilizing the conventional rotationally variant 4PAM ( which corresponds to the maximum WL gain); (IV) the twochoicebased architecture that switches between the 4QAM and the 4PAM constellations according to (27). For clarity, we point out that the solution of (26) loses about 0.3 in comparison with the OPTbased one; we consider the OPTbased architecture in order to provide a lower bound to the SER. The OPTbased and the twochoicebased architectures, unlike the QAMbased and the PAMbased ones, require the existence of a feedback channel between the receiver and the transmitter for constellation adaptation; however, the twochoicebased architecture only needs to transmit a binary information on such feedback channel.
In Figure 6, the SERs of the considered architectures are plotted versus the (in dB). The OPTbased architecture outperforms all the others and provides an SNRgain over the nonoptimized architectures of almost for a . Interestingly, the twochoicebased architecture performs well loosing only in comparison with the OPTbased one. Let us also note that the PAMbased architecture performs poorly for low , but, as the increases, it outperforms the QAMbased one.
In the next experiment, we compare the considered architectures by evaluating their capability to guarantee the required quality of service (QoS). More specifically, in Table 1, we report the percentages of the channels over which the SNR required to achieve the target SER (assumed to be , , ) is not larger than 21. Moreover, Figure 7 reports the probability, say , that each architecture loses in comparison with the OPTbased one for a given target SER under the condition that the SNR is not larger than 21.
The results show the following:

(i)
The PAMbased architecture is robust with respect to the communication environment since it often achieves the target SER. This is mainly due to the improved capabilities of the WL equalizer when the transmitted and the received signals are rotationally variant. However, it requires a larger in comparison with the OPTbased architecture to compensate for the reduction of the dimension of the signal space. Note also that such an SNR loss, which is uniformly distributed between 0 and 4 when the target SER is and , assumes often two specific values (0 and 3 ) for a target SER equal to . In practice, the PAM architecture achieves optimum performance on 50 of the channels where the linear equalizer performs unsatisfactorily and the WL processing gain, specific to rotationally variant constellations, compensates for the smaller minimumdistance of the PAM constellation.

(ii)
The QAMbased architecture is not robust with respect to the communication environment. When it is able to achieve the target SER, it requires a limited amount of excess SNR over the OPTbased architecture; nevertheless, it is unable to achieve the target SER of on 37 of the channels. This is due to the circular symmetry of the constellation that does not allow one to improve by means of the WL processing the unsatisfactory performance of the linear equalizer.

(iii)
The twochoicebased architecture is particularly simple and robust since it combines the advantages of both PAM and QAM constellations.
5. Conclusions
We have addressed the problem of constellation optimization for the WL MMSE equalizer. By modeling the residual disturbance at the output of the WL equalizer as a white Gaussian (possibly rotationally variant) process, we have singled out constellationdesign methods which minimize an upper bound of the symbol error rate. The first method exploits all the degrees of freedom () associated to the order constellation exhibiting, therefore, an unaffordable computational complexity for highorder constellations. To overcome such a problem, a second design method based on a rhombic transformation of a fixed alphabet of order is proposed. It performs the optimization of only two parameters (instead of ) leading to a huge reduction of the computational complexity for large . For loworder constellations, the simulation results show that the two techniques are practically equivalent in terms of symbol error rate; moreover, they also show that a WL MMSE transceiver with constellation adaptation is clearly superior to the same equalizer with fixed constellation. Finally, for , it has been shown that the method that switches between a realvalued and a complexvalued constellation exhibits a limited performance loss versus the optimum adaptation scheme, while it achieves a strong reduction of the computational complexity and it requires to feed back to the transmitter only a binary information.
References
 1.
Lucky R, Hancock J: On the optimum performance of Nary systems having two degrees of freedom. IRE Transactions on Communications Systems 1962, 10: 185192.
 2.
Foschini GJ, Gitlin RD, Weinstein SB: Optimization of twodimensional signal constellations in the presence of Gaussian noise. IEEE Transactions on Communications 1974, 22(1):2838. 10.1109/TCOM.1974.1092061
 3.
Chevalier P, Pipon F: New insights into optimal widely linear array receivers for the demodulation of BPSK, MSK, and GMSK signals corrupted by noncircular interferences—application to SAIC. IEEE Transactions on Signal Processing 2006, 54(3):870883.
 4.
Palomar DP, Cioffi JM, Lagunas MA: Joint TxRx beamforming design for multicarrier MIMO channels: a unified framework for convex optimization. IEEE Transactions on Signal Processing 2003, 51(9):23812401. 10.1109/TSP.2003.815393
 5.
Xu F, Davidson TN, Zhang JK, Wong KM: Design of block transceivers with decision feedback detection. IEEE Transactions on Signal Processing 2006, 54(3):965978.
 6.
Jiang Y, Li J, Hager WW: Uniform channel decomposition for MIMO communications. IEEE Transactions on Signal Processing 2005, 53(11):42834294.
 7.
Scaglione A, Stoica P, Barbarossa S, Giannakis GB, Sampath H: Optimal designs for spacetime linear precoders and decoders. IEEE Transactions on Signal Processing 2002, 50(5):10511064. 10.1109/78.995062
 8.
Picinbono B: On circularity. IEEE Transactions on Signal Processing 1994, 42(12):34733482. 10.1109/78.340781
 9.
Kuchi K, Prabhu VK: Interference cancellation enhancement through generalized widely linear equalization in QAM systems. IEEE Transactions on Wireless Communications 2009, 8(4):15851590.
 10.
Picinbono B, Chevalier P: Widely linear estimation with complex data. IEEE Transactions on Signal Processing 1995, 43(8):20302033. 10.1109/78.403373
 11.
Kuchi K, Prabhu VK: Performance evaluation for widely linear demodulation of PAM/QAM signals in the presence of Rayleigh fading and cochannel interference. IEEE Transactions on Communications 2009, 57(1):183193.
 12.
Gerstacker WH, Schober R, Lampe A: Equalization with widely linear filtering. Proceedings of the IEEE International Symposium on Information Theory (ISIT '01), June 2001 265.
 13.
Mirbagheri A, Plataniotis KN, Pasupathy S: An enhanced widely linear CDMA receiver with OQPSK modulation. IEEE Transactions on Communications 2006, 54(2):261272.
 14.
Parihar A, Lampe L, Schober R, Leung C: Equalization for DSUWB systems—part II: 4BOK modulation. IEEE Transactions on Communications 2007, 55(8):15251535.
 15.
Gelli G, Paura L, Ragozini ARP: Blind widely linear multiuser detection. IEEE Communications Letters 2000, 4(6):187189. 10.1109/4234.848408
 16.
Gerstacker WH, Schober R, Lampe A: Receivers with widely linear processing for frequencyselective channels. IEEE Transactions on Communications 2003, 51(9):15121523. 10.1109/TCOMM.2003.816992
 17.
Parihar A, Lampe L, Schober R, Leung C: Equalization for DSUWB systems—part I: BPSK modulation. IEEE Transactions on Communications 2007, 55(6):11641173.
 18.
Mattera D, Paura L, Sterle F: Widely linear MMSE equaliser for MIMO linear timedispersive channel. Electronics Letters 2003, 39(20):14811482. 10.1049/el:20030945
 19.
Lampe A, Breiling M: Asymptotic analysis of widely linear MMSE multiuser detectioncomplex vs real modulation. Proceedings of the IEEE Information Theory Workshop, September 2001 5557.
 20.
Anderson JB: Digital Transmission Engineering. 2nd edition. IEEE Press, New York, NY, USA; 2005.
 21.
Lin YP, Phoong SM: Optimal ISIfree DMT transceivers for distorted channels with colored noise. IEEE Transactions on Signal Processing 2001, 49(11):27022712. 10.1109/78.960417
 22.
Palomar DP, Barbarossa S: Designing MIMO communication systems: constellation choice and linear transceiver design. IEEE Transactions on Signal Processing 2005, 53(10):38043818.
 23.
Makowski AM: On the optimality of uniform pulse amplitude modulation. IEEE Transactions on Information Theory 2006, 52(12):55465549.
Author information
Affiliations
Corresponding author
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
About this article
Cite this article
Lipardi, M., Mattera, D. & Sterle, F. Constellation Design for Widely Linear Transceivers. EURASIP J. Adv. Signal Process. 2010, 176587 (2010). https://doi.org/10.1155/2010/176587
Received:
Revised:
Accepted:
Published:
Keywords
 Minimum Mean Square Error
 Quadrature Amplitude Modulation
 Feedback Channel
 Constellation Design
 Symbol Error Rate