 Research Article
 Open Access
Constellation Design for Widely Linear Transceivers
 Maddalena Lipardi^{1},
 Davide Mattera^{1}Email author and
 Fabio Sterle^{2}
https://doi.org/10.1155/2010/176587
© Maddalena Lipardi et al. 2010
 Received: 31 October 2009
 Accepted: 6 July 2010
 Published: 25 July 2010
Abstract
Constellation design has been previously addressed by assuming that there is a linear equalizer at the receiver side. However, the widely linear equalizer is well known to outperform the linear one with no significant complexity increase; we derive optimum and suboptimum techniques for constellation design in presence of such an equalizer. The proposed techniques adapt the circularity properties of the transmitted signals to the specific channel to be equalized; their performance analysis shows that also the simplest suboptimum procedure provides significant improvements over a fixedconstellation scheme.
Keywords
 Minimum Mean Square Error
 Quadrature Amplitude Modulation
 Feedback Channel
 Constellation Design
 Symbol Error Rate
1. Introduction
Constellation design has been previously addressed by assuming that there is a linear equalizer at the receiver side. In early works (see, e.g., [1, 2]), the optimization of a twodimensional constellation in order to minimize the symbol error rate (SER) was first addressed with reference to the transmission over a nondispersive channel affected by additive noise.
The advantage provided by the constellations with two degrees of freedom (such as quadrature amplitude modulation (QAM)) over the ones with one degree of freedom (such as phaseshiftkeying (PSK), and pulse amplitude modulation (PAM)) was shown [1], and a proper mapping (based on a gradientdescent procedure) of the information bits into points of a twodimensional constellation was proposed [2]. However, the adoption of an additivenoise nondispersive channel model allows one to consider the constellation mapping independently of the equivalent channel. On the other hand, an amount of literature (e.g., [3–7]) refers to the optimization of the transmitter and/or the receiver without including the choice of the constellation in the optimization procedure. In fact, many existing transceiver processing techniques are optimized (according to a chosen criterion) by only exploiting knowledge of the statistics of the information symbol sequence.
This paper addresses the constellation design under the assumption that the transmitter is fixed (i.e., by considering an equivalent channel representing the transmitter and the channel) and a widely linear (WL) minimum mean square error (MMSE) equalizer is employed at the receiver side [8–14].
The WL filtering generalizes the conventional linear filtering and allows one to achieve a power reduction of the additive noise and interferences at the equalizer output, and therefore a performance gain, by exploiting the statistical redundancy possibly exhibited by a rotationally variant transmitted (and/or received) signal. For such a reason, the adoption of the WL equalization has frequently been confined to the transmission of onedimensional constellations (see, e.g., [3, 15–17] and references therein) since the advantage of using the WL filtering (instead of the linear one) is maximum for onedimensional constellation. Twodimensional constellations (especially highorder ones) are often preferred to onedimensional constellations (in presence of a linear receiver) in order to maximize the minimum distance between the constellation points [1]. However, WL linear filtering provides no performance advantage over linear one when the chosen constellation and the additive noise are circularly symmetric. For such a reason, we consider the optimization both over circularly symmetric and over rotationally variant constellations without any assumption about the circularity properties of the additive noise. In fact, the noncircularity of the constellation is introduced in order to exploit the presence of the WL receiver but it also provides a disadvantage in terms of the minimum distance between the constellation points.
When both the effects are accounted for, the optimum degree of noncircularity of the constellation becomes dependent on the specific channel impulse response. Therefore, we address the constellation design under the assumption that the channel state information (CSI) is available and we propose a CSIdependent symbol mapping that optimizes the performance of the WL MMSE receiver. Symbol mapping is adapted by using a feedback channel (between the receiver and the transmitter) carrying information about the optimum constellation. Moreover, suboptimum strategies are proposed in order to reduce both the amount of information to be transmitted on the feedback channel and the computational complexity of the optimization procedure.
The paper is organized as follows. Section 2 introduces the system model, recalls the MMSE equalizer structure and analyzes how its performance depends on the amount of pseudocorrelation of the transmitted signal. Section 3 addresses the constellation design in the presence of the WL MMSE equalizer by generalizing the results in [2] to the case where the additive disturbance (noise plus interference) is rotationally variant. Section 4 reports the results of simulation experiments mainly aimed at showing the performance advantages provided by the constellation adaptation procedures. Finally, Section 5 provides the conclusions and the final remarks.
Notation 1.
The following notations are adopted throughout the paper. is the imaginary unit, the superscripts , , and denote the complexconjugate, the transpose and the Hermitian transpose, respectively, is the statistical expectation, is the Kronecker delta, is the identity matrix of size , is the vector/matrix with all zero entries (the size is omitted for brevity), denotes the th entry of the vector , denotes the entry of the matrix , denotes the th column of , and are the real and the imaginary part, respectively, denotes the norm with , and, finally, is the transform of .
2. The FIR MMSE Equalizer
In this section, we introduce the considered system model; then, we derive the WL MMSE feedforwardbased equalizer and we study the variations of the achieved MMSE versus the pseudocorrelation of the transmitted signal. Such an analysis will be useful in Section 3 to address the constellation design for MMSE receivers.
2.1. System Model
where the transmitted symbols are independent identically distributed (i.i.d.) zeromean random variables drawn from the complexvalued constellation whose (finite) order determines the bit rate ( bits per symbol) of the uncoded system part. With no loss of generality, we assume that and , that is, the transmitted available power is unit, and that exhibits a possibly nonnull pseudocorrelation , such that (if , then the correlation matrix of the random vector will be positive semidefinite); note that the noncircularity of consists in the difference between the power of the inphase component and the quadrature one and in the correlation between them. Such assumption allows one to consider both the conventional circularly symmetric constellations ( ), such as PSK and square QAM with , and the rotationally variant constellations, such as the wellknown PAM ( ) and its rotated version (for which it exists such that is realvalued and, consequently, ), nonsquare QAM (with since a different power is allocated to the inphase and quadrature components). The timeinvariant FIR channel impulse response of memory is assumed to be known at the receiver side. Finally, the additive noise , whose power is assumed known at the receiver, is modeled as zeromean complexvalued widesense stationary timeuncorrelated and independent of the useful signal. The additive disturbance is not assumed circularly symmetric because it may include the effects of onedimensional cochannel interferences.
where is the (possibly) nonnull noise pseudocorrelation (if , then the noise is circularly symmetric).
2.2. FeedforwardBased MMSE Equalizer
where denotes the th column of and the processing delay has to be chosen in order to optimize the performance. For notational simplicity, in (4) and (5) we have omitted the dependence of and on . Let us point out that when , that is, the transmitted symbols are drawn from a circularly symmetric constellation, = 0 and, therefore, the WL MMSE equalizer degenerates into the conventional linear MMSE equalizer. Another special case is represented by the scenario where a realvalued constellation is adopted. In fact, since , and the WL MMSE equalizer becomes , that is, it is implemented by extracting the inphase component of the linear equalizer , which does not coincide, however, with the linear MMSE equalizer.
Since and are positive semidefinite, one has and, hence, increasing the degree of noncircularity of the transmitted signal improves the MMSE. For such a reason, the use of a realvalued transmitted sequence together with a WL MMSE equalizer corresponds to the optimum choice as far as the MMSE is adopted as the performance measure. On the other hand, when , the variations of with respect to depend on the specific values of the channel impulse response and the noise statistics.
3. Constellation Design
The present section addresses the design of the order constellation with fixed (under the assumption that the WL MMSE equalizer is used) and it is organized as follows. In Section 3.1, we address the optimum constellation design for the WL MMSE receiver by extending the results of [2] to the case of additive rotationally variant disturbance. In Section 3.2, we propose a suboptimum strategy based on the rhombic transformation of a given constellation. Such a strategy allows one to reduce both the computational complexity of the optimization procedure and the amount of information required at the transmitting side in order to adapt the constellation.
The results in the previous section allow one to state that, by using a realvalued constellation ( ) instead of a complexvalued nonredundant ( ) one, a performance gain can be achieved in terms of the MMSE at the equalizer output. On the other hand, not always an MSE gain provided by the WL equalizer leads to a SER gain [19]. In fact, for a fixed expended average energy per bit, the reduction of the minimum distance between the constellation points, due to the adoption of onedimensional constellations rather than twodimensional ones (e.g., when we adopt the PAM rather than the QAM) leads to a potential increase in the SER. Therefore, we address the constellation design minimizing the SER at the WL MMSE equalizer output by accounting for its rotationally variant properties.
The use of a feedback channel in order to improve the bitrate could also be exploited for choosing the constellation size rather than its circularity degree when the signaltonoise ratio of each channel realization is not previously known. For example, the problem of the constellation choice has been addressed in [21, 22] with reference to the discrete multitone (DMT) transceiver and to multipleinput multipleoutput transceiver, respectively. The two parameters of the constellations (size and circularitydegree) could also be jointly optimized by generalizing the procedures here proposed.
3.1. Constellation Optimization in the Presence of Gaussian Rotationally Variant Noise
In order to optimize over the constellation choice we need to first derive a performance analysis of the considered equalizer. Approximated evaluations of the performance of the WL receiver are available in [11] for a QAM constellation and in [3] for a PAM constellation in the presence of a PAM cochannel interference. Moreover, such performance analysis is generalized in [9] for IIR WL filters. Here, we derive an approximation of the equalizer performance suited for successive optimization over transmitter constellation.
where is the transmitted symbol drawn from the complexvalued constellation with and , and is the residual disturbance that includes the intersymbol interference and the noise terms after the WL equalizer filtering. The circularly symmetric model for the additive disturbance is inadequate since the output of a WL filter is, in general, rotationally variant. Therefore, we model as rotationally variant, that is, , , and . Moreover, in order to make the constellation design analytically tractable, we approximate as Gaussian. For the sake of clarity, let us note that, if symbols and noise are circularly symmetric ( ), then the additive disturbance and the equalizer output will be circularly symmetric too; on the other hand, if is rotationally variant, then will be rotationally variant too, but nothing can be stated about the circularity properties of also when .
Unfortunately, it is difficult to find the closedform expression of the solution of such an optimization problem. For such a reason, we propose to find a local solution by means of numerical algorithms (e.g., a projected gradient method). To this aim, we can exploit the gradient of with respect to , while we resort to numerical approximation of the gradient with respect to since it is difficult to obtain its analytical expression.
Condition (17) generalizes the result of [2] to the case of rotationally variant (i.e., or ) and with a constrained pseudocorrelation. ( .) In fact, (17) with (i.e., no constraint is imposed on the pseudocorrelation) requires that is proportional to the weighted sum (with weights ) of , , as found in [2]. For the sake of clarity, let us note that the procedure proposed in [2] does not allow one to exploit the potential advantage of a rotationally variant constellation when the WL MMSE receiver is employed. For example, when a linear MMSE equalizer is employed for in high signaltonoise ratio, the minimum of the SER is equivalently achieved [2] by both the conventional 4QAM constellation and the rhombic constellations with the same perimeter, that is, the perimeter of the largest convex polygon consisting of the lines (see [1] for further details). On the other hand, when a WL MMSE equalizer is employed, a rhombic constellation, which is rotationally variant, is not equivalent to the conventional 4QAM since the achieved MMSE is dependent on as shown in (8).
3.2. A Suboptimum Procedure Based on Rhombic Transformations
In this section, we propose a suboptimum constellationdesign procedure for the WL MMSE equalizer. The method is based on the exploitation of a rhombic transformation that operates on a circularly symmetric constellation making it rotationally variant. Such a transformation depends on two parameters and allows one to control the pseudocorrelation of the obtained constellation; consequently, the optimization procedure is simplified since the SER in (13) is a function of only two parameters, instead of parameters.
 (1)
the huge reduction of the computational complexity of the constellation optimization procedure when ; in fact, the SER becomes a function of only two variables ( and ), regardless of the constellation order ;
 (2)
the reduced implementation complexity of the transmitter stage; in fact, the symbolmapping is implemented by means of the linear transformation (19);
 (3)
the decrease of the information amount to be transmitted on the feedback channel; in fact, only the values of two parameters (instead of ) have to be sent to the transmitter.
where denotes , denotes − , and denotes + − − − , and where (23) follows from (13) and (19), and the dependence of the disturbance parameters on has been replaced by the dependence on and . Since finding the closedform expression of and is a difficult problem, here we propose to approximate with a function, say , whose minimization can be carried out by evaluating it only over a very limited set of points. In the sequel, such an approximation is derived for a QAM constellation , though it can be analogously determined for denser constellations.
where is the curve corresponding to the maximum value of for a fixed (or, equivalently, to the maximum value of for a fixed ). Of course, the restriction to leads to a significant decrease in the computational complexity. Let us point out that, interestingly, such a restricted optimization procedure accounts for the possible transmission of the conventional 4PAM: in fact, it can be easily verified that when , .
Three remarks about the suboptimum procedure (26) follow.
Remark 1.
Remark 2.
The optimum transmission strategy proposed here requires that the receiver sends on the feedback channel the whole optimum constellation. If the suboptimum procedure is used, the transmitter architecture can be simplified. In fact, a unique symbol mapper for the alphabet is needed and the constellation is adapted by adjusting the zeromemory WL filter (19). Unfortunately, the main disadvantage in terms of the computational complexity of the receiver remains the adaptation of the decision mechanism for the constellation .
Remark 3.
It can be easily shown that (a) if , then , unless , and (b) since . Such results show that the minimumdistance decision based on the WL MMSE estimation of outperforms the (computationally simpler) minimumdistance decision based on the WL MMSE estimation of .
4. Numerical Results
In this section, we present the results of simulation experiments aimed at assessing the performance improvements achievable by the proposed constellationoptimization procedures. In all the experiments, we assume that ( ) the noise sequence at the output of the channel is zeromean white Gaussian complexvalued circularly symmetric with variance , that is, ; ( ) the decision delay is optimized; ( ) the SER has been estimated by stopping the simulation after 100 errors occur; ( ) each sample at the output of the WL filter is the input of the decision device that performs the symbolbysymbol ML detection of the transmitted symbol.
4.1. Fixed Channel
In this section, we compare the performances of the constellation design procedures (26) and (14) in terms of SER. In our simulations, we solve (26) by means of an exhaustive search over and : note that in our search we consider , so we consider a finite number of points. On the other hand, we resort to the constrained gradientbased algorithm for solving (14). Since the cost function (13) exhibits local minima, 1000 starting points have been randomly generated according to a uniform distribution. Due to the amount of time required by the computer simulations to determine the solution of (14), we consider, as in [16], the transmission over a twotap channel affected by an additive circularly symmetric white Gaussian noise with variance . In our experiments, we have addressed the optimization of the constellation when and for different values of , , and .
Let us first plot in Figure 2 some of the optimum constellations obtained during our simulations when solving the optimization problem (14) over the considered channel model; moreover, we plot the suboptimum constellation utilized to implement our suboptimum strategy and the PAM constellation obtained by applying to it the rhombic transformation. As in [2], we have found many local optima, some of them were rotated version of the constellations of Figure 2 while others appeared as their rhombic transformation. For the locally optimum constellation set includes the conventional QAM ( ) and PAM ( ), as well as the QAM subject to a rhombic transformation ( ); note that such constellations can be obtained by means of a rhombic transformation of the conventional QAM (as also shown in Section 3.2), which has been utilized to implement our suboptimum strategy when . For , the optimum constellation set includes the noncircular QAM found by Foschini et al. ( ), one of the conventional QAM scheme ( ) called "17" 8QAM [2], the PAM ( ) and the noncircular QAM scheme that we call noncircular 8QAM. In the following, in order to implement the rhombictransformationbased constellationoptimization strategy, we resort to the rectangular QAM; we remember that, unlike QAM, such a scheme cannot be transformed into the conventional uniform PAM, but in the nonoptimum nonuniform PAM (the optimality of uniform PAM over additive white Gaussian noise has been shown in [23]).
Finally, we observe that, when , an architecture switching between the QAM and the PAM can provide a good tradeoff between performance and complexity. Instead, when , the transceiver should switch among the Foschini&All, the noncircular QAM and the PAM.
4.2. Random Channel
In the following simulations, we assume that the channel has memory and its taps are randomly generated according to a complexvalued circularlysymmetric zeromean white Gaussian process with unit variance (i.e., and ); the WL MMSE equalizer has taps; the results have been averaged over 500 independent channel realizations. We compare the performances achieved by four architectures: (I) the OPTimumbased architecture (OPTbased) that selects and in order to minimize the symbol error rate (i.e., , instead of ); (II) the QAMbased architecture adopting the conventional circularly symmetric 4QAM constellation; (III) the PAMbased architecture utilizing the conventional rotationally variant 4PAM ( which corresponds to the maximum WL gain); (IV) the twochoicebased architecture that switches between the 4QAM and the 4PAM constellations according to (27). For clarity, we point out that the solution of (26) loses about 0.3 in comparison with the OPTbased one; we consider the OPTbased architecture in order to provide a lower bound to the SER. The OPTbased and the twochoicebased architectures, unlike the QAMbased and the PAMbased ones, require the existence of a feedback channel between the receiver and the transmitter for constellation adaptation; however, the twochoicebased architecture only needs to transmit a binary information on such feedback channel.
Percentage of channels over which the target SER is achieved.
Target SER  OPTbased  QAMbased  PAMbased  Twochoicebased 
















 (i)
The PAMbased architecture is robust with respect to the communication environment since it often achieves the target SER. This is mainly due to the improved capabilities of the WL equalizer when the transmitted and the received signals are rotationally variant. However, it requires a larger in comparison with the OPTbased architecture to compensate for the reduction of the dimension of the signal space. Note also that such an SNR loss, which is uniformly distributed between 0 and 4 when the target SER is and , assumes often two specific values (0 and 3 ) for a target SER equal to . In practice, the PAM architecture achieves optimum performance on 50 of the channels where the linear equalizer performs unsatisfactorily and the WL processing gain, specific to rotationally variant constellations, compensates for the smaller minimumdistance of the PAM constellation.
 (ii)
The QAMbased architecture is not robust with respect to the communication environment. When it is able to achieve the target SER, it requires a limited amount of excess SNR over the OPTbased architecture; nevertheless, it is unable to achieve the target SER of on 37 of the channels. This is due to the circular symmetry of the constellation that does not allow one to improve by means of the WL processing the unsatisfactory performance of the linear equalizer.
 (iii)
The twochoicebased architecture is particularly simple and robust since it combines the advantages of both PAM and QAM constellations.
5. Conclusions
We have addressed the problem of constellation optimization for the WL MMSE equalizer. By modeling the residual disturbance at the output of the WL equalizer as a white Gaussian (possibly rotationally variant) process, we have singled out constellationdesign methods which minimize an upper bound of the symbol error rate. The first method exploits all the degrees of freedom ( ) associated to the order constellation exhibiting, therefore, an unaffordable computational complexity for highorder constellations. To overcome such a problem, a second design method based on a rhombic transformation of a fixed alphabet of order is proposed. It performs the optimization of only two parameters (instead of ) leading to a huge reduction of the computational complexity for large . For loworder constellations, the simulation results show that the two techniques are practically equivalent in terms of symbol error rate; moreover, they also show that a WL MMSE transceiver with constellation adaptation is clearly superior to the same equalizer with fixed constellation. Finally, for , it has been shown that the method that switches between a realvalued and a complexvalued constellation exhibits a limited performance loss versus the optimum adaptation scheme, while it achieves a strong reduction of the computational complexity and it requires to feed back to the transmitter only a binary information.
Authors’ Affiliations
References
 Lucky R, Hancock J: On the optimum performance of Nary systems having two degrees of freedom. IRE Transactions on Communications Systems 1962, 10: 185192.View ArticleGoogle Scholar
 Foschini GJ, Gitlin RD, Weinstein SB: Optimization of twodimensional signal constellations in the presence of Gaussian noise. IEEE Transactions on Communications 1974, 22(1):2838. 10.1109/TCOM.1974.1092061View ArticleGoogle Scholar
 Chevalier P, Pipon F: New insights into optimal widely linear array receivers for the demodulation of BPSK, MSK, and GMSK signals corrupted by noncircular interferences—application to SAIC. IEEE Transactions on Signal Processing 2006, 54(3):870883.View ArticleGoogle Scholar
 Palomar DP, Cioffi JM, Lagunas MA: Joint TxRx beamforming design for multicarrier MIMO channels: a unified framework for convex optimization. IEEE Transactions on Signal Processing 2003, 51(9):23812401. 10.1109/TSP.2003.815393View ArticleGoogle Scholar
 Xu F, Davidson TN, Zhang JK, Wong KM: Design of block transceivers with decision feedback detection. IEEE Transactions on Signal Processing 2006, 54(3):965978.View ArticleGoogle Scholar
 Jiang Y, Li J, Hager WW: Uniform channel decomposition for MIMO communications. IEEE Transactions on Signal Processing 2005, 53(11):42834294.MathSciNetView ArticleGoogle Scholar
 Scaglione A, Stoica P, Barbarossa S, Giannakis GB, Sampath H: Optimal designs for spacetime linear precoders and decoders. IEEE Transactions on Signal Processing 2002, 50(5):10511064. 10.1109/78.995062View ArticleGoogle Scholar
 Picinbono B: On circularity. IEEE Transactions on Signal Processing 1994, 42(12):34733482. 10.1109/78.340781View ArticleGoogle Scholar
 Kuchi K, Prabhu VK: Interference cancellation enhancement through generalized widely linear equalization in QAM systems. IEEE Transactions on Wireless Communications 2009, 8(4):15851590.View ArticleGoogle Scholar
 Picinbono B, Chevalier P: Widely linear estimation with complex data. IEEE Transactions on Signal Processing 1995, 43(8):20302033. 10.1109/78.403373View ArticleGoogle Scholar
 Kuchi K, Prabhu VK: Performance evaluation for widely linear demodulation of PAM/QAM signals in the presence of Rayleigh fading and cochannel interference. IEEE Transactions on Communications 2009, 57(1):183193.View ArticleGoogle Scholar
 Gerstacker WH, Schober R, Lampe A: Equalization with widely linear filtering. Proceedings of the IEEE International Symposium on Information Theory (ISIT '01), June 2001 265.Google Scholar
 Mirbagheri A, Plataniotis KN, Pasupathy S: An enhanced widely linear CDMA receiver with OQPSK modulation. IEEE Transactions on Communications 2006, 54(2):261272.View ArticleGoogle Scholar
 Parihar A, Lampe L, Schober R, Leung C: Equalization for DSUWB systems—part II: 4BOK modulation. IEEE Transactions on Communications 2007, 55(8):15251535.View ArticleGoogle Scholar
 Gelli G, Paura L, Ragozini ARP: Blind widely linear multiuser detection. IEEE Communications Letters 2000, 4(6):187189. 10.1109/4234.848408View ArticleGoogle Scholar
 Gerstacker WH, Schober R, Lampe A: Receivers with widely linear processing for frequencyselective channels. IEEE Transactions on Communications 2003, 51(9):15121523. 10.1109/TCOMM.2003.816992MathSciNetView ArticleGoogle Scholar
 Parihar A, Lampe L, Schober R, Leung C: Equalization for DSUWB systems—part I: BPSK modulation. IEEE Transactions on Communications 2007, 55(6):11641173.View ArticleGoogle Scholar
 Mattera D, Paura L, Sterle F: Widely linear MMSE equaliser for MIMO linear timedispersive channel. Electronics Letters 2003, 39(20):14811482. 10.1049/el:20030945View ArticleGoogle Scholar
 Lampe A, Breiling M: Asymptotic analysis of widely linear MMSE multiuser detectioncomplex vs real modulation. Proceedings of the IEEE Information Theory Workshop, September 2001 5557.Google Scholar
 Anderson JB: Digital Transmission Engineering. 2nd edition. IEEE Press, New York, NY, USA; 2005.View ArticleGoogle Scholar
 Lin YP, Phoong SM: Optimal ISIfree DMT transceivers for distorted channels with colored noise. IEEE Transactions on Signal Processing 2001, 49(11):27022712. 10.1109/78.960417View ArticleGoogle Scholar
 Palomar DP, Barbarossa S: Designing MIMO communication systems: constellation choice and linear transceiver design. IEEE Transactions on Signal Processing 2005, 53(10):38043818.MathSciNetView ArticleGoogle Scholar
 Makowski AM: On the optimality of uniform pulse amplitude modulation. IEEE Transactions on Information Theory 2006, 52(12):55465549.MathSciNetView ArticleMATHGoogle Scholar
Copyright
This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.