Exact Symbol Error Probability of Cross-QAM in AWGN and Fading Channels

Abstract

The exact symbol error probability (SEP) performance of M -ary cross quadrature amplitude modulation (QAM) in additive white Gaussian noise (AWGN) channel and fading channels, including Rayleigh, Nakagami-m, Rice, and Nakagami-q (Hoyt) channels, is analyzed. The obtained closed-form SEP expressions contain a finite (in proportion to M ) sum of single integrals with finite limits and an integrand composed of elementary (exponential, trigonometric, and/or power) functions, thus readily enabling numerical evaluation. Particularly, Gaussian Q -function is a special case of these integrals and is included in the SEP expressions. Simple and very precise approximations, which contain only Gaussian Q -function for AWGN channel and contain three terms of the single integrals mentioned above for fading channels, respectively, are also given. The analytical expressions show excellent agreement with the simulation results, and numerical evaluation with the proposed expressions reveals that cross QAM can obtain at least 1.1 dB gain compared to rectangular QAM when SEP < 0.3 in all the considered channels.

(ProQuest: ... denotes non-US-ASCII text omitted.)

Recommended by George Karagiannidis

Guangdong Provincial Key Laboratory of Short-Range Wireless Detection and Communication, School of Electronic and Information Engineering , South China University of Technology, Guangzhou 510640, China

Received 28 April 2010; Revised 24 September 2010; Accepted 21 November 2010

1. Introduction

Quadrature amplitude modulation (QAM) has been widely used in digital communication systems due to its high bandwidth efficiency. When the number of bits per symbol is even, transmission can be implemented easily by using square QAM. However, if there is a requirement for the transmission of an odd number of bits per symbol, the rectangular QAM is not a good choice in terms of power efficiency. The issue was overcome by Smith who proposed cross-QAM constellation which is obtained from a square constellation by removing some outer point in each corner and is given the shape of a cross [1]. Smith shows that both the peak and average power can be reduced by using a cross-QAM constellation, and there is at least a 1-dB gain in the average signal-to-noise ratio.

Recently, cross-QAM has been found to be useful in adaptive modulation schemes wherein the constellation size is adjusted depending on the channel quality [2-6]. As the channel quality improves, the constellation size is expected to be increased by incrementing ^2m to ^2m+1 . If one were to use just square QAM, the increments should be from ^2m to ^2m+2 (for instance, we need to go from 16 to 64 to 256-QAM ... ). Using cross-QAM, however, the increment is smoother (16-QAM to cross 32-QAM to 64-QAM ... ). The steps between consecutive squared constellations are too big, especially for small constellations [7]. An intermediate step (corresponding to odd powers of 2) will make the system to work with more granularity obtaining greater coverage for a determined data rate [2]. As a result, cross-QAMs have been adopted in many practical systems. For example, cross-QAMs with constellations from 5 bits to 15 bits have been used in ADSL and VDSL [8, 9], and cross 32-QAM and cross 128-QAM are adopted in DVB-C [10]. On the other hand, cross-QAMs have special application in blind equalization [11-14].

Despite the immense importance of cross-QAM, the implementation and the calculation of the average symbol error probability (SEP) of cross-QAM are more complicated compared to that of square and rectangular QAMs since the inphase and quadrature components of cross-QAMs cannot be demodulated independently. So, the calculation of SEP of cross-QAM cannot be reduced to a one-dimensional problem by using the independence of the inphase and quadrature components, as can be done for square QAM and rectangular QAM. It can be found the upper bounds of the SEP of cross-QAM in [1] and [15, Chapter 5]. Recently, [16] derives the bit error probability (BEP) of cross-QAM constellations with Smith-style Gray coding in additive white Gaussian noise (AWGN) and Rayleigh flat fading. However, the closed-form solutions to BEP for AWGN and Raleigh flat fading channels in [16] are very complicated, not to mention that [16] does not consider the SEP of cross-QAM and that it is not straightforward to extend the result of [16] to SEP calculation. More recently, an exact closed-form SEP expression for 32 cross-QAMs in AWGN has been derived in the form of a finite sum of Gaussian Q -functions [17]. Note, however, that the decision regions of the corner points for other cross-QAM modulation are more complicated than 32-cross-QAM. In [18], an infinite double series of the products of Gaussian Q -functions for the SEP of 128-cross-QAM and 512-cross-QAM in AWGN is derived. The difficulty arises when one tries to find the closed-form exact SEP expression of arbitrary M -ary cross-QAM in AWGN, which involves the calculation of the two-dimensional joint Gaussian Q -function.

In fading channels, on the other hand, the signal-to-noise ratio (SNR) of the received symbol becomes a random variable. As such, the usual method to find the average SEP in fading channels is to first get the conditional SEP as if in an AWGN channel (conditioned on SNR or channel realization) then average the conditional SEP over SNR or channel realization. This approach will, in many cases, result in an integral, usually being two-dimensional integral even three-dimensional integral, that cannot be integrated into a closed form and hence must be integrated numerically. By using the "preaveraging" technique [19], opposed to the customary and widely adopted "postaveraging" technique, the exact SEP of cross-QAM in Rayleigh fading channels has been derived in [20], where the closed-form SEP expression obtained contains only elemental functions (trigonometric). However, the "preaveraging" technique involves tedious calculations again, and it would only apply for Nakagami-m channels with integer parameter m , not to mention whether it can be extended to encompass Rice and Hoyt fading. Perhaps, the best method to get SEP of digital modulation signaling over fading channels is given by Simom and Alouini [21]. They use the moment generating function- (MGF-) based approach to obtain SEP expressions for various digitally modulated signals over fading channels. Their basic technique is to rewrite the Gaussian Q -function into a preferred form of an integral with finite integration limits (many SEP expressions contain the Gaussian Q -function), so that the final average SEP expression can be numerically computed with more accuracy. In some special cases, the MGF-based method can even lead to an exact closed-form SEP without undone integrals.

In this paper, using the alternate representation of the two-dimensional joint Gaussian Q -function and the MGF-based method, the exact SEP expressions of arbitrary M -ary cross-QAM in AWGN and fading channels, including Rayleigh, Nakagami-m, Rice, and Nakagami-q (Hoyt) channels, have been derived. The closed-form SEP expressions obtained contain Gaussian Q -functions and a finite (in proportion to M ) sum of single integrals with finite limits and an integrand composed of elementary (exponential, trigonometric, and power) functions, thus readily enabling numerical evaluation.

The remainder of this paper is organized as follows. First, Section 2 briefly introduces the problem background. Next, Sections 3 and 4 derive the average SEP expressions for cross-QAM in AWGN channels and fading channels, respectively. And then, Section 5 gives the simulation and numerical results. Finally, Section 6 concludes the contributions of this work.

2. Background

2.1. Construction of Cross-QAM

Since we deal with cross-QAMs in this paper, we define M=^22m+1 with m≥2 , that is, M=32,128,512,2048,... . As mentioned in [1], by introducing "block" parameter [figure omitted; refer to PDF] cross-QAM constellation can be constructed by a 6×6 square block array with the 4 corner blocks deleted, each block with ^ν2 uniform distributed points, as shown in Figure 1.

Figure 1: Block structure of XQAM. A 6×6 square block array with the 4 corner blocks deleted, each block with ^ν2 uniform distributed points. Especially, cross 128-QAM (ν=2 ) is shown here as an example.

[figure omitted; refer to PDF]

2.2. Decision Boundaries for Symbols in Cross-QAM

Since the quadrature components of cross-QAM are not independent as in square QAM, the optimal decision regions are not all rectangular. As shown in Figure 2, where the dots represent signal points while the lines indicate decision boundaries, there are three types of points: interior symbols, edge symbols, and corner symbols. The decision regions of interior symbols and edge symbols are closed square and semi-infinite rectangular, respectively. But that of the corner symbols are slightly complicated and can be represented by a combination of vertical, horizontal, and 4^5° lines. According to the symmetry, it is enough to consider the symbols in one quadrant of the cross-QAM constellation. The numbers of the three types of points in one quadrant of the constellation are, respectively, given as [figure omitted; refer to PDF]

Figure 2: Decision boundaries for symbols in cross-QAM. The black points, hollow points, and slash points represent the interior symbols, edge symbols, and corner symbols, respectively. In particular, only one quadrant of the cross 128-QAM constellation (ν=2 ) is shown here as an example.

[figure omitted; refer to PDF]

2.3. System Parameters for M -ary Cross-QAM

We will define some parameters in order to make our expressions simpler and compact. Let d denote half of the minimum Euclidean distance between adjacent symbols in the constellation, and let _N0 /2 denote the two-sided power spectral density of the zero-mean AWGN (i.e., its variance ^σ2 =_N0 /2 ). Especially, the exact SEP expressions will be written in terms of the Gaussian Q -function [figure omitted; refer to PDF] and a well-known integral function related to the alternate representation of one- and two-dimensional joint Gaussian Q -functions [21-24] [figure omitted; refer to PDF] In particular, Q(x)=_Qa (x,π)=2_Qa (x,π/2) [22, equation (2) ] and ^Q2 (x)=2_Qa (x,π/4) [23, equation (12) ], both for x≥0 .

Note that, in addition to the advantage of having finite integration limits, the form in (4) has the argument x contained in the integrand rather than in the integration limits as is the case in (3), and it also has an integrand that is exponential in the argument x , so that it can be numerically evaluated with more accuracy. Moreover, the form in (4) has some interesting implications with regard to simplifying the evaluation of performance results related to communication problems, for example, as seen later to the SEP performance evaluation over fading channels, wherein the argument of the _Qa -function is dependent on random system parameters and, thus, requires averaging over the statistics of these parameters.

To simplify the mathematical expressions, in the following derivation the argument x of the above two functions (3) and (4) sometimes will be expressed as a multiple of [figure omitted; refer to PDF] which denotes the normalized least distance (in noise standard deviation) from a signal point to a decision boundary.

Assuming that the signal points are equally probable and according to the symmetry of the constellation, it can be easily shown that the average symbol energy for cross M -QAM constellation is given by [figure omitted; refer to PDF] where [figure omitted; refer to PDF]

Since the symbol's signal-to-noise ratio (SNR) can be written as [figure omitted; refer to PDF] thus, [figure omitted; refer to PDF] So, we can also leave the SEP expression in terms of δ as mentioned above.

2.4. Overview of SEP Approximations in AWGN

For nonrectangular M -ary QAM signal constellations, Proakis has given an obvious upper bound in [15, page 279] as [figure omitted; refer to PDF] where ^{dmin (e)} is the minimum Euclidean distance between signal points, and ^{dmin (e)} =2d for uniform cross-QAM. This bound may be loose when M is large. In such a case, Proakis suggested replacing (M-1) by _Mn , the largest number of neighboring points that are at distance ^{dmin (e)} from any constellation point. Obviously, for cross-QAM, _Mn =4 . So, (10) can be reproduced for cross-QAM as [figure omitted; refer to PDF]

Alternately, Gilbert approximation [1, equation (1)] to the SEP for any M -ary QAM can also be used for cross-QAM, and it is given as [figure omitted; refer to PDF] where _Nn is the average number of nearest neighbors for a symbol in the constellation, and _Nn =4-6/(8ν)=4-6/2M for cross-QAM (In [1], the expression for _Nn appears erroneously as _Nn =4-5/(8ν) [16].) when M≥32 . Note that, as M increases, _Nn increases and approaches _Mn =4 . In fact, the principle behind the above two approximate expressions is very intuitive since they can be interpreted as the sum of the probabilities that a given point is mistaken for its neighbors. At the same time, since the sum has recalculate some error regions, both the above two expressions overestimate the actual SEP as shown later.

3. Symbol Error Probability in AWGN Channel

While the SEP expressions for the interior symbols and edge symbols can be deduced easily from the SEP expressions for square QAM in [15, pages 265 and 278], the SEP of corner symbols needs to be derived separately.

The SEP of any interior symbol and edge symbol can be written, respectively, as [figure omitted; refer to PDF]

For the corner symbols, from the left to right or from the bottom to the top as shown in Figure 2, the SEP of the k th point is given by [figure omitted; refer to PDF] where p(x) is the probability density function (PDF) of the standard normal distribution and given by [figure omitted; refer to PDF] [figure omitted; refer to PDF]

Having derived the exact SEP of all the points, the exact average SEP for the M -ary cross-QAM constellation can be written as [figure omitted; refer to PDF]

Appendix shows that, with the integral function defined in (4), (17) can be rewritten as [figure omitted; refer to PDF] where [figure omitted; refer to PDF]

Although it is difficult to express the function _Qa (x,[varphi]) in a closed form without integration, it is a one-dimensional integral with finite limits, and its integrand only composes of elementary (exponential and trigonometric) functions, while the function Φ(k,δ;b) actually is a two-dimensional integral of exponential function with infinite limits according to (A.2) in Appendix. With (4), in fact, _Qa (x,[varphi]) can be easily and accurately evaluated numerically (see, e.g., using MATLAB). Note that the numerical calculation of (4) is much simpler and more precise than that of the infinite double series of the products of Gaussian Q -functions of equation (3) in [18].

Note that, when M=32 , only the first three terms of the right side of (18) are retained, while the last three terms disappear since ν=1 . So, the exact SEP expression of 32-ary cross-QAM is [figure omitted; refer to PDF] which is the same as equation (5) in [17].

If ignoring the last three terms and only retaining the first three terms in (18), we will obtain a very tight approximation of the exact SEP written as [figure omitted; refer to PDF] Note that, when M=32 , (21) is also the exact SEP. On the other hand, the first term of (21) is just the average number of nearest neighbors or the Gilbert approximation. At SNR = 0 (i.e., γ=0 ), especially, Gilbert approximation is 2-3/2M , which is much larger than one, while (21) yields _Ppro =1-1/M , which is the exact SEP.

4. Symbol Error Probability in Fading Channels

The fading channels, including Rayleigh, Nakagami-m, Nakagami-q (Hoyt), and Nakagami-n (Rice) channels, are considered in this section. The probability density function (pdf) of the instantaneous received SNR γ in these channels can be written as, respectively, [21] [figure omitted; refer to PDF] where γ=^r2_Es /_N0 is the instantaneous SNR of the received symbol, r is the instantaneous fading amplitude of the channel, _Es is the energy of each transmitted symbol, _N0 is the one-sided power spectral density of the zero-mean AWGN, Ω=E{γ} is the average received SNR per symbol, and E{·} denotes the expectation operator. And _I0 (·) is the modified Bessel function of the first kind and zeroth order. The moment generating function (MGF) _Mγ (s)[triangle, =]E{^e-sγ } corresponding to (22) is, respectively, given by [21] [figure omitted; refer to PDF]

Averaging the SEP expression (18) over the fading distribution of the received SNR, γ , induces the average SEP of arbitrary M -ary cross-QAM over fading channel as given by [figure omitted; refer to PDF] where _pγ (γ) denotes the PDF of γ and [figure omitted; refer to PDF] Note that the relationships Q(x)=2_Qa (x,π/2) and ^Q2 (x)=2_Qa (x,π/4) for x≥0 , mentioned above, are applied in the expression (24). Particularly, the approximate average SEP is only considering the first three terms in (24).

According to (4), it is possible to re-express the integral (25) in terms of the MGF of γ as given by [figure omitted; refer to PDF]

Substituting (23) into (26), the corresponding expressions of I(B,[varphi]) in (24) for Rayleigh, Nakagami-m, Nakagami-q (Hoyt), and Nakagami-n (Rice) channels are given as [figure omitted; refer to PDF] [figure omitted; refer to PDF] [figure omitted; refer to PDF] [figure omitted; refer to PDF] where κ=1+K for the sake of notational convenience.

Using the above four integral expressions, the average SEP (24) over fading channels can be conveniently evaluated through numerical integration since these formulae are single integrals with finite limits and an integrand composed of elementary (exponential, trigonometric, and/or power) functions. Note that (27) and (28) with integer m can also be evaluated in closed form using equation (5A.24) in [21, page 155]. Furthermore, the author in [20] has given a simpler closed-form expression for the SEP of cross-QAM in Rayleigh channel.

5. Numerical Results and Simulations

In this section, using the above formulations, numerical results concerning the SEP performance of cross-QAM and the comparison with rectangular QAM are presented, together with computer simulations. For fading channels, the Rayleigh channel is chosen as a special case since the results of the other type channels are similar to that of Rayleigh channel. So, the corresponding figures of the other type channels are not shown here for limited space. Figure 3 shows excellent agreement between the analytical expressions and the simulation results for cross M -QAMs over AWGN channels and Rayleigh fading channels, respectively.

Comparison of the analytical and simulation results for the SEP of cross M -QAMs.

(a) AWGN Channels

[figure omitted; refer to PDF]

(b) Rayleigh Channels

[figure omitted; refer to PDF]

Shown in Figure 4 is the comparison of the exact SEP and its approximations over AWGN channels and Rayleigh fading channels, respectively. In AWGN channels, it was shown that although the approximations of Proakis and Gilbert are accurate enough at high SNR, both of them are very loose and the former is looser at low SNR. From Figure 5(a), it can be seen that at given SEP the SNR differences between the exact SEP and the approximations of Proakis and Gilbert become smaller and smaller as SEP decreases. However, it can be observed from Figure 4(b) that the difference between the exact SEP and the approximations of Proakis and Gilbert in Rayleigh fading channels is larger than that in AWGN channels at high SNR. From Figure 5(b), especially, it can be found that their SNR differences at the same SEP value are about 1 dB. On the other hand, the proposed approximation is very tight for all the SNR values whether in AWGN channels or in Rayleigh fading channels. In fact, since their SNR differences are almost 0 for all M and all given SEP, so the proposed approximation is almost the same as the exact SEP.

Comparison of the exact and approximate SEP expressions for cross M -QAMs. Note that the proposed approximation is almost the same as the exact SEP.

(a) AWGN Channels

[figure omitted; refer to PDF]

(b) Rayleigh Channels

[figure omitted; refer to PDF]

The SNR differences between the approximate expressions and the exact expression of the SEP for cross M -QAMs.

(a) AWGN Channels

[figure omitted; refer to PDF]

(b) Rayleigh Channels

[figure omitted; refer to PDF]

Figure 6 compares the exact SEP of rectangular QAM and cross-QAM over AWGN channels and Rayleigh fading channels, respectively. Here, the M -ary rectangular QAM signal constellation is assumed to be formed by drawing the inphase and quadrature components from the independent _MI -ary pulse amplitude modulation (PAM) and _MQ -ary PAM, respectively, where _MI =^2m+1 , _MQ =^2m , M=_MI ×_MQ =^22m+1 , m∈... , and m≥2 . Specifically, 8×4 -ary, 16×8 -ary, 32×16 -ary, and 64×32 -ary rectangular QAMs are considered here. In addition, the quadrature-to-inphase decision distance ratio in these constellations is set to be 1, which is the best ratio in terms of symbol error performance as shown in [25, 26]. The exact SEP of M -ary rectangular QAM over AWGN and fading channels are given in [27-29]. From Figure 7, it can be seen that cross-QAM exhibits at least 1.1 dB SNR gain over rectangular QAM when SEP < 0.3. Numerical evaluation under other fading scenarios with different fading parameters, which are not shown here for limited space, also reveals similar SNR gain.

SEP comparison between rectangular QAM and cross-QAM.

(a) AWGN Channels

[figure omitted; refer to PDF]

(b) Rayleigh Channels

[figure omitted; refer to PDF]

SNR gain of cross-QAM over rectangular QAM.

(a) AWGN Channels

[figure omitted; refer to PDF]

(b) Rayleigh Channels

[figure omitted; refer to PDF]

6. Conclusions

In this paper, the exact SEP expressions of cross-QAM in AWGN channel and fading channels have been derived. The obtained closed-form SEP expressions contain a finite sum of single integrals with finite limits and an integrand composed of elementary (exponential, trigonometric, and/or power) functions, which can be easily and accurately evaluated numerically. Simple and very precise approximations, which contain only Gaussian Q -function for AWGN channel and contain three terms of the single integrals mentioned above for fading channels, respectively, are also given. The analytical expressions show excellent agreement with the simulation results, and the numerical evaluation with the proposed expressions reveals that cross-QAM can obtain at least 1.1 dB gain compared to rectangular QAM when SEP <0.3 in all the considered channels. The obtained exact SEP expressions will provide valuable insight into the design of wireless systems. In particular, the exact SEP performance of cross-QAM in AWGN channel will be very useful in adaptive modulation wherein the constellation size is adjusted depending on the channel quality through the SEP performance of the adopted modulations with AWGN.

Acknowledgments

This work was supported by the National Natural Science Foundation of China (no. 61071212), Chinese Universities Scientific Fund of SCUT (nos. 2009ZM0248 and 2009ZM0271), and Nature Science Funds of Guangdong province, China (nos. 07006488 and 9351064101000003).

References

[1] J. G. Smith, "Odd-bit quadrature amplitude-shift keying," IEEE Transactions on Communications , vol. 23, no. 3, pp. 385-389, 1975.

[2] S. Panigrahi, T. Le-Ngoc, "Fine-granularity loading schemes using adaptive Reed-Solomon coding for discrete multitone modulation systems," in Proceedings of the IEEE International Conference on Communications (ICC '05), vol. 2, pp. 1352-1356, Seoul, Korea, May 2005.

[3] A. Ahrens, C. Lange, "Bit and power loading for wireline multicarrier transmission systems," Transactions on Advanced Research , vol. 2, no. 1, pp. 3-9, 2006.

[4] M. Zwingelstein-Colin, M. Gazalet, M. Gharbi, "Non-iterative bit-loading algorithm for ADSL-type DMT applications," IEE Proceedings , vol. 150, no. 6, pp. 414-418, 2003.

[5] M. Sternad, S. Falahati, "Maximizing througput with adaptive M-QAM based on imperfect channel predictions," in Proceedings of the IEEE International Symposium on Personal, Indoor and Mobile Radio Communications (PIMRC '04), vol. 3, pp. 2289-2293, [email protected]; [email protected], 2004.

[6] W. Wang, T. Ottosson, M. Sternad, A. Ahlén, A. Svensson, "Impact of multiuser diversity and channel variability on adaptive OFDM," in Proceedings of the IEEE Vehicular Technology Conference (VTC '03), vol. 58, no. 1, pp. 547-551, [email protected]; [email protected]; [email protected]; [email protected]; [email protected], 2003.

[7] V. Demjanenko, P. Marzec, A. Torres, "Reasons to use non squared QAM constellations with independent I&Q in PAN systems," submitted to IEEE P802.15-15-03, 0311-00-003a, August 2003, http://www.vocal.com/white_paper/15030311.pdf

[8] Asymmetric digital subscriber line (ADSL) transceivers ITU-T Std. G.992.1, June 1999

[9] Very high speed digital subscriber line transceivers ITU-T Std. G.993.1, June 2004

[10] Digital Video Broadcasting (DVB), "Framing Structure, Channel Coding and Modulation for Cable Systems," ETSI Std. EN 300 429, April 1998, http://www.etsi.org/deliver/etsi_en/300400_300499/300429/01.02.01_60/en_300429v010201p.pdf

[11] S. Colonnese, G. Panci, S. Rinauro, G. Scarano, "High SNR performance analysis of a blind frequency offset estimator for cross QAM communication," in Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP '08), pp. 2825-2828, Las Vegas, Nev, USA, [email protected]; [email protected]; [email protected]; [email protected], March 2008.

[12] K. V. Cartwright, E. J. Kaminsky, "Blind phase recovery in cross QAM communication systems with the Reduced-Constellation Eighth-Order Estimator (RCEOE)," in Proceedings of the IEEE Global Telecommunications Conference (GLOBECOM '05), vol. 1, pp. 388-392, St. Louis, Mo, USA, [email protected]; [email protected], November 2005.

[13] S. Abrar, I. M. Qureshi, "Blind equalization of cross-QAM signals," IEEE Signal Processing Letters , vol. 13, no. 12, pp. 745-748, 2006.

[14] K. V. Cartwright, "Blind phase recovery in cross QAM communication systems with eighth-order statistics," IEEE Signal Processing Letters , vol. 8, no. 12, pp. 304-306, 2001.

[15] J. G. Proakis Digital Communications , McGraw Hill, Chicago, Ill, USA, 2001., 4th.

[16] P. K. Vitthaladevuni, M.-S. Alouini, J. C. Kieffer, "Exact BER computation for cross QAM constellations," IEEE Transactions on Wireless Communications , vol. 4, no. 6, pp. 3039-3050, 2005., [email protected]; [email protected]; [email protected]

[17] N. C. Beaulieu, Y. Chen, "Closed-form expressions for the exact symbol error probability of 32-cross-QAM in AWGN and in slow Nakagami fading," IEEE Communications Letters , vol. 11, no. 4, pp. 310-312, 2007., [email protected]; [email protected]

[18] J. Li, X. D. Zhang, N. C. Beaulieu, "Precise calculation of the SEP of 128- and 512-Cross-QAM in AWGN," IEEE Communications Letters , vol. 12, no. 1, pp. 1-3, 2008.

[19] H. Y. Liu, R. Y. Yen, "Error probability for orthogonal space-time block code diversity system using rectangular QAM transmission over Rayleigh fading channels," IEEE Transactions on Signal Processing , vol. 54, no. 4, pp. 1230-1241, 2006.

[20] H. Yu, G. Wei, "Symbol error probability of cross QAM in rayleigh fading channels," IEEE Communications Letters , vol. 14, no. 5, pp. 375-377, 2010.

[21] M. Simon, M.-S. Alouini Digital Communication over Fading Channels , John Wiley & Sons, New York, NY, USA, 2005., 2nd.

[22] M. K. Simon, "Some new twists to problems involving the gaussian probability integral," IEEE Transactions on Communications , vol. 46, no. 2, pp. 200-210, 1998.

[23] M. K. Simon, "A simpler form of the craig representation for the two-dimensional joint Gaussian Q-function," IEEE Communications Letters , vol. 6, no. 2, pp. 49-51, 2002.

[24] G. T. F. De Abreu, "Jensen-cotes upper and lower bounds on the Gaussian Q-function and related functions," IEEE Transactions on Communications , vol. 57, no. 11, pp. 3328-3338, 2009.

[25] X. Lei, P. Fan, L. Hao, "Exact symbol error probability of general order rectangular QAM with MRC diversity reception over Nakagami-m fading channels," IEEE Communications Letters , vol. 11, no. 12, pp. 958-960, 2007.

[26] R. K. Mallik, "Average of product of two Gaussian Q-functions and its application to performance analysis in Nakagami fading," IEEE Transactions on Communications , vol. 56, no. 8, pp. 1289-1299, 2008.

[27] N. C. Beaulieu, "A useful integral for wireless communication theory and its application to rectangular signaling constellation error rates," IEEE Transactions on Communications , vol. 54, no. 5, pp. 802-805, 2006.

[28] A. Maaref, S. Aïssa, "Exact error probability analysis of rectangular QAM for single- and multichannel reception in Nakagami-m fading channels," IEEE Transactions on Communications , vol. 57, no. 1, pp. 214-221, 2009.

[29] X. Lei, P. Fan, Q. Chen, "On the average of the product of two Gaussian Q-functions over Nakagami-q (Hoyt) fading and its application," IEEE Communications Letters , vol. 11, no. 10, pp. 805-807, 2007.

Appendix

Appendix

According to the definition of Gaussian Q -function (3), Φ(k,δ;b) given by (16) can be represented as [figure omitted; refer to PDF] Let y=(z-x)/2 , the above equation can be rewritten as [figure omitted; refer to PDF] Using the two-dimensional joint Gaussian Q -function [22, equation (75) ], [figure omitted; refer to PDF] and its Simon representation [23, equation (10)] in a new form (Since 1-ρu/v and 1-ρv/u can take on positive or negative values, the arctangents in (A.4) are defined by arctanX/Y=π(1-sgn Y)/2+sgn Yarctan(X/|Y|) [23].) [figure omitted; refer to PDF] equation (A.2) with b=∞ and b=δ can be, respectively, expressed as [figure omitted; refer to PDF] where [figure omitted; refer to PDF] Note that the property [21, equation (6.42)] [figure omitted; refer to PDF] and the relationship (due to the symmetry of the sine function around π/2 ) [figure omitted; refer to PDF] are used in the above derivation.

With the above two equations, the exact average SEP for the M -ary cross-QAM constellation can be rewritten as [figure omitted; refer to PDF] Considering that ^αk+ =^αk+1- , ^α1- =π/4 , _Qa (x;π/4)=(1/2)^Q2 (x) , one can simplifies (A.9) to yield (18) after some manipulations.