Open Access

Two-Dimensional Harmonic Retrieval in Correlative Noise Based on Genetic Algorithm

EURASIP Journal on Advances in Signal Processing20102010:569371

https://doi.org/10.1155/2010/569371

Received: 30 December 2009

Accepted: 16 June 2010

Published: 7 July 2010

Abstract

We propose a niche Genetic algorithm (GA) for the two-dimensional (2D) harmonic retrieval in the presence of correlative zero-mean, multiplicative, and additive noise. Firstly, we introduce a 2D fourth-order time-average moment spectrum which has extremum values at the harmonic frequencies. On this basis, the problem of harmonic retrieval is treated as a problem of finding the extremum values for which the niche GA is resorted. Utilizing the global searching ability of the GA, this method can improve the frequency estimation performance. The effectiveness of the proposed algorithm is demonstrated through computer simulations.

1. Introduction

2D harmonic retrieval is of interest in signal processing such as sonar, radar, geophysics, and radio astronomy. In the case of additive noise, some high-resolution techniques such as the 2D MUSIC [1], the 2D MEMP [2], and the 2D ESPRIT method [3] have been developed from their 1D versions. Of these algorithms, the ESPIRIT algorithm is more effective as it does not require to search for the peak value in a 2D space. Different from the above methods considering white noise, in the presence of colored Gaussian noise, Ibrahim and Gharieb [4, 5] have presented some methods based on fourth-order cumulants since the cumulants are insensitive to Gaussian noise while they contain frequency and phase information.

Under certain circumstances, the amplitudes of the received harmonic signals are random since they are usually corrupted by multiplicative noise. For example, multiplicative noise is encountered in underwater acoustic applications due to the dispersive medium [6, 7], and random amplitude modulation occurs in Doppler-radar signals when the target scintillates or when the point target assumption is no longer valid [8]. Techniques based on cyclic statistics have been proposed to estimate the 2D harmonic frequencies in multiplicative noise [9, 10]. However, these methods are based on the assumption that multiplicative and additive noises are mutually independent and mixing.

In practice, the correlation of the multiplicative and additive noise should be considered. In correlative multiplicative and additive noise, Wu and Li [11] has studied the problem of the quadratic nonlinear coupling of 2D harmonics based on 2D third-order time-average moment spectrum. Another two new 2D cyclic statistics are also introduced to estimate the harmonic frequencies in [12, 13], respectively. However, both the methods suffer from a resolution limit and no strategy of searching for the extremum values is discussed. In this paper, we propose a new strategy to improve the frequency estimation performance. Since the fourth-order time-average moment spectrum defined in [13] peaks at the harmonic frequencies, the harmonic retrieval can be treated as finding the extremum values in a 2D space. Utilizing the global searching ability, a GA-based algorithm is presented to estimate the frequencies of 2D harmonic corrupted by correlative multiplicative and additive noise. Simulation examples show that the improved frequency estimation can be achieved.

The organization of the paper is as follows. In Section 2, we introduce a special 2D fourth-order time-average moment spectrum. In Section 3, a GA-based algorithm is proposed to estimate harmonic frequencies. Numerical examples are presented in Section 4, and conclusions are drawn in Section 5.

2. 2D Harmonic Model

Consider a discrete-time -component 2D harmonics in multiplicative and additive noise model
(1)

where denotes the th frequency pair and represents the th phase. and denote multiplicative and additive noise, respectively. In this paper, the following assumptions are given by

  1. (AS1)

    , frequency pairs are mutually unequal and not coupled;

     
  2. (AS2)

    s are deterministic constants in ;

     
  3. (AS3)

    s and are mutually correlative and stationary stochastic processes with the mean and ;

     
  4. (AS4)
    s and satisfy the so-called cross-mixing condition [12]:
    (2)

    where , .

     

Note that if the variance , the model in (1) would become the classical case of harmonics with constant amplitude in additive noise. The first assumption ensures that the fourth-order time-average moment spectrum which will be defined latter peaks at the harmonic frequencies. The second assumption ensures the identifiability of harmonic phases. In the third assumption, without loss of generality, the mean of the additive noise can be assumed to be zero. A nonzero mean can always be estimated consistently via the sample mean and then subtracted from the data. When the mean of multiplicative noise , Wang et al. [9] and Yang and Li [10] have presented some effective methods to estimate the harmonic frequencies.

Generally, and are always assumed to be mixing and mutually independent [610]. In order to describe the correlativity of multiplicative and additive noise, Xu et al. [12] derived the cross mixing condition. If and are mixing and mutually independent, they are also cross mixing. On the contrary, if and are cross mixing, they must be mixing, but it doesn't mean that they are mutually independent. The correlativity of multiplicative and additive noise can be described by cross-mixing condition. The cross-mixing property implies that samples of the processes that are well separated in time can be regarded as approximately independent [14]. Under the cross-mixing condition, time averages of the cyclic statistics converge in the mean-square sense to their sample averages. In model (1), if and are cross-mixing, the observed signal is cyclostationary, and the sample estimates of its cyclic statistics converge in the sense of mean square and are asymptotically normal [15].

For notational simplicity, let , . Then (1) is given by
(3)

Definition 1.

The special fourth-order time-average moment of is defined as
(4)

where .

Definition 2.

The special fourth-order time-average moment spectrum is defined as
(5)

Theorem 1.

From [13], the fourth-order time-average moment spectrum of corresponding to (5) can be obtained by
(6)

where is Kronecker function. Equation (6) contains harmonic frequency information. This relation will be proved in the appendix.

From (6), is unequal to zero only if , or . According to Assumption  1, , the number of the obtained greatest maxima of should be L rather than in the plane.

From [16], can be estimated using single record, namely,
(7)
Further, we have
(8)

where a.s. representsalmost sure convergence which is uniform in and . Equation (8) means that the single record estimator is strongly consistent. Alternatively, we can estimate the harmonic frequencies by searching for greatest maxima of in the plane. Consequently, the frequency estimation of 2D harmonics can be treated as finding the extremum values of binary function. In this paper, the GA is proposed to seek local optimum solutions.

3. Genetic Algorithm Realization

GA is nowadays one of the most popular stochastic optimization techniques which is inspired by natural genetics and biological evolutionary process. It is supposed that individuals with more adaptability in current generation would have better capability of survival and breeding in the next generation. One of the most important advantages of GA is that it can make use of the limited searching processes to automatically find the optimal or near-optimal result in the solution space. Compared with the classical optimization algorithms, GA has such features as follows [17].

  1. (1)

    GA starts from multipoints instead of one point. Thereby, it could effectively prevent the searching processes from stopping in local optimum solutions.

     
  2. (2)

    The optimization rule of GA is varied. It is determined by probability.

     
  3. (3)

    The fitness is calculated only from object function. No other information is necessary.

     
  4. (4)

    It automatically seeks the optimal result in the whole solution space.

     
  5. (5)

    The calculation is relatively simple.

     

GA evaluates a population and generates a new one iteratively, with each successive population referred to as a generation. Assume the current generation is . After applying a set of genetic operations, the GA generates a new generation based on the previous generation. Three basic operators are used to manipulate the genetic composition of a population: selection, crossover, and mutation [17].

The detailed implementation of the proposed method is given as follows.

Fitness Function

In order to perform GA, it is very important to define an appropriate fitness function. In GA, the probability of individual survival to the next generation depends on its fitness value. The greater the fitness value of an individual, the greater probability it has to inherit to the next generation. In this paper, the fitness function is constructed by the operation of getting the absolute value on the nonlinear function (7)
(9)

where is the observed signal.

Generation of the Initial Group

Commonly in GA, the initial population is randomly generated. The real-coded GA is adopted in this paper. The length of chromosome graph is set as 3. The first two genes denote the frequency pairs and the third gene denotes the fitness value.

The performance of GA is influenced heavily by the population size. GA may run the risk of serious under-covering of the solution space and result in a local optimum when the population size is relatively small, whereas GA would increase the computational load when the population size is relatively large. Consequently, the population size should be chosen according to the problem scale.

Selection

The operation is to choose the good individual and get rid of the bad one from the group. The larger the fitness, the larger probability the individual has to be selected. To achieve this, the roulette wheel selection is used. The fitness of the th individual is denoted as . The selection probability of the th individual is computed as . At the same time, we reserve the best individual to the next population.

Crossover

The crossover is to exchange some parts of an individual with corresponding parts of another. The crossover is performed in the following way. Assume that and are pairs of parent chromosome, whether to crossover or not depends on the crossover probability . The result of crossover is
(10)

where is a uniformly distributed random number in .

Mutation

The mutation operator adopts "Nonuniform Mutation" [18]. Compared with the classical uniform mutation operator, this operator has the advantage of making fewer changes on the genes with the number of generations increasing. This property makes the tradeoff between exploration and exploitation. It is more favorable to have exploration in the early stages of the algorithm, while exploitation becomes of greater importance when the obtained solution is closer to the optimal solution. The mutation can be completed in the following way: assuming is the th component of the individual , the mutation probability determines whether to mutate or not. The result of mutation is
(11)

where positive number controls the dependence degree of random fluctuation to evolution number and are uniformly distributed as random numbers on the interval . is the largest evolution number.

Condition to Terminate the GA Iterations

When the number of generation reaches , the iterations would be terminated.

In this paper, we seek all the optimal solutions of nonlinear function , including local optimal solutions and global optimal solutions. However, the simple genetic algorithm is unable to get all optimal solutions. According to the niche phenomenon in nature [19, 20], a niche GA-based method is proposed to estimate harmonic frequencies. A niche in nature can be viewed as a subspace in the environment. Accordingly, a niche is commonly thought as a peak of the fitness function. The niche techniques gather the individuals on several peaks of fitness function in the population according to genetic likeness. The structure of a niche is implemented by decreasing the fitness value of the individual. The concrete method is implemented by calculating the Euclidean distance between parent individual and arbitrary other child individual and then judging whether two individuals are in the circle defined by estimating niche radius . Compare with simple GA, niche GA can find more than one optima during evolution. The basic steps of the algorithm are given as follows.

  1. (1)

    Set the generation number . Create an initial population which includes individuals and evaluate their fitness.

     
  2. (2)

    Sort the population according to their fitness and memorize the first individuals.

     
  3. (3)

    Produce a new population through selection, crossover and mutation.

     
  4. (4)

    Evaluate the fitness of every new individual.

     
  5. (5)

    Keep the individuals from step 3 and memorial individuals from step 2. Evaluate the distanced between each two of them. Introduce a penalty to the individual with lower fitness when .

     
  6. (6)

    Combine the individuals with the individuals. Sort the individuals according to their fitness. Save the first individuals and the first individuals.

     
  7. (7)

    Set and repeat steps 3–6 until .

     

4. Simulations

Computer simulations are presented here to illustrate the main aspects of this paper. In all simulations, we generate (1) with , and . The multiplicative noises are generated by
(12)
where the mean . The additive noise is also generated by with the mean . The signal-to-noise ratio (SNR) is defined as
(13)

Example 1.

Consider as white Gaussian noise with the mean and the variance . The fourth-order time-average moment spectrum is computed according to (7). Figure 1 shows when the SNR is 0 dB and the data size is . which varies with and is plotted in Figure 1(a). It can be observed that there are three obvious peaks. It is shown in Figure 1(b) that three peaks locate at the accurate positions , and . Figure 1(c) shows the ten greatest estimated mean of using the GA from 100 Monte Carlo runs. The -coordinate denotes the index of individuals and the -coordinate denotes the corresponding estimated mean. It can be shown that there is an obvious boundary among the estimated values. The estimated number of harmonics is 3. However, if the SNR is very low, there is no obvious boundary among the estimate values. In this situation, we should estimate the number of harmonics firstly. More detail of estimating the number of harmonics has been presented in [21, 22].
Figure 1

of (7), is white Gaussian noise, SNR = 0 dB. 3D viewVertical viewEstimation based on GA

The GA parameters are set as follows. Initial population , memorial population , genetic times , crossover probability , mutation probability , mutation control parameter , niche destining distance , and individual penalty .

In this simulation, the performance of the GA-based and the fourth-order time-average moment spectrum-based (FOTAMS) method [13] is compared. Figure 2 shows the root mean squared errors (RMSEs) on the estimated frequency pairs when the data size is which are computed as functions of the SNR from 100 Monte Carlo runs. The frequency estimates of the proposed method are more accurate than that of the FOTAMS-based method whatever the SNR is. The RMSEs of the estimated frequency pairs versus the data size at SNR = 0 dB are shown in Figure 3. It is clear that as the data size increases, the estimation accuracy improves. The estimated values of the proposed method are also more accurate than that of the FOTAMS-based method regardless of the data size.
Figure 2

RMSEs of frequency estimation versus the SNR, is white Gaussian noise, the data size is .

Figure 3

RMSEs of frequency estimation versus the data size, is white Gaussian noise, SNR = 0 dB.

Example 2.

To illustrate that the proposed method is insensitive to the distribution of the noise, is assumed to be the i.i.d. white exponential noise with the mean . Other parameters are the same as that in Example 1. Figure 4 shows with SNR = 0 dB. Similar to Example 1, we can also observe that three obvious peaks locate at the accurate positions , and . Figures 5 and 6 show the RMSEs performance of frequency estimation versus the SNR and the data size, respectively. It is illustrated that the GA estimators also perform better than the FOTAMS estimators.
Figure 4

of (7), is i. i.d white exponential noise, SNR = 0 dB.3D viewVertical viewEstimation based on GA

Figure 5

RMSEs of frequency estimation versus the SNR, is i. i.d white exponential noise, the data size is .

Figure 6

RMSEs of frequency estimation versus the data size, is i. i.d white exponential noise, SNR = 0 dB.

5. Conclusion

In this paper, a cyclic statistics-based method for frequency estimation of 2D harmonics in correlative multiplicative and additive noise is addressed. Since the 2D fourth-order time-average moment spectrum peaks at the frequencies of harmonic, the problem of harmonic retrieval can be solved by finding the extremum values. Exploiting global searching ability of GA and the niche phenomenon in nature, we propose a niche GA method to estimate harmonic frequencies. This method can improve the estimation accuracy. Simulation results demonstrated the effectiveness of the presented method. Moreover, our method can be extended to the parameter estimation of 2D harmonics under other conditions.

Declarations

Acknowledgments

The authors would like to thank the anonymous reviewers for their constructive comments and suggestions that helped to improve the paper. This work is supported by the National Natural Science Foundation of China under Grants nos. 60736009 and 60901066.

Authors’ Affiliations

(1)
National Lab of Radar Signal Processing, Xidian University
(2)
Department of Computational Science and Mathematics, Guilin University of Electronic Technology

References

  1. Odendaal JW, Barnard E, Pistorius CWI: Two-dimensional superresolution radar imaging using the MUSIC algorithm. IEEE Transactions on Antennas and Propagation 1994, 42(10):1386-1391. 10.1109/8.320744View ArticleGoogle Scholar
  2. Hua Y: Estimating two-dimensional frequencies by matrix enhancement and matrix pencil. IEEE Transactions on Signal Processing 1992, 40(9):2267-2280. 10.1109/78.157226View ArticleMATHGoogle Scholar
  3. Rouquette S, Najim M: Estimation of frequencies and damping factors by two-dimensional ESPRIT type methods. IEEE Transactions on Signal Processing 2001, 49(1):237-245. 10.1109/78.890367View ArticleGoogle Scholar
  4. Ibrahim HM, Gharieb RR: Estimating two-dimensional frequencies by a cumulant-based FBLP method. IEEE Transactions on Signal Processing 1999, 47(1):262-266. 10.1109/78.738268View ArticleGoogle Scholar
  5. Gharieb RR: Cumulant-based LP method for two-dimensional spectral estimation. IEEE Proceedings: Vision, Image and Signal Processing 1999, 146(6):307-312. 10.1049/ip-vis:19990743Google Scholar
  6. Giannakis GB, Zhou G: Harmonics in multiplicative and additive noise: parameter estimation using cyclic statistics. IEEE Transactions on Signal Processing 1995, 43(9):2217-2221. 10.1109/78.414790View ArticleGoogle Scholar
  7. Dwyer RF: Fourth-order spectra of Gaussian amplitude-modulated sinusoids. Journal of the Acoustical Society of America 1991, 90(2):918-926. 10.1121/1.401958View ArticleGoogle Scholar
  8. Besson O, Stoica P: Sinusoidal signals with random amplitude: least-squares estimators and their statistical analysis. IEEE Transactions on Signal Processing 1995, 43(11):2733-2744. 10.1109/78.482122View ArticleGoogle Scholar
  9. Wang F, Wang S-X, Dou H-J: Two-dimensional parameter estimation using two-dimensional cyclic statistics. Journal of Electronics 2003, 31(10):1522-1525.Google Scholar
  10. Yang S-Y, Li H-W: Two-dimensional harmonics parameters estimation using third-order cyclic-moments. Journal of Electronics 2005, 33(10):1808-1811.Google Scholar
  11. Wu S, Li H: The analysis of two-dimensional quadratic coupled harmonics in the complex noise based on genetic algorithm. Signal Processing Journal 2006, 22: 635-638.Google Scholar
  12. Xu J, Wang S-X, Wang H: Harmonic retrieval and nonlinear frequency-coupled harmonics in the complex noise. Journal of Electronics 2003, 31: 117-122.Google Scholar
  13. Dou H, Wang S-X, Wang F: Two-dimensional harmonics retrieval in correlative multiplication and additive noise. Proceedings of the 7th International Conference on Signal Processing (ICSP '04), September 2004, Beijing, China 264-268.Google Scholar
  14. Brillinger DR: Time Series: Data Analysis and Theory. Holden-day, San Francisco, Calif, USA; 1981.MATHGoogle Scholar
  15. Dandawate AV, Giannakis GB: Asymptotic theory of mixed time averages and kth-order cyclic-moment and cumulant statistics. IEEE Transactions on Information Theory 1995, 41(1):216-232. 10.1109/18.370106MathSciNetView ArticleMATHGoogle Scholar
  16. Li H, Cheng Q, Yuan B: Strong laws of large numbers for two-dimensional processes. Proceedings of the 4th International Conference on Signal Processing (ICSP '98), October 1998, Beijing, China 43-46.Google Scholar
  17. Goldberg DE: Genetic Algorithms in Search, Optimization and Machine Learning. Addison-Wesley, Reading, Mass, USA; 1989.MATHGoogle Scholar
  18. Michalewicz Z: Genetic Algorithms + Data Structures = Evolution Programs. 3rd edition. Springer, New York, NY, USA; 1999.MATHGoogle Scholar
  19. Deb K, Coldberg DE: An investigation of niche and species formation in genetic function optimization. In Proceedings of the 3rd Conference on Genetic Algorithms (ICGA '89), 1989, San Mateo, Calif, USA. Morgan Kaufmann; 42-50.Google Scholar
  20. Zhou M, Sun S: The Theory and Application of Genetic Algorithm. The Press of National Defence and Industry, Beijing, China; 1999.Google Scholar
  21. Yang S, Li H: Estimation of the number of harmonics in multiplicative and additive noise. Signal Processing 2007, 87(5):1128-1137. 10.1016/j.sigpro.2006.10.011View ArticleMATHGoogle Scholar
  22. Yang S, Li H: Estimating the number of harmonics using enhanced matrix. IEEE Signal Processing Letters 2007, 14(2):137-140.View ArticleGoogle Scholar

Copyright

© Sun-Yong Wu et al. 2010

This article is published under license to BioMed Central Ltd. This is an open access article distributed under the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.