 Research
 Open Access
 Published:
Model set adaptive filtering algorithm using variational Bayesian approximations and Rényi information divergence
EURASIP Journal on Advances in Signal Processing volume 2020, Article number: 17 (2020)
Abstract
The paper presents a model set adaptive filtering algorithm based on variational Bayesian approximation (MSAVB) for the target tracking system with the model and noise uncertainties. The Rényi information divergence, as a criterion, is to choose the best match model that has the minimum divergence between candidate models and true mode. Subsequently, the modelconditioned estimation based on variational Bayesian approximation is proposed to estimate system state and measurement noise variances. To deal with the coupled noise intractability, the moments matching technique is used to obtain the mixed statistics of measurement noise at the fusion stage. The proposed algorithm is compared with the interacting multiple models (IMM) algorithm and the variational Bayesianinteracting multiple models (IMMVB) algorithm via two scenarios for maneuvering target tracking, and simulation results show that the MSAVB has improved estimation and tracking performance.
Introduction
Target tracking plays an important role in a variety of practical applications, such as underwater sonar tracking [1], aircraft surveillance [2], and visual tracking [3, 4]. The objective is to accurately estimate the target state for a sequence of observation sets in presence of noise. When the systems are linear and noise are Gaussian, Kalman filter provides an optimal filtering technique to estimate the target state [5]. Its variant have been studied under numerous relaxed assumptions [6–9]. Of course, this limitation in these filters is that it assumes a complete prior knowledge of the dynamic and measurement model parameters, including the noise statistics. In many practical situations, model uncertainty is caused by unknown dynamic model parameters, and noise uncertainty is caused by unknown noise statistics; both violate the abovementioned assumption.
The model uncertainty is due to the fact that the target dynamics cannot be properly modeled by a single state space model (SSM) [10]. For example, in the maneuvering target tracking, the target has different maneuvering behaviors, such as constant velocity, acceleration, and turning with different angular velocity. Thus, the interacting multiple models (IMM) algorithm was proposed in [11], where the multiple models are used to match the different maneuvering behaviors and the transition among different models is subject to a Markov process. Since the state estimation of each model is parallel and independent, the computational complexity of the algorithm increases gradually as the number of models increases and the conflict among the models are more significant. In order to deal with the problem, Li and BarShalom [12] proposed the variable structure multiple model methods (VSMM), which adjusts their model sets in real time. In VSMM, the core idea is the model set adaptation (MSA) that aims at finding the best model set for the state estimation. Different implementations for MSA approaches have been proposed. For instance, the expected mode augmentation (EMA) [13], the likely model set (LMS) [14], the minimal sub model set (MSS) [15], and the best model augmentation (BMA) [16].
In addition, the noise uncertainty also affects the performance of the tracking system. Practically, the measurement noise usually varies with interferences. To cope with the noise uncertainty, the adaptive filtering method is used to address the issue of state estimation in the case of unknown noise statistics in [17]. The adaptive filtering algorithms are classified into four categories: maximum likelihood, correlation, covariance matching, and Bayesian method. Among them, the Bayesian method can be seen as a more general case of the other three algorithms. However, most of the Bayesian algorithms are difficult to get the analytical solution—because of the complexity of the probability density function and the high dimensional integral. These adaptive filters considered that the sequence of state variable follows a firstorder Markov process. For the stationary random sequence (e.g., image and video signal [18]), the denoising technique based on the intersection of confidence intervals (ICI) rule was presented to provide a noisefree image or its best possible estimate [19, 20].
Recently, the variational Bayesian approximation adaptive Kalman filter (VBAKF) proposed in [17] has been introduced to estimate the target state under the case without knowledge of measurement noise variances. Its main idea is that the joint posterior of the target state and measurement noise variances can be approximated by a factored freeform distribution (for models in the conjugateexponential class). Unfortunately, linear system and Gaussian distribution assumption do not really exist in actual applications. The VBAKF cannot achieve the demanding filtering performance. The nonlinear estimation methods, such as unscented Kalman filter (UKF) and cubature Kalman filter (CKF), were combined with VB approximation method [21, 22]. Here, the measurement noise variances are approximated by the variational Bayesian approximation (VB) approach; thereafter, system states are updated by these nonlinear estimation methods. Hu [23] proposed the robust version of VBAKF, which models the measurement noise by using the Student t distribution, and [23] was extended in [24] and [25].
However, the abovementioned algorithms considered only one of these uncertainties. In real environment, the model and noise uncertainties have to be considered simultaneously. Several suggestions for dealing with this problem can be found in literature. In [26], a novel estimator was presented for the jump Markov linear systems with unknown measurement noise variance parameters. A merging scheme is adopted for the system noises in the fusion stage of the IMM approach and a fix recursive form is used to estimate the noise variance parameters. Based on the literature [26], Hong [27] presented a robust variational Bayesianinteracting multiple model (IMMVB), which models the glint noise by using Gaussian mixture distribution. Gao [28] proposed an interacting multiple model estimationbased adaptive robust UKF, which establishes an adaptive fading UKF for the case of process model uncertainty and a robust UKF for the case of measurement model uncertainty. These approaches have obtained better performance for the problem of the absence of model and noise uncertainties, but they have a very high burden of time complexity. That is because more models have been designed in IMM algorithm for demanding results.
In this paper, we present a model set adaptive filtering algorithm based on variational Bayesian approximation to address the state estimation problem under the situation with dual uncertainties. The Rényi information divergence, as a criterion, is used to computing the divergence between the true mode and the candidate models. Subsequently, it develops a modelconditioned estimation based on variational Bayesian approximation to fuse the state and measurement noise variances. Two simulation experiments are provided to illustrate the effectiveness of the proposed algorithm.
The rest of paper is organized as follows. In Section 2, the state estimation problem with unknown noise statistics is formulated and the variational Bayesian method is briefly reviewed. The proposed algorithm is described in Section 3. In Section 4, the simulation results are presented to prove the effectiveness of the proposed algorithms. Finally, the conclusions are given in Section 5.
Methods/experimental
The main drawbacks of the interacting multiple model method for target tracking system are the high computational complexity and poor performance. A model set adaptive filtering algorithm based on variational Bayesian approximation is proposed in this paper. The proposed method is designed based on the idea of the VSMM and VB methods. The Rényi information divergence measures the “closeness” of two probability density functions. It has additional flexibility in that in allows for emphasis to be placed on specific portions of the support of the densities to be compared. Hence, the Rényi information divergence is as a criterion to choose the best match model that has the minimum divergence between candidate models and true mode. And the moments matching technique is used to obtain the mixed statistics of measurement noise and system state at the fusion stage.
The paper performs Monte Carlo simulation using MATLAB software to examine the behavior of the proposed method. The root mean square errors (RMSEs) are used to evaluate the estimation accuracy. We compare our method with IMMVB and IMM in two different scenarios. The parameters in the experiments are introduced in Section 5.
This paper does not contain any studies with human participants or animals performed by any of the authors.
Variational Bayesian approximation
Problem formulation
Consider the following state space model:
where x_{k}∈R^{n} and z_{k}∈R^{d} are the target state and the measurement vectors, respectively. r_{k} denotes the system mode which is described by a discretetime homogenous Markov chain. The process noise \(w_{k1}^{r_{k}}\) corresponding to mode r_{k} and the measurement noise v_{k} are assumed to be mutually independent zeromean Gaussian random processes with the covariance matrices \(Q_{k1}^{r_{k}}\) and Σ_{k}, respectively. Here, we denote the diagonal covariance matrix comprising of these variances by \(\Sigma _{k}=\text {diag}\{\sigma _{k,1}^{2},\sigma _{k,2}^{2}\ldots \sigma _{k,d}^{2}\}\). Due to the fact that the inverse Wishart distribution is the conjugate prior distribution for the variance of the Gaussian distribution [29]. For this reason, a product of inverse Wishart models is adopted to approximate the posterior distribution Σ_{k}. That is
where the notation IW(Σ_{k};κ_{k},Λ_{k}) represents the inverse Wishart distribution for the variable Σ_{k} with the degree of freedom κ_{k}, and the symmetric positive definite matrix Λ_{k}.
Remark 1
Since the inverse gamma distribution is a special case of the inverse wishart distribution in onedimensional space, the discussed model in this paper is much more general and thus more information can be utilized for filter design. Interested readers are referred to [30] and [31] for a detailed introduction.
However, Σ_{k} is unknown in most cases, which requires to joint estimate the posterior distribution of the target state and the measurement noise covariance. Assume that the dynamic model of the state and the covariance matrix are independent for any mode r_{k}, that is
The predicted joint distribution of the state and measurement noise are calculated by the ChapmanKolmogorov equation.
When the measurement z_{k} is available, the joint posterior distribution is given by the Bays rule.
where p(Z_{k}x_{k},Σ_{k},r_{k},Z_{k−1}) denotes the likelihood function which is related with Σ_{k}.
Notice that the two main problems need to be solved. One is the dynamic model of the measurement noise covariance p(Σ_{k}Σ_{k−1},r_{k}) is unknown. The other is that the posterior density is difficult to achieve due to the involved intractable integrals. To calculate the posterior density with the unknown noise covariance, the variational Bayesian approximation method, which uses a simple freefrom distribution to approximate the joint posterior density, is proposed.
Variational Bayesian approximation
Assume that the state vector and measurement noise covariance are independent, and the joint posterior density can be approximated by a freeform factored distribution as follows
where the probability densities Q_{x}(x_{k}) and Q_{Σ}(Σ_{k}) are Gaussian distribution and inverse wishart distribution, respectively. The nonnegative KL divergence represents the measure of the dissimilarity of the approximation and the true posterior, that can be expressed as
The optimal approximation of the joint posterior density can be obtained by minimizing the KL divergence, and the mean field approximation is used to solve the calculation problem of multiple hidden variables [29]. The results are given as
Model set adaptive diltering algorithm based on variational Bayesian approximation
In this section, a model set adaptive filtering algorithm is proposed. The model set adaptive approach is used to select the best model set for multiple model estimation. Moreover, the noise statistics and state of each model are estimated by the model set conditioned estimation based on variational Bayesian approximation.
Modelset adaptation
To address the problem of the model uncertainty, IMMVB needs a lot of models to improve the algorithm performance. This has two obvious defects [13]. First, the computation load grows with the increase of the number of the models. Second, the competition among these models lead to performance decrease greatly.
To overcome this problem, a MSA algorithm based on Rényi divergence is proposed. Rényi information divergence is a distance measure between two densities (the test density f and the reference density f_{0}) [32]. The order α Rényi information divergence of f and f_{0} is defined as
For any order α, the Rényi information divergence takes on its minimum value if and only f=f_{0}. In our application, we wish to compute the divergence between the true mode s_{k} and candidate model \(r_{k}^{j} \in \mathcal {M}^{c}\) at the time k. That is
where p(z_{k}s_{k}) and \(p\left ({z_{k}}r_{k}^{j}\right)\) are the probability density functions of z_{k} conditioned on s_{k} and \(r_{k}^{j}\), respectively. Due to the true mode s_{k} of the system is unknown at the time k [16], it is assumed that the best online estimates of the probability density function of z_{k} for the true mode s_{k} can be approximated as \(p({z_{k}}{\mathcal {M}_{k  1}},{s_{k}},{\Sigma _{{s_{k}}}},{Z_{k  1}})\approx p({z_{k}}{\mathcal {M}_{k  1}},{\mathcal {M}_{k}},{\Sigma _{{k}}},{Z_{k  1}})\).
Let \(p({z_{k}}{s_{k}})=\mathcal {N}\left ({z_{k}};{\bar z_{{s_{k}}}},{\Phi _{{s_{k}}}}\right)\) and \(p\left ({z_{k}}r_{k}^{j}\right)=\mathcal {N}\left ({z_{k}};\bar z_{k}^{j},\Phi _{k}^{j}\right)\) be the Gaussian densities with vector means \(\bar z_{s_{k}}, \bar z_{k}^{j}\) and positive definite covariance matrices \(\Phi _{s_{k}}, \Phi _{k}^{j}\). The Rényi information divergence between p(z_{k}s_{k}) and \(p\left ({z_{k}}r_{k}^{j}\right)\) is
where \(\triangle =\bar z_{s_{k}}\bar z_{k}^{j}\). These means and covariance matrices of the Gaussian densities can be calculated as
Remark 2
Different selections of the parameter α allow for different parts of these distributions to be emphasized. In the limiting case of α→1 the Rényi information divergence becomes the KullbackLiebler divergence. The effect of the order to the Rényi information divergence is detailed and analyzed in [33–35]. The results show that α=0.5 emphasizes the tails of the distribution and allows for the maximum discrimination between two similar distributions. Therefore, we can obtain a better performance by choosing α=0.5 for tracking applications [36,37].
The optimal model \(\hat {r}_{k}\) in the candidate model set \(\mathcal {M}^{c}\) can be selected as the one with the minimum Rényi information divergence.
Thus, the adapted model set is the basic model set \(\mathcal {M}^{b}\) combine with the model \(\hat {r}_{k}\) at the time k.
Modelset conditioned estimation based variational Bayesian approximation
Suppose that the posterior probability density function of model i at the time k1 is described as below
Note that Eq. (16) can be seen as a product of a Gaussian distribution and an inverse Wishart distribution. \(r_{k  1}^{i}\) means the event that model i matches the system model in effect at time \(k1, r_{k  1}^{i} \in {\mathcal {M}_{k  1}}\). The notation \( \mathcal {N}\left ({x_{k  1}};\hat {x}_{k  1k  1}^{i},P_{k  1k  1}^{i}\right)\) represents the Gaussian probability density function with mean \(\hat {x}_{k  1k  1}^{i}\) and covariance \(P_{k  1k  1}^{i}\). The notation \(IW\left (\sigma _{k  1,u}^{2};{\kappa }_{k  1,u}^{i},{\Lambda }_{k  1,u}^{i}\right)\) represents an inverse Wishart distribution with parameters \({\kappa }_{k  1,u}^{i}\) and \({\Lambda }_{k  1,u}^{i}\). By using the total probability theorem, one has
In the model set conditional reinitialization stage, the joint probability density function is described as
where \(\mu _{k  1}^{ij}\) denotes the conditional probability that model j transfers to model i at the time k. It is calculated by
where \(\hat {\mu }_{kk 1}^{j}\) is the normalization coefficient. Based on the model set \(\mathcal {M}_{k}\), the output of each filter is merged in the fusion stage [13]. Therefore, we aim to approximate the sum term in (18) by a single one, that is
where \(\hat {x}_{k  1k  1}^{0j}\) and \(P_{k  1k  1}^{0j}\) are mixed state and covariance matrix of the model j, respectively.
On the basis of the moment matching theory [26], the first and second moments of the variable \(\sigma _{k  1,u}^{0j}\) in (20) can be obtained as follows
The mean and variance of the inverse Wishart sum distribution in (18) are given by
By solving Eqs. (23) and (24), the parameters \({\kappa }_{k  1,u}^{0j}\) and \({\Lambda }_{k  1,u}^{0j}\) are calculated as follows
Remark 3
In the proposed algorithm, the key feature is that the Gaussian sum distribution for the estimated state is approximated by a single Gaussian distribution. Similarly, the inverse Wishart sum distribution for the measurement noise covariance matrix Σ_{k} is approximated by a single inverse Wishart distribution by matching the first and second moments.
Then, the mixed target state and measurement noise covariance are taken as the filter input. The predict density is computed from Eq. (3).
where, taking account into the time variation of the parameters, a forgetting factor ρ is introduced, ρ∈(0,1]. Note that the closer ρ is to 0, the more instability the parameters will be in terms of timefluctuations [38]. The system state, covariance matrix, and the parameters of the inverse wishart distribution are predicted by
After receiving the measurement z_{k}, VB approximation method can be used to obtain a freeform factored approximate distribution for \(p\left ({x_{k}},{\Sigma _{k}}r_{k}^{j},{Z_{k}}\right)\) [38], the analytical expression of the joint posterior probability density function is given by
To calculate the distributions of state and measurement noise covariance of the ith model, VB assumes that the joint posterior distribution in (34) can be factorized as the product of \(q\left (x_{k}^{j}\right)\) and \(q\left (\Sigma _{k}^{j}\right)\). The logarithm of \(q\left (x_{k}^{j}\right)\) can be computed by fixing the \(q\left (\Sigma _{k}^{j}\right)\).
Through the simplified formula, \(p\left ({x_{k  1}},{\Sigma _{k  1}}r_{k}^{j},{Z_{k}}\right)\) is approximated by
The mean and covariance of the Gaussian distribution are derived by the VB approximation as follows
Similarly, the logarithm of \(q\left (\Sigma _{k}^{j}\right)\) can be calculated by keeping \(q\left (x_{k}^{j}\right)\) fixed such as
Here, \(q\left (\Sigma _{k}^{j}\right)\) is approximated as
where
where u=1,2…d, and
Note that Eqs. (37), (38), (41), and (42) are coupled. The fixedpoint algorithm is used to proceeded alternatively the state and noise parameters until the convergence is reached. It has been proved that VB converge very fast and most of the time, only a few iterations in [17].
By using the Bayes rule, the probability of each model is updated
Here, the likelihood function \(L_{k}^{j}\) of model j is calculated
Finally, based on the mixed equation, the state and the covariance in the fusion stage are shown as
The computational complexity of the model set adaptive filter is O(ln^{3}), where n is the dimension of the state and l is the number of the model set adaptive filter. The estimation of the measurement noise in VB step involves the following parameters: O(ld+l) for the posteriors of the means, and O(ld^{2}+l) for the posteriors of precision, where d is the dimension of the measurement. So the computational complexity of the proposed algorithm is O(N_{t}[ln^{3}+l+ld+l+ld^{2}])=O(N_{t}[ln^{3}+ld^{2}]), where N_{t} is the total number of VB iterations. A description of the proposed algorithm is summarized in the following:
Simulation results
In this section, numerical simulations are carried out in order to compare the performance of the five algorithms: IMM3 (3 basic models), IMM11 (3 basic models and 8 CT models), IMM3VB (3 basic models), IMM11VB (3 basic models and 8 CT models), and MSAVB (3 basic models and 8 CT models as the candidate models) with unknown measurement noise and system model. The reference system dynamic can be described by the following state space model
where \({x_{k}} = {\left [ {{\phi _{k}}} \quad {{{\dot \phi }_{k}}} \quad {{\varphi _{k}}} \quad {{{\dot \varphi }_{k}}} \right ]^{T}}, {\phi _{k}}\) and \({\dot \phi _{k}}\) are the target position and velocity in the Xdirections, respectively. φ_{k} and \({\dot \varphi _{k}}\) are the target position and velocity in the Ydirections, respectively. ω denotes the turn rate. t is the sampling time, and t=1s. The root mean square error (RMSE) of position and velocity are used to evaluate the performance of the proposed algorithm.
For the proposed algorithm, the system state is estimated based on the model set with the basic model set \({\mathcal {M}^{b}}\) and the candidate model set \({\mathcal {M}^{c}}\). The number of \({\mathcal {M}^{b}}\) and \({\mathcal {M}^{c}}\) are 3 and 8, respectively. Those models in the model set are constant turn (CT) models [1]. These models differ only in the turn rate ω_{i}, which belongs to the basic model set \({\mathcal {M}^{b}}\) that consists of the initial models of the IMM algorithm and the candidate model set \({\mathcal {M}^{c}}\) that consists of these models with different structures compared with the basic models.
Experiment 1
In this case, a single target moves in a 2D scenario with [−100,100]m×[−100,100]m surveillance region. The turn rate in different time periods is shown in Table 1.
The measurement equation is expressed as
where measurement noise v_{k} is the zeromean Gaussian distribution with the unknown covariance matrix Σ_{k}. The initial degree of freedom and symmetric positive definite matrix are κ_{0},_{i}=5(i=1,2),Λ_{0}=diag{20,20}. The turn rates ω_{i},ω_{j} belong to the following set
The transition probability matrix (TPM) of the IMM11 \(\Pi ^{11} = {(\pi _{i,j}^{11})_{11 \times 11}}\) is extended from the TPM of the basic models set. The TPM \(\Pi _{b}^{3} = {(\pi _{i,j}^{3})_{3 \times 3}}\) is shown as
where i,j=1,…,11, and a=b=0.01.
As can be seen from the RMSEs of position in Figs. 1 and 2. The RMSE of MSAVB is lower than that of IMM3VB. Note that the IMM3 and IMM11 perform a bit better than the IMM3VB, IMM11VB, and MSAVB at the beginning (t<25). The reason for this is VB eliminates the error between initial noise variance and true noise variance by using the iterative computation. The RMSEs of velocity in Figs. 3 and 4. From these figures it can be observed that the RMSEs of velocity of the IMM11VB, MSAVB outperform that of the IMM3, IMM11, and IMM3VB. During the maneuver, MSA also outperforms the other four algorithms.
In [29] and [23], the forgetting factor ρ is chosen empirically. The average RMSEs of the state versus different value of ρ are shown in Fig. 5. Simulation results show that the proposed algorithm performs better when ρ=0.92.
The RMSEs of the five algorithms are given in Table 2 with different measurement noise variance parameters. The variance parameters are chosen as 5, 10, 20, and 50, respectively. From Table 2, with increasing levels of noise variance parameters, the proposed algorithm and the IMM11VB have smaller RMSEs among these algorithms for all measurement noise variance parameters. Compared with the IMM3, IMM3VB, IMM11, and IMM11VB, the average RMSEs of the IMM3 and IMM3VB are larger than that of the IMM11 and IMM11VB. That is because more models are adapted for maneuvering target tracking. Due to VB effectively estimating the noise variance parameters, the average RMSEs of the IMM3VB and IMM11VB is smaller than that of the IMM3 and IMM11, respectively.
The comparison of relative computational times are shown in Table 3. The CPU time needed for IMM11VB is three times the CPU time of MSAVB.
Experiment 2
In this scenario, a bearingsonly tracking (BOT) problem is considered. The target located at coordinate [0,0]m. The initial position of observation platform is [500 m, 20 m/s, 800 m, 10 m/s]. First, the observation platform moves in constant velocity (CV) model for 100 s, then moves in CT model with duration 50 s and the turn rate ω=−0.0232(rad/s), and finally moves in CV model for 100 s. The measurement model at the time k is
The turn rates of the basic model set \({\mathcal {M}^{b}}\) and the candidate model set \({\mathcal {M}^{c}}\) are
The TPMs are shown in Eqs. (49) and (50).
The RMSEs of X and Y position and velocity over 200 Monte Carlo runs are shown in Figs. 6, 7, 8 and 9, respectively. It can be observed that the proposed algorithm performs a bit better than the other four algorithms, and the RMSEs of IMM11 and IMM11VB become larger around the time steps where the true measurement noise variances are jump changes. As can be seen from Fig. 7, the RMSE of IMM11 is shocked in the noise varying process. The reason is that the number of dimensions of measurement vector is lower than that of state vector. The result of variance estimation is shown in the Fig. 10. We can see that the proposed algorithm is effective in the estimation of the measurement noise statistics with some penalty of time delay. This is because the old noise value will be contained in part from the prior time step to the next time step. The RMSEs of the five algorithms are given in Table 4 with different measurement noise variance parameters. The variance parameters are chosen as 0.0001, 0.0005, 0.001, and 0.01, respectively. It can be seen from Table 4 that the average RMSEs increase as the noise variance parameters increase. Compared to the IMM3, IMM3VB, IMM11, and IMM11VB, the proposed algorithm has higher tracking accuracy.
The comparison of relative computational times are shown in Table 5. The CPU time of the IMM3 denotes a unit. It is obvious that MSAVB needs less computational time than IMM11VB.
Discussion
We have shown that the proposed algorithm can mitigates the effects of system model and noise statistics uncertainties in the target track system. We found that the proposed algorithm can effectively estimate the target state, as demonstrated in the numerical simulations. The estimation accuracy was examined by comparing the proposed algorithm, the IMMVB and IMM methods. The average RMSEs of the positions and velocities of the proposed algorithm are smaller than that of the other algorithms. Our results show an improved estimation and tracking performance compared to the IMMVB and IMM methods. In addition, we found that the computational complexity of the proposed method is relatively higher than the IMM3VB and IMM methods. The reason is that most of its computational time is spent on reconstructing the adapted model set and calculating the noise parameters by using the VB method. It should be noted that this study concentrates on only the single sensor target tracking with measurement noise uncertainty. Hence, we currently focus on extending it to multisensor target tracking with unknown measurement and process noise.
Conclusions
In this paper, we present an adaptively robust filter to address the performance degradation of the IMMVB in the presence of system model and noise statistics uncertainties. The main contribution of this paper is that a MSA method is designed to choose the best match model by calculating the divergence between the candidate models and true mode. Based on the chosen model, the modelconditioned estimation based on variational Bayesian approximation is proposed to estimate the system state and noise parameters. The performance of the MSAVB is evaluated over the different target tracking scenes. The RMSE for the positions and velocities are presented which shows higher accuracy compared with the IMMVB and IMM methods.
Abbreviations
 BMA:

Bestmodel augmentation
 BOT:

Bearingsonly tracking
 EMA:

Expected mode augmentation
 IMM:

Interacting multiple models
 LMS:

Likely model set
 MSS:

Minimal sub model set
 SSM:

State space model
 VB:

Variational Bayesian
 VSMM:

Variable structure multiple model methods
References
 1
R. Dehghannasiri, X. Qian, E. R. Dougherty, A Bayesian robust Kalman smoothing framework for statespace models with uncertain noise statistics. EURASIP J. Adv. Signal Process.1:, 55 (2018). https://doi.org/10.1186/s1363401805771.
 2
L. W. Jochumsen, J. Østergaard, S. H Jensen, A recursive kinematic random forest and alpha beta filter classifier for 2D radar tracks. EURASIP J. Adv. Signal Process.1:, 82 (2015). https://doi.org/10.1186/s1363401603783.
 3
X. Lan, S. Zhang, P. C. Yuen, Learning common and featurespecific patterns: A novel multiplesparserepresentationbased tracker. IEEE Trans. Image Process.27(4), 2022–2037 (2018). https://doi.org/10.1109/TIP.2017.2777183.
 4
X. Lan, M. Ye, R. Shao, Learning modalityconsistency feature templates: A robust RGBinfrared tracking system. IEEE Trans. Ind. Electron.66(12), 9887–9897 (2019). https://doi.org/0.1109/TIE.2019.2898618.
 5
J. Zhao, L. Mili, A framework for robust hybrid state estimation with unknown measurement noise statistics. IEEE Trans. Ind. Inform.99:, 1–1 (2017). https://doi.org/10.1109/TII.2017.2764800.
 6
G. Y. Kulikov, M. V. Kulikov, The accurate continuousdiscrete extended Kalman filter for radar tracking. IEEE Trans. Signal Process.64(4), 948–958 (2016). https://doi.org/10.1109/TSP.2015.2493985.
 7
X. Li, P. Willett, M. Baum, PMHT approach for underwater bearing only multisensor multitarget tracking in clutter. IEEE J. Ocean. Eng.41(4), 831–839 (2016). https://doi.org/10.1109/joe.2015.2506220.
 8
A. Roy, D. Mitra, Multitarget trackers using cubature Kalman filter for Doppler radar tracking in clutter. IET Signal Process.10(8), 888–901 (2016). https://doi.org/10.1049/ietspr.2015.0540.
 9
J. Xiao, R. Stolkin, M. Oussalah, Continuously adaptive data fusion and model relearning for particle filter tracking with multiple features. IEEE Sensors J.16(8), 2639–2649 (2016). https://doi.org/10.1109/JSEN.2016.2514704.
 10
M. A. Alirezapouri, H. Khaloozadeh, A. Vali, Set valuebased dynamic model development for nonlinear manoeuvring target tracking problem in the presence of unknown but bounded disturbances. IET Radar Sonar Navig.12(2), 186–194 (2018). https://doi.org/10.1049/ietrsn.2017.0293.
 11
Y. Liu, Y. Liang, Z. Liu, A novel robust MM filter against outliers. Asian J. Control. 18(1), 340–349 (2016). https://doi.org/10.1002/asjc.1042.
 12
X. R Li, Y BarShalom, Multiplemodel estimation with variable structure. IEEE Trans. Autom. Control.41(4), 478–493 (1996). https://doi.org/10.1109/9.489270.
 13
X. R. Li, V. P. Jilkov, R. Jifeng, Multiplemodel estimation with variable structurepart VI: Expectedmode augmentation. IEEE Trans. Aerosp. Electron. Syst.41(3), 853–867 (2005). https://doi.org/10.1109/taes.2005.1541435.
 14
X. R. Li, Y. M. Zhang, Multiplemodel estimation with variable structure. V. Likelymodel set algorithm. IEEE Trans. Aerosp. Electron. Syst.36(2), 448–466 (2000). https://doi.org/0.1109/7.845222.
 15
X. Wang, S. Challa, R. Evans, X. R. Li, Minimal submodelset algorithm for maneuvering target tracking. IEEE Trans. Aerosp. Electron. Syst.39(4), 1218–1231 (2003). https://doi.org/10.1109/TAES.2003.1261123.
 16
J. Lan, X. R. Li, Best model augmentation for variablestructure multiplemodel estimation. IEEE Trans. Aerosp. Electron. Syst.47(3), 2008–2025 (2011). https://doi.org/10.1109/TAES.2011.5937279.
 17
S. Sarkka, A. Nummenmaa, Recursive noise adaptive Kalman filtering by variational Bayesian approximations. IEEE Trans. Autom. Control. 54(3), 596–600 (2009). https://doi.org/10.1109/TAC.2008.2008348.
 18
J. Lerga, V. Sucic, D. Sersic, in Proc. International International Symposium on Image and Signal Processing and Analysis. Performance analysis of the LPARICI denoising method, (2009), pp. 28–33. https://doi.org/10.1109/ISPA.2009.5297758.
 19
G. Segon, J. Lerga, V. Sucic, Improved LPAICIbased estimators embedded in a signal denoising virtual instrument. Signal Image Video Process.11(2), 211–218 (2017). https://doi.org/10.1007/s1176001609216.
 20
I. Volaric, J. Lerga, V. Sucic, A fast signal denoising algorithm based on the LPAICI method for realtime applications. Circ. Syst. Signal Process.36(11), 4653–4669 (2017). https://doi.org/10.1007/s0003401705381.
 21
K. Li, L. Chang, B. Hu, A variational Bayesianbased unscented Kalman filter with both adaptivity and robustness. IEEE Sensors Journal. 16(18), 6966–6976 (2016). https://doi.org/10.1109/JSEN.2016.2591260.
 22
Z. Miao, H. Shi, Y. Zhang, Neural networkaided variational Bayesian adaptive cubature Kalman filtering for nonlinear state estimation. Measurement Science & Technology. 28(10), 6–18 (2017). https://doi.org/10.1088/13616501/aa7d70.
 23
H. Zhu, H. Leung, Z. S. He, A variational Bayesian approach to robust sensor fusion based on Studentt distribution. Inf. Sci.221(1), 201–214 (2013). https://doi.org/10.1016/j.ins.2012.09.017.
 24
H. Nurminen, T. Ardeshiri, R. Piché, Skew t filter and smoother with improved covariance matrix approximation. Inf. Sci.221(1), 201–214 (2016). https://doi.org/10.1109/TSP.2018.2865434.
 25
H. Zhu, H. Leung, Z. S. He, State estimation in unknown nonGaussian measurement noise using variational Bayesian technique. IEEE Trans. Aerosp. Electron. Syst.49(4), 2601–2614 (2013). https://doi.org/10.1109/TAES.2013.6621839.
 26
W. Li, Y. Jia, State estimation for jump Markov linear systems by variational Bayesian approximation. IET Control Theory Appl.6(6), 319–326 (2012). https://doi.org/10.1049/ietcta.2011.0167.
 27
X. Hong, H. Yuan, W. C Xie, Variational Bayesianinteracting multiple model tracking filter with angle glint noise. J. Electron. Inf. Technol.40(7), 1583–1590 (2018).
 28
B Gao, S. S Gao, Y. M Zhong, Interacting multiple model estimationbased adaptive robust unscented Kalman filter. J. Control Autom. Syst.13(1), 1–13 (2013). https://doi.org/10.1007/s1255501605892.
 29
M. J. Beal, Variational algorithms for approximate Bayesian inference. Ph.D. dissertation, The Gatsby Computational Neuroscience Unit, University College London, London, England (2003).
 30
P. Dong, Z. Leung, H. Leung, Variational Bayesian adaptive cubature information filter based on Wishart distribution. IEEE Trans. Autom. Control. 62(11), 6051–6057 (2017). https://doi.org/10.1109/TAC.2017.2704442.
 31
C. Shen, D. J. Xu, F. Shen, Generalized noises adaptive Kalman filtering based on variational inference. XI Tong Gong Cheng Yu Dian Zi Ji Shu/Syst. Eng. Electron.36(8), 1466–1472 (2014). https://doi.org/10.3969/j.issn.1001506X.2014.08.03.
 32
B. Ma, Parametric and nonparametric approaches for multisensor data fusion. Ph.D. dissertation, Dept. Elect. Eng., UMich., Detroit, MI, USA (2003). university of London London.
 33
J. M. Aughenbaugh, B. R. La Cour, Metric selection for information theoretic sensor management. Proc. Int. Conf. Inf. Fusion. 13(1), 1–13 (2015). https://doi.org/10.1109/ICIF.2008.4632451.
 34
V. Sucic, N. Saulig, B. Boashash, Estimating the number of components of a multicomponent nonstationary signal using the shortterm timefrequency Rényi entropy. EURASIP J. Adv. Signal Process.2011(1), 125–125 (2011). https://doi.org/10.1186/168761802011125.
 35
J. Lerga, N. Saulig, V. Mozetic, in in Proc. International Multidisciplinary Conference on Computer and Energy Science. Number of EEG signal components estimated using the shortterm Rényi entropy (Croatia, 2016), pp. 1–6. https://doi.org/10.1109/SpliTech.2016.7555940.
 36
C Kreucher, K Kastella, H. O Alfred, Sensor management using an active sensing approach. Signal Process.85(3), 607–624 (2005). https://doi.org/10.1016/j.sigpro.2004.11.004.
 37
C Shen, D Xu, W Huang, F Shen, An interacting multiple model approach for state estimation with nonGaussian noise using a variational Bayesian method. Asian J. Control. 17(4), 1424–1434 (2014). https://doi.org/10.1002/asjc.1055.
 38
J Zhao, L Mili, A framework for robust hybrid state estimation with unknown measurement noise statistics. IEEE Trans. Ind. Inform.99:, 1–1 (2017). https://doi.org/10.1109/TII.2017.2764800.
Acknowledgements
TM and SG derived the theoretical of the method. TM performed the experiments, analyzed the data, and drafted the paper. CC revised the manuscript. All authors had a significant contribution to the development of early ideas and design of the final methods. All authors read and approved the final manuscript.
Funding
This work was supported in part by the International Science and Technology Innovation Cooperation between Governments Project of National Key Research and Development Program (2016YFE0111900), the International Science and Technology Cooperation Key Project of Shaan xi Province (2019KWZ10), and the Industrial Science and Technology Research Project of Shaan xi Province(2019GY069).
Author information
Affiliations
Contributions
Authors’ contributions
The authors would like to thank the editorial board and anonymous reviewers for their careful reading and constructive comments which provide important guidance for our paper writing and research work. The authors would also like to thank J Lan for their previous studies, which helped us very much. All authors read and approved the final manuscript.
Authors’ information
Ma received his M.E. degree from Xi’An Technological University in 2013. From September 2013 to March 2018, he studied for his Ph.D. degree at the School of Automation, at the Northwestern Polytechnical University. Since May 2018, he has been a PostDoctoral Research Fellow in the Autonomous Systems and Intelligent Control International Joint Research Center, Xi’An Technological University. His research interests include target tracking and information fusion and their applications. Chen is currently working towards the Ph.D. degree at Xi’an University of Technology. His research interests include state estimation, fault diagnosis and faulttolerant control, and data fusion. Gao is Professor and Chair of Control theory and Control Engineering in the school of electronic information engineering at Xi’An Technological University. His research is currently focused on intelligent control, target detection and recognition technology, and gridconnected system.
Corresponding author
Ethics declarations
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Ma, T., Chen, C. & Gao, S. Model set adaptive filtering algorithm using variational Bayesian approximations and Rényi information divergence. EURASIP J. Adv. Signal Process. 2020, 17 (2020). https://doi.org/10.1186/s1363402000670x
Received:
Accepted:
Published:
Keywords
 Target tracking
 Variational Bayesian
 Model set adaptive
 System model uncertainty
 Rényi information divergence