 Research
 Open access
 Published:
Multisensor tracking with partly overlapping FoV using detection field of probability modeling and the GLMB filter
EURASIP Journal on Advances in Signal Processing volume 2023, Article number: 2 (2023)
Abstract
In this paper, we consider multisensor with partly overlapping field of view (FoV) in the labeled random finite set (LRFS) framework. This is different from most existing multisensor tracking algorithms, where the sensors are assumed to have the same FoV. We describe the partly overlapping FoV by modeling probability field of detection for individual sensors in whole observation area and can be seen as the same range of FoV. We consider all these using generalized labeled multiBernoulli filter in labeled RFS framework. Besides, we also propose a measurementdriven target birth model. Finally, the effectiveness of the proposed algorithm is verified by experiments.
1 Introduction
The aim of target tracking of far distance using radar sensor is to infer the states of targets from a set of measurements, which are received by the sensor. It is widely used in the military field or civilian areas, where the single sensor has been studied a lots in current literatures, whether in associationbased approaches such as joint probability data association [1, 2] and multiple hypothesis tracker [3], or in random finite setsbased approach. The RFS approach provides an elegant Bayesian formulation for multitarget tracking problem. The typical RFS multitarget tracking (RFSMTT) filters include the probability hypothesis density (PHD) filter [4], Gaussian mixture (GMPHD) filter [5], the cardinalized PHD (CPHD) filter [6, 7], and the (cardinality balanced) multiBernoulli (CBMeMBer) filter [8, 9]. In multitarget tracking, a recent breakthrough is a closed form solution to the Bayes multitarget filter which can also output target tracks [10, 11]. The most important work is the generalized labeled multiBernoulli (GLMB) filter. It is with the first multitarget conjugate prior [10, 11] the multitarget conjugate prior with respect to the standard multitarget likelihood function, or VoVo prior. Additionally, this multitarget prior is also closed under the ChapmanKolmogorov equation for the standard multitarget transition density [10, 11].
The multisensor multitarget tracking has been studied a lots in traditional associationbased algorithms. For example, the classic Sdimension assignment algorithm [12]. The multisensor with a distributed structure shows more robust performance than the centering one. Li et al. proposed the best linear unbias estimator for the distributed sensors in reference[13]. This result can be used in the MSMT tracking. In the RFS framework, Mahler proposed multisensor PHD filter [4, 14, 15], all belonging to centralized structure and have the same measurement field. For the large range of target movement in the radar tracking network, it is difficult for a single radar to complete the tracking task. Reference [16] developed a collaborative detection and power allocation (CDPA) scheme, which can evidently expand the detection range and improve the target tracking accuracy. Further, the Bayesian CramérRao lower bound (BCRLB) is used in [17, 18] to quantify the target tracking performance, and good results are obtained.
In fact, when a target flies thousands of kilometers, it is difficult for a sensor to track the target. Obviously, the assumption of multisensor having the same field is unrealistic. Usually, certain working pattern like relay race is adopt and thus the sensors are with partly overlapping field of view (FoV). At present, the basic idea to deal with this problem is to fuse the information in the overlapping FoV of each radar to improve the tracking performance, and to combine the information in the nonoverlapping FoV to expand the sensing range. The main methods to solve this problem are dividing, clustering and other methods.

Dividing method: References [19,20,21] used the known radar FoV to divide the multitarget density and then fused the divided terms to represent the multitarget density of overlapping FoV. However, the target information of nonoverlapping FoV was ignored in [19].

Clustering method: Using a clustering method, i.e., finding estimated matches from different sensors for the same target according to different measures, and performing fusion only on the selected matches. Reference [22] calculated the Mahalanobis distance between PHD Gaussian components of different sensors, and fused the Gaussian components with shorter Mahalanobis distance through the GA method, realizing the distributed GA fusion of PHD filters in partly overlapping FoV. Reference [23] achieved the fusion of CPHD filters in partly overlapping fields of view by using a method similar to that in [22]. Reference [24] matched the Bernoulli components between multiBernoulli filters through Mahalanobis distance and realized distributed AA fusion of multiBernoulli filters in limited FoV. For details about GA and AA fusion, see [25, 26]. Reference [27] used Optimal Subpattern Assignment (OSPA) distance as a measure to implement a method similar to that in [22]. Reference [28] used the method based on the highest a posteriori density distance measure to realize the PHD filter fusion of the limited FoV.

Other methods: Reference [29] proposed a tracktotrack fusion method in which the information contents of posteriors are combined. It is proved that using Cauchy Schwarz divergence can better realize LMB filter fusion with limited FoV. A distributed network of sensors with limited field of views is proposed under labeled RFS frameworks [27]. Reference [30] proposed a dualterm nodewise separable likelihood. It can be used for cases in which the sensors have partly overlapping FoVs.
The target birth intensity (TBI) is widely assumed to have a constant amplitude that must be determined in advance, implying that the intensity of emerging targets will be the same in all FoV. However, this is not always desirable. In actual tracking scenarios, the size of TBI is usually unknown and changes over time [31,32,33]. In [34], the target birth probability is adaptively performed in the preprocessing step, combined with the current measurements to correct the preset of the target birth probability, the proposed filter can really adapt to the target birth situation and achieve better tracking accuracy. In [35], a magnitudeadaptive TBI approach has been developed for RFSbased Bayesian filters , which adapts the TBI magnitude online with respect to the newest observations in exchange for very little additional computation. Reference [36] modelled the timevarying spatial distribution of target births as a dynamic density map with adaptive grid points, which is capable of estimating the unknown, dynamically changing birth process.
In this paper, we model the partly overlapping detection field of probability and provide multisensor measurement driven birth model. Based on these, we adopt the labeled random finite set to describe the target states and estimate their states by using the generalized labeled multiBernoulli (GLMB) filter. The preliminary results of this paper are published in a conference version [37], and this article is a complete one.
The structure of this paper is organized as follows. The Sect. 2 shows some theoretical basis for the labeled random finite set, including the GLMB filter. The Sect. 3 proposes the models of the detection of probability for the sensors. Section 3 considers the multisensor GLMB filter with partly overlapping field. The simulation is given in Sect. 4, and Sect. 5 concludes this paper.
2 Background
2.1 The state and measurement RFSs
In category of RFS, the states and measurements of multitarget can be seen as a set, in which each element belongs to a random vector and the cardinality of the set is finite and random. More specifically, the multitarget state RFS can be modeled by [8]:
where \(S_{kk1}(x)\), \(B_{kk1}(x)\), and \(\Gamma _k\) are the target surviving, spawned, and birth RFSs. Let these RFSs are mutually independent. Then, the probability density of the multitarget state RFS can be gotten by [8]:
where \(T_{kk1}(x)\triangleq S_{kk1}(x)\cup B_{kk1}(x)\), \(\pi _{\Gamma ,k}(\cdot )\) is the probability densities of spontaneous birth RFS \(\Gamma _k\). The equation describes all actions of target motion, birth and death. It should be noted that the spawning case is ignored in the paper.
The multitarget is observed by various sensors and multiple measurements may be received. Assume at time k, a target may be detected and produces a measurement \(z_k\) with probability \(P_D(x_k)\) or missed and gives empty set \(\{\emptyset \}\) with probability \(1P_D(x_{k})\). In a word, the received measurements \(z_k\), with probability of detection \(P_D(x_k)\) and likelihood function \(g(z_kx_k)\), involve all the information of the target state RFS \(X_k\). The target measurement RFS plus clutter or false alarms RFS \(K_k\) are expressed in the following:
where \(\Theta _k(X_k) = \cup _{x_k\in X_k}\Theta _k(x_k)\), we may model \(\Theta (x_k)\) as a binary RFS
The \(K_k\) is Poisson RFS with intensity \(v_K(\cdot )\). Its probability distribution is derived by:
Under the assumption of mutual independence between \(\Theta _k(X_k)\) and \(K_k\), the probability density \(\varphi _{k}(Z_kX_k)\) is given by [8]:
where \(\pi _{\Theta _k,k}(WX_k)\) is the probability density of targetgenerated measurement RFS and \(\pi (Z_kW)\) for clutter.
2.2 The labeled random finite set
Based on traditional RFS, a variable of label is added to the above state element x [10], generated a labeled RFS. It is defined on a product space \(\mathbb {X}\times \mathbb {L}\), where \(\mathbb {L}\) is a label space. In practical applications, a labeled random vector is represented by an unique vector in a discrete countable space. For example, the label is defined on space \((k,i)^T\), where k is time stamp and i is the count of this stamp. Some densities of the labeled RFS version are shown in the following.
2.2.1 The labeled Poisson RFS
A Poisson distribution is defined on the positive integer space \(N \triangleq \{0,1,\cdots ,n,\cdots \}\) and given by
where \(\lambda\) is Poisson intensity. For a RFS \(X=\{x_1,\cdots ,x_n\}\), the elements \(x_i\in X\) are i.i.d with density \(v(x)/\bar{N}\), where \(\bar{N}=\int v(x)\textrm{d}x\). Its Poisson distribution is given by
where \(\lambda\) is Poisson intensity. For a RFS \(X=\{x_1,\cdots ,x_n\}\), the elements \(x_i\in X\) are i.i.d with density \(v(x)/\bar{N}\), where \(\bar{N}=\int v(x)\textrm{d}x\). Its Poisson distribution is given by
A labeled Poisson RFS X is expressed by \({X}=\{(x_1,\ell _1),\cdots ,(x_n,\ell _n)\}\) with the following density function:
where \(\delta _{L(n)}(\{l_1,\ldots l_n\})\) is a generalization of the Kronecker delta
\({\langle v, 1\rangle }\) is defined to be \(\int v(x)\textrm{d}x\), \(\text{ Pois}_{\langle v,1 \rangle }(n)\) is the Poisson distribution, i.e., \(e^{\lambda }\lambda ^n/n!,\lambda ={\langle v, 1\rangle }\).
2.2.2 Labeled multiBernoulli RFS
For a fixed number of independent Bernoulli RFS \(X^{(i)}\) with parameters of existing probability \(r^{(i)}\) and density \(p^{(i)}(\cdot )\), their union
belongs to a multiBernoulli RFS and with the following probability density
For a labeled multiBernoulli RFS X with nonempty parameter set \(\{r^{(\zeta )},p^{(\zeta )},\zeta \in \Psi \}\), its probability distribution is given by [38]
where function \(\alpha (\cdot )\) is a 11 map shown as: \(\alpha : \Psi \rightarrow \mathbb {L}\). It should be noted that the distribution is not a multiBernoulli distribution. For simplicity, an alternative form of the labeled multiBernoulli distribution is given by [10]:
where \(\Delta ({X})\) is an indictor function to guarantee the distinct of individual labels. \(\Phi ({X};\cdot )\) is defined by
2.2.3 Generalized labeled multiBernoulli density
The generalized labeled multiBernoulli density is defined by [10]
where c is a discrete index set, \(\omega ^{(c)}\) is a weighted coefficient and dependent on the state label \(\mathscr {L}({X})\). \(p^{(c)}\triangleq p^{(c)}(x,\ell )\) is a distribution function for track with label \(\ell\). Thus, the exponential function \([p^{(c)}]^{X}\) is the factorial of all tracks. Moreover, it has been shown that the labeled Poisson RFS and labeled multiBernoulli are two special cases of GLMB RFSs [10].
3 Methods
3.1 The measurement models
Let \(F_{s,k}\) be the observation area for the sensor s. That is, only the targets in the field \(F_{s,k}\) may be observed. Assume that the state of sensor s is \(y_{s,k}\in R^{n_y}\), where \(R_{n_y}\) is the \(n_y\)dimensional Euclidean space. The measurement model can be modeled by:
The measurement model for sensor s is given by:
where \(\mathscr {P}(\cdot )\) is a projection from certain state space \(R^{n_x}\) to position space \(R^2\), i.e., \(\mathscr {P}: R^{n_x}\rightarrow R^2\) for target state.
3.2 The models of multisensor probability of detection
In general, radar is a feasible sensor for tracking targets over long distances. Its field of view can be regarded as a fanshaped area in polar coordinates, as shown in Fig. 1. It is defined by:
where \(A_{s,k}\) is the FoV of the sensor s, \(\mathbb {R}^+\) is the space of positive real numbers. Accordingly, the corresponding Euclidean space position can be gotten by a projection \(q: A_{s,k}\rightarrow R^2\). Thus, the FoV area in Euclidean space is defined by \(F_{s,k}=\{q(a_{s,k}) \text{ for } \text{ all }~ a_{s,k}\in A_{s,k}\}\). The model of probability of detection for sensor s is given by
where \(P_D\) is a constant, \(\cdot _2\) is 2norm. This model implies that a target may be detected with a certain probability if it locates in area \(F_{s,k}\) of sensor s, and with probability of detection zero otherwise.
3.3 Target birth models of multisensor measurement driven
In most existing algorithms, the FoV of a sensor is assumed to cover all the track region and there is no any dead zone. Hence, the target birth model is assumed to be prior and known. But for sensors with partly overlapping FoV, a sensor scans only part of the surveillance region. Hence, it is impossible to detect a target when the target is born outside the FoV. In order to build the target birth model, we refer the measurementdriven birth model given in [38,39,40] and extend it to the multisensor case.
A multiBernoulli RFS X is a union of a fixed number of independent Bernoulli RFSs \(X^{(i)}\) with existence probability \(r^{(i)}_B \in (0,1)\) and probability density \(p^{(i)}_B(i = 1,\ldots ,M)\)[41]. So, the probability density of a multiBernoulli RFS can be abbreviated as:
Assume that the form of the birth model with generalized labeled multiBernoulli (GLMB) is as follows:
where
The existence probability can be initialized by the following equation:
where
where \(\Theta (I,S)\) is the space of multisensor association map. \(\vartheta\) is a multisensor association map (defined next subsection).
3.4 Multisensor association map
In the GLMB filter, the association map plays a crucial role in the RFS multiobjective likelihood function.
Definition 1
[10]: The association map is a mapping: \(\theta\): \(\mathbb {L}\rightarrow \left\{ {0,1, \cdots ,Z} \right\}\). If \(\theta \left( i \right) = \theta \left( {i'} \right) > 0\), it means \(i = i'\), the set \(\Theta\) represents the associated map space, and its subset I can be represented by \(\Theta (I)\). The association diagram describes the correspondence between the trajectory and the measurement, the trajectory l produces a measure of \({z_{\theta \left( l \right) }} \in Z\), and the undetected trajectory is denoted by 0.
Definition 2
[42]: The multisensor association map is a mapping: \(\vartheta\): \(\mathbb {L}\rightarrow {S_1} \times {S_2} \times \cdots \times {S_m}\), \({S_s} = \left\{ {0,1 \cdots ,\left {{Z_s}} \right } \right\}\), where \(\vartheta \left( i \right) = \vartheta \left( {i'} \right) ,\theta \left( {i,l} \right) \ne 0\) means \(i = i'\), \(\theta \left( {i,l} \right)\) is the rth element in vector \(\theta \left( i \right)\). The set \(\Theta (I,S)\) represents the space of multisensor associated map, and its subset I can be represented by \(\Theta (I,S)\).
Under the independence of all sensors, the multisensor association map \(\vartheta\) can be expressed as
where \(\vartheta ^T_s\) can be seen as components of \(\vartheta\). Assume that multisensor measurements can be represented by \(Z_k \triangleq Z_{1,k}\cup \dots \cup Z_{S,k}\), multisensor posterior probability:
where the integral is defined as:
Assume that the multisensor are independent, then multisensor likelihood function is given by:
where
3.5 GLMB estimation algorithm for multisensor with partly overlapping FoV
The basic principle of the multisensor tracking algorithm is to distribute the multisensor reasonably. At different times, the detection results of the individual sensors may be different. At each moment, we need to judge the target, to determine the target in which the sensor within the scope of observation. The specific multisensor GLMB estimation algorithm is as follows:
3.5.1 Update step
If the multisensor multitarget a priori density function is the form of generalized labeled multiBernoulli, then the multisensor multitarget posterior probability density is also the form of generalized labeled multiBernoulli:
where \(\vartheta\) represents the current multisensor association map. The association parameters are defined as follows:
where \(\mathop \Psi \nolimits _{Z_k} \left( {x,l;\vartheta }\right)\) is the likelihood function in the case of multisensor; assume that the sensors are independent of each other, it can be simplified as:\(\prod {\psi _{Z_{1,k}}\cdots {\psi _{{Z_{S,k}}}}\left( {\;:\;;\vartheta _s } \right) }\), suppose that the likelihood function is a Gaussian distribution,\({P_{s,d}}(x_k,l) = {P_{s,d}}\), \(g(z_{s,k}x_k,l) = \mathscr {N}\left( {z_{s,k};\mathop H_{s,k} ,\mathop R_{s,k} }\right)\). \({H_{s,d}}\) and \({R_{s,d}}\) are the observation matrix and measurement noise covariance for sensor s. Assume that probability density \({p^{(\xi )}}( \cdot ,\ell )\) of target \(\ell\) follows a Gaussian mixture distribution:
Then we can get the following multisensor cost matrix:
where \(z^s_{k,j}\) represents the jth measurement of the sth sensor, the update history \((\xi ,\vartheta )\) and \(\eta _{Z,k}^{(\xi ,\vartheta )}\) of the multisensor association map are as follows:
Although the multisensor labeled multiBernoulli filter has the same representation as the singlesensor, there are many differences between the multisensor and the singlesensor for the specific parameters:
The above formula gives the recursive process of the measurement \({Z_1}\) to \({Z_m}\) of the multisensor association map.
3.5.2 Predict step
The predict step is the same as the case of single sensor. That is, if the multisensor multitarget a priori density function is the form of the generalized labeled multiBernoulli, then the multiobjective prediction is:
where
In this step, the multisensor has the same form as the singlesensor.Let \({w_B}({I_ + } \cap \mathbb {B})\) be the weight of new label \({I_+} \cap \mathbb {B}\),\({w_s}^{\left( \xi \right) }({I_ + } \cap \mathbb {L})\) is the weight of the survival label \(({I_+} \cap \mathbb {L})\), \({p_B}\left( {x,l} \right)\) is the probability density of the new target. \(p_s^{\left( \xi \right) }\left( {x,l}\right)\) is the density of the survival target obtained from the prior density \({p^{(\xi )}}\left( { \cdot ,l} \right)\).\(f\left( {x \cdot ,l} \right)\) represents the probability density of the survival target.
Algorithm 1 provides pseudocode for a multisensor multitarget tracking algorithm with partly overlapping fields of view.
4 Experiments and discussions
To verify the effectiveness and robustness of the proposed algorithm, we set up two scenarios. Experiment 1: high detection probability and small number of targets; Experiment 2: low detection probability and a larger number of targets. As the number of targets increases, more targets are born or die out outside the radar field of view, which poses a challenge to the trajectory tracking capability of the proposed algorithm. The reduction in detection probability also has a direct impact on tracking accuracy.
4.1 Experiment 1: high detection rate scenario and tracking a small number of targets
Given three sensors located in positions \(y^1_{k} = [200\,\textrm{km},0\,\textrm{km}]^{'}, y^2_{k} = [500\,\textrm{km},0\,\textrm{km}]^{'}, y^3_{k} = [800\,\textrm{km},0\,\textrm{km}]^{'}\), respectively. The surveillance sectors are all \([\pi /6,5\pi /6]\times [0, 100]\,\textrm{rad}\cdot \,\textrm{km}\) for the sensors. This means that the range of angle is \({120^\circ }\), detection probability \({P_D} = 0.98\), survival probability \({P_s} = 0.99\), clutter intensity \({\lambda _c} = 3\). Assume the running steps is 200. Consider three targets move in \(xy\) coordinate. The targets move in a constant velocity (CV) model, i.e.,
where the transfer matrix A is:
where sampling time \(T=1\), let state \(x^i_k = [p_{k,x}; \dot{p}_{k,x}; p_{k,y}; \dot{p}_{k,y}]\) represent the positions and velocities in x and y directions, respectively. The observation function is angle and range.
where \(y^s_k \triangleq [u^s_{k,x},u^s_{k,y}]^{'}\) is the position of sensor s. The surviving time interval for target 1 is [1,150]s, for target 2 is [30,170]s, and for target 3 and target 4 is [50, 200]s. The initial states of the four targets are listed in the following:
Only when a target enters into the surveillance region of a sensor. It can be observed. The fields of the four sensors are shown in Fig. 2.
From the figure, the fanshaped areas are shown by two dashed lines and three fixed sensors with partly overlapping fields. Only a target entering into a sensor’s field can be observed.
The target tracks are given in Fig. 3. It can be seen that the initial flying heights in y coordinate are 80 km, 30 km, 60 km and 10 km, respectively. The target 1 enters the observation range of the first sensor 1 around \(k=20\). After moving about 250 km distance, the target 1 moves out of the field of sensor 1 and the measurement cannot be derived simultaneously. About 400 km on the horizontal axis, the first target enters into the observation range of sensor 2 and is observed. Also after around 600 km, target 1 moves out of the field of sensor 2. At about 700 km on the horizontal axis, it enters the observation range of sensor 3 and is observed until it dies within the field of sensor 3. Targets 2 and 3 have the same fields. It can be seen from the figure the proposed algorithm can detect and track the three targets correctly in each sensor field.
Figure 4 shows the trajectories of the targets in the x, y directions and the total flight times are 200s. The time intervals of all target births and deaths are [1,150]s, [30, 170]s, [50, 200]s, [50, 200]s for targets 1 to 4, respectively. Considering the partly overlapping FoV, it can be seen from the figure the whole tracking process well. Each target is detected in various time intervals. For example, in time interval around [10, 65]s, target 1 lies in the FoV of sensor 1. And in time interval [75, 110]s target 1 lies in the FoV of sensor 2 and in time interval [130, 150]s of sensor 3. It can be seen from this figure that the proposed algorithm can successfully detect the targets by using the multisensor measurement driven birth model.
The estimation of the number of targets is shown in the upper subfigure of Fig. 5, where the true number of targets and its estimated value are plotted. It can be seen from Fig. 5 the three targets do not enter into the observation region of all three sensors at the first 20th time steps, so the estimated number of targets is 0. Once target 1 enters into the region, the estimated number of targets becomes 1. In practice, in certain time interval if a target is not detected, it means that the target locates in the blind region or has been died. Therefore, the estimated number of targets and the true value are not coincident in this time interval. Only in the observation region, the target can be detected. Outside the field, nothing can be found. Therefore, it is meaningful to get the true number of detected targets in the observation region, which is plotted in the bottom subfigure of Fig. 5. It can be seen from the subfigure that the number of targets can be estimated efficiently.
Here we use the optimal subpattern assignment (OSPA) metric to evaluate the tracking performance [43]:
The parameters \(c = 50, p = 1\) and the OSPA error is shown in Fig. 6. It shows that the OSPA error, OSPA location error and cardinality error, respectively. It seems there is a large error. In fact, if considering the detected region (outside blind area), the corresponding OSPA error given in Fig. 7 is much better. This shows that in the observation area of all sensors, the targets are detected and tracked well and the number of targets is accurately estimated.
4.2 Experiment 2: low detection rate scenario and tracking more targets
In this scenario, we will verify that the proposed algorithm can correctly track a large number of targets under more complex low detection probability conditions. The initial position of the sensor and other parameters remains unchanged; only the detection probability of each sensor is modified to 0.80. At the same time, we increase the number of targets to 10, whose motion model is still the CV model. The initial state and survival time of these targets are given by:
The tracks for 10 targets are given in Fig. 8. As can be seen from the figure, the initial flight altitude of the target is 90 km, 70 km, 40 km and 10 km. Throughout the 200 s of tracking, the position estimate of target was fairly accurate. It shows that even in the case of low detection probability, the algorithm proposed in this paper can still track a large number of targets correctly. However, in Figs. 8 and 9, we can find that when the target enters the field of view of the sensor, especially when multiple targets overlap, there will be a comparatively large error in the position estimation. At low detection probability, when multitarget are in close proximity, the measurements obtained by the sensors are incomplete and the relative positions of these measurements are very close together. This will pose a great challenge to the filter update process. And this is often seen in sensor tracking with limited field of view.
Similar to Scenario 1, the estimated number of 10 targets is given in Fig. 10. Targets can only be correctly estimated when they appear in the sensor field of view. For example, between 1 and 40 s, 3 targets actually survive. But it was not until about the 10th second that two targets entered the field of view of Sensor 1. A third target enters the field of view of Sensor 1 around the 30th second. By this time, the number of targets detected by the sensor is 3.
The OSPA error of target location estimation at low detection probability is given in Fig. 11. The parameters \(c = 50, p = 1\). When the blind area is considered, the OSPA error of the position estimation is larger. But when the blind area is not considered, as shown in Fig. 12, the OSPA error, OSPA position error and OSPA cardinality error are quite small. This illustrates that in scenarios with low detection probability, the target can be well tracked when it is within the field of view of the sensor and can be satisfied with practical tracking tasks.
5 Conclusions
In this paper, we consider the target tracking problem of multisensor partly overlapping FoV. We establish a model to describe partly overlapping FoV using probability field of detection (PFoD). Then, a multisensor multitarget tracking algorithm based on generalized labeled multiBernoulli (GLMB) filter is proposed. Finally, the proposed algorithm is verified by using three sensors with partly overlapping fields. Experiments show that the effective of the algorithm in detecting and tracking multitarget.
Availability of data and materials
In this work, we have used the free RFS MATLAB code provided by Prof. BaNgu Vo and Prof. BaTuong Vo at http://batuong.voau.com/codes.html.
Abbreviations
 FoV:

Field of view
 RFS:

Random finite set
 LRFS:

Labeled random finite set
 PFoD:

Probability field of detection
 GLMB:

Generalized labeled multiBernoulli
 PHD:

Probability hypothesis density
 CPHD:

Cardinalized PHD
 CBMeMBer:

Cardinality balanced multitarget multiBernoulli
 GMPHD:

Gaussian mixture probability hypothesis density
 KNN:

Knearest neighbor algorithm
 CV model:

Constant velocity model
 OSPA:

Optimal subpattern assignment
References
Y. BarShalom, Tracking methods in a multitarget environment. IEEE Trans. Autom. Control 23(4), 618–626 (1978)
Y. BarShalom, T.E. Fortmann, P.G. Cable, Tracking and data association. Acoust. Soc. Am. J. 87(2), 918–919 (1990)
D. Reid, An algorithm for tracking multiple targets. IEEE Trans. Autom. Control 24(6), 843–854 (1979)
R.P. Mahler, Multitarget bayes filtering via firstorder multitarget moments. IEEE Trans. Aerosp. Electron. Syst. 39(4), 1152–1178 (2003)
B.N. Vo, W.K. Ma, The gaussian mixture probability hypothesis density filter. IEEE Trans. Signal Process. 54(11), 4091–4104 (2006)
R. Mahler, Phd filters of higher order in target number. IEEE Trans. Aerosp. Electron. Syst. 43(4), 1523–1543 (2007)
B.T. Vo, B.N. Vo, A. Cantoni, Analytic implementations of the cardinalized probability hypothesis density filter. IEEE Trans. Signal Process. 55(7), 3553–3567 (2007)
R.P. Mahler, Statistical Multisourcemultitarget Information Fusion, Artech House Norwood (MA, USA, 2007)
B.T. Vo, B.N. Vo, A. Cantoni, The cardinality balanced multitarget multibernoulli filter and its implementations. IEEE Trans. Signal Process. 57(2), 409–423 (2008)
B.T. Vo, B.N. Vo, Labeled random finite sets and multiobject conjugate priors. IEEE Trans. Signal Process. 61(13), 3460–3475 (2013)
B.N. Vo, B.T. Vo, D. Phung, Labeled random finite sets and the bayes multitarget tracking filter. IEEE Trans. Signal Process. 62(24), 6554–6567 (2014)
S. Deb, M. Yeddanapudi, K. Pattipati, Y. BarShalom, A generalized sd assignment algorithm for multisensormultitarget state estimation. IEEE Trans. Aerosp. Electron. Syst. 33(2), 523–538 (1997)
X.R. Li, Y. Zhu, J. Wang, C. Han, Optimal linear estimation fusion. i. unified fusion rules. IEEE Trans. Inf. Theory 49(9), 2192–2208 (2003)
R. Mahler, The multisensor phd filter: I. general solution via multitarget calculus, in Signal Processing, Sensor Fusion, and Target Recognition XVIII (International Society for Optics and Photonics, 2009), vol. 7336, p. 73360
R. Mahler, Approximate multisensor cphd and phd filter, in 2010 13th International Conference on Information Fusion (IEEE, 2010), pp. 1–8
J. Yan, W. Pu, S. Zhou, H. Liu, Z. Bao, Collaborative detection and power allocation framework for target tracking in multiple radar system. Inf. Fusion 55, 173–183 (2020)
J. Yan, W. Pu, S. Zhou, H. Liu, M.S. Greco, Optimal resource allocation for asynchronous multiple targets tracking in heterogeneous radar networks. IEEE Trans. Signal Process. 68, 4055–4068 (2020)
J. Yan, J. Dai, W. Pu, H. Liu, M. Greco, Target capacity based resource optimization for multiple target tracking in radar network. IEEE Trans. Signal Process. 69, 2410–2421 (2021)
T. Li, V. Elvira, H. Fan, J.M. Corchado, Localdiffusionbased distributed smcphd filtering using sensors with limited sensing range. IEEE Sens. J. 19(4), 1580–1589 (2018)
K. Da, T. Li, Y. Zhu, Q. Fu, Gaussian mixture particle jumpmarkovcphd fusion for multitarget tracking using sensors with limited views. IEEE Trans. Signal Inf. Process. Netw. 6, 605–616 (2020)
L. Gao, G. Battistelli, L. Chisci, Fusion of labeled rfs densities with different fields of view. IEEE Trans. Aerospace Electron. Syst. 1–16 (2022)
M. Vasic, D. Mansolino, A. Martinoli, A system implementation and evaluation of a cooperative fusion and tracking algorithm based on a gaussian mixture phd filter, in 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE, 2016), pp. 4172–4179
G. Li, G. Battistelli, L. Chisci, W. Yi, L. Kong, Distributed multiview multitarget tracking based on cphd filtering. Signal Process. 188, 108210 (2021)
S. Wu, L. Wang, T. Li, Multibernoulli target tracking based on distributed limited sensing network. Acta Automatica Sinica 48(5), 1370–1384 (2022)
K. Da, T. Li, Y. Zhu, H. Fan, Q. Fu, Recent advances in multisensor multitarget tracking using random finite set. Front. Inf. Technol. Electron. Eng. 22(1), 5–24 (2021)
Y. Cao, O. Kaiwartya, T. Li, Secure and Digitalized Future Mobility: Shaping the Ground and Air Vehicles Cooperation (CRC Press, 2022)
H. Van Nguyen, H. Rezatofighi, B.N. Vo, D.C. Ranasinghe, Distributed multiobject tracking under limited field of view sensors. IEEE Trans. Signal Process. 69, 5329–5344 (2021)
W. Yi, G. Li, G. Battistelli, Distributed multisensor fusion of phd filters with different sensor fields of view. IEEE Trans. Signal Process. 68, 5204–5218 (2020)
A.K. Gostar, T. Rathnayake, R. Tennakoon, A. BabHadiashar, G. Battistelli, L. Chisci, R. Hoseinnezhad, Cooperative sensor fusion in centralized sensor networks using cauchyschwarz divergence. Signal Process. 167, 107278 (2020)
M. Üney, B. Mulgrew, D. Clark, Distributed localisation of sensors with partially overlapping fieldofviews in fusion networks, in 2016 19th International Conference on Information Fusion (FUSION) (IEEE, 2016), pp. 1340–1347
L. Chai, L. Kong, S. Li, W. Yi, The multiple model multibernoulli filter based trackbeforedetect using a likelihood based adaptive birth distribution. Signal Process. 171, 107501 (2020)
C. Berry, D.J. Bucci, S.W. Schmidt, Passive multitarget tracking using the adaptive birth intensity phd filter, in 2018 21st International Conference on Information Fusion (FUSION) (IEEE, 2018), pp. 353–360
Q. Huang, L. Xie, H. Su, Estimations of timevarying birth cardinality distribution and birth intensity in gaussian mixture cphd filter for multitarget tracking. Signal Process. 190, 108321 (2022)
X. Hu, H. Ji, L. Liu, Adaptive target birth intensity multibernoulli filter with noisebased threshold. Sensors 19(5), 1120 (2019)
T. Li, S. Sun, J.M. Corchado, M.F. Siyau, Random finite setbased bayesian filters using magnitudeadaptive target birth intensity, in 17th International Conference on Information Fusion (FUSION) (IEEE, 2014), pp. 1–8
Q. Huang, L. Xie, X. Hu, H. Su, Kernelbased learning of birth process from evolving spatiotemporal rfs data stream in smccphd filter for multitarget tracking. Signal Process. 203, 108783 (2023)
W. Liu, Y. Chen, H. Cui, Q. Ge, Multisensor tracking with onoverlapping field for the glmb filter, in The Sixth International Conference on Control, Automation and Information Sciences (ICCAIS 2017) (IEEE, 2017), pp. 202–207
S. Reuter, B.T. Vo, B.N. Vo, K. Dietmayer, The labeled multibernoulli filter. IEEE Trans. Signal Process. 62(12), 3246–3260 (2014)
B. Ristic, D. Clark, B.N. Vo, B.T. Vo, Adaptive target birth intensity for phd and cphd filters. IEEE Trans. Aerosp. Electron. Syst. 48(2), 1656–1668 (2012)
S. Lin, B.T. Vo, S.E. Nordholm, Measurement driven birth model for the generalized labeled multibernoulli filter, in 2016 International Conference on Control, Automation and Information Sciences (ICCAIS) (IEEE, 2016), pp. 94–99
B.T. Vo, B.N. Vo, A. Cantoni, The cardinality balanced multitarget multibernoulli filter and its implementations. IEEE Trans. Signal Process. 57(2), 409–423 (2009)
W. Liu, B. Wei, S. Zhu, A multisensor generalized labeled multibernoulli filter via extended association map, in 2015 International Conference on Control, Automation and Information Sciences (ICCAIS) (IEEE, 2015), pp. 225–230
D. Schuhmacher, B.T. Vo, B.N. Vo, A consistent metric for performance evaluation of multiobject filters. IEEE Trans. Signal Process. 56(8), 3447–3457 (2008)
Acknowledgements
Not applicable.
Funding
This work was supported in part by the NSFC(61771177), and the key research and development program of Shaanxi province (2021GY087)
Author information
Authors and Affiliations
Contributions
WL developed and wrote the method presented in this paper. QL and JY performed the experiments. All authors discussed the results and implications and commented on the manuscript at all stages. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Liu, W., Liu, Q., Chen, Y. et al. Multisensor tracking with partly overlapping FoV using detection field of probability modeling and the GLMB filter. EURASIP J. Adv. Signal Process. 2023, 2 (2023). https://doi.org/10.1186/s13634022009624
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13634022009624