 Research
 Open access
 Published:
Adaptive link selection algorithms for distributed estimation
EURASIP Journal on Advances in Signal Processing volume 2015, Article number: 86 (2015)
Abstract
This paper presents adaptive link selection algorithms for distributed estimation and considers their application to wireless sensor networks and smart grids. In particular, exhaustive searchbased least mean squares (LMS) / recursive least squares (RLS) link selection algorithms and sparsityinspired LMS / RLS link selection algorithms that can exploit the topology of networks with poorquality links are considered. The proposed link selection algorithms are then analyzed in terms of their stability, steadystate, and tracking performance and computational complexity. In comparison with the existing centralized or distributed estimation strategies, the key features of the proposed algorithms are as follows: (1) more accurate estimates and faster convergence speed can be obtained and (2) the network is equipped with the ability of link selection that can circumvent link failures and improve the estimation performance. The performance of the proposed algorithms for distributed estimation is illustrated via simulations in applications of wireless sensor networks and smart grids.
1 Introduction
Distributed signal processing algorithms have become a key approach for statistical inference in wireless networks and applications such as wireless sensor networks and smart grids [1–5]. It is well known that distributed processing techniques deal with the extraction of information from data collected at nodes that are distributed over a geographic area [1]. In this context, for each specific node, a set of neighbor nodes collect their local information and transmit the estimates to a specific node. Then, each specific node combines the collected information together with its local estimate to generate an improved estimate.
1.1 Prior and related work
Several works in the literature have proposed strategies for distributed processing which include incremental [1, 6–8], diffusion [2, 9], sparsityaware [3, 10], and consensusbased strategies [11]. With the incremental strategy, the processing follows a Hamiltonian cycle, i.e., the information flows through these nodes in one direction, which means each node passes the information to its adjacent node in a uniform direction. However, in order to determine an optimum cyclic path that covers all nodes (considering the noise, interference, path loss, and channels between neighbor nodes), this method needs to solve an NPhard problem. In addition, when any of the nodes fails, data communication through the cycle is interrupted and the distributed processing breaks down [1].
In distributed diffusion strategies [2, 10], the neighbors for each node are fixed and the combining coefficients are calculated after the network topology is deployed and starts its operation. One potential risk of this approach is that the estimation procedure may be affected by poorly performing links. More specifically, the fixed neighbors and the precalculated combining coefficients may not provide an optimized estimation performance for each specified node because there are links that are more severely affected by noise or fading. Moreover, when the number of neighbor nodes is large, each node requires a large bandwidth and transmit power. In [12, 13], the idea of partial diffusion was introduced for reducing communications between neighbor nodes. Prior work on topology design and adjustment techniques includes the studies in [14–16] and [17], which are not dynamic in the sense that they cannot track changes in the network and mitigate the effects of poor links.
1.2 Contributions
The adaptive link selection algorithms for distributed estimation problems are proposed and studied in this chapter. Specifically, we develop adaptive link selection algorithms that can exploit the knowledge of poor links by selecting a subset of data from neighbor nodes. The first approach consists of exhaustive searchbased least mean squares (LMS)/ recursive least squares (RLS) link selection (ESLMS/ESRLS) algorithms, whereas the second technique is based on sparsityinspired LMS/RLS link selection (SILMS/SIRLS) algorithms. With both approaches, distributed processing can be divided into two steps. The first step is called the adaptation step, in which each node employs LMS or RLS to perform the adaptation through its local information. Following the adaptation step, each node will combine its collected estimates from its neighbors and local estimate, through the proposed adaptive link selection algorithms. The proposed algorithms result in improved estimation performance in terms of the mean square error (MSE) associated with the estimates. In contrast to previously reported techniques, a key feature of the proposed algorithms is that the combination step involves only a subset of the data associated with the best performing links.
In the ESLMS and ESRLS algorithms, we consider all possible combinations for each node with its neighbors and choose the combination associated with the smallest MSE value. In the SILMS and SIRLS algorithms, we incorporate a reweighted zero attraction (RZA) strategy into the adaptive link selection algorithms. The RZA approach is often employed in applications dealing with sparse systems in such a way that it shrinks the small values in the parameter vector to zero, which results in better convergence and steadystate performance. Unlike prior work with sparsityaware algorithms [3, 18–20], the proposed SILMS and SIRLS algorithms exploit the possible sparsity of the MSE values associated with each of the links in a different way. In contrast to existing methods that shrink the signal samples to zero, SILMS and SIRLS shrink to zero the links that have poor performance or high MSE values. By using the SILMS and SIRLS algorithms, the data associated with unsatisfactory performance will be discarded, which means the effective network topology used in the estimation procedure will change as well. Although the physical topology is not changed by the proposed algorithms, the choice of the data coming from the neighbor nodes for each node is dynamic, leads to the change of combination weights, and results in improved performance. We also remark that the topology could be altered with the aid of the proposed algorithms and a feedback channel which could inform the nodes whether they should be switched off or not. The proposed algorithms are considered for wireless sensor networks and also as a tool for distributed state estimation that could be used in smart grids.
In summary, the main contributions of this chapter are the following:

We present adaptive link selection algorithms for distributed estimation that are able to achieve significantly better performance than existing algorithms.

We devise distributed LMS and RLS algorithms with link selection capabilities to perform distributed estimation.

We analyze the MSE convergence and tracking performance of the proposed algorithms and their computational complexities, and we derive analytical formulas to predict their MSE performance.

A simulation study of the proposed and existing distributed estimation algorithms is conducted along with applications in wireless sensor networks and smart grids.
This paper is organized as follows. Section 2 describes the system model and the problem statement. In Section 3, the proposed link selection algorithms are introduced. We analyze the proposed algorithms in terms of their stability, steadystate, and tracking performance and computational complexity in Section 4. The numerical simulation results are provided in Section 5. Finally, we conclude the paper in Section 6.
Notation: We use boldface upper case letters to denote matrices and boldface lower case letters to denote vectors. We use (·)^{T} and (·)^{−1} to denote the transpose and inverse operators, respectively, (·)^{H} for conjugate transposition and (·)^{∗} for complex conjugate.
2 System model and problem statement
We consider a set of N nodes, which have limited processing capabilities, distributed over a given geographical area as depicted in Fig. 1. The nodes are connected and form a network, which is assumed to be partially connected because nodes can exchange information only with neighbors determined by the connectivity topology. We call a network with this property a partially connected network whereas a fully connected network means that data broadcast by a node can be captured by all other nodes in the network in one hop [21]. We can think of this network as a wireless network, but our analysis also applies to wired networks such as power grids. In our work, in order to perform link selection strategies, we assume that each node has at least two neighbors.
The aim of the network is to estimate an unknown parameter vector ω _{0}, which has length M. At every time instant i, each node k takes a scalar measurement d _{ k }(i) according to
where x _{ k }(i) is the M×1 random regression input signal vector and n _{ k }(i) denotes the Gaussian noise at each node with zero mean and variance \(\sigma _{n,k}^{2}\). This linear model is able to capture or approximate well many inputoutput relations for estimation purposes [22], and we assume I>M. To compute an estimate of ω _{ 0 } in a distributed fashion, we need each node to minimize the MSE cost function [2]
where \(\mathbb {E}\) denotes expectation and ω _{ k }(i) is the estimated vector generated by node k at time instant i. Equation (3) is also the definition of the MSE, and the global network cost function could be described as
To solve this problem, diffusion strategies have been proposed in [2, 9] and [23]. In these strategies, the estimate for each node is generated through a fixed combination strategy given by
where \(\mathcal {N}_{k}\) denotes the set of neighbors of node k including node k itself, c _{ kl }≥0 is the combining coefficient, and ψ _{ l }(i) is the local estimate generated by node l through its local information.
There are many ways to calculate the combining coefficient c _{ kl } which include the Hastings [24], the Metropolis [25], the Laplacian [26], and the nearest neighbor [27] rules. In this work, due to its simplicity and good performance, we adopt the Metropolis rule [25] given by
where \(\mathcal {N}_{k}\) denotes the cardinality of \(\mathcal {N}_{k}\). The set of coefficients c _{ kl } should satisfy [2]
For the combination strategy mentioned in (4), the choice of neighbors for each node is fixed, which results in some problems and limitations, namely:

Some nodes may face high levels of noise or interference, which may lead to inaccurate estimates.

When the number of neighbors for each node is high, large communication bandwidth and high transmit power are required.

Some nodes may shut down or collapse due to network problems. As a result, local estimates to their neighbors may be affected.
Under such circumstances, a performance degradation is likely to occur when the network cannot discard the contribution of poorly performing links and their associated data in the estimation procedure. In the next section, the proposed adaptive link selection algorithms are presented, which equip a network with the ability to improve the estimation procedure. In the proposed scheme, each node is able to dynamically select the data coming from its neighbors in order to optimize the performance of distributed estimation techniques.
3 Proposed adaptive link selection algorithms
In this section, we present the proposed adaptive link selection algorithms. The goal of the proposed algorithms is to optimize the distributed estimation and improve the performance of the network by dynamically changing the topology. These algorithmic strategies give the nodes the ability to choose their neighbors based on their MSE performance. We develop two categories of adaptive link selection algorithms; the first one is based on an exhaustive search, while the second is based on a sparsityinspired relaxation. The details will be illustrated in the following subsections.
3.1 Exhaustive search–based LMS/RLS link selection
The proposed ESLMS and ESRLS algorithms employ an exhaustive search to select the links that yield the best performance in terms of MSE. First, we describe how we define the adaptation step for these two strategies. In the ESLMS algorithm, we employ the adaptation strategy given by
where μ _{ k } is the step size for each node. In the ESRLS algorithm, we employ the following steps for the adaptation:
where λ is the forgetting factor. Then, we let
and
Following the adaptation step, we introduce the combination step for both the ESLMS and ESRLS algorithms, based on an exhaustive search strategy. At first, we introduce a tentative set Ω _{ k } using a combinatorial approach described by
where the set Ω _{ k } is a nonempty set with \(2^{\mathcal {N}_{k}}\) elements. After the tentative set Ω _{ k } is defined, we write the cost function (2) for each node as
where
is the local estimator and ψ _{ l }(i) is calculated through (7) or (11), depending on the algorithm, i.e., ESLMS or ESRLS. With different choices of the set Ω _{ k }, the combining coefficients c _{ kl } will be recalculated through (5), to ensure condition (6) is satisfied.
Then, we introduce the error pattern for each node, which is defined as
For each node k, the strategy that finds the best set Ω _{ k }(i) must solve the following optimization problem:
After all steps have been completed, the combination step in (4) is performed as described by
At this stage, the main steps of the ESLMS and ESRLS algorithms have been completed. The proposed ESLMS and ESRLS algorithms find the set \(\widehat {\Omega }_{k}(i)\) that minimizes the error pattern in (16) and (17) and then use this set of nodes to obtain ω _{ k }(i) through (18).
The ESLMS/ESRLS algorithms are briefly summarized as follows: Step 1 Each node performs the adaptation through its local information based on the LMS or RLS algorithm. Step 2 Each node finds the best set Ω _{ k }(i), which satisfies (17). Step 3 Each node combines the information obtained from its best set of neighbors through (18).
The details of the proposed ESLMS and ESRLS algorithms are shown in Algorithms 1 and 2. When the ESLMS and ESRLS algorithms are implemented in networks with a large number of small and low–power sensors, the computational complexity cost may become high, as the algorithm in (17) requires an exhaustive search and needs more computations to examine all the possible sets Ω _{ k }(i) at each time instant.
3.2 Sparsity–inspired LMS/RLS link selection
The ESLMS/ESRLS algorithms previously outlined need to examine all possible sets to find a solution at each time instant, which might result in high computational complexity for large networks operating in timevarying scenarios. To solve the combinatorial problem with reduced complexity, we propose the SILMS and SIRLS algorithms, which are as simple as standard diffusion LMS or RLS algorithms and are suitable for adaptive implementations and scenarios where the parameters to be estimated are slowly timevarying. The zeroattracting (ZA) strategy, RZA strategy, and zeroforcing (ZF) strategy are reported in [3] and [28] as for sparsityaware techniques. These approaches are usually employed in applications dealing with sparse systems in scenarios where they shrink the small values in the parameter vector to zero, which results in a better convergence rate and a steadystate performance. Unlike existing methods that shrink the signal samples to zero, the proposed SILMS and SIRLS algorithms shrink to zero the links that have poor performance or high MSE values. To detail the novelty of the proposed sparsityinspired LMS/RLS link selection algorithms, we illustrate the processing in Fig. 2.
Figure 2 a shows a standard type of sparsityaware processing. We can see that, after being processed by a sparsityaware algorithm, the nodes with small MSE values will be shrunk to zero. In contrast, the proposed SILMS and SIRLS algorithms will keep the nodes with lower MSE values and reduce the combining weight of the nodes with large MSE values as illustrated in Fig. 2 b. When compared with the EStype algorithms, the SILMS/RLS algorithms do not need to consider all possible combinations of nodes, which means that the SILMS/RLS algorithms have lower complexity. In the following, we will show how the proposed SILMS/SI–RLS algorithms are employed to realize the link selection strategy automatically.
In the adaptation step, we follow the same procedure in (7)–(11) as that of the ESLMS and ESRLS algorithms for the SILMS and SIRLS algorithms, respectively. Then, we reformulate the combination step. First, we introduce the logsum penalty into the combination step in (4). Different penalty terms have been considered for this task. We have adopted a heuristic approach [3, 29] known as reweighted zeroattracting strategy into the combination step in (4) because this strategy has shown an excellent performance and is simple to implement. The logsum penalty is defined as:
where the error \(e_{\textit {kl}}(i) (l\in \mathcal {N}_{k})\), which stands for the neighbor node l of node k including node k itself, is defined as
and ε is the shrinkage magnitude. Then, we introduce the vector and matrix quantities required to describe the combination step. We first define a vector c _{ k } that contains the combining coefficients for each neighbor of node k including node k itself as described by
Then, we define a matrix Ψ _{ k } that includes all the estimated vectors, which are generated after the adaptation step of SILMS and of SIRLS for each neighbor of node k including node k itself as given by
Note that the adaptation steps of SILMS and SIRLS are identical to (7) and (11), respectively. An error vector \(\hat {\boldsymbol e}_{k}\) that contains all error values calculated through (20) for each neighbor of node k including node k itself is expressed by
To devise the sparsityinspired approach, we have modified the vector \(\hat {\boldsymbol e}_{k}\) in the following way:

1.
The element with largest absolute value e _{ kl }(i) in \(\hat {\boldsymbol e}_{k}\) will be kept as e _{ kl }(i).

2.
The element with smallest absolute value will be set to −e _{ kl }(i). This process will ensure the node with smallest error pattern has a reward on its combining coefficient.

3.
The remaining entries will be set to zero.
At this point, the combination step can be defined as [29]
where \(c_{k,j}, \hat {e}_{k,j}\) stand for the jth element in the \(\boldsymbol c_{k}, \hat {\boldsymbol e}_{k}\), and ψ _{ k,j } stands for the jth column in Ψ _{ k }. The parameter ρ is used to control the algorithm’s shrinkage intensity. We then calculate the partial derivative of \(\hat {\boldsymbol e}_{k}[\!j]\):
To ensure that \(\sum \limits _{j=1}^{\mathcal {N}_{k}} \left (c_{k,j}\rho \frac {\partial f_{1}(\hat {e}_{k,j})}{\partial \hat {e}_{k,j}}\right)=1\), we replace \(\hat {e}_{k,j}\) with ξ _{min} in the denominator of (25), where the parameter ξ _{min} stands for the minimum absolute value of e _{ kl }(i) in \(\hat {\boldsymbol e}_{k}\). Then, (25) can be rewritten as
At this stage, the logsum penalty performs shrinkage and selects the set of estimates from the neighbor nodes with the best performance, at the combination step. The function sign(a) is defined as
Then, by inserting (26) into (24), the proposed combination step is given by
Note that the condition \(c_{k,j}\rho \varepsilon \frac {{\text {sign}}({\hat {e}_{k,j}}) }{1+\varepsilon \xi _{\text {min}}}\geq 0\) is enforced in (28). When \(c_{k,j}\rho \varepsilon \frac {{\text {sign}}({\hat {e}_{k,j}}) }{1+\varepsilon \xi _{\text {min}}}= 0\), it means that the corresponding node has been discarded from the combination step. In the following time instant, if this node still has the largest error, there will be no changes in the combining coefficients for this set of nodes.
To guarantee the stability, the parameter ρ is assumed to be sufficiently small and the penalty takes effect only on the element in \({\hat {\boldsymbol e}_{k}}\) for which the magnitude is comparable to 1/ε [3]. Moreover, there is little shrinkage exerted on the element in \({\hat {\boldsymbol e}_{k}}\) whose \(\hat {\boldsymbol e}_{k}[j]\ll 1/\varepsilon \). The SILMS and SIRLS algorithms perform link selection by the adjustment of the combining coefficients through (28). At this point, it should be emphasized that:

The process in (28) satisfies condition (6), as the penalty and reward amounts of the combining coefficients are the same for the nodes with maximum and minimum error, respectively, and there are no changes for the rest nodes in the set.

When computing (28), there are no matrix–vector multiplications. Therefore, no additional complexity is introduced. As described in (24), only the jth element of \(\boldsymbol c_{k}, \hat {\boldsymbol e}_{k}\) and jth column of Ψ _{ k } are used for calculation.
For the neighbor node with the largest MSE value, after the modifications of \(\hat {\boldsymbol e}_{k}\), its e _{ kl }(i) value in \(\hat {\boldsymbol e}_{k}\) will be a positive number which will lead to the term \(\rho \varepsilon \frac {{\text {sign}}({\hat {e}_{k,j}})}{1+\varepsilon \xi _{\text {min}}}\) in (28) being positive too. This means that the combining coefficient for this node will be shrunk and the weight for this node to build ω _{ k }(i) will be shrunk too. In other words, when a node encounters high noise or interference levels, the corresponding MSE value might be large. As a result, we need to reduce the contribution of that node.
In contrast, for the neighbor node with the smallest MSE, as its e _{ kl }(i) value in \(\hat {\boldsymbol e}_{k}\) will be a negative number, the term \(\rho \varepsilon \frac {{\text {sign}}({\hat {e}_{k,j}})}{1+\varepsilon \xi _{\text {min}}}\) in (28) will be negative too. As a result, the weight for this node associated with the smallest MSE to build ω _{ k }(i) will be increased. For the remaining neighbor nodes, the entry e _{ kl }(i) in \(\hat {\boldsymbol e}_{k}\) is zero, which means the term \(\rho \varepsilon \frac {{\text {sign}}({\hat {e}_{k,j}})}{1+\varepsilon \xi _{\text {min}}}\) in (28) is zero and there is no change for the weights to build ω _{ k }(i). The main steps for the proposed SILMS and SIRLS algorithms are listed as follows: Step 1 Each node carries out the adaptation through its local information based on the LMS or RLS algorithm. Step 2 Each node calculates the error pattern through (20). Step 3 Each node modifies the error vector \(\hat {\boldsymbol e}_{k}\). Step 4 Each node combines the information obtained from its selected neighbors through (28).
The SILMS and SIRLS algorithms are detailed in Algorithm 3. For the ESLMS/ESRLS and SILMS/SIRLS algorithms, we design different combination steps and employ the same adaptation procedure, which means the proposed algorithms have the ability to equip any diffusiontype wireless networks operating with other than the LMS and RLS algorithms. This includes, for example, the diffusion conjugate gradient strategy [30]. Apart from using weights related to the node degree, other signal dependent approaches may also be considered, e.g., the parameter vectors could be weighted according to the signaltonoise ratio (SNR) (or the noise variance) at each node within the neighborhood.
4 Analysis of the proposed algorithms
In this section, a statistical analysis of the proposed algorithms is developed, including a stability analysis and an MSE analysis of the steadystate and tracking performance. In addition, the computational complexity of the proposed algorithms is also detailed. Before we start the analysis, we make some assumptions that are common in the literature [22]. Assumption I: The weighterror vector ε _{ k }(i) and the input signal vector x _{ k }(i) are statistically independent, and the weighterror vector for node k is defined as
where ω _{0} denotes the optimum Wiener solution of the actual parameter vector to be estimated, and ω _{ k }(i) is the estimate produced by a proposed algorithm at time instant i.
Assumption II: The input signal vector x _{ l }(i) is drawn from a stochastic process, which is ergodic in the autocorrelation function [22].
Assumption III: The M×1 vector q(i) represents a stationary sequence of independent zero mean vectors and positive definite autocorrelation matrix \(\boldsymbol Q\,=\,\mathbb {E}\left [\boldsymbol q(i)\boldsymbol q^{H}(i)\right ]\), which is independent of x _{ k }(i), n _{ k }(i) and ε _{ l }(i).
Assumption IV (Independence): All regressor input signals x _{ k }(i) are spatially and temporally independent. This assumption allows us to consider the input signal x _{ k }(i) independent of \(\boldsymbol \omega _{l}(i), l\in \mathcal {N}_{k}\).
4.1 Stability analysis
In general, to ensure that a partially connected network performance can converge to the global network performance, the estimates should be propagated across the network [31]. The work in [14] shows that it is central to the performance that each node should be able to reach the other nodes through one or multiple hops [31].
To discuss the stability analysis of the proposed ESLMS and SILMS algorithms, we first substitute (7) into (18) and obtain
Then, we have
By employing Assumption IV, we start with (31) for the ESLMS algorithm and define the global vectors and matrices:
and the N M×1 vector
We also define an N×N matrix C where the combining coefficients {c _{ kl }} correspond to the {l,k} entries of the matrix C and the N M×N M matrix C _{ G } with a Kronecker structure:
where ⊗ denotes the Kronecker product.
By inserting \(e_{l}(i+1)=e_{0l}(i+1){\boldsymbol \varepsilon _{l}^{H}}(i)\boldsymbol x_{l}(i+1)\) into (31), the global version of (31) can then be written as
where e _{0−l }(i+1) is the estimation error produced by the Wiener filter for node l as described by
If we define
and take the expectation of (37), we arrive at
Before we proceed, let us define \(\boldsymbol X=\boldsymbol I\mathcal {\boldsymbol M}\mathcal {D}\). We say that a square matrix X is stable if it satisfies X ^{i}→0 as i→∞. A known result in linear algebra states that a matrix is stable if, and only if, all its eigenvalues lie inside the unit circle. We need the following lemma to proceed [9].
Lemma 1.
Let C _{ G } and X denote arbitrary N M×N M matrices, where C _{ G } has real, nonnegative entries, with columns adding up to one. Then, the matrix \(\boldsymbol Y=\boldsymbol {C_{G}^{T}}\boldsymbol X\) is stable for any choice of C _{ G } if, and only if, X is stable.
Proof.
Assume that X is stable, it is true that for every square matrix X and every α>0, there exists a submultiplicative matrix norm ·_{ τ } that satisfies X_{ τ }≤τ(X)+α, where the submultiplicative matrix norm A B≤A·B holds and τ(X) is the spectral radius of X [32, 33]. Since X is stable, τ(X)<1, and we can choose α>0 such that τ(X)+α=v<1 and X_{ τ }≤v<1. Then we obtain [9]
Since \(\boldsymbol {C_{G}^{T}}\) has nonnegative entries with columns that add up to one, it is elementwise bounded by unity. This means its Frobenius norm is bounded as well and by the equivalence of norms, so is any norm, in particular \(\left (\boldsymbol {C_{G}^{T}}\right)^{i}_{\tau }\). As a result, we have
so Y ^{i} converges to the zero matrix for large i. Therefore, Y is stable.
In view of Lemma 1 and (82), we need the matrix \(\boldsymbol I\mathcal {\boldsymbol M}\mathcal {D}\) to be stable. As a result, it requires I−μ _{ k } R _{ k } to be stable for all k, which holds if the following condition is satisfied:
where λ _{ max }(R _{ k }) is the largest eigenvalue of the correlation matrix R _{ k }. The difference between the ESLMS and SILMS algorithms is the strategy to calculate the matrix C. Lemma 1 indicates that for any choice of C, only X needs to be stable. As a result, SILMS has the same convergence condition as in (43). Given the convergence conditions, the proposed ESLMS/ESRLS and SILMS/SIRLS algorithms will adapt according to the network connectivity by choosing the group of nodes with the best available performance to construct their estimates.
4.2 MSE steadystate analysis
In this part of the analysis, we devise formulas to predict the excess MSE (EMSE) of the proposed algorithms. The error signal at node k can be expressed as
With Assumption I, the MSE expression can be derived as
where tr(·) denotes the trace of a matrix and \(\mathcal {J}_{mink}\) is the minimum mean square error (MMSE) for node k [22]:
\(\boldsymbol R_{k}(i)=\mathbb {E}\left [\boldsymbol x_{k}(i)\boldsymbol {x_{k}^{H}}(i)\right ]\) is the correlation matrix of the inputs for node k, \(\boldsymbol p_{k}(i)= \mathbb {E}\left [\boldsymbol x_{k}(i)d_{k}^{*}(i)\right ]\) is the crosscorrelation vector between the inputs and the measurement d _{ k }(i), and \(\boldsymbol K_{k}(i)=\mathbb {E}\left [\boldsymbol \varepsilon _{k}(i)\boldsymbol {\varepsilon _{k}^{H}}(i)\right ]\) is the weighterror correlation matrix. From [22], the EMSE is defined as the difference between the mean square error at time instant i and the minimum mean square error. Then, we can write
For the proposed adaptive link selection algorithms, we will derive the EMSE formulas separately based on (47) and we assume that the input signal is modeled as a stationary process.
4.2.1 ES–LMS
To update the estimate ω _{ k }(i), we employ
Then, subtracting ω _{0} from both sides of (48), we arrive at
Let us introduce the random variables α _{ kl }(i):
At each time instant, each node will generate data associated with network covariance matrices A _{ k } with size N×N which reflect the network topology, according to the exhaustive search strategy. In the network covariance matrices A _{ k }, a value equal to 1 means nodes k and l are linked and a value 0 means nodes k and l are not linked.
For example, suppose a network has 5 nodes. For node 3, there are two neighbor nodes, namely, nodes 2 and 5. Through Eq. (13), the possible configurations of set Ω _{3} are {3,2},{3,5}, and {3,2,5}. Evaluating all the possible sets for Ω _{3}, the relevant covariance matrices A _{3} with size 5×5 at time instant i are described in Fig. 3.
Then, the coefficients α _{ kl } are obtained according to the covariance matrices A _{ k }. In this example, the three sets of α _{ kl } are respectively shown in Table 1.
The parameters c _{ kl } will then be calculated through Eq. (5) for different choices of matrices A _{ k } and coefficients α _{ kl }. After α _{ kl } and c _{ kl } are calculated, the error pattern for each possible Ω _{ k } will be calculated through (16) and the set with the smallest error will be selected according to (17).
With the newly defined α _{ kl }, (49) can be rewritten as
Starting from (47), we then focus on K _{ k }(i+1).
In (51), the term α _{ kl }(i) is determined through the network topology for each subset, while the term c _{ kl }(i) is calculated through the Metropolis rule. We assume that α _{ kl }(i) and c _{ kl }(i) are statistically independent from the other terms in (51). Upon convergence, the parameters α _{ kl }(i) and c _{ kl }(i) do not vary because at steady state, the choice of the subset \(\widehat {\Omega }_{k}(i)\) for each node k will be fixed. Then, under these assumptions, substituting (51) into (52), we arrive at:
where \(\boldsymbol R_{l,q}(i+1)=\mathbb {E}\left [\!\boldsymbol x_{l}(i+1)\boldsymbol {x_{q}^{H}}(i+1)\right ]\) and \(\boldsymbol K_{l,q}(i)=\mathbb {E}\left [\!\boldsymbol \varepsilon _{l}(i)\boldsymbol {\varepsilon _{q}^{H}}(i)\right ]\). To further simplify the analysis, we assume that the samples of the input signal x _{ k }(i) are uncorrelated, i.e., \(\boldsymbol R_{k}=\sigma _{x,k}^{2}\boldsymbol I\) with \(\sigma _{x,k}^{2}\) being the variance. Using the diagonal matrices \(\boldsymbol R_{k}=\boldsymbol \Lambda _{k}=\sigma _{x,k}^{2}\boldsymbol I\) and R _{ l,q }=Λ _{ l,q }=σ _{ x,l } σ _{ x,q } I, we can write
Due to the structure of the above equations, the approximations, and the quantities involved, we can decouple (54) into
where \({K_{k}^{n}}(i+1)\) is the nth element of the main diagonal of K _{ k }(i+1). With the assumption that α _{ kl }(i) and c _{ kl }(i) are statistically independent from the other terms in (51), we can rewrite (55) as
By taking i→∞, we can obtain (57).
We assume that the choice of covariance matrix A _{ k } for node k is fixed upon the proposed algorithms convergence, as a result, the covariance matrix A _{ k } is deterministic and does not vary. In the above example, we assume the choice of A _{3} is fixed as shown in Fig. 4.
Then the coefficients α _{ kl } will also be fixed and given by
as well as the parameters c _{ kl } that are computed using the Metropolis combining rule. As a result, the coefficients α _{ kl } and the coefficients c _{ kl } are deterministic and can be taken out from the expectation. The MSE is then given by
4.2.2 SILMS
For the SILMS algorithm, we do not need to consider all possible combinations. This algorithm simply adjusts the combining coefficients for each node with its neighbors in order to select the neighbor nodes that yield the smallest MSE values. Thus, we redefine the combining coefficients through (28)
For each node k, at time instant i, after it receives the estimates from all its neighbors, it calculates the error pattern e _{ kl }(i) for every estimate received through Eq. (20) and finds the nodes with the largest and smallest errors. An error vector \( \hat {\boldsymbol e}_{k}\) is then defined through (23), which contains all error patterns e _{ kl }(i) for node k.
Then a procedure which is detailed after Eq. (23) is carried out and modifies the error vector \( \hat {\boldsymbol e}_{k}\). For example, suppose node 5 has three neighbor nodes, which are nodes 3,6, and 8. The error vector \(\hat {\boldsymbol e}_{5}\) has the form described by \( \hat {\boldsymbol e}_{5}=~\left [e_{53},e_{55},e_{56},e_{58}\right ]=~\left [0.023,0.052,0.0004,0.012\right ]\). After the modification, the error vector \( \hat {\boldsymbol e}_{5}\) will be edited as \( \hat {\boldsymbol e}_{5}=~\left [0,0.052,0.0004,0\right ]\). The quantity h _{ kl } is then defined as
and the term ‘error pattern’ e _{ kl } in (60) is from the modified error vector \( \hat {\boldsymbol e}_{k}\).
From [29], we employ the relation \(\mathbb {E}\, [\!\text {sign}(e_{\textit {kl}})]\approx \text {sign}(e_{0k})\). According to Eqs. (1) and (38), when the proposed algorithm converges at node k or the time instant i goes to infinity, we assume that the error e _{0−k } will be equal to the noise variance at node k. Then, the asymptotic value h _{ kl } can be divided into three situations due to the rule of the SILMS algorithm:
Under this situation, after the time instant i goes to infinity, the parameters h _{ kl } for each neighbor node of node k can be obtained through (61) and the quantity h _{ kl } will be deterministic and can be taken out from the expectation.
Finally, removing the random variables α _{ kl }(i) and inserting (59) and (60) into (57), the asymptotic values \({K_{k}^{n}}\) for the SILMS algorithm are obtained as in (62).
At this point, the theoretical results are deterministic, and the MSE for SILMS algorithm is given by
4.2.3 ESRLS
For the proposed ESRLS algorithm, we start from (11), after inserting (11) into (18), we have
Then, subtracting the ω _{0} from both sides of (48), we arrive at
Then, with the random variables α _{ kl }(i), (65) can be rewritten as
Since \(\boldsymbol k_{l}(i+1)=\boldsymbol \Phi ^{1}_{l}(i+1)\boldsymbol x_{l}(i+1)\) [22], we can modify (66) as
At this point, if we compare (67) with (51), we can find that the difference between (67) and (51) is that the \(\boldsymbol \Phi ^{1}_{l}(i+1)\) in (67) has replaced the μ _{ l } in (51). From [22], we also have
As a result, we can arrive
Due to the structure of the above equations, the approximations and the quantities involved, we can decouple (70) into
where \({K_{k}^{n}}(i+1)\) is the nth elements of the main diagonals of K _{ k }(i+1). With the assumption that, upon convergence, α _{ kl } and c _{ kl } do not vary, because at steady state, the choice of subset \(\widehat {\Omega }_{k}(i)\) for each node k will be fixed, we can rewrite (71) as (72). Then, the MSE is given by
On the basis of (72), we have that when i tends to infinity, the MSE approaches the MMSE in theory [22].
4.2.4 SIRLS
For the proposed SIRLS algorithm, we insert (59) into (72) and remove the random variables α _{ kl }(i), and following the same procedure as for the SILMS algorithm, we can obtain (74), where h _{ kl } and h _{ kq } satisfy the rule in (61). Then, the MSE is given by
In conclusion, according to (62) and (74), with the help of modified combining coefficients, for the proposed SItype algorithms, the neighbor node with lowest MSE contributes the most to the combination, while the neighbor node with the highest MSE contributes the least. Therefore, the proposed SItype algorithms perform better than the standard diffusion algorithms with fixed combining coefficients.
4.3 Tracking analysis
In this subsection, we assess the proposed ESLMS/RLS and SILMS/RLS algorithms in a nonstationary environment, in which the algorithms have to track the minimum point of the error performance surface [34, 35]. In the timevarying scenarios of interest, the optimum estimate is assumed to vary according to the model ω _{0}(i+1)=β ω _{0}(i)+q(i), where q(i) denotes a random perturbation [32] and β=1 in order to facilitate the analysis. This is typical in the context of tracking analysis of adaptive algorithms [22, 32, 36, 37].
4.3.1 ESLMS
For the tracking analysis of the ESLMS algorithm, we employ Assumption III and start from (48). After subtracting the ω _{0}(i+1) from both sides of (48), we obtain
Using Assumption III, we can arrive at
The first part on the right side of (77) has already been obtained in the MSE steadystate analysis part in Section 4 B. The second part can be decomposed as
The MSE is then obtained as
4.3.2 SILMS
For the SILMS recursions, we follow the same procedure as for the ESLMS algorithm and obtain
4.3.3 ESRLS
For the SIRLS algorithm, we follow the same procedure as for the ESLMS algorithm and arrive at
4.3.4 SIRLS
We start from (75), and after a similar procedure to that of the SILMS algorithm, we have
In conclusion, for timevarying scenarios, there is only one additional term \(M\sigma _{x,k}^{2}\text {tr}\{\boldsymbol Q\}\) in the MSE expression for all algorithms, and this additional term has the same value for all algorithms. As a result, the proposed SItype algorithms still perform better than the standard diffusion algorithms with fixed combining coefficients, according to the conclusion obtained in the previous subsection.
4.4 Computational complexity
In the analysis of the computational cost of the algorithms studied, we assume complexvalued data and first analyze the adaptation step. For both ESLMS/RLS and SILMS/RLS algorithms, the adaptation cost depends on the type of recursions (LMS or RLS) that each strategy employs. The details are shown in Table 2.
In the combination step, we analyze the computational complexity in Table 3. The overall complexity for each algorithm is summarized in Table 4. In the above three tables, t is the number of nodes chosen from \(\mathcal {N}_{k}\) and M is the length of the unknown vector ω _{0}. The proposed algorithms require extra computations as compared to the existing distributed LMS and RLS algorithms. This extra cost ranges from a small additional number of operations for the SILMS/RLS algorithms to a more significant extra cost that depends on \(\mathcal {N}_{k}\) for the ESLMS/RLS algorithms.
5 Simulations
In this section, we investigate the performance of the proposed link selection strategies for distributed estimation in two scenarios: wireless sensor networks and smart grids. In these applications, we simulate the proposed link selection strategies in both static and timevarying scenarios. We also show the analytical results for the MSE steadystate and tracking performances that we obtained in Section 4.
5.1 Diffusion wireless sensor networks
In this subsection, we compare the proposed ESLMS/ESRLS and SILMS/SIRLS algorithms with the diffusion LMS algorithm [2], the diffusion RLS algorithm [38], and the singlelink strategy [39] in terms of their MSE performance. A reducedcommunication diffusion LMS algorithm with a performance comparable or worse to the standard diffusion LMS algorithm, which has been reported in [40], may also be considered if a designer needs to reduce the required bandwidth.
The network topology is illustrated in Fig. 5, and we employ N=20 nodes in the simulations. The average node degree of the wireless sensor network is 5. The length of the unknown parameter vector ω _{0} is M=10, and it is generated as a complex random vector. The input signal is generated as x _{ k }(i)=[x _{ k }(i) x _{ k }(i−1) … x _{ k }(i−M+1)] and x _{ k }(i)=u _{ k }(i)+α _{ k } x _{ k }(i−1), where α _{ k } is a correlation coefficient and u _{ k }(i) is a white noise process with variance \(\sigma ^{2}_{u,k}= 1\alpha _{k}^{2}\), to ensure the variance of x _{ k }(i) is \(\sigma ^{2}_{x,k}= 1\). The x _{ k }(0) is defined as a Gaussian random number with zero mean and variance \(\sigma ^{2}_{x,k}\). The noise samples are modeled as circular Gaussian noise with zero mean and variance \(\sigma ^{2}_{n,k}\in [0.001,0.01]\). The step size for the diffusion LMS ESLMS and SILMS algorithms is μ=0.2. For the diffusion RLS algorithm, both ESRLS and SIRLS, the forgetting factor λ is set to 0.97 and δ is equal to 0.81. In the static scenario, the sparsity parameters of the SILMS/SIRLS algorithms are set to ρ=4×10^{−3} and ε=10. The Metropolis rule is used to calculate the combining coefficients c _{ kl }. The MSE and MMSE are defined as in (3) and (46), respectively. The results are averaged over 100 independent runs.
In Fig. 6, we can see that the ESRLS has the best performance for both steadystate MSE and convergence rate and obtains a gain of about 8 dB over the standard diffusion RLS algorithm. The SIRLS is worse than the ES–RLS but is still significantly better than the standard diffusion RLS algorithm by about 5 dB. Regarding the complexity and processing time, the SIRLS is as simple as the standard diffusion RLS algorithm, while the ESRLS is more complex. The proposed ESLMS and SILMS algorithms are superior to the standard diffusion LMS algorithm.
In the timevarying scenario, the sparsity parameters of the SILMS and SIRLS algorithms are set to ρ=6×10^{−3} and ε=10. The unknown parameter vector ω _{0} varies according to the firstorder Markov vector process:
where q(i) is an independent zero mean Gaussian vector process with variance \({\sigma ^{2}_{q}}= 0.01\) and β=0.9998.
Figure 7 shows that, similarly to the static scenario, the ESRLS has the best performance and obtains a 5 dB gain over the standard diffusion RLS algorithm. The SIRLS is slightly worse than the ESRLS but is still better than the standard diffusion RLS algorithm by about 3 dB. The proposed ESLMS and SILMS algorithms have the same advantage over the standard diffusion LMS algorithm in the timevarying scenario. Notice that in the scenario with large \(\mathcal {N}_{k}\), the proposed SItype algorithms still have a better performance when compared with the standard techniques.
To illustrate the link selection for the EStype algorithms, we provide Figs. 8 and 9. From these two figures, we can see that upon convergence, the proposed algorithms converge to a fixed selected set of links \(\widehat {\Omega }_{k}\).
5.2 MSE analytical results
The aim of this section is to validate the analytical results obtained in Section 4. First, we verify the MSE steadystate performance. Specifically, we compare the analytical results in (58), (63), (73) and (75) to the results obtained by simulations under different SNR values. The SNR indicates the input signal variance to noise variance ratio. We assess the MSE against the SNR, as shown in Figs. 10 and 11. For ESRLS and SIRLS algorithms, we use (73) and (75) to compute the MSE after convergence. The results show that the analytical curves coincide with those obtained by simulations, which indicates the validity of the analysis. We have assessed the proposed algorithms with SNR equal to 0, 10, 20, and 30 dB, respectively, with 20 nodes in the network. For the other parameters, we follow the same definitions used to obtain the network MSE curves in a static scenario. The details have been shown on the top of each subfigure in Figs. 10 and 11. The theoretical curves for ESLMS/RLS and SILMS/RLS are all close to the simulation curves.
The tracking analysis of the proposed algorithms in a timevarying scenario is discussed as follows. Here, we verify that the results in (79), (80), (81), and (82) of the subsection 4.3 can provide a means of estimating the MSE. We consider the same model as in (83), but with β set to 1. In the next examples, we employ N=20 nodes in the network and the same parameters used to obtain the network MSE curves in a timevarying scenario. A comparison of the curves obtained by simulations and by the analytical formulas is shown in Figs. 12 and 13. From these curves, we can verify that the gap between the simulation and analysis results are extraordinary small under different SNR values. The details of the parameters are shown on the top of each subfigure in Figs. 12 and 13.
5.3 Smart Grids
The proposed algorithms provide a costeffective tool that could be used for distributed state estimation in smart grid applications. In order to test the proposed algorithms in a possible smart grid scenario, we consider the IEEE 14bus system [41], where 14 is the number of substations. At every time instant i, each bus k,k=1,2,…,14, takes a scalar measurement d _{ k }(i) according to
where ω _{0}(i) is the state vector of the entire interconnected system and X _{ k }(ω _{0}(i)) is a nonlinear measurement function of bus k. The quantity n _{ k }(i) is the measurement error with mean equal to zero and which corresponds to bus k.
Initially, we focus on the linearized DC state estimation problem. The state vector ω _{0}(i) is taken as the voltage phase angle vector ω _{0} for all busses. Therefore, the nonlinear measurement model for state estimation (84) is approximated by
where x _{ k }(i) is the measurement Jacobian vector for bus k. Then, the aim of the distributed estimation algorithm is to compute an estimate of ω _{0}, which can minimize the cost function given by
We compare the proposed algorithms with the MCSE algorithm [4], the singlelink strategy [39], the standard diffusion RLS algorithm [38], and the standard diffusion LMS algorithm [2] in terms of MSE performance. The MSE comparison is used to determine the accuracy of the algorithms and compare the rate of convergence. We define the IEEE 14bus system as in Fig. 14.
All busses are corrupted by additive white Gaussian noise with variance \(\sigma ^{2}_{n,k}\in \,[\!0.001,0.01]\). The step size for the standard diffusion LMS [2], the proposed ESLMS, and SILMS algorithms is 0.15. The parameter vector ω _{0} is set to an allone vector. For the diffusion RLS, ESRLS, and SIRLS algorithms, the forgetting factor λ is set to 0.945 and δ is equal to 0.001. The sparsity parameters of the SILMS/RLS algorithms are set to ρ=0.07 and ε=10. The results are averaged over 100 independent runs. We simulate the proposed algorithms for smart grids under a static scenario.
From Fig. 15, it can be seen that ESRLS has the best performance and significantly outperforms the standard diffusion LMS [2] and the \(\mathcal {M}\)–\(\mathcal {CSE}\) [4] algorithms. The ESLMS is slightly worse than the ESRLS, which outperforms the remaining techniques. The SIRLS is worse than the ESLMS but is still better than SILMS, while the SILMS remains better than the diffusion RLS, LMS, and \(\mathcal {M}\)\(\mathcal {CSE}\) algorithms and the singlelink strategy.
6 Conclusions
In this paper, we have proposed the ESLMS/RLS and SILMS/RLS algorithms for distributed estimation in applications such as wireless sensor networks and smart grids. We have compared the proposed algorithms with existing methods. We have also devised analytical expressions to predict their MSE steadystate performance and tracking behavior. Simulation experiments have been conducted to verify the analytical results and illustrate that the proposed algorithms significantly outperform the existing strategies, in both static and timevarying scenarios, in examples of wireless sensor networks and smart grids.
References
CG Lopes, AH Sayed, Incremental adaptive strategies over distributed networks. IEEE Trans. Signal Process. 48(8), 223–229 (2007).
CG Lopes, AH Sayed, Diffusion leastmean squares over adaptive networks: Formulation and performance analysis. IEEE Trans. Signal Process. 56(7), 3122–3136 (2008).
Y Chen, Y Gu, AO Hero, in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing. Sparse LMS for system identification, (2009), pp. 3125–3128.
L Xie, DH Choi, S Kar, HV Poor, Fully distributed state estimation for widearea monitoring systems. IEEE Trans. Smart Grid. 3(3), 1154–1169 (2012).
YH Huang, S Werner, J Huang, VG N. Kashyap, State estimation in electric power grids: meeting new challenges presented by the requirements of the future grid. IEEE Signal Process. Mag. 29(5), 33–43 (2012).
D Bertsekas, A new class of incremental gradient methods for least squares problems. SIAM J. Optim. 7(4), 913–926 (1997).
A Nedic, D Bertsekas, Incremental subgradient methods for nondifferentiable optimization. SIAM J. Optim. 12(1), 109–138 (2001).
MG Rabbat, RD Nowak, Quantized incremental algorithms for distributed optimization. IEEE J. Sel. Areas Commun. 23(4), 798–808 (2005).
FS Cattivelli, AH Sayed, Diffusion LMS strategies for distributed estimation. IEEE Trans. Signal Process. 58, 1035–1048 (2010).
PD Lorenzo, S Barbarossa, AH Sayed, in Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing. Sparse diffusion LMS for distributed adaptive estimation, (2012), pp. 3281–3284.
G Mateos, ID Schizas, GB Giannakis, Distributed Recursive LeastSquares for ConsensusBased InNetwork Adaptive Estimation. IEEE Trans. Signal Process. 57(11), 4583–4588 (2009).
R Arablouei, K Doǧançay, S Werner, YF Huang, Adaptive distributed estimation based on recursive leastsquares and partial diffusion. IEEE Trans. Signal Process. 62, 3510–3522 (2014).
R Arablouei, S Werner, YF Huang, K Doǧançay, Distributed least mean–square estimation with partial diffusion. IEEE Trans. Signal Process. 62, 472–484 (2014).
CG Lopes, AH Sayed, in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing. Diffusion adaptive networks with changing topologies (Las Vegas, 2008), pp. 3285–3288.
B Fadlallah, J Principe, in Proc. IEEE International Joint Conference on Neural Networks. Diffusion leastmean squares over adaptive networks with dynamic topologies, (2013), pp. 1–6.
SY Tu, AH Sayed, On the influence of informed agents on learning and adaptation over networks. IEEE Trans. Signal Process. 61, 1339–1356 (2013).
T Wimalajeewa, SK Jayaweera, Distributed node selection for sequential estimation over noisy communication channels. IEEE Trans. Wirel. Commun. 9(7), 2290–2301 (2010).
RC de Lamare, R SampaioNeto, Adaptive reducedrank processing based on joint and iterative interpolation, decimation and filtering. IEEE Trans. Signal Process. 57(7), 2503–2514 (2009).
RC de Lamare, PSR Diniz, Setmembership adaptive algorithms based on timevarying error bounds for CDMA interference suppression. IEEE Trans. Vehi. Techn. 58(2), 644–654 (2009).
L Guo, YF Huang, Frequencydomain setmembership filtering and its applications. IEEE Trans. Signal Process. 55(4), 1326–1338 (2007).
A Bertrand, M Moonen, Distributed adaptive node–specific signal estimation in fully connected sensor networks–part II: simultaneous and asynchronous node updating. IEEE Trans. Signal Process. 58(10), 5292–5306 (2010).
S Haykin, Adaptive Filter Theory, 4th edn. (Prentice Hall, Upper Saddle River, NJ, USA, 2002).
L Li, JA Chambers, in Proc. IEEE/SP 15th Workshop on Statistical Signal Processing. Distributed adaptive estimation based on the APA algorithm over diffusion networks with changing topology, (2009), pp. 757–760.
X Zhao, AH Sayed, Performance limits for distributed estimation over LMS adaptive networks. IEEE Trans. Signal Process. 60(10), 5107–5124 (2012).
L Xiao, S Boyd, Fast linear iterations for distributed averaging. Syst. Control Lett. 53(1), 65–78 (2004).
R OlfatiSaber, RM Murray, Consensus problems in networks of agents with switching topology and timedelays. IEEE Trans. Autom. Control. 49, 1520–1533 (2004).
A Jadbabaie, J Lin, AS Morse, Coordination of groups of mobile autonomous agents using nearest neighbor rules. IEEE Trans. Autom. Control. 48(6), 988–1001 (2003).
R Meng, RC de Lamare, VH Nascimento, in Proc. Sensor Signal Processing for Defence. Sparsityaware affine projection adaptive algorithms for system identification (London, UK, 2011).
Y Chen, Y Gu, A Hero, Regularized leastmeansquare algorithms. Tech. Rep. AFOSR (2010).
S Xu, RC de Lamare, in Proc. Sensor Signal Processing for Defence. Distributed conjugate gradient strategies for distributed estimation over sensor networks (London, UK, 2012).
F Cattivelli, AH Sayed, Diffusion strategies for distributed Kalman filtering and smoothing. IEEE Trans. Autom. Control. 55(9), 2069–2084 (2010).
AH Sayed, Fundamentals of adaptive filtering (John Wiley&Sons, Hoboken, NJ, USA, 2003).
T Kailath, AH Sayed, B Hassibi, Linear Estimation (PrenticeHall, Englewood Cliffs, NJ, USA, 2000).
RC de Lamare, PSR Diniz, Blind adaptive interference suppression based on setmembership constrained constantmodulus algorithms with dynamic bounds. IEEE Trans. Signal Process. 61(5), 1288–1301 (2013).
Y Cai, RC de Lamare, Lowcomplexity variable stepsize mechanism for codeconstrained constant modulus stochastic gradient algorithms applied to CDMA interference suppression. IEEE Trans. Signal Process. 57(1), 313–323 (2009).
B Widrow, SD Stearns, Adaptive signal processing (PrenticeHall, Englewood Cliffs, NJ, USA, 1985).
E Eweda, Comparison of RLS, LMS, and sign algorithms for tracking randomly timevarying channels. IEEE Trans. Signal Process. 42, 2937–2944 (1994).
FS Cattivelli, CG Lopes, AH Sayed, Diffusion recursive leastsquares for distributed estimation over adaptive networks. IEEE Trans. Signal Process. 56(5), 1865–1877 (2008).
X Zhao, AH Sayed, in Proc. IEEE International Conference on Acoustics, Speech and Signal Processing. Singlelink diffusion strategies over adaptive networks, (2012), pp. 3749–3752.
R Arablouei, S Werner, K Doǧançanay, YF Huang, Analysis of a reducedcommunication diffusion LMS algorithm. Signal Processing. 117, 355–361 (2015).
A Bose, Smart transmission grid applications and their supporting infrastructure. IEEE Trans. Smart Grid. 1(1), 11–19 (2010).
Acknowledgements
This research was supported in part by the US National Science Foundation under Grants CCF1420575, CNS1456793, and DMS1118605.
Part of this work has been presented at the 2013 IEEE International Conference on Acoustics, Speech, and Signal Processing, Vancouver, Canada and 2013 IEEE International Workshop on Computational Advances in MultiSensor Adaptive Processing, Saint Martin.
The authors wish to thank the anonymous reviewers, whose comments and suggestions have greatly improved the presentation of these results.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License(http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
About this article
Cite this article
Xu, S., de Lamare, R.C. & Poor, H.V. Adaptive link selection algorithms for distributed estimation. EURASIP J. Adv. Signal Process. 2015, 86 (2015). https://doi.org/10.1186/s1363401502724
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1363401502724