- Open Access
TSaT-MUSIC: a novel algorithm for rapid and accurate ultrasonic 3D localization
EURASIP Journal on Advances in Signal Processing volume 2011, Article number: 101 (2011)
We describe a fast and accurate indoor localization technique using the multiple signal classification (MUSIC) algorithm. The MUSIC algorithm is known as a high-resolution method for estimating directions of arrival (DOAs) or propagation delays. A critical problem in using the MUSIC algorithm for localization is its computational complexity. Therefore, we devised a novel algorithm called Time Space additional Temporal-MUSIC, which can rapidly and simultaneously identify DOAs and delays of mul-ticarrier ultrasonic waves from transmitters. Computer simulations have proved that the computation time of the proposed algorithm is almost constant in spite of increasing numbers of incoming waves and is faster than that of existing methods based on the MUSIC algorithm. The robustness of the proposed algorithm is discussed through simulations. Experiments in real environments showed that the standard deviation of position estimations in 3D space is less than 10 mm, which is satisfactory for indoor localization.
In recent years, localization techniques have attracted considerable attention in ubiquitous computing communities.There have been many studies on localizing objects by using ultrasonic signals; for example, indoor positioning [1–3] or robotics [4, 5]. There are several requirements for localization techniques, including accuracy, robustness, and ease of deployment.
We propose a new localization technique using the Time Space additional Temporal MUSIC (TSaT-MUSIC) algorithm, a variant of the MUltiple SIgnal Classification (MUSIC) algorithm . The principle advantage of the TSaT-MUSIC algorithm is its low computational complexity compared with other variants of the MUSIC algorithm.
The MUSIC algorithm is a well-known method for direction of arrival (DOA) or propagation delay estimations. As the algorithm conducts null steering of incoming waves, it shows higher resolution than the main beam steering methods such as the delay and sum beamforming methods. There have been many studies on 3D localization using MUSIC algorithm; for example, . The Spatial-MUSIC (S-MUSIC) algorithm, which is just called the MUSIC algorithm, is used for DOA estimations. Another variant of the MUSIC algorithm called Temporal-MUSIC (T-MUSIC) offers propagation delay estimates. By using these algorithms, we can identify either the DOA or the delay but not both simultaneously.
To estimate the DOA and delay simultaneously using these algorithms, two main famous approaches have been proposed. The first applies the MUSIC algorithm to spatial- and frequency-domain data at the same time; for example, 2D-MUSIC , 2D-TDM MUSIC , and JADE-MUSIC . This approach conducts a 2D search of angle and time. Thus, its computational complexity becomes very large. The second approach integrates other DOA or delay estimation methods with the MUSIC algorithm, such as . For instance, TST-MUSIC  uses beamforming and temporal filtering methods. Compared with the first approach, the second approach has less computational complexity. However, it still requires high computation times, because the computational complexity increases in proportion to the number of incoming waves.
Our proposed algorithm can estimate DOA and delay values simultaneously in an entirely different manner from the existing approaches. The procedure of the TSaT-MUSIC algorithm is as follows. First, sets of DOA and delay values are estimated using the S-MUSIC and T-MUSIC algorithms, respectively. Next, the true pairs of DOA and delay values are decided by applying the T-MUSIC algorithm at a sensor different from the sensor used in the first step. As a result, we can estimate DOAs and delays with only three MUSIC algorithm executions. The original TSaT-MUSIC algorithm is for DOA-delay estimation in a 2D space and can easily be extended to a localization method in a 3D space.
One advantageous point of MUSIC algorithms used for 3D localization is that we can design a compact receiver array. In this study, a small L-shaped receiver array (about 36 mm × 36 mm) is implemented to evaluate the performance of the TSaT-algorithm for 3D localization.
The objective of this paper is to prove that the proposed method reduces the computational complexity of sound source localization and still retains the satisfactory level of accuracy. Thus, we conduct comparative evaluations using the TST-MUSIC algorithm, which is one of the fastest and most accurate localization methods using MUSIC algorithms.
In this paper, a brief introduction of the MUSIC algorithm is first presented. then, the proposed algorithm and its 3D localization method are explained. Subsequently, the results of computer simulations, and experiments in real environments using the TSaT-MUSIC algorithm are reported.
2 The MUSIC algorithm
2.1 Data model
First, we define the data model that is adopted in this paper. Figure 1 shows the configuration of a sensor array. We assume that the transmitted signal consists of multicarrier ultrasonic waves and that a linear sensor array is used. The numbers of sensors and frequencies are defined as K and M, respectively. By using the Fourier transform for received signals at each sensor, we obtain a received data matrix X. The dimension of X is K × M. We define the received data for the mth frequency at the k th sensor as xk,m, so X can be written as:
Then, two received data vectors can be defined. A vector S m (m = 1, 2,..., M) is the received data vector at the mth frequency, and a vector T k (k = 1, 2,..., K) is the data received at the k th sensor. Thus, S m and T k can be expressed as:
where the superscript [·]Tdenotes the matrix transpose operation. Next, we introduce the mode vector a m (θ l ) (m = 1, 2,..., M), where θl is the angle of the l th wave. a m (θ l ) is defined as:
Ψm,k(θ l ) (k = 1,2,...,K) is the phase of the l th wave of the m th frequency at the k th sensor and is expressed as:
where c is the velocity of sound, f m is the m th frequency, and d k is the distance between the k th sensor and the 1st sensor (as shown in Figure 1). Assuming that the receiving waves are plane waves, S m can be written as:
where F l is the complex amplitude of the l th wave, and N is the Gaussian noise vector with zero means and equal variances σ2.
Similarly, we introduce a new mode vector g k (τ l ) (k = 1, 2,..., K), where τ l is the propagation delay time of the lth wave. g k is defined as:
By using g k , T k can be written as:
where G k is:
2.2 The S-MUSIC algorithm
The S-MUSIC algorithm is for DOA estimation. This algorithm is used with single-frequency signals. By Equation (1), the correlation matrix calculated using Sm is given as:
where the superscript [·]Hdenotes the Hermitian operation. The eigenvectors of Rss are the orthogonal direct sum of the signal subspace and the noise subspace. Assuming that the incoming waves are incoherent and that the value of L is smaller than that of K, we can derive the MUSIC spectrum by using the eigenvectors u i (i = L + 1,..., K) that span the noise subspace of Rss. The MUSIC spectrum can be written as:
The DOAs can be obtained as the peak values of Ps(θ) by changing the angle θ. As can be seen in Equation (3), the number of incoming waves L is given. If L is unknown, Akaike Information Criteria (AIC) or Minimum Description Length (MDL)  can be used to estimate L. When the incoming waves are coherent, the S-MUSIC Algorithm does not work properly. Therefore, spatial smoothing preprocessing (SSP)  is used to suppress the coherence.
2.3 The T-MUSIC algorithm
The T-MUSIC algorithm is for propagation delay estimations. It differs from the S-MUSIC algorithm in that the T-MUSIC algorithm uses only one sensor and multiple-frequency waves. We therefore use a received data vector T k .
Considering the Equation (2), the form of this equation corresponds to that of Equation (1). Thus, we can derive the MUSIC spectrum of propagation delays Pt(τ) in the same way as in the S-MUSIC algorithm. When the eigenvectors of the correlation matrix calculated using T k are defined as v i (i = 1, 2,..., M), Pt(τ) can be described as:
The propagation delays are obtained by finding the peak values of Pt(τ) in the same way as in the S-MUSIC algorithm.
When the bandwidth of the multicarrier waves is f d , the T-MUSIC algorithm can estimate a delay time to an accuracy of 1/f d .
3 The TSaT-MUSIC algorithm
By applying the T-MUSIC and S-MUSIC algorithms to L incoming waves at sensor A in the sensor array their DOA and propagation delay values are described as (θ1, θ2,..., θL) and (τ1, τ2,..., τ L ) as shown in Figure 2. By applying T-MUSIC again at sensor B in the same sensor array, propagation delays can be estimated as (D1, D2,..., D L ). The path length of the l th incoming wave arriving at sensor A is d sin θ l /c longer than that of the wave arriving at sensor B, where d is the distance between the two sensors. Therefore, we can plot L2 points as possible DOA-delay pairs in the (d sin θ, cτ) space. These points are called "candidate points". Here, the following equation must be fulfilled:
We define the Equation (5) drawn in the (d sin θ, cτ) space as "path difference lines". Theoretically, there can be only one point that represents a correct DOA-delay pair on each line. In the situation shown in Figure 3, for example, the pair of DOA and delay values are estimated as (θ1, τ2), (θ2, τ3), (θ3,τ1).
In real environments, however, the correct point is not always on the line because of noise. Hence, we calculate the distance dist(i,j,l) between each candidate point (d sin θ i , cτ j ) and the path different line cτ - d sin θ = cD l as:
Then, the points with the minimum distance are selected as true points.
3.2 3D localization using the TSaT-MUSIC algorithm
The TSaT-MUSIC algorithm allows us to simultaneously obtain the DOA and delay values in a 2D space. By using an L-shaped ultrasonic sensor array as shown in Figure 4, TSaT-MUSIC can be extended to a 3D localization algorithm.
We can estimate two angles, θ a and θ b , and one time delay τ c by using two sensor arrays Aa and Ab, and the sensor Sc, respectively. The pairs of θ a and τ c , and θ b and τ c can be decided by TSaT-MUSIC. As shown in Figure 5, the position of the transmitter from Sc is described as:
Hence, we can estimate the transmitter's position by using the TSaT-MUSIC algorithm.
3.3 Computational complexity
The procedure of the TSaT-MUSIC algorithm includes one S-MUSIC calculation and two T-MUSIC calculations. The computational complexity of the S-MUSIC algorithm can be written as max (O (K3), O (hK2)), where h is the number of searches conducted along the DOA axis, O (K3) is the computational complexity of the eigenvalue decomposition of Rss, and O (hK2) is that of the 1D spatial search. In the same way, the computational complexity of T-MUSIC can be expressed as max (O (M3), O (htM2)), where h t is the number of searches conducted along the time delay axis. Because K is generally smaller than M, the computational complexity of the TSaT-MUSIC algorithm is given bymax(O(M3),O(htM2)).
On the other hand, the computational complexity of the 2D-MUSIC algorithm is max (O ((KM)3), O (hht(KM)2)) and that of the TST-MUSIC algorithm is max (O (LM3), O (LhtM2)). This means that the TST-MUSIC algorithm must perform the T-MUSIC calculation at least L times. Consequently our proposed algorithm is theoretically faster than the existing method using the MUSIC algorithm.
4.1 Simulation setting
We conducted two computer simulations using a PC (Dell Latitude D630, CPU: Intel(R) Core2Duo 2.60 GHz, Memory: 2.0 GB) and GNU Octave 3.0.1. The transmitted multicarrier ultrasonic wave has six subcarriers that are orthogonal to each other. The multicarrier wave x(t) can be expressed as:
where N is the number of subcarriers (here, N = 6), f0 is the center frequency, Δf is the interval of the subcarriers, a i is the amplitude of the i th carrier, and ϕ i is its initial phase. In this simulation, all the subcarriers have the same amplitude, and their initial phases are given so that the transmitted wave has a peak amplitude at the half time of the transmission period (0.5 ms). The frequencies of the subcarriers are 34-39 kHz (their interval was 1 kHz). Because the bandwidth of the wave was 5 kHz, the theoretical time resolution was 0.2 ms. In the simulations, DOA-delay estimations in the 2D space were conducted using a linear array sensor consisting of 16 receiver sensors at 5-mm intervals. The SNR (Signal Noise Ratio) of the multicarrier wave is set to 20 dB by adding Gaussian noise.
As we plan to use the TSaT-MUSIC algorithm for rapid ultrasonic imaging by detecting reflectors, all sound sources transmit the same signal in this simulation. Therefore, receiving waves at a receiver array become coherent. To control the effect of the coherence, we use the spatial smoothing method  in S-MUSIC and T-MUSIC algorithm, respectively. In 2D localization simulations, the number of sensors in a subarray (K), the number of frequencies (M), and the number of searches conducted along the time delay axis (h t ) were set to 11, 15, and 1,000, respectively.
From the principle of the TSaT-MUSIC algorithm as described in the previous section, its angular and range resolutions are same as those of the 1D S-MUSIC and T-MUSIC algorithms, respectively. Therefore, comparative evaluations between the proposed method and the TST-MUSIC algorithm are conducted through computer simulations shown in this section and experiments in real environments shown in the next section.
4.2 Computational complexity and accuracy
The DOA and delay values were set as shown in Table 1 by changing the number (L) of incoming waves. The simulations of the TSaT-MUSIC and TST-MUSIC algorithms for each L were conducted 1,000 times, and their average computation times and values of the root mean square error (RMSE) were measured. Figure 6a shows the simulation results of the computation times. From the figure, we find that the TSaT-MUSIC algorithm can estimate DOAs and delays in almost a constant time. On the other hand, the computation time of the TST-MUSIC algorithm increases linearly as L increases. This is consistent with the theory discussed in Section 3.3. Therefore, the computational complexity of the TSaT-MUSIC algorithm is proved to be less than that of the TST-MUSIC algorithm. Figure 6b shows the simulation results of the RMSE. These values were calculated by estimated positions of a sound source at (-60°, 0.6 ms). From the figure, we find that the values of RMSE using the TSaT-MUSIC algorithm is higher than that using TST-MUSIC algorithm regardless of the number of waves. However, all the RMSE values of the TSaT-MUSIC algorithm are less than 6 mm, which indicates the satisfactory level of accuracy.
When positions of ultrasonic transmitters change, two or more candidate points become close to a path difference line. Figure 7 shows that two candidate points almost lie on a path difference line, when transmitters are placed at points (125.7,713.0), (-939.5, 341.9), and (746.38,430.9) (unit: mm). In order to investigate the robustness of the TSaT-MUSIC algorithm in such situations, simulations were conducted by setting SNRs between 0 and 50-dB at 5-dB intervals. Probabilities of selecting a true point were calculated through simulations conducted 100 times for each SNR as shown in Figure 8. The figure demonstrates that the probabilities are 30 to 40% when the SNRs are lower than 30 dB. However, when they are 30 dB or higher, the probabilities are almost 100%. We are now investigating the reason why the performance of the proposed algorithm deteriorates when the SNR is lower than 30 dB. At the moment, we suppose that it is due to the effects of the coherence between receiving signals. When the SNR is higher than 30 dB, the effects of the coherence are controlled and the proposed algorithm retains higher probabilities of selecting true points.
4.4 3D localization simulations
In this simulation, the L-shaped sensor array consisting of 15 receiver sensors at 5-mm intervals was used. The same signals were transmitted from transmitters, and the spatial smoothing method was applied in the same way as in the 2D localization simulations. The SNR was set to 20 dB. Because the L-shaped sensor array had 8 sensors on each side, the number of waves which could be classified was up to 4. Hence, the number of transmitters was set to 3.
The transmitters were placed at points Ta (800, -300, 400), Tb (0, 200, 2,000), and Tc (-900, -850, 700) (unit: mm). The L-shaped sensor was placed in the x-y plane in the same way as in Figure 5. The average and standard deviations of the transmitters' positions were calculated for 25 simulations.
The results of the simulations are shown in Table 2. They show that the TSaT-MUSIC algorithm selected correct pairs of DOA and delay values. Differences between the true and estimated positions came from errors in the S-MUSIC or T-MUSIC algorithms.
5.1 Configuration of experimental system
The configuration of the experimental system is shown in Figure 9. The signal processing board includes A/D converters and an operational amplifier. First, the PC receives the trigger signal that is sent by the signal processing board.
Next, the waveform generator (ADLINK DAQe-2501) creates signals that are sent to the ultrasonic transmitters (PIONEER PT-R4, Figure 10a) through the amplifier. The ultrasonic wave is transmitted from the transmitter to the receiver sensor array, where 15 ultrasonic sensors (SPM0204UD5 from Knowles, Figure 10b) are arranged in an L-shaped manner (the interval between sensors is 5 mm) for 3D localization experiments. Finally, the signals received at the ultrasonic receiver are sent to the PC through the signal processing board. The parameters of the ultrasonic waves used in this experiment (such as frequencies and phases of subcarriers) were the same as those used in the computer simulations.
5.2 3D localization using TSaT-MUSIC
3D localization experiments in real environments were conducted by using the TSaT-MUSIC algorithm to estimate the positions of three ultrasonic transmitters. These transmitters were set at the same positions as in the simulations in Section 4.
The measured average and standard deviation values of the ultrasonic transmitters' positions were obtained as shown in Table 3. All standard deviation values were less than 10 mm, proving that the accuracy of the proposed algorithm was satisfactory for indoor 3D localization. The differences between the true positions and calculated average positions were larger in the real experiments than in the computer simulations. One reason for this was inaccurate placement of the transmitters and receivers. Sensor characteristics such as directivity might also affect the performance of the 3D localization. The other reasons for this performance deterioration in real experiments seemed related to the attenuation of the transmitted signals or multipath problems that were not taken into account in the simulations. To improve the accuracy of the proposed algorithm, intensive investigations through further experiments are necessary.
5.3 Comparisons with TST-MUSIC
Through experiments in real environment, we compared TSaT-MUSIC with TST-MUSIC in terms of RMSE values and computation times. Because TST-MUSIC algorithm is 2D localization algorithm, we conducted 2D localization experiment.
In the experiments, we used a linear sensor array including 16 receiver sensors arranged at 5-mm intervals. The other experimental settings were same as the 3D localization experiments described in this section. The localization measurements were taken 25 times. The transmitters were placed at points Ta(-300, 300), Tb(0, 1,000), and Tc(1,000, 800) (unit: mm), respectively. The measured values of RMSE are shown in Table 4. From this table, it is found that the accuracy differences between TSaT-MUSIC and TST-MUSIC are not so remarkable. In comparison with the simulation results in Section 4, the RMSE values of TSaT-MUSIC and TST-MUSIC became worse. This deterioration was presumably caused by the same reasons as discussed in the 3D localization experiment. As for the computation time, it was confirmed that the TSaT-MUSIC algorithm was 1.8 times faster than the TST-MUSIC algorithm. Thus, the experiments indicated that TSaT-MUSIC was smaller than TST-MUSIC in their computational complexity and still retains the satisfactory level of localization accuracy.
6 Conclusions and future work
We have proposed a new DOA-delay estimation algorithm called the TSaT-MUSIC algorithm. The remarkable feature of the algorithm is its small computational complexity compared with existing algorithms based on the MUSIC algorithm. This feature was proved through computer simulations. Moreover, the 3D localization technique using the TSaT-MUSIC algorithm was verified to show its satisfactory accuracy using computer simulations and experiments in real environments. There are several remaining issues to be investigated. Improving the performance of 3D localization using the proposed algorithm is one of the most important future tasks. Another important task is to improve the robustness of the TSaT-MUSIC algorithm when a true point is not clearly identified due to placements of transmitters and low SNRs. We also plan to develop applications using our 3D localization technique, such as indoor positioning and robot navigation systems.
Priyantha NB, Chakraborty A, Balakrishnan H: The cricket location-support system. In MobiCom '00: Proceedings of the 6th annual international conference on Mobile computing and networking. ACM, New York; 2000:32-43.
Qiu W: Application of the Location and Tracking System Based on Cricket, volume 106 of Communications in Computer and Information Science. Springer, Berlin; 2010.
Woodman OJ, Harle RK: Concurrent scheduling in the active bat location system. Pervasive Computing and Communications Workshops (PER-COM Workshops), 2010 8th IEEE International Conference on 2010, 431-437.
Zhu H, Inubushi H, Takahashi N, Taniguchi K: An ultrasonic 3D image sensor employing PN code. Sensors 2006 5th IEEE Conference on 2006, 319-322.
Nishihara K, Yamaguchi T, Hachiya H: Position detection of small objects in indoor environments using coded acoustic signal. Acoust Sci Technol 2008,29(1):15-20. 10.1250/ast.29.15
Schmidt R: Multiple emitter location and signal parameter estimation. IEEE Trans Antennas Propag 1986,34(3):276-280. 10.1109/TAP.1986.1143830
Yong W, Ping Z, Lifang L, Linjing W, Qianqian J, Wei W: An acoustic array imaging algorithm for 3d display based on mimo and music location fusion. Computer Application and System Modeling (ICCASM), 2010 International Conference on 2010, 9: V9-107-V9-110.
Ogawa Yasutaka, Hamaguchi Norihiro, Ohshima Kohzoh, Itoh Kiyohiko: High-Resolution Analysis of Indoor Multipath Propagation Structure. IE-ICE TRANSACTIONS on Communications 1995,E78-B(11):1450-1457.
Yasuhiko T, Yasutaka O, Takeo O: High-resolution estimation of multipath propagation based on the 2D-MUSIC algorithm using time-domain signals. IEICE Trans Commun 2000,83(4):407-415.
Vanderveen MC: Joint angle and delay estimation (JADE) for multipath signals arriving at an antenna array. IEEE Commun Lett 1997.,1(12):
Fujita A, Fukue T, Hamada N: Both direction and time of arrival estimation by using beamforming and MUSIC algorithm for stepped FM array radar. Circuits and Systems 2004 MWSCAS '04 The 2004 47th Midwest Symposium on 2004, 2: II-85-II-88.
Wang YY, Chen JT, Fang WH: TST-MUSIC for joint DOA-delay estimation. IEEE Trans Signal Process 2001,49(4):721-729. 10.1109/78.912916
Wax M, Kailath T: Detection of signals by information theoretic criteria. IEEE Trans Acoust Speech Signal Process 1985,33(2):387-392. 10.1109/TASSP.1985.1164557
Shan TJ, Wax M, Kailath T: On spatial smoothing for direction-of-arrival estimation of coherent signals. IEEE Trans Acoust Speech Signal Process 1985,33(4):806-811. 10.1109/TASSP.1985.1164649
7 Competing interests
The authors declare that they have no competing interests.
Authors’ original submitted files for images
Below are the links to the authors’ original submitted files for images.
About this article
Cite this article
Mizutani, K., Ito, T., Sugimoto, M. et al. TSaT-MUSIC: a novel algorithm for rapid and accurate ultrasonic 3D localization. EURASIP J. Adv. Signal Process. 2011, 101 (2011). https://doi.org/10.1186/1687-6180-2011-101
- Adaptive Array
- Computational Complexity
- 3D Localization
- DOA-Delay Estimation