 Research
 Open Access
 Published:
An improved denoising method for eye blink detection using automotive millimeter wave radar
EURASIP Journal on Advances in Signal Processing volume 2022, Article number: 9 (2022)
Abstract
With the development of radar technology, the automotive millimeter wave radar is widely applied in the fields including internet of vehicles, Artificial Intelligence (AI)based autonomous driving, health monitoring, etc. Eye blink, as one of the most common human activities, can effectively reflect the person’s consciousness and fatigue. The contacted eye blink detection often leads to uncomfortable experience and the camerabased eye blink detection has privacy issues. As an alternative, the noncontacted eye blink detection based on automotive millimeter wave radar resolves the aforementioned issues and has been received much attention. This paper proposes an eye blink detection method using the frequency modulated continuous wave radar. Firstly, the position of the person’s head is estimated by carrying out fast Fourier transform on the intermediate frequency signal, and the signals of the range bins at the head are extracted. Then, the complete ensemble empirical mode decomposition with adaptive noise algorithm is applied to decompose the eye signals into a series of intrinsic mode functions (IMFs), and the singular value decomposition is adopted to constrain the selection and reconstruction of the useful IMFs related to the eye blink signal. Finally, the shorttime Fourier transformation and cell average constant false alarm rate are applied to detect the eye blink behavior. Experiments are carried out to validate the effectiveness of the proposed eye blink detection method.
1 Introduction
The Internet of Things (IoT) involves many aspects and can be applied in some fields such as energy, transportation, and manufacturing [1, 2]. It can effectively promote the intelligent development of these areas, and make the limited resources more reasonable to use [3]. With the development of the IoT, the millimeter wave radar sensing [4] has been received widespread attention. In recent years, the automotive millimeter wave radar [5, 6] has been rapidly penetrated and developed in the fields of internet of vehicles [5], Artificial Intelligence (AI)based autonomous driving [6], etc. The automotive millimeter wave radar with multiple transmitting antennas and multiple receiving antennas can reasonably allocate resources according to the different requirements, so as to realize corresponding functions [7, 8]. And with the increasing demand for health monitoring [9, 10], physiological signs detection based on automotive millimeter wave radar has been received a lot of attention. Physiological signals, such as heart signal, breath signal, blink signal, etc., can reflect the fatigue, attention, stress, or consciousness level of the person [11, 12]. Since the eye blink motion is one of the most natural and frequent human activities, the eye blink detection is an effective way to measure fatigue and concentration. Hence, the eye blink detection has been researched widely [13, 14]. ElectroOculogram [15], as a common blink detection method, mainly relies on the contacted devices. The eye blink motion is detected by attaching electrodes to the human skin near the eyes to measure potential changes between the electrodes. However, attaching electrodes to the skin causes abrasion, leading to uncomfortable user experience.
On the other hand, noncontacted eye blink detection usually relies on vision devices [16, 17]. It applies the camera to capture the image sequences that contain eye blink motion, and achieves eye blink detection by using computer vision technology. ALGawwam et al. [17] use facial feature trackers to localize the contours of the eyes and eyelids. They measure the range between the eyelids to obtain the opening state of the eyes, and the rapid change of the range between the eyelids is detected as an eye blink. Although the visionbased eye blink detection method improves user’s natural experience, the expensive cost, light sensitivity and privacy issues should be addressed.
As an alternative, the noncontacted eye blink detection based on radar resolves the aforementioned issues. The Doppler sensors are widely applied for eye blink detection [18,19,20]. Specifically, Tamba et al. [18] apply the Doppler sensor with setting the thresholds of the blink width and height for each person to reduce the influence of individual differences. Kim [19] adopts the principal component analysis to distinguish conscious and unconscious eye blink using a 5.8 GHz Doppler sensor radar. Yamamoto et al. [20] estimate the eye blink duration time by analyzing the eyelids, closing and opening behavior on the spectrograms. Compared to Doppler sensors, the frequency modulated continuous wave (FMCW) radar at the millimeter frequency range has significant advantages in the fields of target detection [21], vital signs detection [22], driver’s behavior detection [23], hand gesture recognition [24], and so on. Cardillo et al. [25] apply a 120 GHz FMCW radar to realize the head motion and eye blink detection. However, the authors only use the range information of the eye blink motion, the Doppler information is not mentioned.
Therefore, in this paper, we focus on the noncontacted eye blink detection and propose an eye blink detection method based on complete ensemble empirical mode decomposition with adaptive noise (CEEMDAN) with singular value decomposition (SVD) denoising using FMCW radar. The main contributions of this paper are concluded as follows:
Firstly, the intermediate frequency (IF) signal is obtained by mixing and filtering the eye blink data. Then, the person’s head position is estimated by performing fast Fourier transform (FFT) on the IF signal, and the signals in the position interval are extracted.
Secondly, we propose an eye blink signal reconstructed method by the CEEMDAN algorithm combining with the SVD. The extracted signal is decomposed into a series of intrinsic mode functions (IMFs) by CEEMDAN algorithm. Then, SVD is applied to constrain the selection and reconstruction of the useful IMFs for eye blink signal reconstruction.
Thirdly, the shorttime Fourier transformation (STFT) is performed on the reconstructed eye blink signal, and the eye blink detection is realized by the cell average constant false alarm rate (CACFAR).
Finally, we carry out a series of experiments to verify the effectiveness of the proposed eye blink detection method. Experimental results show that the proposed method can successfully detect the eye blink motion.
The rest of this paper is organized as follows. In Sect. 2, the principle of FMCW radar is described. In Sect. 3, the proposed eye blink detection method is introduced in detail. The experimental results are analyzed and discussed in Sect. 4. The conclusion is drawn in Sect. 5.
2 FMCW radar principle
In this section, the principle of FMCW radar is first described (shown in Fig. 1). The radar system mainly contains several parts such as signal source, transmitting antenna (TX), receiving antenna (RX), mixer, lowpass filter (LPF), ADC sampler (A/D), etc. The signal source is responsible for generating the FMCW signal. The TX and RX are responsible for the transmission and reception of the signal. The received echo signal and the transmitted signal are mixed by the mixer, and passed through a LPF to obtain the IF signal. Finally, the IF signal is sampled by A/D sampler for further processing.
In this paper, we adopt sawtooth modulation and the transmitter transmits modulated sawtooth microwave (shown in Fig. 2) [23], which is expressed as
where \({f_{\mathrm{c}}}\) is the carrier frequency, \({f_{\mathrm{T}}}(\tau ) = S \cdot \tau\) indicates that the frequency of the transmitted signal within a period of time, \(S = {B \big /{{T_{\mathrm{c}}}}}\) is the slope of the chirp signal, B is the maximum bandwidth of the signal, \({T_{\mathrm{c}}}\) is the pulse width of the chirp signal, and \({A_{\mathrm{T}}}\) is the amplitude of the transmitted signal.
Let R be the range from the FMCW radar to the person’s head. The received echo signal can be expressed as
where \({A_{\mathrm{R}}}\) is the amplitude of the received signal, \({t_{\mathrm{d}}} = {{2R} \big /c}\) is the signal delayed time from transmission to reception, c is the light speed, \({f_{\mathrm{R}}}(t) = S \cdot (t  {t_{\mathrm{d}}}) + \Delta {f_{\mathrm{d}}}\), and \(\Delta {f_{\mathrm{d}}}\) is Doppler shift.
The received signal \({S_{\mathrm{R}}}(t)\) and the transmitted signal \({S_{\mathrm{T}}}(t)\) are sent to the mixer and passed through a LPF, then the IF signal can be expressed as
where \({f_{{\mathrm{IF}}}} = S \cdot {t_{\mathrm{d}}}\). Specifically, the eye blink signal is contained in the IF signal. Therefore, to detect the eye blink, the IF signal needs to be processed and analyzed.
3 Methods
In this section, we present the proposed eye blink detection method in detail. The flowchart of the proposed method is shown in Fig. 3. Firstly, the range FFT is performed on the IF signal to determine the position interval of the human head, and the signals in this position interval are extracted. Then, the extracted signal is decomposed into a series of IMFs by CEEMDAN algorithm. Next, the SVD is applied on each IMF signal to constrain the selection and reconstruction of the useful IMFs to reconstruct the eye blink signal. Finally, the STFT is performed on the reconstructed eye blink signal and the CACFAR is applied to detect the eye blink.
3.1 Signal extraction
We place the FMCW radar directly in front of the person’s head and eyes, so the received signals mainly include the eye blink signal, the signals from other facial parts and noise signals. Therefore, we need to obtain the all signals located at the distance R for extracting the eye blink signal. Then, we firstly need to estimate the position information of the head. According to \({t_{\mathrm{d}}} = {{2R}\big / c}\) and \({f_{{\mathrm{IF}}}} = S \cdot {t_{\mathrm{d}}}\), the corresponding relationship between R and \({f_{{\mathrm{IF}}}}\) is
Therefore, to obtain the range information of the head, it is necessary to analyze the IF signal and estimate the frequency \({f_{{\mathrm{IF}}}}\). Firstly, the IF signal is sampled by A/D and the FFT is performed on sampling points of each chirp to obtain range information of the head. We assume for simple calculation, the sampled signal and transformed signal after FFT are [24]
where M is the number of transmitted chirps, N is the number of sampling points, \(p = 0,1, \ldots ,N  1\), the \({T_{\mathrm{s}}}\) is the sampling time and \({T_{\mathrm{c}}} = N{T_{\mathrm{s}}}\). Therefore, when the absolute value \(\left {{S_1}} \right\) wants to reach the maximum, it needs to satisfy \(p = \left( {{f_{{\mathrm{IF}}}}  \Delta {f_{\mathrm{d}}}} \right) N{T_{\mathrm{s}}}\). Because of \({f_{{\mathrm{IF}}}} \gg \Delta {f_{\mathrm{d}}}\), we can roughly obtain \({f_{{\mathrm{IF}}}} \approx {p \big / {N{T_{\mathrm{s}}}}}\) after FFT and the range value of the head can be obtained according to Eq. (4). Then, the signals located at the estimated range are extracted as the signal \(x\left( t \right)\) that includes the eye blink signal, the signals from other facial parts and noise signals.
where \(t = m{T_{\mathrm{c}}}\), \(m = 0,1, \ldots ,M  1\), and \(p = {n_1}\) while \(\left {{S_1}} \right\) reaches the maximum.
In addition, considering the sampling of FMCW radar signal, the maximum measuring range can be expressed as
The maximum measuring range is 8.55 m when the parameters of FMCW radar are adopted in the experiments.
3.2 CEEMDAN algorithm
Due to the interference of the face and the environmental noise, the eye blink signal is too weak to be detected. Therefore, it is necessary to remove the interference and the noise to enhance the eye blink signal. The empirical mode decomposition (EMD) algorithm [26] is usually applied to denoise the weak vital signals. EMD decomposes the raw signal into several IMFs, and it realizes denoising by removing the noisy IMFs [26]. However, the EMD algorithm usually leads to the problem of the modal aliasing. Towards this end, the ensemble empirical modal decomposition (EEMD) algorithm [27] adds different white noises into the raw signal, and performs multiple EMD on the noisy signal and averages the IMFs of multiple EMD to obtain the final IMFs. Furthermore, the SVD is often used in conjunction with EEMD for constraining the selection and reconstruction of the useful IMFs [28]. However, the EEMD algorithm cannot completely eliminate the influence of white noise on the decomposition results. The CEEMDAN algorithm [29] adds a finite number of adaptive white noises at each stage of the decomposition process of EMD, which effectively solves the problems of EEMD. Therefore, we apply the CEEMDAN algorithm to decompose the extracted signal for signal denoising.
The white noise \({n^g}\left( t \right)\), \(g = 1,2, \ldots ,{\mathrm{G}}\) with a standard normal distribution is added to the extracted signal \(x\left( t \right)\), and the EMD is applied on the added signal to obtain the \({{\mathrm{IMF}}}_1^g\left( t \right)\). Then, \({{\mathrm{IMF}}_1}\left( t \right)\) can be computed as
where \({{\mathrm{IMF}}_1}\left( t \right)\) represents the first IMF component, and the first remaining component \({r_1}\left( t \right)\) can be derived as
Then, the white noise is continuously added the remaining component \({r_1}\left( t \right)\) for obtaining \({{\mathrm{IMF}}_2}\left( t \right)\). This step is repeated until the remaining component is a monotonic function. Finally, the extracted signal \(x\left( t \right)\) is decomposed into a series of IMFs using CEEMDAN algorithm, that is
where J is the number of IMFs, \({\mathrm{IM}}{{\mathrm{F}}_j}\) is the jth IMF, and \({r_J}\left( t \right)\) is the residual component of the signal after decomposing. The process of CEEMDAN algorithm is concluded in Table 1. It can be seen from Table 1 that the signal is decomposed into J IMFs and a residual component \({r_J}\left( t \right)\) by CEEMDAN algorithm.
Each IMF represents different frequency component of the IF signals. Assuming that the useful signal and noise are distributed in different IMFs, the useful IMFs can be reconstructed by removing the noisy IMFs expressed as follows:
where \({\hat{x}}\left( t \right)\) is the denoised signal, and \({J_{\mathrm{u}}}\) is the number of the useful IMFs.
3.3 Eye blink signal reconstruction using SVD
After CEEMDAN decomposing, the SVD [28] is adopted to constrain the selection and reconstruction of the IMFs. By applying the SVD, the IMFs related to the eye blink are selected and reconstructed, so as to obtain the eye blink signal from the extracted signal. In addition, the interference is removed in the selection process of IMFs, and each selected IMF is denoised during the reconstruction process.
Since the extracted signal is first decomposed into several IMFs by the CEEMDAN algorithm, and each IMF can be expressed as
where N is the temporal sampling number of the IMF.
Then, the Hankel matrix \({{\mathbf{H }}_j}\) of each IMF can be constructed as
where \(m = \left\lfloor {{N \big /2}} \right\rfloor + 1\), \(n = N  m + 1\), \({{\mathbf{T }}_H}\) is the Hankel matrix construction operator, and └┘ means Floor operation. By applying the SVD to \({{\mathbf{H }}_j}\), \({{\mathbf{H }}_j}\) can be expressed as
where \({\mathbf{U }}\) and \({\mathbf{V }}\) are the orthogonal matrices, \({\varvec{\Sigma }} = {\mathrm{diag}}\left( {{\sigma _1},{\sigma _2}, \ldots ,{\sigma _r}} \right)\), r and \({\sigma _i}\) are the rank and the singular value of \({{\mathbf{H }}_j}\), respectively.
The singular values represents the signal coherence in each IMF. The larger singular value represents the effective signal with better coherence. Therefore, the difference of the signal coherence is used as the criterion to select useful IMFs to reconstruct the eye blink signal.
The normalized singular spectrum energy \(p\left( j \right)\) of the jth IMF is
where \(E\left( {{{\mathbf{H }}_j}} \right) = \sum \nolimits _{i = 1}^r {\sigma _i^2}\) is the singular spectrum energy.
Based on the energy probability theory [28], the energy probability of the singular spectrum \(q\left( j \right)\) is defined as follows:
Since the singular spectrum energy of the useful IMFs is different with the noisy IMFs [28], it can be regarded as the criterion for selecting the useful IMFs.
Moreover, due to the influence of white noise, the selected IMFs may retain the noise which may have the same frequency as the useful signals. In generally, the r singular values are sorted in descending order, and the k largest singular values are remained to reconstruct the Hankel matrix, that is
where the rank of \({\varvec{\Sigma }}\) is k.
Then, the new Hankel matrix \({{{\hat{\mathbf{H }}}}_j}\) can be reconstructed as
where \({{\mathbf{T }}_k}\) represents the reconstruction operator of the new Hankel matrix \({{{\hat{\mathbf{H }}}}_j}\).
Therefore, the final reconstructed eye blink signal \(s\left( t \right)\) after denoising can be written as
where \({\mathbf{T }}_H^{ 1}\) is the inverse of the Hankel matrix construction operator.
Furthermore, the process of the selection and reconstruction of IMFs using SVD is shown in Table 2. It can be seen from Table 2 that the SVD is applied to all IMFs, and the useful IMFs related to the eye blink are selected through the energy probability of the singular spectrum \(q(j)\). The eye blink signal is finally reconstructed.
3.4 Eye blink detection by STFT combining with CACFAR
Although the eye blink signal has been reconstructed, it is still difficult to detect the eye blink in the time domain. Fortunately, the timefrequency analysis is usually performed for achieving the eye blink detection [30,31,32].
In this paper, the STFT is applied on the reconstructed eye blink signal \(s\left( t \right)\), that is
where \(h\left( {\tau  t} \right)\) is the window function.
After performing STFT, the timefrequency spectrum can be obtained. The Doppler feature of eye blink can be observed on the timefrequency spectrum, but it does not mean that the eye blink detection has been realized. Therefore, to achieve the eye blink detection, the CACFAR algorithm [33] is adopted to perform on the timefrequency spectrum.
For the CACFAR detector, noise samples are extracted from both leading and lagging cells around the cell under test (CUT). The noise power can be estimated as [34]
where \({P_n}\) is the estimated noise power, I is the number of training cells and \({y_i}\) is the sample in each training cell.
Then, the detection threshold can be given by
where T represents the detection threshold and \({\alpha }\) is a scaling factor. Then, we compute the power result for each CUT. If the calculation result of one CUT exceeds the threshold T, this CUT is considered as an eye blink motion [35].
4 Experimental results and discussion
In this section, we first introduce the FMCW radar and radar parameters used in the experiment. We carry out a series of experiments to verify the effectiveness of the proposed eye blink detection method.
4.1 Experimental specification
The experimental scene is shown in Fig. 4, where the person’s head and eyes are located at R (\({R \approx 20}\) cm) directly in front of the FMCW radar. The radar adopted in the experiment is Texas Instruments AWR1642 as shown in the red device in Fig. 4, and it has two transmitting and four receiving antennas. The green equipment behind AWR1642 is DCA1000 and it is used for data acquisition.
The central frequency of the FMCW radar is 77 GHz, and the bandwidth is 4 GHz. The sampling frequency of the A/D sampler is set to 2 MHz. The pulse width of chirp is set to 114 microseconds (\(\mu\)s) and the time of one frame is set to 100 milliseconds (ms). We use 30 frames to collect the data of eye blink motion and the collection time is 3 seconds (s). Moreover, each frame contains 255 chirps and each chirp contains 200 sampling points. The parameters of FMCW radar used in the experiments are listed in Table 3.
4.2 Experimental results and discussion
During the eye blink data collection stage, the head of the person is located stably in front of the FMCW radar, and the eyes are looking at the antennas of the radar. In the experiment, the IF data of eye blink in 3 s is collected. Then, by performing FFT on the IF signal, the range between the head and FMCW radar is estimated. The estimated result of range is shown in Fig. 5. It can be seen from Fig. 5 that the head is approximately 20 cm in front of the radar, and keeps stable, which is consistent with the set conditions.
Since the signals at the range bin with strongest spectrum contain the eye blink motion, they are extracted for eye blink detection. In order to reduce the time complexity of CEEMDAN decomposition, the extracted signal is averaged on every continuous five chirps. It should be noted that the time of one chirp is 114 μs, so the time of five chirps is 570 μs. The signals remain relatively stable in a short time. Then, the processed signal is decomposed by the CEEMDAN algorithm. The decomposition result is shown in Fig. 6. It can be seen from Fig. 6 that the IF signal is decomposed into seven IMFs and one residual signal. These IMFs are sorted from high frequency to low frequency.
Subsequently, the Hankel matrix of each IMF is constructed and SVD is applied to obtain the corresponding singular values, and the singular values of each IMF are as shown in Fig. 7. We also show the energy probability of the singular spectrum of each IMF in Fig. 8. It can be observed from Figs. 7 and 8 that the singular values and the singular spectrum energy probability of IMF5 to IMF7 are larger than other IMFs, and the respective frequencies of IMF5 to IMF7 are calculated which are close to 0 Hz. This is because the low frequency signals reflected from the face are more intense and the eye blink is so weak that the singular spectrum energy probability caused by the eye blink motion is small. Therefore, according to the principle of the CEEMDAN algorithm, we want to remove IMF5 to IMF7 for removing interference from the other facial parts, and select IMF1 to IMF4 as the useful IMFs to reconstruct the eye blink signal. In fact, the IMFs are selected for reconstruction with the rule that the energy probability of the singular spectrum is less than the threshold, where the threshold is set as the averaged value of the sum of the energy probabilities of the singular spectrum of all IMFs. In addition, it is noted that in the reconstruction process, the k largest singular values are selected for each useful IMF reconstruction. The selected IMFs are denoised during the reconstruction process.
Furthermore, the reconstructed eye blink signal, the IF signal and useful IMFs are shown in Fig. 9. The blue line represents the IF signal and the red line represents the reconstructed eye blink signal. The yellow line represents the useful IMFs which is the summation of IMF1 to IMF4. It can be seen from Fig. 9 that the IF signal has two obvious changes in amplitude, which are located at about 40 chirps and 1060 chirps, respectively. The amplitude change may be caused by the hardware device, the noise or the eye blink motion. By observing the IF signal and useful IMFs, it can be found that CEEMDAN algorithm can effectively denoise the signal by removing the noisy IMFs. However, the two amplitude changes are still obvious, which means that the useful IMFs still contain the noise. Compared with the useful IMFs in Fig. 9, the amplitude change located at about 1060 chirps can be more clearly observed in the reconstructed eye blink signal, while the amplitude change at about 40 chirps is weakened. This is because the noise contained in each selected IMF is further removed during the reconstruction of the selected IMFs, so as to enhance the eye blink signal. Therefore, the amplitude change at about 40 chirps may be affected by the hardware device and noise, while the amplitude change at about 1060 chirps may be caused by the eye blink motion.
Then, STFT is performed on the reconstructed eye blink signal to obtain the timefrequency spectrum. We denote the result of STFT performing on IF signal by IF + STFT. The CEEMDAN + STFT represents the result of STFT performing on the reconstructed useful signal of IMF1 to IMF4 by CEEMDAN algorithm, and the result of STFT performing on the reconstructed eye blink signal by CEEMDAN algorithm with SVD is denoted by CEEMDAN + SVD + STFT. To validate the effectiveness of the proposed algorithm, we compare the timefrequency spectrum with eye blink once and twice in 3 seconds, and the results are shown in Figs. 10 and 11, respectively. It can be observed from Figs. 10a and 11a that the strong static interferences with zero frequencies from the face cause the eye blink motion difficult to observe. Since the CEEMDAN algorithm can remove the noise and interference of the signal, the strong static interference from the face can be eliminated and the eye blink signal can be reconstructed. Therefore, the timefrequency spectrum of CEEMDAN + STFT can be easy to detect the eye blink motion as shown in Figs. 10b and 11b.
Although the zerofrequency components can be effectively removed, the noise contained in each IMF cannot be eliminated. The CEEMDAN algorithm combining with SVD is proposed to reconstruct the eye blink signal, so as to remove the noise in each selected IMF. In fact, we can see from Figs. 10c and 11c that the interference is effectively eliminated, and the eye blink motion can be observed clearly.
Finally, the CACFAR is performed on the timefrequency map to realize the blink detection. The detection results are shown in Figs. 10d and 11d. It can be clearly observed that there is one blink motion in 3 s in Fig. 10d and there are two blink motions in 3 s in Fig. 11d. The experimental results show that the results of the eye blink detection are consistent with the actual situation, so as to validate the effectiveness of the proposed method.
5 Conclusion
In this paper, we proposed an eye blink detection method using 77 GHz FMCW radar. Firstly, the FFT was performed on the IF signal to obtain the position of the head. The signals located in the position were extracted and the extracted signal was averaged every continuous five chirps. Then, the CEEMDAN algorithm was applied to decompose the averaged signal into several IMFs, and the eye blink signal was reconstructed by using SVD to constrain the selection and reconstruction of the useful IMFs. Finally, the eye blink detection was realized by performing STFT and CACFAR on the reconstructed eye blink signal. Furthermore, the experimental results proved the effectiveness of the proposed eye blink detection method. In the future, we will combine the eye blink detection with machine learning to achieve eye blink classification or fatigue detection.
Availability of data and materials
All data generated or analyzed during this study are included in this paper.
Abbreviations
 IoT:

Internet of Things
 AI:

Artificial intelligence
 FMCW:

Frequency modulated continuous wave
 IF:

Intermediate frequency
 TX:

Transmitting antenna
 RX:

Receiving antenna
 LPF:

Lowpass filter
 A/D:

ADC sampler
 FFT:

Fast Fourier transform
 EMD:

Empirical mode decomposition
 EEMD:

Ensemble empirical modal decomposition
 CEEMDAN:

Complete ensemble empirical mode decomposition with adaptive noise
 IMF:

Intrinsic mode function
 SVD:

Singular value decomposition
 STFT:

Shorttime Fourier transformation
 CACFAR:

Cell average constant false alarm rate
References
X. Liu, X. Zhang, NOMAbased resource allocation for clusterbased cognitive industrial Internet of Things. IEEE Trans. Ind. Inform. 16(8), 5379–5388 (2020)
F. Li, K.Y. Lam, X. Liu et al., Joint pricing and power allocation for multibeam satellite systems with dynamic game model. IEEE Trans. Veh. Technol. 67(3), 2398–2408 (2018)
X. Liu, X.B. Zhai, W. Lu, C. Wu, QoSguarantee resource allocation for multibeam satellite industrial Internet of Things with NOMA. IEEE Trans. Ind. Inform. 17(3), 2052–2061 (2021)
P.J.B. Morris, K.V.S. Hari, Detection and localization of unmanned aircraft systems using millimeterwave automotive radar sensors. IEEE Sens. Lett. 5(6), 1–4 (2021)
K.Z. Ghafoor, L. Kong, S. Zeadally et al., Millimeterwave communication for internet of vehicles: status, challenges, and perspectives. IEEE Internet Things J. 7(9), 8525–8546 (2020)
H. Ning, R. Yin, A. Ullah, F. Shi, A survey on hybrid humanartificial intelligence for autonomous driving. IEEE Trans. Intelligent Transp. Syst. (2021). https://doi.org/10.1109/TITS.2021.3074695
X. Liu, X. Zhang, M. Jia et al., 5Gbased green broadband communication system design with simultaneous wireless information and power transfer. Phys. Commun. 28, 130–137 (2018)
X. Liu, X. Zhang, Rate and energy efficiency improvements for 5Gbased IoT with simultaneous transfer. IEEE Internet Things J. 6(4), 5971–5980 (2019)
M. Mercuri, I.R. Lorato, Y. Liu et al., Vitalsign monitoring and spatial tracking of multiple people using a contactless radarbased sensor. Nat. Electron. 2, 252–262 (2019)
J. Zhong, D. Wang, J. Guo, D. Cabrera, C. Li, Theoretical investigations on kurtosis and entropy and their improvements for system health monitoring. IEEE Trans. Instrum. Meas. 70, 1–10 (2021)
M. Ingre, T. Åkerstedt, B. Peters, A. Anund, G. Kecklund, Subjective sleepiness, simulated driving performance and blink duration: examining individual differences. J. Sleep Res. 15(1), 47–53 (2010)
S. Hu, G. Zheng, Driver drowsiness detection with eyelid related parameters by support vector machine. Exp. Syst. Appl. 36(4), 7651–7658 (2009)
A. Maleki, M. Uchida, Noncontact measurement of eyeblink by using Doppler sensor. Artif. Life Robot. 23(2), 279–285 (2018)
T. Morris, P. Blenkhorn, F. Zaidi, Blink detection for realtime eye tracking. J. Netw. Comput. Appl. 25(2), 129–143 (2002)
J. Ma, Y. Zhang, A. Cichocki, F. Matsuno, A novel EOG/EEG hybrid humanmachine interface adopting eye movements and ERPs: application to robot control. IEEE Trans. Biomed. Eng. 62(3), 876–889 (2015)
I. Bacivarov, M. Ionita, P. Corcoran, Statistical models of appearance for eye tracking and eyeblink detection and measurement. IEEE Trans. Consum. Electron. 54(3), 1312–1320 (2008)
S. AlGawwam, M. Benaissa. In: Proceedings of the International Conference on Bioinformatics Research and Applications 2017 (ICBRA 2017), Eye blink detection using facial features tracker (Association for Computing Machinery, New York, NY, USA, 2017), pp. 27–30
C. Tamba, S. Tomii, T. Ohtsuki. In: Proceedings of the 2014 IEEE 25th Annual International Symposium on Personal, Indoor, and Mobile Radio Communication (PIMRC), Blink detection using Doppler sensor (IEEE, Washington, DC, USA), pp. 2119–2124 (2014)
Y. Kim, Detection of eye blinking using doppler sensor with principal component analysis. IEEE Antennas Wirel. Propag. Lett. 14, 123–126 (2015)
K. Yamamoto, K. Toyoda, T. Ohtsuki, Doppler sensorbased blink duration estimation by analysis of eyelids closing and opening behavior on spectrogram. IEEE Access 7, 42726–42734 (2019)
Q. Zheng, L. Yang, Y. Xie et al., A target detection scheme with decreased complexity and enhanced performance for rangeDoppler FMCW radar. IEEE Trans. Instrum. Meas. 70, 1–13 (2021)
Y. Wang, W. Wang, M. Zhou, A. Ren, Z. Tian, Remote monitoring of human vital signs based on 77GHz mmwave FMCW radar. Sensors 20(10), 2999 (2020)
C. Ding, R. Chae, J. Wang et al., Inattentive driving behavior detection based on portable FMCW radar. IEEE Trans. Microwave Theory Tech. 67(10), 4031–4041 (2019)
Y. Wang, Y. Shu, X. Jia et al., Multifeature fusionbased hand gesture sensing and recognition system. IEEE Geosci. Remote Sens. Lett. 19, 1–5 (2022)
E. Cardillo, G. Sapienza, C. Li, A. Caddemi. In: Proceedings of the 2020 50th European Microwave Conference (EuMC), Head Motion and Eyes Blinking Detection: A mmWave Radar for Assisting People with Neurodegenerative Disorders (IEEE, Utrecht, Netherlands), pp. 925–928 (2021)
M.R. Thirumalaisamy, P.J. Ansell, Fast and adaptive empirical mode decomposition for multidimensional, multivariate signals. IEEE Signal Process. Lett. 25(10), 1550–1554 (2018)
L. Pan, K. Liu, J. Jiang et al., A denoising algorithm based on EEMD in Ramanbased distributed temperature sensor. IEEE Sensors J. 17(1), 134–138 (2017)
R. Wang, M. Xiang, C. Li, Denoising FMCW ladar signals via EEMD with singular spectrum constraint. IEEE Geosci. Remote Sens. Lett. 17(6), 983–987 (2020)
M.A. Colominas, G. Schlotthauer, M.E. Torres, Improved complete ensemble EMD: a suitable tool for biomedical signal processing. Biomed. Signal Process. Control 14(1), 19–29 (2014)
K. Yamamoto, K. Toyoda, T. Ohtsuki. In Proceedings of the 2017 IEEE 28th Annual International Symposium on Personal, Indoor, and Mobile Radio Communications (PIMRC), Driver’s blink detection using Doppler sensor (IEEE, Montreal, QC, Canada), pp. 1–6 (2017)
K. Yamamoto, K. Toyoda, T. Ohtsuki. In: Proceedings of the 2018 IEEE International Conference on Communications (ICC), Doppler sensorbased blink duration estimation by spectrogram analysis (IEEE, Kansas City, MO, USA), pp. 1–6 (2018)
K. Yamamoto, K. Toyoda, T. Ohtsuki. In: Proceedings of the 2019 IEEE International Conference on Communications (ICC), SpectrogramBased Simultaneous Heartbeat and Blink Detection Using Doppler sensor (IEEE, Shanghai, China), pp. 1–6 (2019)
A. Melebari, A.K. Mishra, M.Y. Abdul Gaffar. In: Proceedings of the 2015 IEEE Radar Conference, Comparison of Square Law, Linear and Bessel Detectors for CA and OS CFAR Algorithms (IEEE, Johannesburg, South Africa), pp. 383–388 (2015)
M. Richards, Fundamentals of Radar Signal Processing (McGraw Hill, New York, 2005)
C. Tamba, H. Hayashi, T. Ohtsuki. In: Proceedings of the 2016 IEEE Global Communications Conference (GLOBECOM), Improvement of Blink Detection using a Doppler Sensor based on CFAR Processing (IEEE, Washington, DC, USA), pp. 1–6 (2016)
Acknowledgements
This work was supported by the School of Communication and Information Engineering, Chongqing University of Posts and Telecommunications.
Funding
This work was supported in part by the National Natural Science Foundation of China under Grant 61901076; in part by the National Science Foundation of Chongqing under Grant cstc2020jcyjmsxmX0865; in part by the China Postdoctoral Science Foundation under Grant 2021M693773; and in part by the Science and Technology Research Program of Chongqing Education Commission under Grant KJQN201900603, Grant KJZDK202000605, and Grant KJQN202000630.
Author information
Authors and Affiliations
Contributions
The research and results of this specific publication are a longterm collaboration between the authors based on FMCW radar applications. For the present manuscript, we achieve an improved denoising method for eye blink detection using automotive millimeter wave radar. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All procedures performed in this paper were in accordance with the ethical standards of research community.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Shu, Y., Wang, Y., Yang, X. et al. An improved denoising method for eye blink detection using automotive millimeter wave radar. EURASIP J. Adv. Signal Process. 2022, 9 (2022). https://doi.org/10.1186/s1363402200841y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1363402200841y
Keywords
 Millimeter wave radar
 Eye blink detection
 CEEMDAN
 SVD
 STFT