 Research
 Open access
 Published:
A muscle synergiesbased movements detection approach for recognition of the wrist movements
EURASIP Journal on Advances in Signal Processing volume 2020, Article number: 43 (2020)
Abstract
Myoelectric signals are regarded as the control signal for prosthetic limbs. But, the main research challenge is reliable and repeatable movement detection using electromyography. In this study, the analysis of the muscle synergy pattern has been considered as a key idea to cope with this main challenge. The main objective of this research was to provide an analytical tool to recognize six wrist movements through electromyography (EMG) based on analysis of the muscle synergy patterns. In order to design such a system‚ the synergy patterns of the wrist muscles have been extracted and utilized to identify wrist movements. Also, different decision fusion algorithms were used to increase the reliability of the synergy pattern classification. The classification performance was evaluated while no data subject was enrolled. In terms of the achieved performance, using a multilayer perceptron (MLP) neural network as the fusion algorithm turned out to be the best combination. The classification average accuracy, obtained in an offline manner, was about 99.78 ± 0.45%. While the classification average crossvalidation accuracy, obtained in an offline manner, using Bayesian fusion, and Bayesian fuzzy clustering (BFC) fusion algorithm were 99.33 ± 0.80% and 96.43 ± 1.08%, respectively.
1 Introduction
The electromyogram (EMG) signal represents the electrical potentials generated in the muscles during muscle contraction, which shows the important neuromuscular information [1]. The EMG signal recorded from each surface electrode is the total potential of the motor units in the region where the electrode is positioned [2]. Due to the useful application of EMG signal in clinical diagnoses, and biomedical applications as well as rehabilitation, they are considered as one of the best resources of controlling (i.e., prostheses, robots, and humancomputer interfaces), recognition of intended limb movements [1, 3]. Extensive research has been done in order to control various functions and increase the efficiency of prostheses (i.e., several degreesoffreedom (DoF). One class of the known control approaches are based on recognizing the pattern of EMG signals elicited from the residual healthy muscles [3]. Many researchers are engaged in improving the performance of such recognition algorithms in order to improve the efficiency of prostheses. Hence, the estimation algorithms, pattern recognition and regression methods [4, 5], and their combination [6, 7] are among the topics of interest to researchers.
Pattern recognition algorithms are applied to classify the EMG activity patterns in multiple muscles. So, in these researches, the first step is windowing the EMG signal [8, 9] and extracting a set of important features from timewindowed signal in the time domain (TD) [10, 11] and in the frequency domain (FD) [10,11,12,13]. The computational cost of TD features is less than the computational of FD features, yet yield comparable classification accuracy [10].. The classification accuracy in the classification model depends on the type of classification algorithm (i.e., supervised or unsupervised) and the features which are selected [12], [14, 15]. Also, it depends on the type of subject (ablebodied or amputee) [3]. Sang et al. [10] recognized six predetermined tasks of muscle activation patterns using TD features and linear discriminant analysis classifiers in stroke subjects. Similarly, Francesco et al. [16] investigated the recognition of hand and finger movements individually and reported the different accuracies for ablebodied subjects and amputated ones. They used the feedforward multilayer perceptron (MLP) and four TD features [16]. In the other study, Chu et al. [13], nine types of wrist movements were detected based on packet wavelet analysis using MLP and selforganizing feature map (SOFM) neural networks with an accuracy of 97%. The research results of the past decades have shown that the pattern recognitionbased methodology has promising results [12]. But some impediments such as number of the selected features, the computational cost of the required, and the minimum number of the data required for training the classifier can limit their practical applications. The other challenge is detecting the movements with multi DoF [17, 18], and some research works were focused on detecting the movement with only one DoF [3, 6, 8].
The authors believe that most of these challenges are raised because of specificity movement detection approaches used in the aforementioned researches. In fact, according to a specificity approach, activation dynamics of each involved muscle is analyzed distinctly. In this manner, the muscle coactivation dynamics, characterizing the movement pattern, cannot be revealed. While using the synergybased analysis, the muscle interaction dynamics can be studied. The synergybased analysis is a type of movement analysis which addresses the interactive behavior among the involved subsystems (muscles, joint), instead analyzing the behavior of each subsystem (muscles, joints) separately. Since the real movement emerged from the interaction among the muscles, it is expected that the synergybased analyses can better reveal and discriminate the different motion dynamics in comparison with the nonsynergetic analyses. Therefore, the analyses approaches designed based on muscle synergy patterns can be preferable to the analyses approaches based on the electromyography of the individual muscle distinctly. But most of the related published works have been designed based on electromyography of the individual muscle distinctly [13,14,15,16,17]. Hence, researchers believe that controlling and detecting neural information based on synergistic patterns [3, 8, 18,19,20,21] is preferable than other methods [2, 4,5,6]. Recently, studies have been done on the synergy pattern [3, 8, 18,19,20,21]. For example, Jiang et al. [3] extracted muscle synergy patterns using nonnegative matrix analysis in order to two DoF control of wrist. Similarly, Jiaxin et al. [21] used muscle synergy matrixes to control wrist movements (open, close, pronate, and supinate). The main goal of this paper is presenting a new muscle synergybased wrist movement recognition algorithm. In this study, the extracted muscle synergy patterns were used as the input data for SOFM classifiers instead the TD or FD features. For improving the movement recognition performance, six different classifiers were applied, and different fusion algorithms were used to combine the classification results.
It is worth noting that muscle activation onset can give rise to the presence of transient dynamics which may degrade the performance of movement classifiers. Therefore, in this study, a specific algorithm has been utilized for muscle activation onset detection.
2 Materials and methods
2.1 Experiments and data collection
In this study, eight ablebodied subjects (5 males, 3 females: 26–40 years; all righthanded) without any history of a disease or other skeletal disorders participated in the experiment. Everyone read and signed the consent form before any data was collected and the local ethics committees approved this study. During the experiments, the subject seated comfortably and held a hand horizontally forward and in pronation. For all individuals, six pairs of Ag–AgCl surface bipolar electrodes were placed on the extensor digitorum, flexor pollicis longus, extensor carpi ulnaris, abductor pollicis longus, pronator teres, and supinator forearm muscles. The reference electrode is placed on the ulnar styloid bone. In these subjects, surface EMG signals of wrist movements were recorded by a commercial biosignal amplifier (16 channels, ME6000, Canada) with a 1000 Hz sampling frequency. Wrist movements included extension, flexion, abduction, adduction, pronation, and supination. Each movement was repeated 10 times; the duration of each repetition and the rest time between the repetitions were recorded 4–5 and 3 s, respectively. Sixty seconds of interruption was considered between movements individually to relieve muscle fatigue. The total duration of each movement was 72 ± 5 s. The EMG data were filtered between 10 and 450 Hz using a fourthorder Butterworth bandpass filter to reduce the effects of noises and movement artifacts. Maximum voluntary contractions were performed before the data were collected to verify the validation of the electrodes and normalize the signal. All processing was done in Python library and MATLAB 64 bit, running on a system with a 1.8 GHz processor and 6 GB of memory. Figure 1 illustrates the experimental setup.
The appropriate response time for hand myoelectric control has to be less than 300 ms [22]. Because, in this manner, no delay will be perceived by user [22]. Therefore, the moving window length was set to 256 ms (256 samples at 1000 Hz sampling) in conformity with the previous researches [13, 22]. The more important parameter is window increment length which data processing has to be carried out during this time band. In this study, according to the calculated processing times, the incremental window was set to 10 ms and increased gradually to 150 ms. Each incremental step was 10 ms. In this manner, the influence of the incremental window length on the proposed detection algorithm was evaluated.
2.2 The proposed movement detection algorithm
To address the wrist task discrimination problem, we have proposed a protocol that allows us to use the EMG data for differentiating the tasks from one set. The input of this proposed protocol is EMG data and its outputs are the detected tasks. At the first step, the hierarchical alternating least squares (HALS) algorithm was used for extracting the muscle synergies of the wrist movement from filtered EMG signals. Then, extracted muscle synergies, as the extracted features, were regarded as the input data for classification. Two different classification algorithms were applied and compared. In the first algorithm, a single SOFM network was used as a single classifier. In the second algorithm, a fusion method was utilized alongside six distinct SOFM networks, as six distinct classifiers, for detecting six different wrist movements. The applied SOFM networks were trained using the Kohonen algorithm as an unsupervised algorithm [23]. We evaluated four fusion methods including SOFM, MLP fusion, Bayesian fusion, and Bayesian fuzzy clustering (BFC) fusion algorithm, respectively. The schematic of the proposed scheme is shown in Fig. 2.
In order to assess the proposed algorithms performance, a Kfold crossvalidation (K = 10) method was adopted. For performing this approach, the samples of data recorded during each wrist movement was labeled firstly to determine the type of wrist movement elicited each recorded data. Then, the labeled data was partitioned into 10 subsets. During each round of crossvalidation, the training process performed on one subset (called training set), and validating process performed on the other subsets (called the testing set). Multiple rounds of crossvalidation were performed using different partitions, and the validation results were combined.
2.3 Identification of the synergy model
EMG signal analysis is a linear combination of timevarying muscle synergies, with each synergy individually having an amplitude and a time shift. The weight coefficient and synergy of each muscle are different for each motion. Each synergy has a weight coefficient and a range of amplitude as well as a time shift, by combining these synergies, the muscle activation pattern is generated [24]. The timevarying synergy model is defined as follows [24]:
Here, M is the timevarying muscle activity pattern; N denotes the number of timevarying synergies, c_{i} is a nonnegative coefficient for synergy ith; and t_{i} is the delay in the start of synergy ith. w is a synergistic matrix and w_{i} is the muscle activity for ith synergy at time t_{i}. Here, C and W are nonnegative.
The synergy patterns of each movement are extracted by the HALS algorithm [25] from the corresponding EMG signal. In this method, a gradient of a local cost function based on the optimality conditions (KTT) [26] is used to update the stationary points (i.e., the matrix of coefficients and the synergies). The cost function using the Frobenius norm is as follows:
Where M^{k} is the timevarying muscle activity pattern, C_{k} and W_{k} are the matrix of synergy matrixes and their corresponding coefficient matrixes, respectively; k denotes the number of current iteration of the HALS algorithm.
Detailed description for the synergy is presented in Table 1.
2.4 Applied classification methods
In this study, two different classification methods have been used. Figure 2 shows the structure of the adopted methods. The first algorithm was designed based on using a single SOFM without using the fusion algorithms. The second algorithm was designed based on using multi SOFM alongside the fusion algorithms. The proposed methods are elaborated in the following subsections.
2.4.1 Classification using single SOFM
In this study, we propose an unsupervised learning and SOFM as a competitive network. During training, the SOFM network, the Euclidean distance between each input training samples vector and the weight vector of each neuron is taken. The Kohonen algorithm was used for training the SOFM network. In performing the Kohonen algorithm, the weight vector of each neuron is updated gradually in a manner that the Euclidean distance between the input training samples vectors and the weight vector of each neuron reduces. In this manner, all the neurons are involved in a competition. At the end of the training process, the neuron which its weight vector has the minimum Euclidean distance to the input training samples vectors is regarded as the winner neuron among all neurons [23]. This winner neuron is called the best matching unit (BMU), and its weight vector is called voronoi vector. The position of the winner neuron within the SOFM network determines the label of the class which the date belongs to it. The position of the winner neuron changes as the class which the input training samples vectors belongs to it, changes. In this manner, the SOFM network can be used for multiclass classification. Accordingly, in this study, the performance of a single SOFM was firstly evaluated for classification of six wrist movements (Fig. 2, the first algorithm). The range of changes is decreased based on the time and distance from the BMU. In this study, a 10 × 10 twodimensional (2D) lattice SOFM with neighborhood function h(t) with radius of σ(t), a learningrate parameter η(t), and training of 1000 epochs were used. The learning rate and neighborhood functions are applied as decreasing functions to the SOFM network [13] and defined in (3) and (5), respectively.
Here, dist is the neuron distance from BMU in the twodimensional SOFM network, σ(t) is the width of neighborhood at the instant, and t is defined by an exponential decay function in (4).
Here, σ_{0} is the radius of neighborhood at the instant t_{0}is 20 [13].
Where η_{0} is the value η(t) at the instant t_{0} is 0.9 [13]. The learningrate parameter decrease gradually with increasing time t. Constant value τ is 2000 and t is the number of iterations. The t and τ are unitless constants. The network input is the synergy pattern extracted using HALS algorithm.
In the end, voronoi vectors are applied to the fusion block. Detailed description for the task discrimination with this approach is presented in AlgorithmI
2.4.2 Classification using multi SOFM
In this approach, each SOFM network was used as a twoclass classifier to recognize a single movement. Since six different movements must be differentiated, six SOFM networks were applied (Fig. 2, the second algorithm). Then, for improving the performance, different fusion algorithms were used to combine the classification results (Fig. 2, the second algorithm). The applied fusion algorithms are elaborated in the following subsections.
MLPbased fusion
In this study, the MLP network has been used to process output data of the SOFM network. The extracted muscle synergy matrixes were regarded as the input data of the MLP network. The MLP network has two hidden layers. Each hidden layer had 10 neurons with the rectified linear activation function (Eq. 6). The number of neurons in the output layer was six, and the softmax was regarded as the activation function of the output neurons (Eq. 7).
Where x is the input to a neuron in hidden layer ith.
In the formula, k represents the index of the output node, and j represents the indexes of all nodes in the group or layer. The LevenbergMarquardt used as the learning algorithm. The network structure was used as determined by trial and error based on Kfold crossvalidation results. Two hidden layers were envisioned which each layer had 10 neurons. Figure 3 shows the structure of the used MLP.
AlgorithmI: Task discrimination (SOFM algorithm)  
Step 1: Randomly determine the initial values (t=0) of the network’s weights (from the input i to the output neuron j) (0 ≤ i ≤ n − 1)w_{ij}(t) Step 2: Enter the inputs to the network X_{t} = [x_{0}(t), x_{1}(t), x_{2}(t), …, x_{n − 1}(t)] Step 3: Calculate distances between input vector X_{t} and each output node j weight vector w_{ij}(t) using the Euclidean criterion. \( {d}_j={\sum}_{i=0}^{n1}{\left({x}_i(t){w}_{ij}(t)\right)}^2 \) Step 4: Select the winner j^{*} neuron with the least distance min(d_{1}, d_{2}, …, d_{n − 1})=dj^{*} Step 5: update w_{ij}(t),σ(t), η(t) The new weight coefficients are calculated using the given equation. w_{ij}(t + 1) = w_{ij}(t) + η(t)h(t)(x(t) w_{ij}(t)) Step 6: t+1=t, if the network training is not completed, the process is repeated from the step 2. 
Bayesian modelbased fusion
The Bayesian classifier is a straight forward based on probabilities inference. There is a probability model for each quantity that can be adopted optimal decisions by assumption about the probability distribution of new data. For estimating the parameters Bayesian model, the maximum likelihood estimation approach is applied. Given the proposed probability model, Bayesian classifier is trained by supervised learning. Let us suppose the X is input data which contains n synergy vectors {x_{i} : i = 1, 2, …, n}, and Cj shows the jth class which X can belong to it {C_{j} : j = 1, 2, …, c}. Then, the conditional probability of class C_{j} to input X is can be calculated as follows [27]:
The conditional probability of class C_{j} to input X is calculated using minimum error Bayesian classification [27]. The input belongs to a class which has the highest posterior probability.
Where
P(C_{j}): The probability of belonging the input data to the jth class (C_{j})
P(C_{j} X): The probability of belonging the input data to the jth class (C_{j}) given that the input data is X
P(X C_{j}): The conditional probability of class C_{j} to input X.
P(X): The probability that the input data is X. P(X) is constant for all classes, only the P(X C_{j})P(C_{j}) need to be maximized.
Bayesian fuzzy clusteringbased fusion
Fuzzy clustering is an unsupervised algorithm which every data point from a data set simultaneously belongs to all clusters with a varying degree of membership [28]. Each data point, X_{n} for n = 1, 2, …N has a nonnegative membership function u_{nc} in each fuzzy set c = 1.2. …. C. The membership function sum of each data point in all sets is equal to 1, i.e., \( \sum \limits_{c=1}^C{u}_{nc}=1 \). In the BFC algorithm, first, the clusters center, y_{c}, is selected as a random variable; then the membership function (u_{nc}) is defined using (10) [28].
Where, d(X_{n} − y_{c})=‖X_{n} − y_{c}‖ is Euclidean distance.
The prior distribution for clusters membership functions is defined as follows [28]:
Where D is the data dimensions. The negative power in \( \prod \limits_{c=1}^C{u}_{nc}^{\frac{ mD}{2}} \) produce some values of m and D out of the interval [0, 1]. Therefore, inversegamma distributions are used. \( \upalpha =\frac{\mathrm{mD}}{2}1 \) have a small value. Dirichlet is defined as follows [28]:
Here, x_{k} is for all k = 1. …. K x_{k} ≥ 0 and\( \sum \limits_{k=1}^K{x}_k=1 \). If α > 1, membership values converge to values (0 or 1) else fuzzy membership values are selected. α = 1_{C} is a column vector of all ones that clustering output has not been affected. To simplify, conditional distribution of the memberships, p(UX,Y) is obtained from an uniform symmetric Dirichlet distribution [28].
To substitute u_{n} with the new membership sample \( {u}_n^{+} \), first the values u_{n} and \( {u}_n^{+} \) must be obtained by (14), then \( {u}_n^{+} \) replaces u_{n} with the condition (15) [28].
Gaussian prior distribution on the clusters center using average and covariance of the clusters center is as follows [28]:
Here, the control parameter γ is Gaussian prior variance on the clusters center, in which γ < 1 tends toward average data. For simplicity, the new values of the clusters center are considered as follows [28]:
\( {y}_n^{+}\sim \) \( \mathcal{N}\left({y}_c.\frac{1}{\delta }{\varSigma}_y\right) \) (19)
Here, δ is the sample acceptance rate.
In order to create a new cluster in the samples space first, the cluster values \( {y}_n^{+} \) and y_{n} should be calculated in (20), then the new cluster is replaced by y_{n} with considering condition (21) [28]:
Detailed description for the task discrimination with this approach is presented in AlgorithmII.
AlgorithmII: Task discrimination (Bayesian Fuzzy Clustering)  
Step 1: Determine the initial values of the clusters (y_{c}) randomly from the samples and calculate the initial membership functions from (10) Step 2: Calculate the mean value and covariance of clusters centers from (17) and (18) Step 3: Create membership functions and new cluster centers for all samples from (13) and (19) Step 4: Calculate the new and initial membership functions using (14) Step 5: If \( \overset{\sim }{p}\left({x}_n.{u}_n^{+}\right\ Y\left)>\overset{\sim }{p}\left({x}_n.{u}_n\right\ Y\right) \) then u_{n}← \( {u}_n^{+} \) Step 6: Calculate the new and initial cluster centers using (20) Step 7: If \( \overset{\sim }{p}\left({x}_n.{y}_c^{+}\right\ \mathrm{U}\left)>\overset{\sim }{p}\left({x}_n.{y}_c\right\ \mathrm{U}\right) \) then y_{c}← \( {y}_c^{+} \) Step 8: Step 3 to 7, they are repeated in N_{iter} 
3 Results
3.1 Wrist muscle synergies
At the first step, the number of the synergy vectors required to discriminate different tasks was determined. R^{2} criterion was used to determine the number of synergies in (22) [19]. Here, SSE is the sum of the remaining squares, SST is the sum of the remaining squares of the mean activation vector (\( \overline{\mathrm{m}} \)). Figure 4 shows the number of muscle synergies is used in the HALS algorithm to reach the best reconstruction accuracy. The R^{2} criterion for all individuals and tasks with muscles synergy number was evaluated (1–8) using (22).
The R^{2} value obtained as the number of synergies were larger than 5 and was nearly stable (R^{2} ≥ 0.96). Figures 4 and 5 show the value of the computed R^{2} changes with respect to the number of the regarded synergy matrixes. As it can be seen, the reconstruction accuracy has significantly increased as the number of synergy matrixes hit 5 and more (p < 0.05). But, no significant improvement was observed when the number of synergy matrixes increased more the 5 (p > 0.05). As shown in Fig. 6a, reconstruction accuracy has been significantly improved due to increasing the number of synergy patterns from one to five (p < 0.05). According to the carried out analyses, the achieved results were repeatable. For example, as shown in Fig. 6b, the same result has been achieved using the data recorded during different recording trials. It can be seen again in Fig. 6 that reconstruction accuracy has been significantly improved due to increasing the number of synergy patterns from one to five.
3.2 Quantitative comparison of the proposed methods
3.2.1 Evaluation without applying the moving window
At first, the performance of the proposed detection algorithm implemented using different fusion strategies was evaluated while only 70% of the data recorded during performing movement used for processing and detection. In other words, the early and final parts of the data samples, related to muscle activation onset and offset, were removed. In this manner, the data were related to the transient times coincide with the muscle activation onset and offset were removed. As a preliminary evaluation, it can be an acceptable compromise between offline accuracy and realtime performance [8].
In order to assess algorithms performance, a Kfold crossvalidation (K = 10) method was adopted. Then, the quantitative measures computed to compare the efficacy of the applied classification methods using ANOVA test. The statistical analysis showed that there is no significant difference (p > 0.05) among the overall accuracies and sensitivities of the classification methods designed utilizing the MLP, Bayesian, and BFC fusion algorithms along with the classifiers. Overall specificity of BFCbased classifiers significantly differs from two other classifiers designed based on MLP and Bayesian fusion algorithms (p < 0.05). In addition, there is a significant difference (p < 0.05) between the performance of the SOFMbased classification method and used fusionbased classification methods.
Figure 7 shows the overall results and comparison of the proposed algorithms using the data recorded from different subjects. As Fig. 7 shows, using a single SOFM entailed the accuracy value, sensitivity value, and specificity value equal to 87.88 ± 1.54%, 83.38 ± 1.93%, and 74.51 ± 3.03%, respectively. Also, the accuracy values for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 99.78 ± 0.45%, 99.33 ± 0.80%, and 96.43 ± 1.08%, respectively. Also, sensitivity value for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 99.78 ± 0.45%, 99.31 ± 0.79%, and 95.93 ± 1.74%, respectively. In addition, the specificity values for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 98.96 ± 1.06%, 98.56 ± 1.08%, and 90.63 ± 1.56%, respectively. Overall, the average accuracy, average specificity, and average sensitivity achieved through utilizing the fusion algorithms were 97%, 95%, and 96%, respectively. While the average accuracy, average specificity, and average sensitivity achieved through utilizing a single SOFM classifier were less than 88%, less than 75%, and less than 85%, respectively.
The presence of learning interference due to using a single SOFM classifier might cause such relatively low efficient classification. In fact, it can be clearly seen that adopting the fusion algorithms has improved the movements separation.
3.3 Evaluation with applying the moving window
After preliminary evaluations, the detection algorithms were evaluated again while a 256 ms moving window was applied. In fact, a sliding window (256 ms) was moved over the data recorded during a movement. The time window was moved by the moving step called window increment length. In this context, an online mechanism for muscle activation onset detection (integrated profile method) has to be used [29]. According to the adopted mechanism, the continuous integration of rectified SEMG was conducted. Then, the difference between the conducted integration and a reference line was computed over the time. The time instance at which the computed difference value was equal to the maximum value and was regarded as the onset time [29]. Table 2 describes the applied detection strategy, briefly.
As emphasized previously, the window increment length which data processing has to be carried out during this time band is so important. In fact, the processing time must be less than or at least equal to the envisioned window increment length. Therefore, the processing time needed for performing the proposed algorithm as implemented using different incorporated fusion algorithms. Since the classification performance using a single SOFM was not acceptable, the single SOFM classifier was excluded. Table 3 shows the calculated processing time related to the proposed detection method as implemented using different fusion algorithm.
As Table 3 shows, the needed processing times are less than 10 ms. Accordingly, the increment window length must be set to at least 10 ms. In order to determine the optimal increment window length, incremental window length increased gradually from 10 ms to 150 ms. Each incremental step was 10 ms. The statistical analyses (AVOVA) proved that increasing the increment window length did not have a significant influence on the overall performance of the proposed classification methods designed using incorporating the different fusion algorithms (p > 0.05). Therefore, the increment window length was set to the least possible size equals 10 ms. Then, the assessment procedures repeated again using Kfold crossvalidation method (K = 10). As Fig. 8 shows, using a single SOFM entailed the accuracy value, sensitivity value, and specificity value equal to 86.54 ± 2.12%, 80.73 ± 1.63%, and 72.98 ± 2.13%, respectively. Also, the accuracy values for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 99.78 ± 0.45%, 99.33 ± 0.80%, and 96.43 ± 1.08%, respectively. Also, sensitivity value for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 98.51 ± 0.83%, 97.52 ± 0.95%, and 95.80 ± 1.51%, respectively. In addition, the specificity values for MLP, Bayesian, and Bayesian fuzzy clustering (BFC) fusion algorithms were 97.77 ± 0.50%, 97.15 ± 0.11%, and 88.24 ± 2.11, respectively. Overall, using the fusion algorithms yielded the average accuracy more than 96%, the average specificity more than 93, and the average sensitivity more than 94%. According to the statistical analysis, it was showed again that there is no significant difference (p > 0.05) among the overall accuracies and sensitivities of three utilized fusionbased classification methods. While overall specificity of BFCbased classifiers significantly differs from two other classifiers designed based on MLP and Bayesian fusion algorithms (p < 0.05).
4 Discussion
In this paper, the separation of different wrist movements based on muscle synergy patterns was performed using SOFM and based on fusion (i.e., MLP, Bayesian, and BFC) algorithms. The idea of this approach is to use synergy patterns to cover the coordination between the muscles. Furthermore, the fusion mechanism was used to enhance the separation of movements due to the different synergy patterns. The obtained results can be analyzed from different aspects. We will discuss these aspects as follows.
4.1 Number of the synergy patterns
In this study, the effect of the number of extracted synergy vectors on reconstruction error of the wrist muscle activation pattern was analyzed. The results show that increasing the number of synergy vectors more than 5 did not improve the reconstruction performance. In addition, the performance of the movement detection for all subjects are close to each other using five identified synergy patterns. As a result, it can be considered that muscle activity pattern of each movement is extractable with a limited number of synergy vectors. Such results are in conformity with assumptions related to the muscle synergy theory [18], [30, 31].
4.2 The role of the fusion algorithms
The preliminary results that showed the performance of a single SOFM, as a classifier, were not acceptable. It was attributed to the learning interference could arise from possible mutual dependence among the different EMG signals recorded from different participants. Therefore, adopting the fusion approaches seemed necessary to prevent learning interference [32]. Before applying the fusion algorithm, some preprocessing is recommended to enhance the separability of the input data [32, 33]. In this study, three fusion algorithms with nonlinear, probabilistic nature, and fuzzy characteristics have been utilized. The obtained results showed that when a fusion method is used, the results of various movements separation in all participants increased significantly (p < 0.05) compared to a classification using a single SOFM. In fact, instead of using a classification block SOFM for all different movements, a classification block SOFM is considered for each separate movement. Then, the final output of the classification blocks is applied to a fusion block. The statistical analysis showed that there is no significant difference (p > 0.05) among the overall accuracies and sensitivities of three utilized fusionbased classification methods. But, it is worth noting that the average specificity of BFCbased classification method is significantly less than the average specificity of the classification methods designed based on two other fusion algorithms. The BFC fusion algorithm works based on creating the membership functions for each clusters and determining the center of cluster using a probabilistic approach [28]. Therefore, the performance of this fusion algorithm is fully dependent on the clustering accuracy. In other words, misclustering can give rise to increase the number of members negatively clustered in the clusters except the desired cluster (false positive (FP)). Thus, such relatively lower specificity can be attributed to relatively high value of FP arises from likely misclustering.
4.3 Comparing with the previous works
Movement discrimination based on synergy muscle can potentially be more appropriate than other methods since it contains vital information in relation to the muscle activity pattern generated by neural processes [8]; because synergy vectors represent contractions of lowdimensions muscle activities [34]. Hence, the analysis of synergy vectors with different techniques could be a good strategy to improve the approach of the upper limb prostheses. In the last decade, studies have been conducted for movement separation, especially for controlling prostheses based on muscle synergy analyses [3, 8]. The reported separation accuracies are about 95% [3, 8]. While, in this study, the separation average accuracy was obtained more than 97%. This relatively increased accuracy can be attributed to effect of incorporating the fusion algorithms and using six distinct SOFM neural networks as classifiers. This elucidates again the degrading role of learning interference on the performance of the single SOFMbased classifier.
5 Conclusion
In this study, the separation of different wrist movements based on muscle synergy analysis was investigated. In fact, instead of considering each muscle activity patterns and features of each muscle individually, the synergy pattern of movement was extracted. Since the separation of the activity of each muscle and the elimination of the interactions of other muscles is difficult, the authors believe that synergy vectors can be used directly for controlling the rehabilitation and dependent devices in further innovation. The promising achieved classification accuracy can confirm such believe. Nevertheless, more experimental data has to be recorded and has to be analyzed to prove decisively that the achieved results are generalizable. In addition, though the EMG is a good tool to analyze the muscle electrical activity, but the EMG devices are relatively expensive devices and the EMG preprocessing is time consuming. Thus, using the cheap and reliable muscle sensors is preferable for practical implementation of electromyographybased motion detection system. It is recommended to perform initial evaluations on patients in order to implement it practically on basic microcontroller systems.
Availability of data and materials
Please contact corresponding author for data requests.
Abbreviations
 EMG:

Electromyography
 MLP:

Multilayer perceptron
 DoF :

Degreesoffreedom
 TD :

Time domain
 FD:

Frequency domain
 HALS:

Hierarchical alternating least squares
 SOFM:

Selforganizing feature map
 BFC:

Bayesian fuzzy clustering
 ED:

Extensor digitorum
 FPL:

Flexor pollicis longus
 ECU :

Extensor carpi ulnaris
 APL :

Abductor pollicis longus
 PT:

Pronator teres
 Sup :

Supinator
 KKT :

Karush–Kuhn–Tucker
 BMU :

Best matching unit
 FP :

False positive
References
A. Ameri, E.N. Kamavuako, E.J. Scheme, K.B. Englehart, P.A. Parker, Support vector regression for improved realtime, simultaneous myoelectric control. IEEE Transactions on Neural Systems and Rehabilitation Engineering 22(6), 1198–1209 (2014)
M. Chen, P. Zhou, A novel framework based on FastICA for high density surface EMG decomposition. IEEE Transactions on Neural Systems and Rehabilitation Engineering 24(1), 117–127 (2016)
N. Jiang, H. Rehbaum, I. Vujaklija, B. Graimann, D. Farina, Intuitive, online, simultaneous, and proportional myoelectric control over two degreesoffreedom in upper limb amputees. IEEE transactions on neural systems and rehabilitation engineering 22(3), 501–510 (2014)
N. Jiang, I. Vujaklija, H. Rehbaum, B. Graimann, D. Farina, Is accurate mapping of EMG signals on kinematics needed for precise online myoelectric control? IEEE Transactions on Neural Systems and Rehabilitation Engineering 22(3), 549–558 (2014)
J.M. Hahne et al., Linear and nonlinear regression techniques for simultaneous and proportional myoelectric control. IEEE Transactions on Neural Systems and Rehabilitation Engineering 22(2), 269–279 (2014)
S. Amsuess et al., Contextdependent upper limb prosthesis control for natural and robust use. IEEE Transactions on Neural Systems and Rehabilitation Engineering 24(7), 744–753 (2016)
N. Jiang, K.B. Englehart, P.A. Parker, Extracting simultaneous and proportional neural control information for multipleDOF prostheses from the surface electromyographic signal. IEEE transactions on Biomedical Engineering 56(4), 1070–1080 (2009)
G. Rasool, K. Iqbal, N. Bouaynaya, G. White, Realtime task discrimination for myoelectric control employing taskspecific muscle synergies. IEEE Transactions on Neural Systems and Rehabilitation Engineering 24(1), 98–108 (2016)
G. Rasool, N. Bouaynaya, K. Iqbal, G. White, Surface myoelectric signal classification using the ARGARCH model. Biomedical Signal Processing and Control 13, 327–336 (2014)
S.W. Lee, K.M. Wilson, B.A. Lock, D.G. Kamper, Subjectspecific myoelectric pattern classification of functional hand movements for stroke survivors. IEEE Transactions on Neural Systems and Rehabilitation Engineering 19(5), 558–566 (2011)
G. Wang, Z. Wang, W. Chen, J. Zhuang, Classification of surface EMG signals using optimal wavelet packet method based on DaviesBouldin criterion. Medical and Biological Engineering and Computing 44(10), 865–872 (2006)
S. Micera, J. Carpaneto, S. Raspopovic, Control of hand prostheses using peripheral information. IEEE Reviews in Biomedical Engineering 3, 48–68 (2010)
J.U. Chu, I. Moon, M.S. Mun, A realtime EMG pattern recognition system based on linearnonlinear feature projection for a multifunction myoelectric hand. IEEE Transactions on biomedical engineering 53, 2232–2239 (2006)
K. Eom, Y. Choi, H. Sirisena, EMG pattern classification using SOFMs for hand signal recognition. Soft Computing 6(6), 436–440 (2002)
P.A. Parker, R.N. Scott, Myoelectric control of prostheses. Critical reviews in biomedical engineering 13(4), 283–310 (1986)
F.V. Tenore, A. Ramos, A. Fahmy, S. Acharya, R. EtienneCummings, N.V. Thakor, Decoding of individuated finger movements using surface electromyography. IEEE transactions on biomedical engineering 56(5), 1427–1434 (2009)
I. Vujaklija, V. Shalchyan, E. N. Kamavuako, N. Jiang, H. R. Marateb, and D. Farina, Online mapping of EMG signals into kinematics by autoencoding, Journal of neuroengineering and rehabilitation, vol. 15, no. 1, p. 21, 2018.
G. Huang, Z. Xian, Z. Zhang, S. Li, X. Zhu, Divideandconquer muscle synergies: a new feature space decomposition approach for simultaneous multifunction myoelectric control. Biomedical Signal Processing and Control 44, 209–220 (2018)
A. d'Avella, A. Portone, L. Fernandez, F. Lacquaniti, Control of fastreaching movements by muscle synergy combinations. Journal of Neuroscience 26(30), 7791–7810 (2006)
D. J. Berger and A. d’Avella, Towards a myoelectrically controlled virtual reality interface for synergybased stroke rehabilitation, in Converging Clinical and Engineering Research on Neurorehabilitation II, ed: Springer, 2017, pp. 965969.
J. Ma, N. V. Thakor, and F. Matsuno, Hand and wrist movement control of myoelectric prosthesis based on synergy," IEEE Transactions on HumanMachine Systems, vol. 45, no. 1, pp. 7483, 2015.
K. Englehart, B. Hudgins, A robust, realtime control scheme for multifunction myoelectric control. IEEE transactions on biomedical engineering 50, 848–854 (2003)
K.L. Hsieh, C.C. Jeng, I.C. Yang, Y.K. Chen, C.N. Lin, The study of applying a systematic procedure based on SOFM clustering technique into organism clustering. Expert Systems with Applications 33(2), 330–336 (2007)
A. d'Avella, P. Saltiel, and E. Bizzi, Combinations of muscle synergies in the construction of a natural motor behavior, Nature neuroscience, vol. 6, no. 3, p. 300, 2003.
S. Jia, Y. Qian, J. Li, Y. Li, and Z. Ming, Hierarchical alternating least squares algorithm with sparsity constraint for hyperspectral unmixing, in Image Processing (ICIP), 2010 17th IEEE International Conference on, 2010, pp. 23052308: IEEE.
A. Cichocki, R. Zdunek, and S.i. Amari, Hierarchical ALS algorithms for nonnegative matrix and 3D tensor factorization, in International Conference on Independent Component Analysis and Signal Separation, 2007, pp. 169176: Springer.
P.A. Flach, N. Lachiche, Naive Bayesian classification of structured data. Machine Learning 57, 233–269 (2004)
T.C. Glenn, A. Zare, P.D. Gader, Bayesian fuzzy clustering. IEEE Transactions on Fuzzy Systems 23(5), 1545–1561 (2015)
J. Liu, Q. Liu, Use of the integrated profile for voluntary muscle activity detection using EMG signals with spurious background spikes: a study with incomplete spinal cord injury. Biomedical Signal Processing and Control 24, 19–24 (2016)
E. Bizzi, V. Cheung, A. d'Avella, P. Saltiel, M. Tresch, Combining modules for movement. Brain research reviews 57(1), 125–133 (2008)
A. Ebied, E. KinneyLang, L. Spyrou, J. Escudero, Evaluation of matrix factorisation approaches for muscle synergy extraction. Medical engineering & physics 57, 51–60 (2018)
J. Kim and E. André, Fusion of multichannel biosignals towards automatic emotion recognition, in Multisensor Fusion and Integration for Intelligent Systems: Springer, 2009, pp. 5568.
J.A. Benediktsson, I. Kanellopoulos, Classification of multisource and hyperspectral data based on decision fusion. IEEE Transactions on Geoscience and Remote Sensing 37(3), 1367–1377 (1999)
M. Tavakoli, C. Benussi, J.L. Lourenco, Single channel surface EMG control of advanced prosthetic hands: A simple, low cost and efficient approach. Expert Systems with Applications 79, 322–332 (2017)
Acknowledgements
All research steps were carried out in the Biomedical Research Center at Islamic Azad University of Mashhad.
Funding
Not applicable
Author information
Authors and Affiliations
Contributions
AM conducted the data recording experiments on the participants and contributed to implementing the proposed detection algorithms. RS provided assistances in the design the study and contributed to the result analysis and preparation of manuscript. HRK carried out the design and coordinated the study and contributed to data analysis and preparing the manuscript. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Consent for publication
Not applicable
Competing interests
The authors declare that they have no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Masoumdoost, A., Saadatyar, R. & Kobravi, H.R. A muscle synergiesbased movements detection approach for recognition of the wrist movements. EURASIP J. Adv. Signal Process. 2020, 43 (2020). https://doi.org/10.1186/s1363402000699y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s1363402000699y