1
|
Cao G, Jia S, Wu Q, Xia C. MMG-Based Motion Segmentation and Recognition of Upper Limb Rehabilitation Using the YOLOv5s-SE. SENSORS (BASEL, SWITZERLAND) 2025; 25:2257. [PMID: 40218771 PMCID: PMC11990975 DOI: 10.3390/s25072257] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/17/2025] [Revised: 03/30/2025] [Accepted: 04/01/2025] [Indexed: 04/14/2025]
Abstract
Mechanomyography (MMG) is a non-invasive technique for assessing muscle activity by measuring mechanical signals, offering high sensitivity and real-time monitoring capabilities, and it has many applications in rehabilitation training. Traditional MMG-based motion recognition relies on feature extraction and classifier training, which require segmenting continuous actions, leading to challenges in real-time performance and segmentation accuracy. Therefore, this paper proposes an innovative method for the real-time segmentation and classification of upper limb rehabilitation actions based on the You Only Look Once (YOLO) algorithm, integrating the Squeeze-and-Excitation (SE) attention mechanism to enhance the model's performance. In this paper, the collected MMG signals were transformed into one-dimensional time-series images. After image processing, the training set and test set were divided for the training and testing of the YOLOv5s-SE model. The results demonstrated that the proposed model effectively segmented isolated and continuous MMG motions while simultaneously performing real-time motion category prediction and outputting results. In segmentation tasks, the base YOLOv5s model achieved 97.9% precision and 98.0% recall, while the improved YOLOv5s-SE model increased precision to 98.7% (+0.8%) and recall to 98.3% (+0.3%). Additionally, the model demonstrated exceptional accuracy in predicting motion categories, achieving an accuracy of 98.9%. This method realizes the automatic segmentation of time-domain motions, avoids the limitations of manual parameter adjustment in traditional methods, and simultaneously enhances the real-time performance of MMG motion recognition through image processing, providing an effective solution for motion analysis in wearable devices.
Collapse
Affiliation(s)
- Gangsheng Cao
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (G.C.); (S.J.)
| | - Shen Jia
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (G.C.); (S.J.)
| | - Qing Wu
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (G.C.); (S.J.)
| | - Chunming Xia
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (G.C.); (S.J.)
- School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, China
| |
Collapse
|
2
|
CAO GANGSHENG, ZHANG YUE, ZHANG HANYANG, ZHAO TONGTONG, XIA CHUNMING. A HYBRID RECOGNITION METHOD VIA KELM WITH CPSO FOR MMG-BASED UPPER-LIMB MOVEMENTS CLASSIFICATION. J MECH MED BIOL 2024; 24. [DOI: 10.1142/s0219519423500847] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Abstract
Mechanomyography (MMG) is a low-frequency signal emitted during muscle contraction; it can overcome the inherently unreliable defects of electromyography (EMG) and electroencephalography (EEG). For MMG-based movement pattern recognition, this paper proposes an innovative kernel extreme learning machine (KELM) based on the chaotic particle swarm optimization (CPSO), namely CPSO–KELM. By using CPSO–KELM in MMG-based movement pattern recognition, the classification accuracy of upper-limb movement has been improved, and the results can be better applied to the control of passive rehabilitation training of the upper-limb exoskeleton, which can provide help for the upper extremity rehabilitation of stroke patients. In this paper, MMG which is used for pattern recognition research, is collected by accelerometers when the subjects performed seven types of upper-limb rehabilitation movements. After filtering and segmentation, six time-domain features are extracted for the MMG of each channel, then kernel principal component analysis (KPCA) and principal component analysis (PCA) are used to reduce the feature dimensions. By using different classifiers to build classification models, the average recognition accuracies of movement classification under different processing methods are obtained; it is found that for most classifiers, the recognition rate of MMG after KPCA dimensionality reduction is better than that of PCA, and the overall recognition rate of upper-limb movements using the CPSO–KELM classifier can reach 97.1%, which is better than support vector machine (SVM), back-propagation neural network (BPNN), linear discriminant algorithm (LDA) and other MMG common classifiers in recognition accuracy. Moreover, the experimental analysis shows that compared with genetic algorithm (GA) and particle swarm optimization (PSO), CPSO has faster convergence and smaller training error, and the final recognition accuracy proves that the performance of CPSO–KELM is better than those of GA–KELM and PSO–KELM.
Collapse
Affiliation(s)
- GANGSHENG CAO
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - YUE ZHANG
- School of Mechanical Engineering, Nantong University Nantong, Jiangsu 226019, P. R. China
| | - HANYANG ZHANG
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - TONGTONG ZHAO
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - CHUNMING XIA
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
- School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620, P. R. China
| |
Collapse
|
3
|
Zhang Y, Cao G, Sun M, Zhao B, Wu Q, Xia C. Mechanomyography signals pattern recognition in hand movements using swarm intelligence algorithm optimized support vector machine based on acceleration sensors. Med Eng Phys 2024; 124:104060. [PMID: 38418032 DOI: 10.1016/j.medengphy.2023.104060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Revised: 09/19/2023] [Accepted: 10/02/2023] [Indexed: 03/01/2024]
Abstract
On the basis of extracting mechanomyography (MMG) signal features, the classification of hand movements has certain application values in human-machine interaction systems and wearable devices. In this paper, pattern recognition of hand movements based on MMG signal is studied with swarm intelligence algorithms introduced to optimize support vector machine (SVM). Time domain (TD) features, wavelet packet node energy (WPNE) features, frequency domain (FD) features, convolution neural network (CNN) features were extracted from each channel to constitute different feature sets. Three novel swarm intelligence algorithms (i.e., bald eagle search (BES), sparrow search algorithm (SSA), grey wolf optimization (GWO)) optimized SVM is proposed to train the models and recognition of hand movements are tested for each MMG feature extraction method. Using GWO as the optimization algorithm, time consumption is less than using the other two swarm algorithms. Using GWO with TD+FD features can obtain the classification accuracy of 93.55 %, which is higher than other methods while using CNN to extract features can be independent of domain knowledge. The results confirm GWO-SVM with TD + FD features is superior to some other methods in the classification problem for tiny samples based on MMG.
Collapse
Affiliation(s)
- Yue Zhang
- School of Mechanical Engineering, Nantong University, Nantong 226019 China
| | - Gangsheng Cao
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237 China
| | - Maoxun Sun
- School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| | - Baigan Zhao
- School of Mechanical Engineering, Nantong University, Nantong 226019 China
| | - Qing Wu
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237 China
| | - Chunming Xia
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237 China; School of Mechanical and Automotive Engineering, Shanghai University of Engineering Science, Shanghai 201620 China.
| |
Collapse
|
4
|
Zhang Y, Sun M, Xia C, Zhou J, Cao G, Wu Q. Mechanomyography Signal Pattern Recognition of Knee and Ankle Movements Using Swarm Intelligence Algorithm-Based Feature Selection Methods. SENSORS (BASEL, SWITZERLAND) 2023; 23:6939. [PMID: 37571722 PMCID: PMC10422262 DOI: 10.3390/s23156939] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2023] [Revised: 07/24/2023] [Accepted: 08/03/2023] [Indexed: 08/13/2023]
Abstract
Pattern recognition of lower-limb movements based on mechanomyography (MMG) signals has a certain application value in the study of wearable rehabilitation-training devices. In this paper, MMG feature selection methods based on a chameleon swarm algorithm (CSA) and a grasshopper optimization algorithm (GOA) are proposed for the pattern recognition of knee and ankle movements in the sitting and standing positions. Wireless multichannel MMG acquisition systems were designed and used to collect MMG movements from four sites on the subjects thighs. The relationship between the threshold values and classification accuracy was analyzed, and comparatively high recognition rates were obtained after redundant information was eliminated. When the threshold value rose, the recognition rates from the CSA fluctuated within a small range: up to 88.17% (sitting position) and 90.07% (standing position). However, the recognition rates from the GOA drop dramatically when increasing the threshold value. The comparison results demonstrated that using a GOA consumes less time and selects fewer features, while a CSA gives higher recognition rates of knee and ankle movements.
Collapse
Affiliation(s)
- Yue Zhang
- School of Mechanical Engineering, Nantong University, Nantong 226019, China; (Y.Z.)
| | - Maoxun Sun
- School of Mechanical Engineering, University of Shanghai for Science and Technology, Shanghai 200093, China;
| | - Chunming Xia
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (C.X.)
| | - Jie Zhou
- School of Mechanical Engineering, Nantong University, Nantong 226019, China; (Y.Z.)
| | - Gangsheng Cao
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (C.X.)
| | - Qing Wu
- School of Mechanical and Power Engineering, East China University of Science and Technology, Shanghai 200237, China; (C.X.)
| |
Collapse
|
5
|
Zhao T, Cao G, Zhang Y, Zhang H, Xia C. Incremental learning of upper limb action pattern recognition based on mechanomyography. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2022.103959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/15/2022]
|
6
|
Zhang H, Wang X, Zhang Y, Cao G, Xia C. Design on a wireless mechanomyography acquisition equipment and feature selection for lower limb motion recognition. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103679] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
7
|
ZHANG HANYANG, ZHONG YANBIAO, ZHANG YUE, YANG KE, XIA CHUNMING, SHAN CHUNLEI. FEATURES ANALYSIS AND SYSTEM IDENTIFICATION OF MECHANOMYOGRAPHY AND ELECTROMYOGRAPHY UNDER TRANSCRANIAL MAGNETIC STIMULATION. J MECH MED BIOL 2021. [DOI: 10.1142/s0219519421500597] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Transcranial magnetic stimulation (TMS) is an electrophysiological technique that uses alternating magnetic fields to deliver electric current and stimulate the cerebral cortex. When TMS is used for the evaluation of brain diseases, it is necessary to detect the contraction of the corresponding muscles in the cerebral cortex stimulated by TMS, and the muscle activity referred to as motor evoked potential (MEP). This study simultaneously recorded the mechanomyography (MMG) and electromyography (EMG) from the right abductor pollicis brevis muscle during TMS with different intensities in order to observe whether the MEP parameters from MMG signals showed similar trait of EMG recordings. Moreover, the subspace method (N4SID) and transfer function were used to identify the TMS–MMG system. In this system, the input was a pulse signal of TMS, and the output was the MMG signal detected from the target muscle. The TMS–MMG system was identified as a fourth-order model. This study also analyzed the internal features of the system and demonstrated that the poles of healthy subjects were distributed in a range, and the gain increased with the increase of the TMS intensity. It was found that MMG signals can be used as diagnostic indicators of TMS, and the TMS–MMG model can be used to further explore the details of how TMS generates responses measured with MMG.
Collapse
Affiliation(s)
- HANYANG ZHANG
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - YANBIAO ZHONG
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, 1200 Cailun Road, Pudong New District, Shanghai 201203, P. R. China
| | - YUE ZHANG
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - KE YANG
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - CHUNMING XIA
- Department of Mechanical Engineering, East China University of Science and Technology, Shanghai 200237, P. R. China
| | - CHUNLEI SHAN
- School of Rehabilitation Science, Shanghai University of Traditional Chinese Medicine, 1200 Cailun Road, Pudong New District, Shanghai 201203, P. R. China
| |
Collapse
|