1
|
Su S, Chai G, Xu W, Meng J, Sheng X, Mouraux A, Zhu X. Neural evidence for functional roles of tactile and visual feedback in the application of myoelectric prosthesis. J Neural Eng 2023; 20. [PMID: 36595235 DOI: 10.1088/1741-2552/acab32] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2021] [Accepted: 12/13/2022] [Indexed: 12/15/2022]
Abstract
Objective. The primary purpose of this study was to investigate the electrophysiological mechanism underlying different modalities of sensory feedback and multi-sensory integration in typical prosthesis control tasks.Approach. We recruited 15 subjects and developed a closed-loop setup for three prosthesis control tasks which covered typical activities in the practical prosthesis application, i.e. prosthesis finger position control (PFPC), equivalent grasping force control (GFC) and box and block control (BABC). All the three tasks were conducted under tactile feedback (TF), visual feedback (VF) and tactile-visual feedback (TVF), respectively, with a simultaneous electroencephalography (EEG) recording to assess the electroencephalogram (EEG) response underlying different types of feedback. Behavioral and psychophysical assessments were also administered in each feedback condition.Results. EEG results showed that VF played a predominant role in GFC and BABC tasks. It was reflected by a significantly lower somatosensory alpha event-related desynchronization (ERD) in TVF than in TF and no significant difference in visual alpha ERD between TVF and VF. In PFPC task, there was no significant difference in somatosensory alpha ERD between TF and TVF, while a significantly lower visual alpha ERD was found in TVF than in VF, indicating that TF was essential in situations related to proprioceptive position perception. Tactile-visual integration was found when TF and VF were congruently implemented, showing an obvious activation over the premotor cortex in the three tasks. Behavioral and psychophysical results were consistent with EEG evaluations.Significance. Our findings could provide neural evidence for multi-sensory integration and functional roles of tactile and VF in a practical setting of prosthesis control, shedding a multi-dimensional insight into the functional mechanisms of sensory feedback.
Collapse
Affiliation(s)
- Shiyong Su
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Guohong Chai
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Wei Xu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Jianjun Meng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - Xinjun Sheng
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| | - André Mouraux
- Institute of Neuroscience (IoNS), Université catholique de Louvain, Brussels, Belgium
| | - Xiangyang Zhu
- State Key Laboratory of Mechanical System and Vibration, Shanghai Jiao Tong University, Shanghai, People's Republic of China
| |
Collapse
|
2
|
Qin C, Liang W, Xie D, Bi S, Chou CH. EEG Features of Evoked Tactile Sensation: Two Cases Study. Front Hum Neurosci 2022; 16:904216. [PMID: 35754770 PMCID: PMC9221836 DOI: 10.3389/fnhum.2022.904216] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2022] [Accepted: 05/10/2022] [Indexed: 11/13/2022] Open
Abstract
Purpose: Sensory feedback for prosthetics is an important issue. The area of forearm stump skin that has evoked tactile sensation (ETS) of fingers is defined as the projected finger map (PFM), and the area close to the PFM region that does not have ETS is defined as the non-projected finger map (NPFM). Previous studies have confirmed that ETS can restore the tactile pathway of the lost finger, which was induced by stimulation of transcutaneous electrical nerve stimulation (TENS) on the end of stump skin. This study aims to reveal EEG features between the PFM and the NPFM regions of the stumps under the same TENS stimulation condition. Methods: The PFM and NPFM regions of the two subjects were stimulated with the same intensity of TENS, respectively. TENS as target stimuli are modulated according to the Oddball paradigm to evoke the P300 components. Result: The PFM regions of both subjects were able to elicit P300 components, while their NPFM regions were not able to elicit P300 components. However, this P300 appears early (249 ms for subject 1,230 ms for subject 2) and has continuous positive peaks (peak 1,139 ± 3 ms, peak 2,194 ± 0.5 ms) in front of it. Discussion: N30 and P300 can prove that the two subjects with PFM can perceive and recognize ETS. The heteromorphisms of the P300 waveform may be related to the difficulty in subjects' cognition of ETS or caused by the fusion of P150, P200, and P300.
Collapse
Affiliation(s)
- Changyu Qin
- National Research Center for Rehabilitation Technical Aids, Beijing, China
| | - Wenyuan Liang
- National Research Center for Rehabilitation Technical Aids, Beijing, China.,Beijing Key Laboratory of Rehabilitation Technical Aids for Old-Age Disability, Beijing, China
| | - Dian Xie
- Beijing Language and Culture University, Beijing, China
| | - Sheng Bi
- National Research Center for Rehabilitation Technical Aids, Beijing, China
| | - Chih-Hong Chou
- School of Biomedical Engineering, Shanghai Jiaotong University, Shanghai, China
| |
Collapse
|
3
|
Geng Y, Qin L, Li Y, Yu Z, Li L, Asogbon MG, Zhan Y, Yan N, Guo X, Li G. Identifying Oscillations under Multi-site Sensory Stimulation for High-level Peripheral Nerve Injured Patients:A Pilot Study. J Neural Eng 2022; 19. [PMID: 35580572 DOI: 10.1088/1741-2552/ac7079] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2021] [Accepted: 05/17/2022] [Indexed: 11/11/2022]
Abstract
OBJECTIVE For high-level peripheral nerve injured (PNI) patients with severe sensory dysfunction of upper extremities, identifying the multi-site tactile stimulation is of great importance to provide neurorehabilitation with sensory feedback. In this pilot study, we showed the feasibility of identifying multi-site and multi-intensity tactile stimulation in terms of electroencephalography (EEG). APPROACH Three high-level PNI patients and eight non-PNI participants were recruited in this study. Four different sites over the upper arm, forearm, thumb finger and little finger were randomly stimulated at two intensities (both sensory-level) based on the transcutaneous electrical nerve stimulation (TENS). Meanwhile, 64-channel EEG signals were recorded during the passive tactile sense stimulation on each side. MAIN RESULTS The spatial-spectral distribution of brain oscillations underlying multi-site sensory stimulation showed dominant power attenuation over the somatosensory and prefrontal cortices in both alpha-band (8-12 Hz) and beta-band (13-30 Hz). But there was no significant difference among different stimulation sites in terms of the averaged power spectral density over the region of interest (ROI). By further identifying different stimulation sites using temporal-spectral features, we found the classification accuracies were all above 89% for the affected arm of PNI patients, comparable to that from their intact side and that from the non-PNI group. When the stimulation site-intensity combinations were treated as eight separate classes, the classification accuracies were ranging from 88.89% to 99.30% for the affected side of PNI subjects, similar to that from their non-affected side and that from the non-PNI group. Other performance metrics, including Specificity, Precision, and F1-Score, also showed a sound identification performance for both PNI patients and non-PNI subjects. SIGNIFICANCE These results suggest that reliable brain oscillations could be evoked and identified well, even though induced tactile sense could not be discerned by the PNI patients. This study have implication for facilitating bidirectional neurorehabilitation systems with sensory feedback.
Collapse
Affiliation(s)
- Yanjuan Geng
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Liuni Qin
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Yongcheng Li
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Zhebin Yu
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Linling Li
- Shenzhen University, 1066 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, 518060, CHINA
| | - Mojisola Grace Asogbon
- Shenzhen Institutes of Advanced Technology, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Yang Zhan
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Nan Yan
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| | - Xin Guo
- Hebei University of Technology, Hebei University of Technology, Tianjin 300130, China, Tianjin, Tianjin, 300401, CHINA
| | - Guanglin Li
- Shenzhen Institutes of Advanced Technology Chinese Academy of Sciences, 1068 Xueyuan Boulevard, University Town of Shenzhen, Xili Nanshan, Shenzhen 518055, China, Shenzhen, Guangdong, 518055, CHINA
| |
Collapse
|
4
|
Liu Y, Xi P, Li B, Zhang M, Liu H, Tang R, Xin S, Huang Q, He J, Liu Z, Yuan Z, Lang Y. Effect of neuromorphic transcutaneous electrical nerve stimulation (nTENS) of cortical functional networks on tactile perceptions: An event-related electroencephalogram study. J Neural Eng 2022; 19. [PMID: 35263714 DOI: 10.1088/1741-2552/ac5bf6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2021] [Accepted: 03/09/2022] [Indexed: 11/12/2022]
Abstract
BACKGROUND Transcutaneous electrical nerve stimulation (TENS) is generally applied for tactile feedback in the field of prosthetics. The distinct mechanisms of evoked tactile perception between stimulus patterns in conventional TENS (cTENS) and neuromorphic TENS (nTENS) are relatively unknown. This is the first study to investigate the neurobiological effect of nTENS for cortical functional mechanism in evoked tactile perception. METHODS Twenty-one healthy participants were recruited in this study. Electroencephalogram (EEG) was recorded while the participants underwent a tactile discrimination task. One cTENS pattern (square pattern) and two nTENS patterns (electromyography and single motor unit patterns) were applied to evoke tactile perception in four fingers, including the right and left index and little fingers. EEG was preprocessed and somatosensory-evoked potentials (SEPs) were determined. Then, source-level functional networks based on graph theory were evaluated, including clustering coefficient, path length, global efficiency, and local efficiency in six frequency bands. RESULTS Behavioral results suggested that the single motor units (SMU) pattern of nTENS was the most natural tactile perception. SEPs results revealed that SMU pattern exhibited significant shorter latency in P1 and N1 components than the other patterns, while nTENS patterns have significantly longer latency in P3 component than cTENS pattern. Cortical functional networks showed that the SMU pattern had the lowest short path and highest efficiency in beta and gamma bands. CONCLUSION This study highlighted that distinct TENS patterns could affect brain activities. The new characteristics in tactile manifestation of nTENS would provide insights for the application of tactile perception restoration.
Collapse
Affiliation(s)
- Yafei Liu
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, 100081, CHINA
| | - Pengcheng Xi
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Bo Li
- School of Mechatronical Engineering, Beijing Institute of Technology, No. 5, South Street, Zhongguancun, Haidian District, Beijing, Bei Jing, Bei Jing, 100081, CHINA
| | - Minjian Zhang
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Honghao Liu
- School of Mechatronical Engineering, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Rongyu Tang
- School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, No.1 Zhanlanguan Road, Xicheng District, Beijing, Beijing, 100044, CHINA
| | - Shan Xin
- School of Electrical and Information Engineering, Beijing University of Civil Engineering and Architecture, NO.1, Zhanlanguan Road, Xicheng District, Beijing, Beijing, 100044, CHINA
| | - Qiang Huang
- Beijing Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Jiping He
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, No.5 South Zhongguancun street, Haidian District, Beijing, Beijing, 100081, CHINA
| | - Zhiqiang Liu
- Beijing institute of basic medical sciences, 27 Taiping Road, HaidianDistrict, Beijing, Beijing, 100850, CHINA
| | - Zengqiang Yuan
- Beijing institute of basic medical sciences, 27 Taiping Road, HaidianDistrict, Beijing, 100850, CHINA
| | - Yiran Lang
- Beijing Advanced Innovation Center for Intelligent Robots and Systems, Beijing Institute of Technology, Haidian Dist. Zhongguancun South Street No. 5, Beijing, 100081, CHINA
| |
Collapse
|
5
|
Su S, Chai G, Meng J, Sheng X, Mouraux A, Zhu X. Towards optimizing the non-invasive sensory feedback interfaces in a neural prosthetic control. J Neural Eng 2022; 19. [DOI: 10.1088/1741-2552/ac4e1b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/03/2021] [Accepted: 01/24/2022] [Indexed: 11/12/2022]
Abstract
Abstract
Objective. The somatotopic interface (SI) and non-somatotopic interface (NI) are commonly used to provide non-invasive sensory feedback. Nevertheless, differences between SI and NI are rarely reported, and objective evaluations of the corresponding brain response are missing as well. Few studies have reported how to design the stimulation encoding based on the two interfaces. The objective of this study was to investigate the difference in sensory characteristics between SI and NI, and propose an optimal encoding method for non-invasive feedback interfaces. Approach. We recruited seven amputees and compared the tactile sensitivity to stimulated positions and intensities between SI (phantom finger area) and NI (upper arm) in a tactile discrimination task. Electroencephalography (EEG) evaluation task was subsequently conducted to objectively evaluate the stimulus-evoked brain response. Finally, the two kinds of tactile information (stimulated position and intensity) was applied to an object recognition task. Specifically, the object size was reflected by the prosthetic finger position through stimulated position encoding, and the object stiffness was reflected by the contact force of prosthetic fingers through stimulated intensity encoding. We compared the performance under four feedback conditions (combinations between two kinds of tactile information and two interfaces). Results. Behavioral results showed that NI was more sensitive to position information while SI was more sensitive to intensity information. EEG results were consistent with behavioral results, showing a higher sensitivity of sensory alpha ERD for NI in the position discrimination, while the trend was opposite in the intensity discrimination. The feedback encoding allowed amputees to discriminate the size and stiffness of nine objects with the best performance of 62% overall accuracy (84% for size discrimination, 71% for stiffness discrimination) when position and intensity information was delivered on the NI and SI, respectively. Signicance. Our results provided an instructive strategy for sensory feedback via non-invasive solutions.
Collapse
|
6
|
Petit J, Rouillard J, Cabestaing F. EEG-based brain-computer interfaces exploiting steady-state somatosensory-evoked potentials: a literature review. J Neural Eng 2021; 18. [PMID: 34725311 DOI: 10.1088/1741-2552/ac2fc4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Accepted: 10/14/2021] [Indexed: 11/11/2022]
Abstract
A brain-computer interface (BCI) aims to derive commands from the user's brain activity in order to relay them to an external device. To do so, it can either detect a spontaneous change in the mental state, in the so-called 'active' BCIs, or a transient or sustained change in the brain response to an external stimulation, in 'reactive' BCIs. In the latter, external stimuli are perceived by the user through a sensory channel, usually sight or hearing. When the stimulation is sustained and periodical, the brain response reaches an oscillatory steady-state that can be detected rather easily. We focus our attention on electroencephalography-based BCIs (EEG-based BCI) in which a periodical signal, either mechanical or electrical, stimulates the user skin. This type of stimulus elicits a steady-state response of the somatosensory system that can be detected in the recorded EEG. The oscillatory and phase-locked voltage component characterising this response is called a steady-state somatosensory-evoked potential (SSSEP). It has been shown that the amplitude of the SSSEP is modulated by specific mental tasks, for instance when the user focuses their attention or not to the somatosensory stimulation, allowing the translation of this variation into a command. Actually, SSSEP-based BCIs may benefit from straightforward analysis techniques of EEG signals, like reactive BCIs, while allowing self-paced interaction, like active BCIs. In this paper, we present a survey of scientific literature related to EEG-based BCI exploiting SSSEP. Firstly, we endeavour to describe the main characteristics of SSSEPs and the calibration techniques that allow the tuning of stimulation in order to maximise their amplitude. Secondly, we present the signal processing and data classification algorithms implemented by authors in order to elaborate commands in their SSSEP-based BCIs, as well as the classification performance that they evaluated on user experiments.
Collapse
Affiliation(s)
- Jimmy Petit
- University of Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL, F-59000 Lille, France
| | - José Rouillard
- University of Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL, F-59000 Lille, France
| | - François Cabestaing
- University of Lille, CNRS, Centrale Lille, UMR 9189 CRIStAL, F-59000 Lille, France
| |
Collapse
|
7
|
Xu L, Xu M, Jung TP, Ming D. Review of brain encoding and decoding mechanisms for EEG-based brain-computer interface. Cogn Neurodyn 2021; 15:569-584. [PMID: 34367361 PMCID: PMC8286913 DOI: 10.1007/s11571-021-09676-z] [Citation(s) in RCA: 37] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2020] [Revised: 03/10/2021] [Accepted: 03/26/2021] [Indexed: 01/04/2023] Open
Abstract
A brain-computer interface (BCI) can connect humans and machines directly and has achieved successful applications in the past few decades. Many new BCI paradigms and algorithms have been developed in recent years. Therefore, it is necessary to review new progress in BCIs. This paper summarizes progress for EEG-based BCIs from the perspective of encoding paradigms and decoding algorithms, which are two key elements of BCI systems. Encoding paradigms are grouped by their underlying neural meachanisms, namely sensory- and motor-related, vision-related, cognition-related and hybrid paradigms. Decoding algorithms are reviewed in four categories, namely decomposition algorithms, Riemannian geometry, deep learning and transfer learning. This review will provide a comprehensive overview of both modern primary paradigms and algorithms, making it helpful for those who are developing BCI systems.
Collapse
Affiliation(s)
- Lichao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Tzyy-Ping Jung
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Swartz Center for Computational Neuroscience, University of California, San Diego, USA
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|