1
|
Wang Y, Wang X, Wang L, Zheng L, Meng S, Zhu N, An X, Wang L, Yang J, Zheng C, Ming D. Dynamic prediction of goal location by coordinated representation of prefrontal-hippocampal theta sequences. Curr Biol 2024:S0960-9822(24)00372-5. [PMID: 38608677 DOI: 10.1016/j.cub.2024.03.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 01/20/2024] [Accepted: 03/19/2024] [Indexed: 04/14/2024]
Abstract
Prefrontal (PFC) and hippocampal (HPC) sequences of neuronal firing modulated by theta rhythms could represent upcoming choices during spatial memory-guided decision-making. How the PFC-HPC network dynamically coordinates theta sequences to predict specific goal locations and how it is interrupted in memory impairments induced by amyloid beta (Aβ) remain unclear. Here, we detected theta sequences of firing activities of PFC neurons and HPC place cells during goal-directed spatial memory tasks. We found that PFC ensembles exhibited predictive representation of the specific goal location since the starting phase of memory retrieval, earlier than the hippocampus. High predictive accuracy of PFC theta sequences existed during successful memory retrieval and positively correlated with memory performance. Coordinated PFC-HPC sequences showed PFC-dominant prediction of goal locations during successful memory retrieval. Furthermore, we found that theta sequences of both regions still existed under Aβ accumulation, whereas their predictive representation of goal locations was weakened with disrupted spatial representation of HPC place cells and PFC neurons. These findings highlight the essential role of coordinated PFC-HPC sequences in successful memory retrieval of a precise goal location.
Collapse
Affiliation(s)
- Yimeng Wang
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China
| | - Xueling Wang
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China
| | - Ling Wang
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China
| | - Li Zheng
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China
| | - Shuang Meng
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China
| | - Nan Zhu
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China
| | - Xingwei An
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China
| | - Lei Wang
- School of Statistics and Data Science, Nankai University, Tianjin 300071, China.
| | - Jiajia Yang
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300072, China.
| | - Chenguang Zheng
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300072, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, Tianjin 300072, China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072, China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300072, China.
| |
Collapse
|
2
|
Kang X, Liu X, Chen S, Zhang W, Liu S, Ming D. Major depressive disorder recognition by quantifying EEG signal complexity using proposed APLZC and AWPLZC. J Affect Disord 2024; 356:105-114. [PMID: 38580036 DOI: 10.1016/j.jad.2024.03.169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/07/2023] [Revised: 03/27/2024] [Accepted: 03/29/2024] [Indexed: 04/07/2024]
Abstract
BACKGROUND Seeking objective quantitative indicators is important for accurately recognizing major depressive disorder (MDD). Lempel-Ziv complexity (LZC), employed to characterize neurological disorders, faces limitations in tracking dynamic changes in EEG signals due to defects in the coarse-graining process, hindering its precision for MDD objective quantitative indicators. METHODS This work proposed Adaptive Permutation Lempel-Ziv Complexity (APLZC) and Adaptive Weighted Permutation Lempel-Ziv Complexity (AWPLZC) algorithms by refining the coarse-graining process and introducing weight factors to effectively improve the precision of LZC in characterizing EEGs and further distinguish MDD patients better. APLZC incorporated the ordinal pattern, while False Nearest Neighbor and Mutual Information algorithms were introduced to determine and adjust key parameters adaptively. Furthermore, we proposed AWPLZC by assigning different weights to each pattern based on APLZC. Thirty MDD patients and 30 healthy controls (HCs) were recruited and their 64-channel resting EEG signals were collected. The complexities of gamma oscillations were then separately computed using LZC, APLZC, and AWPLZC algorithms. Subsequently, a multi-channel adaptive K-nearest neighbor model was constructed for identifying MDD patients and HCs. RESULTS LZC, APLZC, and AWPLZC algorithms achieved accuracy rates of 78.29 %, 90.32 %, and 95.13 %, respectively. Sensitivities reached 67.96 %, 85.04 %, and 98.86 %, while specificities were 88.62 %, 95.35 %, and 89.92 %, respectively. Notably, AWPLZC achieved the best performance in accuracy and sensitivity, with a specificity limitation. LIMITATION The sample size is relatively small. CONCLUSION APLZC and AWPLZC algorithms, particularly AWPLZC, demonstrate superior effectiveness in differentiating MDD patients from HCs compared with LZC. These findings hold significant clinical implications for MDD diagnosis.
Collapse
Affiliation(s)
- Xianyun Kang
- Medical School, Tianjin University, Tianjin 300072, China
| | - Xiaoya Liu
- Medical School, Tianjin University, Tianjin 300072, China
| | - Sitong Chen
- Medical School, Tianjin University, Tianjin 300072, China
| | - Wenquan Zhang
- Medical School, Tianjin University, Tianjin 300072, China
| | - Shuang Liu
- Medical School, Tianjin University, Tianjin 300072, China.
| | - Dong Ming
- Medical School, Tianjin University, Tianjin 300072, China
| |
Collapse
|
3
|
Ke Y, Liu S, Ming D. Enhancing SSVEP Identification With Less Individual Calibration Data Using Periodically Repeated Component Analysis. IEEE Trans Biomed Eng 2024; 71:1319-1331. [PMID: 37971909 DOI: 10.1109/tbme.2023.3333435] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2023]
Abstract
OBJECTIVE Spatial filtering and template matching-based steady-state visually evoked potentials (SSVEP) identification methods usually underperform in SSVEP identification with small-sample-size calibration data, especially when a single trial of data is available for each stimulation frequency. METHODS In contrast to the state-of-the-art task-related component analysis (TRCA)-based methods, which construct spatial filters and SSVEP templates based on the inter-trial task-related components in SSVEP, this study proposes a method called periodically repeated component analysis (PRCA), which constructs spatial filters to maximize the reproducibility across periods and constructs synthetic SSVEP templates by replicating the periodically repeated components (PRCs). We also introduced PRCs into two improved variants of TRCA. Performance evaluation was conducted in a self-collected 16-target dataset, a public 40-target dataset, and an online experiment. RESULTS The proposed methods show significant performance improvements with less training data and can achieve comparable performance to the baseline methods with 5 trials by using 2 or 3 training trials. Using a single trial of calibration data for each frequency, the PRCA-based methods achieved the highest average accuracies of over 95% and 90% with a data length of 1 s and maximum average information transfer rates (ITR) of 198.8±57.3 bits/min and 191.2±48.1 bits/min for the two datasets, respectively. Averaged online accuracy of 94.00 ± 7.35% and ITR of 139.73±21.04 bits/min were achieved with 0.5-s calibration data per frequency. SIGNIFICANCE Our results demonstrate the effectiveness and robustness of PRCA-based methods for SSVEP identification with reduced calibration effort and suggest its potential for practical applications in SSVEP-BCIs.
Collapse
|
4
|
Han Y, Ke Y, Wang R, Wang T, Ming D. Enhancing SSVEP-BCI Performance Under Fatigue State Using Dynamic Stopping Strategy. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1407-1415. [PMID: 38517720 DOI: 10.1109/tnsre.2024.3380635] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/24/2024]
Abstract
Steady-state visual evoked potential (SSVEP)-based brain-computer interfaces (BCIs) have emerged as a prominent technology due to their high information transfer rate, rapid calibration time, and robust signal-to-noise ratio. However, a critical challenge for practical applications is performance degradation caused by user fatigue during prolonged use. This work proposes novel methods to address this challenge by dynamically adjusting data acquisition length and updating detection models based on a fatigue-aware stopping strategy. Two 16-target SSVEP-BCIs were employed, one using low-frequency and the other using high-frequency stimulation. A self-recorded fatigue dataset from 24 subjects was utilized for extensive evaluation. A simulated online experiment demonstrated that the proposed methods outperform the conventional fixed stopping strategy in terms of classification accuracy, information transfer rate, and selection time, irrespective of stimulation frequency. These findings suggest that the proposed approach can significantly improve SSVEP-BCI performance under fatigue conditions, leading to superior performance during extended use.
Collapse
|
5
|
Wang L, Wang S, Mo W, Li Y, Yang Q, Tian Y, Zheng C, Yang J, Ming D. Ultrasound Stimulation Attenuates CRS-Induced Depressive Behavior by Modulating Dopamine Release in the Prefrontal Cortex. IEEE Trans Neural Syst Rehabil Eng 2024; 32:1314-1323. [PMID: 38498742 DOI: 10.1109/tnsre.2024.3378976] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/20/2024]
Abstract
Depression is one of the most serious mental disorders affecting modern human life and is often caused by chronic stress. Dopamine system dysfunction is proposed to contribute to the pathophysiology of chronic stress, especially the ventral tegmental area (VTA) which mainly consists of dopaminergic neurons. Focused ultrasound stimulation (FUS) is a promising neuromodulation modality and multiple studies have demonstrated effective ultrasonic activation of cortical, subcortical, and related networks. However, the effects of FUS on the dopamine system and the potential link to chronic stress-induced depressive behaviors are relatively unknown. Here, we measured the effects of FUS targeting VTA on the improvement of depression-like behavior and evaluated the dopamine concentration in the downstream region - medial prefrontal cortex (mPFC). We found that targeting VTA FUS treatment alleviated chronic restraint stress (CRS) -induced anhedonia and despair behavior. Using an in vivo photometry approach, we analyzed the dopamine signal of mPFC and revealed a significant increase following the FUS, positively associated with the improvement of anhedonia behavior. FUS also protected the dopaminergic neurons in VTA from the damage caused by CRS exposure. Thus, these results demonstrated that targeting VTA FUS treatment significantly rescued the depressive-like behavior and declined dopamine level of mPFC induced by CRS. These beneficial effects of FUS might be due to protection in the DA neuron of VTA. Our findings suggest that FUS treatment could serve as a new therapeutic strategy for the treatment of stress-related disorders.
Collapse
|
6
|
Liu XY, Mu JJ, Han JG, Pang MJ, Zhang K, Zhai WQ, Su N, Ni GJ, Guo ZG, Ming D. Heart-brain axis: low blood pressure during off-pump CABG surgery is associated with postoperative heart failure. Mil Med Res 2024; 11:18. [PMID: 38509590 PMCID: PMC10956228 DOI: 10.1186/s40779-024-00522-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/04/2023] [Accepted: 03/12/2024] [Indexed: 03/22/2024] Open
Affiliation(s)
- Xiu-Yun Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China.
- State Key Laboratory of Advanced Medical Materials and Devices, Tianjin, 300072, China.
- Haihe Laboratory of Brain -Computer Interaction and Human-Machine Integration, Tianjin, 300380, China.
| | - Jing-Jing Mu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Jian-Ge Han
- Department of Anesthesiology, Tianjin University Chest Hospital, Tianjin Key Laboratory of Cardiovascular Emergency and Critical Care, Tianjin Municipal Science and Technology Bureau, Tianjin, 300222, China
| | - Mei-Jun Pang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Kuo Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Wen-Qian Zhai
- Department of Anesthesiology, Tianjin University Chest Hospital, Tianjin Key Laboratory of Cardiovascular Emergency and Critical Care, Tianjin Municipal Science and Technology Bureau, Tianjin, 300222, China
| | - Nan Su
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Guang-Jian Ni
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Zhi-Gang Guo
- Department of Cardiac Surgery, Tianjin University Chest Hospital, Tianjin Key Laboratory of Cardiovascular Emergency and Critical Care, Tianjin Municipal Science and Technology Bureau, Tianjin, 300222, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China.
- State Key Laboratory of Advanced Medical Materials and Devices, Tianjin, 300072, China.
- Haihe Laboratory of Brain -Computer Interaction and Human-Machine Integration, Tianjin, 300380, China.
| |
Collapse
|
7
|
Chen L, He J, Zhang J, Wang Z, Zhang L, Gu B, Liu X, Ming D. Influence of Transcutaneous Vagus Nerve Stimulation on Motor Planning: A Resting-State and Task-State EEG Study. IEEE J Biomed Health Inform 2024; 28:1374-1385. [PMID: 37824310 DOI: 10.1109/jbhi.2023.3324085] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/14/2023]
Abstract
Transcutaneous vagus nerve stimulation (tVNS) shows a potential regulatory role for motor planning. Still, existing research mainly focuses on behavioral studies, and the neural modulation mechanism needs to be clarified. Therefore, we designed a multi-condition (active or sham, pre or under, difficult or easy, left-hand or right-hand) motor planning experiment to explore the effect of online tVNS (i.e., tVNS and tasks synchronized). Twenty-eight subjects were recruited and randomly assigned to active and sham groups. Both groups performed the same tasks in the experiment and separately collected task-state EEG and 5-min eye-open resting-state EEG. The results showed that the changes in event-related potential (ERP) and movement-related cortical potential (MRCP) amplitudes were more significant for the left-hand difficult task (LD) under active-tVNS. According to the power spectrum results, active-tVNS significantly modulated the activities of the contralateral motor cortex at beta and gamma bands in the resting state. The functional connectivity based on partial directed coherence (PDC) showed significant changes in the parietal lobe after active-tVNS. These findings suggest that tVNS is a promising way to improve motor planning ability.
Collapse
|
8
|
Wang M, An X, Pei Z, Li N, Zhang L, Liu G, Ming D. An Efficient Multi-Task Synergetic Network for Polyp Segmentation and Classification. IEEE J Biomed Health Inform 2024; 28:1228-1239. [PMID: 37155397 DOI: 10.1109/jbhi.2023.3273728] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/10/2023]
Abstract
Colonoscopy is considered the best diagnostic tool for early detection and resection of polyps, which can effectively prevent consequential colorectal cancer. In clinical practice, segmenting and classifying polyps from colonoscopic images have a great significance since they provide precious information for diagnosis and treatment. In this study, we propose an efficient multi-task synergetic network (EMTS-Net) for concurrent polyp segmentation and classification, and we introduce a polyp classification benchmark for exploring the potential correlations of the above-mentioned two tasks. This framework is composed of an enhanced multi-scale network (EMS-Net) for coarse-grained polyp segmentation, an EMTS-Net (Class) for accurate polyp classification, and an EMTS-Net (Seg) for fine-grained polyp segmentation. Specifically, we first obtain coarse segmentation masks by using EMS-Net. Then, we concatenate these rough masks with colonoscopic images to assist EMTS-Net (Class) in locating and classifying polyps precisely. To further enhance the segmentation performance of polyps, we propose a random multi-scale (RMS) training strategy to eliminate the interference caused by redundant information. In addition, we design an offline dynamic class activation mapping (OFLD CAM) generated by the combined effect of EMTS-Net (Class) and RMS strategy, which optimizes bottlenecks between multi-task networks efficiently and elegantly and helps EMTS-Net (Seg) to perform more accurate polyp segmentation. We evaluate the proposed EMTS-Net on the polyp segmentation and classification benchmarks, and it achieves an average mDice of 0.864 in polyp segmentation and an average AUC of 0.913 with an average accuracy of 0.924 in polyp classification. Quantitative and qualitative evaluations on the polyp segmentation and classification benchmarks demonstrate that our EMTS-Net achieves the best performance and outperforms previous state-of-the-art methods in terms of both efficiency and generalization.
Collapse
|
9
|
Chen L, Tang C, Wang Z, Zhang L, Gu B, Liu X, Ming D. Enhancing Motor Sequence Learning via Transcutaneous Auricular Vagus Nerve Stimulation (taVNS): An EEG Study. IEEE J Biomed Health Inform 2024; 28:1285-1296. [PMID: 38109248 DOI: 10.1109/jbhi.2023.3344176] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2023]
Abstract
Motor learning plays a crucial role in human life, and various neuromodulation methods have been utilized to strengthen or improve it. Transcutaneous auricular vagus nerve stimulation (taVNS) has gained increasing attention due to its non-invasive nature, affordability and ease of implementation. Although the potential of taVNS on regulating motor learning has been suggested, its actual regulatory effect has yet been fully explored. Electroencephalogram (EEG) analysis provides an in-depth understanding of cognitive processes involved in motor learning so as to offer methodological support for regulation of motor learning. To investigate the effect of taVNS on motor learning, this study recruited 22 healthy subjects to participate a single-blind, sham-controlled, and within-subject serial reaction time task (SRTT) experiment. Every subject involved in two sessions at least one week apart and received a 20-minute active/sham taVNS in each session. Behavioral indicators as well as EEG characteristics during the task state, were extracted and analyzed. The results revealed that compared to the sham group, the active group showed higher learning performance. Additionally, the EEG results indicated that after taVNS, the motor-related cortical potential amplitudes and alpha-gamma modulation index decreased significantly and functional connectivity based on partial directed coherence towards frontal lobe was enhanced. These findings suggest that taVNS can improve motor learning, mainly through enhancing cognitive and memory functions rather than simple movement learning. This study confirms the positive regulatory effect of taVNS on motor learning, which is particularly promising as it offers a potential avenue for enhancing motor skills and facilitating rehabilitation.
Collapse
|
10
|
Sheng T, Feng Q, Luo Z, Zhao S, Xu M, Ming D, Yan Y, Yin E. Effect of Phase Clustering Bias on Phase-Amplitude Coupling for Emotional EEG. J Integr Neurosci 2024; 23:33. [PMID: 38419437 DOI: 10.31083/j.jin2302033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 06/18/2023] [Accepted: 06/25/2023] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Emotions are thought to be related to distinct patterns of neural oscillations, but the interactions among multi-frequency neural oscillations during different emotional states lack full exploration. Phase-amplitude coupling is a promising tool for understanding the complexity of the neurophysiological system, thereby playing a crucial role in revealing the physiological mechanisms underlying emotional electroencephalogram (EEG). However, the non-sinusoidal characteristics of EEG lead to the non-uniform distribution of phase angles, which could potentially affect the analysis of phase-amplitude coupling. Removing phase clustering bias (PCB) can uniform the distribution of phase angles, but the effect of this approach is unknown on emotional EEG phase-amplitude coupling. This study aims to explore the effect of PCB on cross-frequency phase-amplitude coupling for emotional EEG. METHODS The technique of removing PCB was implemented on a publicly accessible emotional EEG dataset to calculate debiased phase-amplitude coupling. Statistical analysis and classification were conducted to compare the difference in emotional EEG phase-amplitude coupling prior to and post the removal of PCB. RESULTS Emotional EEG phase-amplitude coupling values are overestimated due to PCB. Removing PCB enhances the difference in coupling strength between fear and happy emotions in the frontal lobe. Comparable emotion recognition performance was achieved with fewer features after removing PCB. CONCLUSIONS These findings suggest that removing PCB enhances the difference in emotional EEG phase-amplitude coupling patterns and generates features that contain more emotional information. Removing PCB may be advantageous for analyzing emotional EEG phase-amplitude coupling and recognizing human emotions.
Collapse
Affiliation(s)
- Tingyu Sheng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- National Innovation Institute of Defense Technology, Academy of Military Sciences, 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| | - Qiansheng Feng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
- Faculty of Mathematics and Physics, Huaiyin Institute of Technology, 223003 Huaian, Jiangsu, China
| | - Zhiguo Luo
- National Innovation Institute of Defense Technology, Academy of Military Sciences, 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| | - Shaokai Zhao
- National Innovation Institute of Defense Technology, Academy of Military Sciences, 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Ye Yan
- National Innovation Institute of Defense Technology, Academy of Military Sciences, 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| | - Erwei Yin
- National Innovation Institute of Defense Technology, Academy of Military Sciences, 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center, 300072 Tianjin, China
| |
Collapse
|
11
|
Liu S, Wang Y, Zhao Y, Liu L, Sun S, Zhang S, Liu H, Liu S, Li Y, Yang F, Jiao M, Sun X, Zhang Y, Liu R, Mu X, Wang H, Zhang S, Yang J, Xie X, Duan X, Zhang J, Hong G, Zhang XD, Ming D. A Nanozyme-Based Electrode for High-Performance Neural Recording. Adv Mater 2024; 36:e2304297. [PMID: 37882151 DOI: 10.1002/adma.202304297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 10/19/2023] [Indexed: 10/27/2023]
Abstract
Implanted neural electrodes have been widely used to treat brain diseases that require high sensitivity and biocompatibility at the tissue-electrode interface. However, currently used clinical electrodes cannot meet both these requirements simultaneously, which hinders the effective recording of electronic signals. Herein, nanozyme-based neural electrodes incorporating bioinspired atomically precise clusters are developed as a general strategy with a heterogeneous design for multiscale and ultrasensitive neural recording via quantum transport and biocatalytic processes. Owing to the dual high-speed electronic and ionic currents at the electrode-tissue interface, the impedance of nanozyme electrodes is 26 times lower than that of state-of-the-art metal electrodes, and the acquisition sensitivity for the local field potential is ≈10 times higher than that of clinical PtIr electrodes, enabling a signal-to-noise ratio (SNR) of up to 14.7 dB for single-neuron recordings in rats. The electrodes provide more than 100-fold higher antioxidant and multi-enzyme-like activities, which effectively decrease 67% of the neuronal injury area by inhibiting glial proliferation and allowing sensitive and stable neural recording. Moreover, nanozyme electrodes can considerably improve the SNR of seizures in acute epileptic rats and are expected to achieve precise localization of seizure foci in clinical settings.
Collapse
Affiliation(s)
- Shuangjie Liu
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Yang Wang
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Yue Zhao
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Ling Liu
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Si Sun
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Shaofang Zhang
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Haile Liu
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Shuhu Liu
- Beijing Synchrotron Radiation Facility (BSRF), Institute of High Energy Physics (IHEP), Chinese Academy of Sciences (CAS), Beijing, 100049, China
| | - Yonghui Li
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Fan Yang
- Department of Materials Science and Engineering, Stanford University, Stanford, California, 94305, USA
| | - Menglu Jiao
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Xinyu Sun
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Yuqin Zhang
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Renpeng Liu
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Xiaoyu Mu
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Hao Wang
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| | - Shu Zhang
- Tianjin Neurological Institute, Department of Neurosurgery, General Hospital, Tianjin Medical University, Tianjin, 300041, China
| | - Jiang Yang
- School of Electronics and Information Technology and Medicine, Sun Yat-sen University, Guangzhou, 510060, China
| | - Xi Xie
- School of Electronics and Information Technology and Medicine, Sun Yat-sen University, Guangzhou, 510060, China
| | - Xiaojie Duan
- Department of Biomedical Engineering, College of Engineering, Peking University, Beijing, 100871, China
| | - Jianning Zhang
- Tianjin Neurological Institute, Department of Neurosurgery, General Hospital, Tianjin Medical University, Tianjin, 300041, China
| | - Guosong Hong
- Department of Materials Science and Engineering, Stanford University, Stanford, California, 94305, USA
| | - Xiao-Dong Zhang
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
- Department of Physics and Tianjin Key Laboratory of Low Dimensional Materials Physics and Preparing Technology, School of Science, Tianjin University, Tianjin, 300354, China
| | - Dong Ming
- Tianjin Key Laboratory of Brain Science and Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, China
| |
Collapse
|
12
|
Zhao R, Yue T, Xu Z, Zhang Y, Wu Y, Bai Y, Ni G, Ming D. Electroencephalogram-based objective assessment of cognitive function level associated with age-related hearing loss. GeroScience 2024; 46:431-446. [PMID: 37273160 PMCID: PMC10828275 DOI: 10.1007/s11357-023-00847-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/05/2023] [Accepted: 05/29/2023] [Indexed: 06/06/2023] Open
Abstract
Age-Related Hearing Loss (ARHL) is a common problem in aging. Numerous longitudinal cohort studies have revealed that ARHL is closely related to cognitive function, leading to a significant risk of cognitive decline and dementia. This risk gradually increases with the severity of hearing loss. We designed dual auditory Oddball and cognitive task paradigms for the ARHL subjects, then obtained the Montreal Cognitive Assessment (MoCA) scale evaluation results for all the subjects. Multi-dimensional EEG characteristics helped explore potential biomarkers to evaluate the cognitive level of the ARHL group, having a significantly lower P300 peak amplitude coupled with a prolonged latency. Moreover, visual memory, auditory memory, and logical calculation were investigated during the cognitive task paradigm. In the ARHL groups, the alpha-to-beta rhythm energy ratio in the visual and auditory memory retention period and the wavelet packet entropy value within the logical calculation period were significantly reduced. Correlation analysis between the above specificity indicators and the subjective scale results of the ARHL group revealed that the auditory P300 component characteristics could assess attention resources and information processing speed. The alpha and beta rhythm energy ratio and wavelet packet entropy can become potential indicators to determine working memory and logical cognitive computation-related cognitive ability.
Collapse
Affiliation(s)
- Ran Zhao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, 300072, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392, China
| | - Tao Yue
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China
| | - Zihao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China
| | - Yunqi Zhang
- School of Education, Tianjin University, Tianjin, China
| | - Yubo Wu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China
| | - Yanru Bai
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China.
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, 300072, China.
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392, China.
| | - Guangjian Ni
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China.
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, 300072, China.
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, 300072, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, 300392, China
| |
Collapse
|
13
|
Yu H, Xu M, Xiao X, Xu F, Ming D. Detection of dynamic changes of electrodermal activity to predict the classroom performance of college students. Cogn Neurodyn 2024; 18:173-184. [PMID: 38406194 PMCID: PMC10881450 DOI: 10.1007/s11571-023-09930-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 12/02/2022] [Accepted: 01/09/2023] [Indexed: 02/20/2023] Open
Abstract
It is emphasized in the Self-regulated learning (SRL) framework that self-monitoring of learning state is vital for students to keep effective in studying. However, it's still challenging to get an accurate and timely understanding of their learning states during classes. In this study, we propose to use electrodermal activity (EDA) signals which are deemed to be associated with physiological arousal state to predict the college student's classroom performance. Twenty college students were recruited to attend eight lectures in the classroom, during which their EDA signals were recorded simultaneously. For each lecture, the students should complete pre- and after-class tests, and a self-reported scale (SRS) on their learning experience. EDA indices were extracted from both time and frequency domains, and they were furtherly mapped to the student's learning efficiency. As a result, the indices relevant to the dynamic changes of EDA had significant positive correlations with the learning efficiency. Furthermore, compared with only using SRS, a combination with EDA indices had significantly higher accuracy in predicting the learning efficiency. In conclusion, our findings demonstrate that the EDA dynamics are sensitive to the changes in learning efficiency, suggesting a promising approach to predicting the classroom performance of college students.
Collapse
Affiliation(s)
- Haiqing Yu
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Xiaolin Xiao
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Fangzhou Xu
- Department of Physics, School of Electronic and Information Engineering, Qilu University of Technology, Jinan, Shandong China
| | - Dong Ming
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| |
Collapse
|
14
|
Chang Y, Wang X, Liao J, Chen S, Liu X, Liu S, Ming D. Temporal hyper-connectivity and frontal hypo-connectivity within gamma band in schizophrenia: A resting state EEG study. Schizophr Res 2024; 264:220-230. [PMID: 38183959 DOI: 10.1016/j.schres.2023.12.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/27/2022] [Revised: 11/12/2023] [Accepted: 12/16/2023] [Indexed: 01/08/2024]
Abstract
OBJECTIVE The brain network serves as the physiological foundation for information processing of the brain. Many studies have reported abnormalities of gamma oscillations in Schizophrenia. The aim of this study was to investigate the gamma-band connectivity in Schizophrenia patients. METHODS We recorded the resting state electroencephalogram (EEG) for 15 schizophrenia patients with refractory auditory hallucinations and 14 healthy controls, with eyes open and closed. The brain network was constructed based on weighted phase lag index for gamma band. Whole scalp metrics (clustering coefficient, global efficiency and local efficiency) and local region metrics (degree and betweenness centrality) in the frontal and temporal lobes were computed. Correlation analyses between network metrics and symptom scales were examined to find associations with symptom severity. RESULTS Schizophrenia patients had larger global efficiency and local efficiency (p < 0.05) with eyes closed, probably representing greater brain activity and information exchange. For degree and betweenness centrality, schizophrenia patients showed an increase (p < 0.05) in the temporal lobe but a decrease (p < 0.05) in the frontal lobe with eyes closed and open, potentially account for the patients' symptoms such as hallucinations and thought disorders. Local efficiency and frontal lobe degree were positively and negatively correlated with the scales, respectively (both p < 0.05). CONCLUSIONS Altered connectivity of the resting state brain network has been revealed and may be associated with the core symptoms of schizophrenia. Our study provides promising evidence for the investigation of the pathological basis of Schizophrenia and could aid in objective diagnosis.
Collapse
Affiliation(s)
- Yuan Chang
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| | - Xiaojuan Wang
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| | - Jingmeng Liao
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| | - Sitong Chen
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| | - Xiaoya Liu
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| | - Shuang Liu
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China.
| | - Dong Ming
- Tianjin University, Academy of Medical Engineering and Translational Medicine, Tianjin, China
| |
Collapse
|
15
|
Liu H, Bai Y, Xu Z, Liu J, Ni G, Ming D. The scalp time-varying network of auditory spatial attention in "cocktail-party" situations. Hear Res 2024; 442:108946. [PMID: 38150794 DOI: 10.1016/j.heares.2023.108946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Revised: 12/21/2023] [Accepted: 12/22/2023] [Indexed: 12/29/2023]
Abstract
Sound source localization in "cocktail-party" situations is a remarkable ability of the human auditory system. However, the neural mechanisms underlying auditory spatial attention are still largely unknown. In this study, the "cocktail-party" situations are simulated through multiple sound sources and presented through head-related transfer functions and headphones. Furthermore, the scalp time-varying network of auditory spatial attention is constructed using the high-temporal resolution electroencephalogram, and its network properties are measured quantitatively using graph theory analysis. The results show that the time-varying network of auditory spatial attention in "cocktail-party" situations is more complex and partially different than in simple acoustic situations, especially in the early- and middle-latency periods. The network coupling strength increases continuously over time, and the network hub shifts from the posterior temporal lobe to the parietal lobe and then to the frontal lobe region. In addition, the right hemisphere has a stronger network strength for processing auditory spatial information in "cocktail-party" situations, i.e., the right hemisphere has higher clustering levels, higher transmission efficiency, and more node degrees during the early- and middle-latency periods, while this phenomenon disappears and appears symmetrically during the late-latency period. These findings reveal different network patterns and properties of auditory spatial attention in "cocktail-party" situations during different periods and demonstrate the dominance of the right hemisphere in the dynamic processing of auditory spatial information.
Collapse
Affiliation(s)
- Hongxing Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
| | - Yanru Bai
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392 China
| | - Zihao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
| | - Jihan Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
| | - Guangjian Ni
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392 China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China; Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China; Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392 China
| |
Collapse
|
16
|
Zhou Y, Song Y, Qi S, Song X, Xu M, He F, Ming D. In Vivo Transcranial Acoustoelectric Brain Imaging of Different Deep Brain Stimulation Currents. IEEE Trans Neural Syst Rehabil Eng 2024; 32:597-606. [PMID: 38241112 DOI: 10.1109/tnsre.2024.3356440] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/21/2024]
Abstract
Deep brain stimulation (DBS) is an effective treatment for neurologic disease and its clinical effect is highly dependent on the DBS leads localization and current stimulating state. However, standard human brain imaging modalities could not provide direct feedback on DBS currents spatial distribution and dynamic changes. Acoustoelectric brain imaging (AEBI) is an emerging neuroimaging method that can directly map current density distribution. Here, we investigate in vivo AEBI of different DBS currents to explore the potential of DBS visualization using AEBI. According to the typical DBS stimulus parameters, four types of DBS currents, including time pattern, waveform, frequency, and amplitude are designed to implement AEBI experiments in living rat brains. Based on acoustoelectric (AE) signals, the AEBI images of each type DBS current are explored and the resolution is quantitatively analyzed for performance evaluation. Furtherly, the AE signals are decoded to characterize DBS currents from multiple perspectives, including time-frequency domain, spatial distribution, and amplitude comparation. The results show that in vivo transcranial AEBI can accurately locate the DBS contact position with a millimeter spatial resolution (< 2 mm) and millisecond temporal resolution (< 10 ms). Besides, the decoded AE signal at DBS contact position is capable of describing the corresponding DBS current characteristics and identifying current pattern changes. This study first validates that AEBI can localize in vivo DBS contact and characterize different DBS currents. AEBI is expected to develop into a noninvasive DBS real-time monitoring technology with high spatiotemporal resolution.
Collapse
|
17
|
Xu R, Zhang H, Liu S, Meng L, Ming D. cTBS over primary motor cortex increased contralateral corticomuscular coupling and interhemispheric functional connection. J Neural Eng 2024; 21:016012. [PMID: 38211343 DOI: 10.1088/1741-2552/ad1dc4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2023] [Accepted: 01/11/2024] [Indexed: 01/13/2024]
Abstract
Objective.Transcranial magnetic stimulation is a non-invasive brain stimulation technique that changes the activity of the cerebral cortex. Contralesional continuous theta burst stimulation (cTBS) has been proposed and verified beneficial to stroke motor recovery. However, the underlying mechanism is still unclear.Approach.20 healthy right-handed subjects were recruited in this study, receiving real-cTBS over their left primary motor cortex or sham-cTBS. We designed the finger tapping task (FTT) before and after stimulation and recorded the accuracy and reaction time (RT) of the task. The electroencephalogram and surface electromyogram signals were recorded during the left finger pinching task (FPT) before and after stimulation. We calculated cortico-muscular coherence (CMC) in the contralateral hemisphere and cortico-cortical coherence (CCC) in the bilateral hemisphere. The two-way repeated measures analysis of variance was used to analyze the effect of cTBS.Main results.In the FTT, there was a significant main effect of 'time' on RT (F(1, 38) = 24.739,p< 0.001). In the FPT, the results showed that there was a significant interaction effect on the CMC peak and area in the beta band (peak:F(1, 38) = 8.562,p= 0.006; area:F(1, 38) = 5.273,p= 0.027), on the CCC peak in the alpha band (F(1, 38) = 4.815,p= 0.034) and area in the beta band (F(1, 38) = 4.822,p= 0.034). The post hoc tests showed that the CMC peak (W= 20,p= 0.002), the CMC area (W= 13,p= 0.003) and the CCC peak (t= -2.696,p= 0.014) increased significantly after real-cTBS. However, there was no significant decrease or increase after sham-cTBS.Significance.Our study found that cTBS can improve CMC of contralateral hemisphere and CCC of bilateral hemisphere, indicating that cTBS can strengthen cortico-muscular and cortico-cortical coupling.
Collapse
Affiliation(s)
- Rui Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Haichao Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Shizhong Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Department of Rehabilitation, Tianjin Medical University General Hospital, Tianjin 300052, People's Republic of China
| | - Lin Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| |
Collapse
|
18
|
Wang X, Pei Y, Luo Z, Zhao S, Xie L, Yan Y, Yin E, Liu S, Ming D. Fusion of Multi-domain EEG Signatures Improves Emotion Recognition. J Integr Neurosci 2024; 23:18. [PMID: 38287841 DOI: 10.31083/j.jin2301018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/07/2023] [Revised: 05/19/2023] [Accepted: 05/22/2023] [Indexed: 01/31/2024] Open
Abstract
BACKGROUND Affective computing has gained increasing attention in the area of the human-computer interface where electroencephalography (EEG)-based emotion recognition occupies an important position. Nevertheless, the diversity of emotions and the complexity of EEG signals result in unexplored relationships between emotion and multichannel EEG signal frequency, as well as spatial and temporal information. METHODS Audio-video stimulus materials were used that elicited four types of emotions (sad, fearful, happy, neutral) in 32 male and female subjects (age 21-42 years) while collecting EEG signals. We developed a multidimensional analysis framework using a fusion of phase-locking value (PLV), microstates, and power spectral densities (PSDs) of EEG features to improve emotion recognition. RESULTS An increasing trend of PSDs was observed as emotional valence increased, and connections in the prefrontal, temporal, and occipital lobes in high-frequency bands showed more differentiation between emotions. Transition probability between microstates was likely related to emotional valence. The average cross-subject classification accuracy of features fused by Discriminant Correlation Analysis achieved 64.69%, higher than that of single mode and direct-concatenated features, with an increase of more than 7%. CONCLUSIONS Different types of EEG features have complementary properties in emotion recognition, and combining EEG data from three types of features in a correlated way, improves the performance of emotion classification.
Collapse
Affiliation(s)
- Xiaomin Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
| | - Yu Pei
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Zhiguo Luo
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Shaokai Zhao
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Liang Xie
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Ye Yan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Erwei Yin
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300450 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| |
Collapse
|
19
|
Chen J, Ke Y, Ni G, Liu S, Ming D. Evidence for modulation of EEG microstates by mental workload levels and task types. Hum Brain Mapp 2024; 45:e26552. [PMID: 38050776 PMCID: PMC10789204 DOI: 10.1002/hbm.26552] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2023] [Revised: 11/14/2023] [Accepted: 11/21/2023] [Indexed: 12/06/2023] Open
Abstract
Electroencephalography (EEG) microstate analysis has become a popular tool for studying the spatial and temporal dynamics of large-scale electrophysiological activities in the brain in recent years. Four canonical topographies of the electric field (classes A, B, C, and D) have been widely identified, and changes in microstate parameters are associated with several psychiatric disorders and cognitive functions. Recent studies have reported the modulation of EEG microstate by mental workload (MWL). However, the common practice of evaluating MWL is in a specific task. Whether the modulation of microstate by MWL is consistent across different types of tasks is still not clear. Here, we studied the topographies and dynamics of microstate in two independent MWL tasks: NBack and the multi-attribute task battery (MATB) and showed that the modulation of MWL on microstate topographies and parameters depended on tasks. We found that the parameters of microstates A and C, and the topographies of microstates A, B, and D were significantly different between the two tasks. Meanwhile, all four microstate topographies and parameters of microstates A and C were different during the NBack task, but no significant difference was found during the MATB task. Furthermore, we employed a support vector machine recursive feature elimination procedure to investigate whether microstate parameters were suitable for MWL classification. An averaged classification accuracy of 87% for within-task and 78% for cross-task MWL discrimination was achieved with at least 10 features. Collectively, our findings suggest that topographies and parameters of microstates can provide valuable information about neural activity patterns with a dynamic temporal structure at different levels of MWL, but the modulation of MWL depends on tasks and their corresponding functional systems. Moreover, as a potential indicator, microstate parameters could be used to distinguish MWL.
Collapse
Affiliation(s)
- Jingxin Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural EngineeringTianjin UniversityTianjinPeople's Republic of China
- Haihe Laboratory of Brain‐Computer Interaction and Human‐Machine IntegrationTianjinPeople's Republic of China
| | - Yufeng Ke
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural EngineeringTianjin UniversityTianjinPeople's Republic of China
- Haihe Laboratory of Brain‐Computer Interaction and Human‐Machine IntegrationTianjinPeople's Republic of China
| | - Guangjian Ni
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural EngineeringTianjin UniversityTianjinPeople's Republic of China
- Haihe Laboratory of Brain‐Computer Interaction and Human‐Machine IntegrationTianjinPeople's Republic of China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural EngineeringTianjin UniversityTianjinPeople's Republic of China
- Haihe Laboratory of Brain‐Computer Interaction and Human‐Machine IntegrationTianjinPeople's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural EngineeringTianjin UniversityTianjinPeople's Republic of China
- Haihe Laboratory of Brain‐Computer Interaction and Human‐Machine IntegrationTianjinPeople's Republic of China
| |
Collapse
|
20
|
Mei J, Luo R, Xu L, Zhao W, Wen S, Wang K, Xiao X, Meng J, Huang Y, Tang J, Cheng L, Xu M, Ming D. MetaBCI: An open-source platform for brain-computer interfaces. Comput Biol Med 2024; 168:107806. [PMID: 38081116 DOI: 10.1016/j.compbiomed.2023.107806] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 11/29/2023] [Accepted: 11/29/2023] [Indexed: 01/10/2024]
Abstract
BACKGROUND Recently, brain-computer interfaces (BCIs) have attracted worldwide attention for their great potential in clinical and real-life applications. To implement a complete BCI system, one must set up several links to translate the brain intent into computer commands. However, there is not an open-source software platform that can cover all links of the BCI chain. METHOD This study developed a one-stop open-source BCI software, namely MetaBCI, to facilitate the construction of a BCI system. MetaBCI is written in Python, and has the functions of stimulus presentation (Brainstim), data loading and processing (Brainda), and online information flow (Brainflow). This paper introduces the detailed information of MetaBCI and presents four typical application cases. RESULTS The results showed that MetaBCI was an extensible and feature-rich software platform for BCI research and application, which could effectively encode, decode, and feedback brain activities. CONCLUSIONS MetaBCI can greatly lower the BCI's technical threshold for BCI beginners and can save time and cost to build up a practical BCI system. The source code is available at https://github.com/TBC-TJU/MetaBCI, expecting new contributions from the BCI community.
Collapse
Affiliation(s)
- Jie Mei
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
| | - Ruixin Luo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
| | - Lichao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Wei Zhao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Shengfu Wen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Xiaolin Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Jiayuan Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Yongzhi Huang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Jiabei Tang
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China; Tiankai Suishi (Tianjin) Intelligence Ltd., Tianjin, 300192, People's Republic of China
| | - Longlong Cheng
- China Electronics Cloud Brain (Tianjin) Technology Co., Ltd., Tianjin, 300392, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| |
Collapse
|
21
|
Ke Y, Wang T, He F, Liu S, Ming D. Enhancing EEG-based cross-day mental workload classification using periodic component of power spectrum. J Neural Eng 2023; 20:066028. [PMID: 37995362 DOI: 10.1088/1741-2552/ad0f3d] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/02/2023] [Accepted: 11/23/2023] [Indexed: 11/25/2023]
Abstract
Objective. The day-to-day variability of electroencephalogram (EEG) poses a significant challenge to decode human brain activity in EEG-based passive brain-computer interfaces (pBCIs). Conventionally, a time-consuming calibration process is required to collect data from users on a new day to ensure the performance of the machine learning-based decoding model, which hinders the application of pBCIs to monitor mental workload (MWL) states in real-world settings.Approach. This study investigated the day-to-day stability of the raw power spectral density (PSD) and their periodic and aperiodic components decomposed by the Fitting Oscillations and One-Over-F algorithm. In addition, we validated the feasibility of using periodic components to improve cross-day MWL classification performance.Main results. Compared to the raw PSD (69.9% ± 18.5%) and the aperiodic component (69.4% ± 19.2%), the periodic component had better day-to-day stability and significantly higher cross-day classification accuracy (84.2% ± 11.0%).Significance. These findings indicate that periodic components of EEG have the potential to be applied in decoding brain states for more robust pBCIs.
Collapse
Affiliation(s)
- Yufeng Ke
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Tao Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Feng He
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| |
Collapse
|
22
|
Wang F, Li Y, Tang D, Zhao J, Yang B, Zhang C, Su M, He Z, Zhu X, Ming D, Liu Y. Epidemiological analysis of drinking water-type fluorosis areas and the impact of fluorosis on children's health in the past 40 years in China. Environ Geochem Health 2023; 45:9925-9940. [PMID: 37906380 PMCID: PMC10673999 DOI: 10.1007/s10653-023-01772-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/31/2022] [Accepted: 09/28/2023] [Indexed: 11/02/2023]
Abstract
This study analyzed the effect of China's fluorosis prevention and control program, which has been in effect for more than 40 years, and the impact of fluorosis on children's health. Relevant research studies were retrieved from the following online databases from the time of their inception to May 2022: PubMed, ScienceDirect, Embase, Cochrane, China National Knowledge Infrastructure, and Wanfang. The Review Manager 5.3 software was used in statistical analyses. This article included seventy studies: Thirty-eight studies reported the effect of improving water quality and reducing fluoride content, the incidence rate of dental fluorosis in children, and the level of urinary fluoride, and thirty-two studies reported the intelligence quotient (IQ) and health status of children. Following water improvement strategies, the fluoride levels in drinking water decreased significantly; urinary fluoride levels and dental fluorosis decreased significantly in children. With regard to the effect of fluorosis on the IQ of children, the results showed that the IQ of children in areas with a high fluoride of fluorosis was lesser than that in areas with a low fluoride, and this difference was significant. Based on the prevalence of dental fluorosis and its effect on the intelligence of children, it appears that reducing fluoride levels in drinking water and monitoring water quality are important strategies for the prevention and treatment of fluorosis.
Collapse
Affiliation(s)
- Feiqing Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin City, 300072, China
- Clinical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, No. 71 Bao Shan North Road, Yunyan District, Guiyang, 550001, Guizhou Province, China
| | - Yanju Li
- Clinical Research Institute, Affiliated Hospital of Guizhou Medical University, Guiyang, 550004, Guizhou Province, China
| | - Dongxin Tang
- Clinical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, No. 71 Bao Shan North Road, Yunyan District, Guiyang, 550001, Guizhou Province, China
| | - Jianing Zhao
- Clinical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, No. 71 Bao Shan North Road, Yunyan District, Guiyang, 550001, Guizhou Province, China
| | - Bo Yang
- Clinical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, No. 71 Bao Shan North Road, Yunyan District, Guiyang, 550001, Guizhou Province, China
| | - Chike Zhang
- Clinical Research Institute, Affiliated Hospital of Guizhou Medical University, Guiyang, 550004, Guizhou Province, China
| | - Min Su
- National and Guizhou Joint Engineering Laboratory for Cell Engineering and Biomedicine Technique, Guiyang, 550004, Guizhou Province, China
| | - Zhixu He
- National and Guizhou Joint Engineering Laboratory for Cell Engineering and Biomedicine Technique, Guiyang, 550004, Guizhou Province, China
| | - Xiaodong Zhu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin City, 300072, China.
- Neurological Institute, Tianjin Medical University General Hospital, Tianjin, 300072, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92 Weijin Road, Nankai District, Tianjin City, 300072, China
| | - Yang Liu
- Clinical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, No. 71 Bao Shan North Road, Yunyan District, Guiyang, 550001, Guizhou Province, China.
- National and Guizhou Joint Engineering Laboratory for Cell Engineering and Biomedicine Technique, Guiyang, 550004, Guizhou Province, China.
| |
Collapse
|
23
|
Liu S, He Y, Guo D, Liu X, Hao X, Hu P, Ming D. Transcranial alternating current stimulation ameliorates emotional attention through neural oscillations modulation. Cogn Neurodyn 2023; 17:1473-1483. [PMID: 37969947 PMCID: PMC10640550 DOI: 10.1007/s11571-022-09880-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2022] [Revised: 07/04/2022] [Accepted: 08/28/2022] [Indexed: 11/15/2022] Open
Abstract
Background Numerous clinical reports have suggested that psychopathy like schizophrenia, anxiety and depression is accompanied by early attentional abnormalities in emotional processing. Recently, the efficacy of transcranial alternating current stimulation (tACS) in changing emotional functioning has been repeatedly observed and demonstrated a causal relationship between endogenous oscillations and emotional processing. Aims Up to now, tACS effects on emotional attention have not yet been tested. To assess such ability, we delivered active-tACS at individual alpha frequency (IAF), 10 Hz or sham-tACS for 7 consecutive days in the bilaterally dorsolateral prefrontal cortex (dlPFC) to totally 79 healthy participants. Results IAF-tACS group showed significant alpha entrainment at-rest, especially in open state around stimulation area and showed an obvious advantage compared to 10 Hz-tACS. Event-related potential revealed a significant larger P200 amplitude after active-tACS and IAF group showed wider range of emotions than 10 Hz-tACS, indicating the attentional improvement in facial emotion processing. A notable positive correlation between alpha power and P200 amplitude provided an electrophysiological interpretation regarding the role of tACS in emotional attention modulation instead of somatosensory effects. Conclusion These results support a seminal outcome for the effect of IAF-tACS on emotional attention modulation, demonstrating a feasible and individual-specific therapy for neuropsychiatric disorders related to emotion processing, especially regarding oscillatory disturbances.
Collapse
Affiliation(s)
- Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Yuchen He
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Dongyue Guo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Xiaoya Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Xinyu Hao
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, 300072 Tianjin, China
| | - Pengchong Hu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, 300072 Tianjin, China
- Tianjin International Joint Research Center for Neural Engineering, 300072 Tianjin, China
| |
Collapse
|
24
|
Ni G, Xu Z, Bai Y, Zheng Q, Zhao R, Wu Y, Ming D. EEG-based assessment of temporal fine structure and envelope effect in mandarin syllable and tone perception. Cereb Cortex 2023; 33:11287-11299. [PMID: 37804238 DOI: 10.1093/cercor/bhad366] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 09/13/2023] [Accepted: 09/15/2023] [Indexed: 10/09/2023] Open
Abstract
In recent years, speech perception research has benefited from low-frequency rhythm entrainment tracking of the speech envelope. However, speech perception is still controversial regarding the role of speech envelope and temporal fine structure, especially in Mandarin. This study aimed to discuss the dependence of Mandarin syllables and tones perception on the speech envelope and the temporal fine structure. We recorded the electroencephalogram (EEG) of the subjects under three acoustic conditions using the sound chimerism analysis, including (i) the original speech, (ii) the speech envelope and the sinusoidal modulation, and (iii) the fine structure of time and the modulation of the non-speech (white noise) sound envelope. We found that syllable perception mainly depended on the speech envelope, while tone perception depended on the temporal fine structure. The delta bands were prominent, and the parietal and prefrontal lobes were the main activated brain areas, regardless of whether syllable or tone perception was involved. Finally, we decoded the spatiotemporal features of Mandarin perception from the microstate sequence. The spatiotemporal feature sequence of the EEG caused by speech material was found to be specific, suggesting a new perspective for the subsequent auditory brain-computer interface. These results provided a new scheme for the coding strategy of new hearing aids for native Mandarin speakers. HIGHLIGHTS
Collapse
Affiliation(s)
- Guangjian Ni
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392 China
| | - Zihao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China
| | - Yanru Bai
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China
| | - Qi Zheng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
| | - Ran Zhao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China
| | - Yubo Wu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072 China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin 300072 China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392 China
| |
Collapse
|
25
|
Xiao X, Wang L, Xu M, Wang K, Jung TP, Ming D. A data expansion technique based on training and testing sample to boost the detection of SSVEPs for brain-computer interfaces. J Neural Eng 2023; 20:066017. [PMID: 37683663 DOI: 10.1088/1741-2552/acf7f6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2023] [Accepted: 09/08/2023] [Indexed: 09/10/2023]
Abstract
Objective.Currently, steady-state visual evoked potentials (SSVEPs)-based brain-computer interfaces (BCIs) have achieved the highest interaction accuracy and speed among all BCI paradigms. However, its decoding efficacy depends deeply on the number of training samples, and the system performance would have a dramatic drop when the training dataset decreased to a small size. To date, no study has been reported to incorporate the unsupervised learning information from testing trails into the construction of supervised classification model, which is a potential way to mitigate the overfitting effect of limited samples.Approach.This study proposed a novel method for SSVEPs detection, i.e. cyclic shift trials (CSTs), which could combine unsupervised learning information from test trials and supervised learning information from train trials. Furthermore, since SSVEPs are time-locked and phase-locked to the onset of specific flashes, CST could also expand training samples on the basis of its regularity and periodicity. In order to verify the effectiveness of CST, we designed an online SSVEP-BCI system, and tested this system combined CST with two common classification algorithms, i.e. extended canonical correlation analysis and ensemble task-related component analysis.Main results.CST could significantly enhance the signal to noise ratios of SSVEPs and improve the performance of systems especially for the condition of few training samples and short stimulus time. The online information transfer rate could reach up to 236.19 bits min-1using 36 s calibration time of only one training sample for each category.Significance.The proposed CST method can take full advantages of supervised learning information from training samples and unsupervised learning information of testing samples. Furthermore, it is a data expansion technique, which can enhance the SSVEP characteristics and reduce dependence on sample size. Above all, CST is a promising method to improve the performance of SSVEP-based BCI without any additional experimental burden.
Collapse
Affiliation(s)
- Xiaolin Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integation, Tianjin 300392, People's Republic of China
| | - Lijie Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Research Center for Augmented Intelligence, Zhejiang Lab, Hangzhou, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integation, Tianjin 300392, People's Republic of China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integation, Tianjin 300392, People's Republic of China
| | - Tzyy-Ping Jung
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- The Swartz Centre for Computational Neuroscience, University of California, San Diego, CA, United States of America
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integation, Tianjin 300392, People's Republic of China
| |
Collapse
|
26
|
Luo R, Xiao X, Chen E, Meng L, Jung TP, Xu M, Ming D. Almost free of calibration for SSVEP-based brain-computer interfaces. J Neural Eng 2023; 20:066013. [PMID: 37948768 DOI: 10.1088/1741-2552/ad0b8f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 11/10/2023] [Indexed: 11/12/2023]
Abstract
Objective. Steady-state visual evoked potential (SSVEP)-based brain-computer interface (BCI) is a promising technology that can achieve high information transfer rate (ITR) with supervised algorithms such as ensemble task-related component analysis (eTRCA) and task-discriminant component analysis (TDCA). However, training individual models requires a tedious and time-consuming calibration process, which hinders the real-life use of SSVEP-BCIs. A recent data augmentation method, called source aliasing matrix estimation (SAME), can generate new EEG samples from a few calibration trials. But SAME does not exploit the information across stimuli as well as only reduces the number of calibration trials per command, so it still has some limitations.Approach. This study proposes an extended version of SAME, called multi-stimulus SAME (msSAME), which exploits the similarity of the aliasing matrix across frequencies to enhance the performance of SSVEP-BCI with insufficient calibration trials. We also propose a semi-supervised approach based on msSAME that can further reduce the number of SSVEP frequencies needed for calibration. We evaluate our method on two public datasets, Benchmark and BETA, and an online experiment.Main results. The results show that msSAME outperforms SAME for both eTRCA and TDCA on the public datasets. Moreover, the semi-supervised msSAME-based method achieves comparable performance to the fully calibrated methods and outperforms the conventional free-calibrated methods. Remarkably, our method only needs 24 s to calibrate 40 targets in the online experiment and achieves an average ITR of 213.8 bits min-1with a peak of 242.6 bits min-1.Significance. This study significantly reduces the calibration effort for individual SSVEP-BCIs, which is beneficial for developing practical plug-and-play SSVEP-BCIs.
Collapse
Affiliation(s)
- Ruixin Luo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
| | - Xiaolin Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Enze Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
| | - Lin Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Tzyy-Ping Jung
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- The Swartz Center for Computational Neuroscience, University of California, San Diego, CA, United States of America
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| |
Collapse
|
27
|
Pan L, Wang K, Xu L, Sun X, Yi W, Xu M, Ming D. Riemannian geometric and ensemble learning for decoding cross-session motor imagery electroencephalography signals. J Neural Eng 2023; 20:066011. [PMID: 37931299 DOI: 10.1088/1741-2552/ad0a01] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2023] [Accepted: 11/06/2023] [Indexed: 11/08/2023]
Abstract
Objective.Brain-computer interfaces (BCIs) enable a direct communication pathway between the human brain and external devices, without relying on the traditional peripheral nervous and musculoskeletal systems. Motor imagery (MI)-based BCIs have attracted significant interest for their potential in motor rehabilitation. However, current algorithms fail to account for the cross-session variability of electroencephalography signals, limiting their practical application.Approach.We proposed a Riemannian geometry-based adaptive boosting and voting ensemble (RAVE) algorithm to address this issue. Our approach segmented the MI period into multiple sub-datasets using a sliding window approach and extracted features from each sub-dataset using Riemannian geometry. We then trained adaptive boosting (AdaBoost) ensemble learning classifiers for each sub-dataset, with the final BCI output determined by majority voting of all classifiers. We tested our proposed RAVE algorithm and eight other competing algorithms on four datasets (Pan2023, BNCI001-2014, BNCI001-2015, BNCI004-2015).Main results.Our results showed that, in the cross-session scenario, the RAVE algorithm outperformed the eight other competing algorithms significantly under different within-session training sample sizes. Compared to traditional algorithms that involved a large number of training samples, the RAVE algorithm achieved similar or even better classification performance on the datasets (Pan2023, BNCI001-2014, BNCI001-2015), even when it did not use or only used a small number of within-session training samples.Significance.These findings indicate that our cross-session decoding strategy could enable MI-BCI applications that require no or minimal training process.
Collapse
Affiliation(s)
- Lincong Pan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Lichao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Xinwei Sun
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing 100192, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| |
Collapse
|
28
|
Meng J, Liu H, Wu Q, Zhou H, Shi W, Meng L, Xu M, Ming D. A SSVEP-Based Brain-Computer Interface With Low-Pixel Density of Stimuli. IEEE Trans Neural Syst Rehabil Eng 2023; 31:4439-4448. [PMID: 37906489 DOI: 10.1109/tnsre.2023.3328917] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
The brain-computer interface (BCI) based on the steady-state visual evoked potential (SSVEP) has drawn widespread attention due to its high communication speed and low individual variability. However, there is still a need to enhance the comfort of SSVEP-BCI, especially considering the assurance of its effectiveness. This study aims to achieve a perfect balance between comfort and effectiveness by reducing the pixel density of SSVEP stimuli. Three experiments were conducted to determine the most suitable presentation form (flickering square vs. flickering checkerboard), pixel distribution pattern (random vs. uniform), and pixel density value (100%, 90%, 80%, 70%, 60%, 40%, 20%). Subjects' electroencephalogram (EEG) and fatigue scores were recorded, while comfort and effectiveness were measured by fatigue score and classification accuracy, respectively. The results showed that the flickering square with random pixel distribution achieved a lower fatigue score and higher accuracy. EEG responses induced by stimuli with a square-random presentation mode were then compared across various pixel densities. In both offline and online tests, the fatigue score decreased as the pixel density decreased. Strikingly, when the pixel density was above 60%, the accuracies of low-pixel-density SSVEP were all satisfactory (>90%) and showed no significant difference with that of the conventional 100%-pixel density. These results support the feasibility of using 60%-pixel density with a square-random presentation mode to improve the comfort of SSVEP-BCI, thereby promoting its practical applications in communication and control.
Collapse
|
29
|
Meng J, Zhao Y, Wang K, Sun J, Yi W, Xu F, Xu M, Ming D. Rhythmic temporal prediction enhances neural representations of movement intention for brain-computer interface. J Neural Eng 2023; 20:066004. [PMID: 37875107 DOI: 10.1088/1741-2552/ad0650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2023] [Accepted: 10/24/2023] [Indexed: 10/26/2023]
Abstract
Objective.Detecting movement intention is a typical use of brain-computer interfaces (BCI). However, as an endogenous electroencephalography (EEG) feature, the neural representation of movement is insufficient for improving motor-based BCI. This study aimed to develop a new movement augmentation BCI encoding paradigm by incorporating the cognitive function of rhythmic temporal prediction, and test the feasibility of this new paradigm in optimizing detections of movement intention.Methods.A visual-motion synchronization task was designed with two movement intentions (left vs. right) and three rhythmic temporal prediction conditions (1000 ms vs. 1500 ms vs. no temporal prediction). Behavioural and EEG data of 24 healthy participants were recorded. Event-related potentials (ERPs), event-related spectral perturbation induced by left- and right-finger movements, the common spatial pattern (CSP) and support vector machine, Riemann tangent space algorithm and logistic regression were used and compared across the three temporal prediction conditions, aiming to test the impact of temporal prediction on movement detection.Results.Behavioural results showed significantly smaller deviation time for 1000 ms and 1500 ms conditions. ERP analyses revealed 1000 ms and 1500 ms conditions led to rhythmic oscillations with a time lag in contralateral and ipsilateral areas of movement. Compared with no temporal prediction, 1000 ms condition exhibited greater beta event-related desynchronization (ERD) lateralization in motor area (P< 0.001) and larger beta ERD in frontal area (P< 0.001). 1000 ms condition achieved an averaged left-right decoding accuracy of 89.71% using CSP and 97.30% using Riemann tangent space, both significantly higher than no temporal prediction. Moreover, movement and temporal information can be decoded simultaneously, achieving 88.51% four-classification accuracy.Significance.The results not only confirm the effectiveness of rhythmic temporal prediction in enhancing detection ability of motor-based BCI, but also highlight the dual encodings of movement and temporal information within a single BCI paradigm, which is promising to expand the range of intentions that can be decoded by the BCI.
Collapse
Affiliation(s)
- Jiayuan Meng
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Yingru Zhao
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Kun Wang
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| | - Jinsong Sun
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing, People's Republic of China
| | - Fangzhou Xu
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Minpeng Xu
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, People's Republic of China
| | - Dong Ming
- The Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin 300392, People's Republic of China
| |
Collapse
|
30
|
Zhang H, Zhang Y, Wang X, Chen G, Jian X, Xu M, Ming D. Transcranial dipole localization and decoding study based on ultrasonic phased array for acoustoelectric brain imaging. J Neural Eng 2023; 20:066001. [PMID: 37918024 DOI: 10.1088/1741-2552/ad08f5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Accepted: 11/02/2023] [Indexed: 11/04/2023]
Abstract
Objective. Neuroimaging is one of the effective tools to understand the functional activities of the brain, but traditional non-invasive neuroimaging techniques are difficult to combine both high temporal and spatial resolution to satisfy clinical needs. Acoustoelectric brain imaging (ABI) can combine the millimeter spatial resolution advantage of focused ultrasound with the millisecond temporal resolution advantage of electroencephalogram signals.Approach. In this study, we first explored the transcranial modulated acoustic field distribution based on ABI, and further localized and decoded single and double dipoles signals.Main results. The results show that the simulation-guided acoustic field modulation results are significantly better than those of self-focusing, which can realize precise modulation focusing of intracranial target focusing. The single dipole transcranial localization error is less than 0.4 mm and the decoding accuracy is greater than 0.93. The double dipoles transcranial localization error is less than 0.2 mm and the decoding accuracy is greater than 0.89.Significance. This study enables precise focusing of transcranial acoustic field modulation, high-precision localization of source signals and decoding of their waveforms, which provides a technical method for ABI in localizing evoked excitatory neuron areas and epileptic focus.
Collapse
Affiliation(s)
- Hao Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, People's Republic of China
| | - Yanqiu Zhang
- School of Biomedical Engineering and Technology, Tianjin Medical University, Tianjin 300070, People's Republic of China
| | - Xue Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| | - Guowei Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
| | - Xiqi Jian
- School of Biomedical Engineering and Technology, Tianjin Medical University, Tianjin 300070, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, People's Republic of China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin 300392, People's Republic of China
| |
Collapse
|
31
|
Ke Y, Liu S, Chen L, Wang X, Ming D. Lasting enhancements in neural efficiency by multi-session transcranial direct current stimulation during working memory training. NPJ Sci Learn 2023; 8:48. [PMID: 37919371 PMCID: PMC10622507 DOI: 10.1038/s41539-023-00200-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2023] [Accepted: 10/20/2023] [Indexed: 11/04/2023]
Abstract
The neural basis for long-term behavioral improvements resulting from multi-session transcranial direct current stimulation (tDCS) combined with working memory training (WMT) remains unclear. In this study, we used task-related electroencephalography (EEG) measures to investigate the lasting neurophysiological effects of anodal high-definition (HD)-tDCS applied over the left dorsolateral prefrontal cortex (dlPFC) during a challenging WMT. Thirty-four healthy young adults were randomized to sham or active tDCS groups and underwent ten 30-minute training sessions over ten consecutive days, preceded by a pre-test and followed by post-tests performed one day and three weeks after the last session, respectively, by performing high-load WM tasks along with EEG recording. Multi-session HD-tDCS significantly enhanced the behavioral benefits of WMT. Compared to the sham group, the active group showed facilitated increases in theta, alpha, beta, and gamma task-related oscillations at the end of training and significantly increased P300 response 3 weeks post-training. Our findings suggest that applying anodal tDCS over the left dlPFC during multi-session WMT can enhance the behavioral benefits of WMT and facilitate sustained improvements in WM-related neural efficiency.
Collapse
Affiliation(s)
- Yufeng Ke
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin, PR China.
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, PR China.
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin, PR China.
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, PR China.
| | - Long Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin, PR China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, PR China
| | - Xiashuang Wang
- The Second Academy of China Aerospace Science and Industry Corporation, Beijing, PR China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin International Joint Research Centre for Neural Engineering, and Tianjin Key Laboratory of Brain Science and Neural Engineering, Tianjin University, Tianjin, PR China.
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, PR China.
| |
Collapse
|
32
|
Zhou Y, Song X, Song Y, Guo J, Han G, Liu X, He F, Ming D. Acoustoelectric brain imaging with different conductivities and acoustic distributions. Front Physiol 2023; 14:1241640. [PMID: 38028773 PMCID: PMC10644821 DOI: 10.3389/fphys.2023.1241640] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Accepted: 10/16/2023] [Indexed: 12/01/2023] Open
Abstract
Objective: Acoustoelectric brain imaging (AEBI) is a promising imaging method for mapping brain biological current densities with high spatiotemporal resolution. Currently, it is still challenging to achieve human AEBI with an unclear acoustoelectric (AE) signal response of medium characteristics, particularly in conductivity and acoustic distribution. This study introduces different conductivities and acoustic distributions into the AEBI experiment, and clarifies the response interaction between medium characteristics and AEBI performance to address these key challenges. Approach: AEBI with different conductivities is explored by the imaging experiment, potential measurement, and simulation on a pig's fat, muscle, and brain tissue. AEBI with different acoustic distributions is evaluated on the imaging experiment and acoustic field measurement through a deep and surface transmitting model built on a human skullcap and pig brain tissue. Main results: The results show that conductivity is not only inversely proportional to the AE signal amplitude but also leads to a higher AEBI spatial resolution as it increases. In addition, the current source and sulcus can be located simultaneously with a strong AE signal intensity. The transcranial focal zone enlargement, pressure attenuation in the deep-transmitting model, and ultrasound echo enhancement in the surface-transmitting model cause a reduced spatial resolution, FFT-SNR, and timing correlation of AEBI. Under the comprehensive effect of conductivity and acoustics, AEBI with skull finally shows reduced imaging performance for both models compared with no-skull AEBI. On the contrary, the AE signal amplitude decreases in the deep-transmitting model and increases in the surface-transmitting model. Significance: This study reveals the response interaction between medium characteristics and AEBI performance, and makes an essential step toward developing AEBI as a practical neuroimaging technique.
Collapse
Affiliation(s)
- Yijie Zhou
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Xizi Song
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yibo Song
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jiande Guo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Gangnan Han
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Xiuyun Liu
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Feng He
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
33
|
Xu F, Ming D, Jung TP, Xu P, Xu M. Editorial: The application of artificial intelligence in brain-computer interface and neural system rehabilitation. Front Neurosci 2023; 17:1290961. [PMID: 37965214 PMCID: PMC10641882 DOI: 10.3389/fnins.2023.1290961] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2023] [Accepted: 10/05/2023] [Indexed: 11/16/2023] Open
Affiliation(s)
| | | | - Tzyy-Ping Jung
- University of California, San Diego, San Diego, CA, United States
| | - Peng Xu
- University of Electronic Science and Technology of China, Chengdu, China
| | | |
Collapse
|
34
|
Xie Y, Wang K, Meng J, Yue J, Meng L, Yi W, Jung TP, Xu M, Ming D. Cross-dataset transfer learning for motor imagery signal classification via multi-task learning and pre-training. J Neural Eng 2023; 20:056037. [PMID: 37774694 DOI: 10.1088/1741-2552/acfe9c] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Accepted: 09/29/2023] [Indexed: 10/01/2023]
Abstract
Objective.Deep learning (DL) models have been proven to be effective in decoding motor imagery (MI) signals in Electroencephalogram (EEG) data. However, DL models' success relies heavily on large amounts of training data, whereas EEG data collection is laborious and time-consuming. Recently, cross-dataset transfer learning has emerged as a promising approach to meet the data requirements of DL models. Nevertheless, transferring knowledge across datasets involving different MI tasks remains a significant challenge in cross-dataset transfer learning, limiting the full utilization of valuable data resources. APPROACH This study proposes a pre-training-based cross-dataset transfer learning method inspired by Hard Parameter Sharing in multi-task learning. Different datasets with distinct MI paradigms are considered as different tasks, classified with shared feature extraction layers and individual task-specific layers to allow cross-dataset classification with one unified model. Then, Pre-training and fine-tuning are employed to transfer knowledge across datasets. We also designed four fine-tuning schemes and conducted extensive experiments on them. MAIN RESULTS The results showed that compared to models without pre-training, models with pre-training achieved a maximum increase in accuracy of 7.76%. Moreover, when limited training data were available, the pre-training method significantly improved DL model's accuracy by 27.34% at most. The experiments also revealed that pre-trained models exhibit faster convergence and remarkable robustness. The training time per subject could be reduced by up to 102.83 s, and the variance of classification accuracy decreased by 75.22% at best. SIGNIFICANCE This study represents the first comprehensive investigation of the cross-dataset transfer learning method between two datasets with different MI tasks. The proposed pre-training method requires only minimal fine-tuning data when applying DL models to new MI paradigms, making MI-Brain-computer interface more practical and user-friendly.
Collapse
Affiliation(s)
- Yuting Xie
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Jiayuan Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Jin Yue
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
| | - Lin Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Weibo Yi
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
- Beijing Institute of Mechanical Equipment, Beijin, People's Republic of China
| | - Tzyy-Ping Jung
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, People's Republic of China
| |
Collapse
|
35
|
Gu B, Wang K, Chen L, He J, Zhang D, Xu M, Wang Z, Ming D. Study of the Correlation between the Motor Ability of the Individual Upper Limbs and Motor Imagery Induced Neural Activities. Neuroscience 2023; 530:56-65. [PMID: 37652289 DOI: 10.1016/j.neuroscience.2023.08.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2023] [Revised: 07/13/2023] [Accepted: 08/25/2023] [Indexed: 09/02/2023]
Abstract
Motor imagery based brain-computer interfaces (MI-BCIs) have excellent application prospects in motor enhancement and rehabilitation. However, MI-induced electroencephalogram features applied to MI-BCI usually vary from person to person. This study aimed to investigate whether the motor ability of the individual upper limbs was associated with these features, which helps understand the causes of inter-subject variability. We focused on the behavioral and psychological factors reflecting motor abilities. We first obtained the behavioral scale scores from Edinburgh Handedness Questionnaire, Maximum Grip Strength Test, and Purdue Pegboard Test assessments to evaluate the motor execution ability. We also required the subjects to complete the psychological Movement Imagery Questionnaire-3 estimate, representing MI ability. Then we recorded EEG signals from all twenty-two subjects during MI tasks. Pearson correlation coefficient and stepwise regression were used to analyze the relationships between MI-induced relative event-related desynchronization (rERD) patterns and motor abilities. Both Purdue Pegboard Test and Movement Imagery Questionnaire-3 scores had significant correlations with MI-induced neural oscillation patterns. Notably, the Purdue Pegboard Test of the left hand had the most significant correlation with the alpha rERD. The results of stepwise multiple regression analysis showed that the Purdue Pegboard Test and Movement Imagery Questionnaire-3 could best predict the MI-induced rERD. The results demonstrate that hand dexterity and fine motor coordination are significantly related to MI-induced neural activities. In addition, the method of imagining is also relevant to MI features. Therefore, this study is meaningful for understanding individual differences and the design of user-centered MI-BCI.
Collapse
Affiliation(s)
- Bin Gu
- SUISHI (Tianjin) Intelligence Ltd, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China.
| | - Long Chen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China.
| | - Jiatong He
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Dingze Zhang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Zhongpeng Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, China
| |
Collapse
|
36
|
Song X, Huang P, Chen X, Xu M, Ming D. The frontooccipital interaction mechanism of high-frequency acoustoelectric signal. Cereb Cortex 2023; 33:10723-10735. [PMID: 37724433 DOI: 10.1093/cercor/bhad306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 07/13/2023] [Accepted: 07/15/2023] [Indexed: 09/20/2023] Open
Abstract
Based on acoustoelectric effect, acoustoelectric brain imaging has been proposed, which is a high spatiotemporal resolution neural imaging method. At the focal spot, brain electrical activity is encoded by focused ultrasound, and corresponding high-frequency acoustoelectric signal is generated. Previous studies have revealed that acoustoelectric signal can also be detected in other non-focal brain regions. However, the processing mechanism of acoustoelectric signal between different brain regions remains sparse. Here, with acoustoelectric signal generated in the left primary visual cortex, we investigated the spatial distribution characteristics and temporal propagation characteristics of acoustoelectric signal in the transmission. We observed a strongest transmission strength within the frontal lobe, and the global temporal statistics indicated that the frontal lobe features in acoustoelectric signal transmission. Then, cross-frequency phase-amplitude coupling was used to investigate the coordinated activity in the AE signal band range between frontal and occipital lobes. The results showed that intra-structural cross-frequency coupling and cross-structural coupling co-occurred between these two lobes, and, accordingly, high-frequency brain activity in the frontal lobe was effectively coordinated by distant occipital lobe. This study revealed the frontooccipital long-range interaction mechanism of acoustoelectric signal, which is the foundation of improving the performance of acoustoelectric brain imaging.
Collapse
Affiliation(s)
- Xizi Song
- Academy of Medical Engineering and Translation Medicine, Tianjin University, Tianjin 300072, China
| | - Peishan Huang
- Academy of Medical Engineering and Translation Medicine, Tianjin University, Tianjin 300072, China
| | - Xinrui Chen
- Academy of Medical Engineering and Translation Medicine, Tianjin University, Tianjin 300072, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translation Medicine, Tianjin University, Tianjin 300072, China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| | - Dong Ming
- Academy of Medical Engineering and Translation Medicine, Tianjin University, Tianjin 300072, China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin 300072, China
| |
Collapse
|
37
|
Meng L, Wang D, Shi Y, Li Z, Zhang J, Lu H, Zhu X, Ming D. Enhanced brain functional connectivity and activation after 12-week Tai Chi-based action observation training in patients with Parkinson's disease. Front Aging Neurosci 2023; 15:1252610. [PMID: 37881362 PMCID: PMC10595151 DOI: 10.3389/fnagi.2023.1252610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 09/12/2023] [Indexed: 10/27/2023] Open
Abstract
Introduction Motor-cognitive interactive interventions, such as action observation training (AOT), have shown great potential in restoring cognitive function and motor behaviors. It is expected that an advanced AOT incorporating specific Tai Chi movements with continuous and spiral characteristics can facilitate the shift from automatic to intentional actions and thus enhance motor control ability for early-stage PD. Nonetheless, the underlying neural mechanisms remain unclear. The study aimed to investigate changes in brain functional connectivity (FC) and clinical improvement after 12 weeks of Tai Chi-based action observation training (TC-AOT) compared to traditional physical therapy (TPT). Methods Thirty early-stage PD patients were recruited and randomly assigned to the TC-AOT group (N = 15) or TPT group (N = 15). All participants underwent resting-state functional magnetic resonance imaging (rs-fMRI) scans before and after 12 weeks of training and clinical assessments. The FCs were evaluated by seed-based correlation analysis based on the default mode network (DMN). The rehabilitation effects of the two training methods were compared while the correlations between significant FC changes and clinical improvement were investigated. Results The results showed that the TC-AOT group exhibited significantly increased FCs between the dorsal medial prefrontal cortex and cerebellum crus I, between the posterior inferior parietal lobe and supramarginal gyrus, and between the temporal parietal junction and clusters of middle occipital gyrus and superior temporal. Moreover, these FC changes had a positive relationship with patients' improved motor and cognitive performance. Discussion The finding supported that the TC-AOT promotes early-stage PD rehabilitation outcomes by promoting brain neuroplasticity where the FCs involved in the integration of sensorimotor processing and motor learning were strengthened.
Collapse
Affiliation(s)
- Lin Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Deyu Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yu Shi
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Zhuo Li
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China
| | - Jinghui Zhang
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China
| | - Hanna Lu
- Department of Psychiatry, The Chinese University of Hong Kong, Shatin, Hong Kong SAR, China
| | - Xiaodong Zhu
- Department of Neurology, Tianjin Medical University General Hospital, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, School of Precision Instrument and Opto-Electronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
38
|
Jiang Z, An X, Liu S, Yin E, Yan Y, Ming D. Neural oscillations reflect the individual differences in the temporal perception of audiovisual speech. Cereb Cortex 2023; 33:10575-10583. [PMID: 37727958 DOI: 10.1093/cercor/bhad304] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Revised: 08/01/2023] [Accepted: 08/02/2023] [Indexed: 09/21/2023] Open
Abstract
Multisensory integration occurs within a limited time interval between multimodal stimuli. Multisensory temporal perception varies widely among individuals and involves perceptual synchrony and temporal sensitivity processes. Previous studies explored the neural mechanisms of individual differences for beep-flash stimuli, whereas there was no study for speech. In this study, 28 subjects (16 male) performed an audiovisual speech/ba/simultaneity judgment task while recording their electroencephalography. We examined the relationship between prestimulus neural oscillations (i.e. the pre-pronunciation movement-related oscillations) and temporal perception. The perceptual synchrony was quantified using the Point of Subjective Simultaneity and temporal sensitivity using the Temporal Binding Window. Our results revealed dissociated neural mechanisms for individual differences in Temporal Binding Window and Point of Subjective Simultaneity. The frontocentral delta power, reflecting top-down attention control, is positively related to the magnitude of individual auditory leading Temporal Binding Windows (auditory Temporal Binding Windows; LTBWs), whereas the parieto-occipital theta power, indexing bottom-up visual temporal attention specific to speech, is negatively associated with the magnitude of individual visual leading Temporal Binding Windows (visual Temporal Binding Windows; RTBWs). In addition, increased left frontal and bilateral temporoparietal occipital alpha power, reflecting general attentional states, is associated with increased Points of Subjective Simultaneity. Strengthening attention abilities might improve the audiovisual temporal perception of speech and further impact speech integration.
Collapse
Affiliation(s)
- Zeliang Jiang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Xingwei An
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| | - Erwei Yin
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300457 Tianjin, China
| | - Ye Yan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
- Defense Innovation Institute, Academy of Military Sciences (AMS), 100071 Beijing, China
- Tianjin Artificial Intelligence Innovation Center (TAIIC), 300457 Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, 300072 Tianjin, China
| |
Collapse
|
39
|
Liang R, Wang L, Yang Q, Xu Q, Sun S, Zhou H, Zhao M, Gao J, Zheng C, Yang J, Ming D. Time-course adaptive changes in hippocampal transcriptome and synaptic function induced by simulated microgravity associated with cognition. Front Cell Neurosci 2023; 17:1275771. [PMID: 37868195 PMCID: PMC10585108 DOI: 10.3389/fncel.2023.1275771] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 09/18/2023] [Indexed: 10/24/2023] Open
Abstract
Introduction The investigation of cognitive function in microgravity, both short-term and long-term, remains largely descriptive. And the underlying mechanisms of the changes over time remain unclear. Methods Behavioral tests, electrophysiological recording, and RNA sequencing were used to observe differences in behavior, synaptic plasticity, and gene expression. Results Initially, we measured the performance of spatial cognition exposed to long-term simulated microgravity (SM). Both working memory and advanced cognitive abilities were enhanced. Somewhat surprisingly, the synaptic plasticity of the hippocampal CA3-CA1 synapse was impaired. To gain insight into the mechanism of changing regularity over time, transcriptome sequencing in the hippocampus was performed. The analysis identified 20 differentially expressed genes (DEGs) in the hippocampus after short-term modeling, 19 of which were up-regulated. Gene Ontology (GO) analysis showed that these up-regulated genes were mainly enriched in synaptic-related processes, such as Stxbp5l and Epha6. This might be related to the enhancement of working memory performance under short-term SM exposure. Under exposure to long-term SM, 7 DEGs were identified in the hippocampus, all of which were up-regulated and related to oxidative stress and metabolism, such as Depp1 and Lrg1. Compensatory effects occurred with increased modeling time. Discussion To sum up, our current research indicates that the cognitive function under SM exposure is consistently maintained or potentially even being enhanced over both short and long durations. The underlying mechanisms are intricate and potentially linked to the differential expression of hippocampal-associated genes and alterations in synaptic function, with these effects being time-dependent. The present study will lay the experimental and theoretical foundation of the multi-level mechanism of cognitive function under space flight.
Collapse
Affiliation(s)
- Rong Liang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Ling Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| | - Qing Yang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Qing Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Shufan Sun
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Haichen Zhou
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Meiling Zhao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jing Gao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Chenguang Zheng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| | - Jiajia Yang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Tianjin Key Laboratory of Brain Science and Neuroengineering, Tianjin, China
- Haihe Laboratory of Brain-Computer Interaction and Human-Machine Integration, Tianjin, China
| |
Collapse
|
40
|
Zhang X, Nan J, Xu M, Chen L, Ni G, Ming D. PSIs of EEG With Refined Frequency Decomposition Could Prognose Motor Recovery Before Rehabilitation Intervention. IEEE Trans Neural Syst Rehabil Eng 2023; 31:3760-3771. [PMID: 37721877 DOI: 10.1109/tnsre.2023.3316210] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/20/2023]
Abstract
Stroke often leads to permanent impairment in motor function. Accurate and quantitative prognosis of potential motor recovery before rehabilitation intervention can help healthcare centers improve resources organization and enable individualized intervention. The context of this paper investigated the potential of using electroencephalography (EEG) functional connectivity (FC) measures as biomarkers for assessing and prognosing improvement of Fugl-Meyer Assessment in upper extremity motor function ( ∆FMU) among participants with chronic stroke. EEG data from resting and motor imagery task were recorded from 13 participants with chronic stroke. Three functional connectivity methods, which were Pearson correlation measure (PCM), weighted Phase Lag Index (wPLI) and phase synchronization index (PSI), were investigated, under three regions of interest (inter-hemispheric, intra-hemispheric, and whole-brain), in two statues (resting and motor imagery), with 15 refined center frequencies. We applied correlation analysis to identify the optimal center frequencies and pairs of synchronized channels that were consistently associated with ∆FMU . Predictive models were generated using regression analysis algorithms based on optimized center frequencies and channel pairs identified from the proposed analysis method, with leave-one-out cross-validation. We found that PSI in the Alpha band (with center frequency of 9Hz) was the most sensitive FC measures for prognosing motor recovery. Strong and significant correlations were identified between the predictions and actual ∆FMU scores both in the resting state ( [Formula: see text], [Formula: see text], N=13) and motor imagery ( [Formula: see text], [Formula: see text], N=13). Our results suggested that EEG connectivity measured with PSI in resting state could be a promising biomarker for quantifying motor recovery before motor rehabilitation intervention.
Collapse
|
41
|
Wang K, Qiu S, Wei W, Yi W, He H, Xu M, Jung TP, Ming D. Investigating EEG-based cross-session and cross-task vigilance estimation in BCI systems. J Neural Eng 2023; 20:056001. [PMID: 37611567 DOI: 10.1088/1741-2552/acf345] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2023] [Accepted: 08/23/2023] [Indexed: 08/25/2023]
Abstract
Objective. The state of vigilance is crucial for effective performance in brain-computer interface (BCI) tasks, and therefore, it is essential to investigate vigilance levels in BCI tasks. Despite this, most studies have focused on vigilance levels in driving tasks rather than on BCI tasks, and the electroencephalogram (EEG) patterns of vigilance states in different BCI tasks remain unclear. This study aimed to identify similarities and differences in EEG patterns and performances of vigilance estimation in different BCI tasks and sessions.Approach.To achieve this, we built a steady-state visual evoked potential-based BCI system and a rapid serial visual presentation-based BCI system and recruited 18 participants to carry out four BCI experimental sessions over four days.Main results. Our findings demonstrate that specific neural patterns for high and low vigilance levels are relatively stable across sessions. Differential entropy features significantly differ between different vigilance levels in all frequency bands and between BCI tasks in the delta and theta frequency bands, with the theta frequency band features playing a critical role in vigilance estimation. Additionally, prefrontal, temporal, and occipital regions are more relevant to the vigilance state in BCI tasks. Our results suggest that cross-session vigilance estimation is more accurate than cross-task estimation.Significance.Our study clarifies the underlying mechanisms of vigilance state in two BCI tasks and provides a foundation for further research in vigilance estimation in BCI applications.
Collapse
Affiliation(s)
- Kangning Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- Laboratory of Brain Atlas and Brain-Inspired Intelligence, State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, People's Republic of China
| | - Shuang Qiu
- Laboratory of Brain Atlas and Brain-Inspired Intelligence, State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, People's Republic of China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, People's Republic of China
| | - Wei Wei
- Laboratory of Brain Atlas and Brain-Inspired Intelligence, State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, People's Republic of China
| | - Weibo Yi
- Beijing Machine and Equipment Institute, Beijing, People's Republic of China
| | - Huiguang He
- Laboratory of Brain Atlas and Brain-Inspired Intelligence, State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, People's Republic of China
- School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
| | - Tzyy-Ping Jung
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
- Swartz Center for Computational Neuroscience, University of California, San Diego, CA, United States of America
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, People's Republic of China
- College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, People's Republic of China
| |
Collapse
|
42
|
Ge R, Liu Y, Yan Z, Cheng Q, Qiu S, Ming D. Design of a Self-Aligning Four-Finger Exoskeleton for Finger Abduction/Adduction and Flexion/Extension Motion. IEEE Int Conf Rehabil Robot 2023; 2023:1-6. [PMID: 37941292 DOI: 10.1109/icorr58425.2023.10304720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
For wearable four-finger exoskeletons, it is still a challenge to design the metacarpophalangeal (MCP)joint abduction/adduction (a/a) kinematic chain and achieve axes self-aligning. This paper proposes a novel exoskeleton for four fingers that features a high degree of dexterity enabling MCP joint flexion/extension (f/e) and a/a motion. Other features of the exoskeleton include a self-aligning mechanism that absorbs misalignment between the exoskeleton and human joints, the ability to accommodate fingers of different sizes, and a compact design that allows simultaneous a/a motion without interference. This paper presents the exoskeleton's kinematic model, optimizes the range of motion (ROM), and length of the exoskeleton linkage using the Genetic Algorithm. We compare the four-finger MCP joint's ROM and fingertip workspace with and without the exoskeleton. Our experiments show that the proposed exoskeleton has no significant impact on the natural ROM of the four-finger MCP joint, enables the fingers to cover an average of 82.96% of the original workspace, and can reach a significant portion of the fingertip workspace.
Collapse
|
43
|
Wang F, Li Y, Tang D, Yang B, Tian T, Tian M, Meng N, Xie W, Zhang C, He Z, Zhu X, Ming D, Liu Y. Exploration of the SIRT1-mediated BDNF-TrkB signaling pathway in the mechanism of brain damage and learning and memory effects of fluorosis. Front Public Health 2023; 11:1247294. [PMID: 37711250 PMCID: PMC10499441 DOI: 10.3389/fpubh.2023.1247294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/25/2023] [Accepted: 08/16/2023] [Indexed: 09/16/2023] Open
Abstract
Introduction Fluoride is considered an environmental pollutant that seriously affects organisms and ecosystems, and its harmfulness is a perpetual public health concern. The toxic effects of fluoride include organelle damage, oxidative stress, cell cycle destruction, inflammatory factor secretion, apoptosis induction, and synaptic nerve transmission destruction. To reveal the mechanism of fluorosis-induced brain damage, we analyzed the molecular mechanism and learning and memory function of the SIRT1-mediated BDNF-TrkB signaling pathway cascade reaction in fluorosis-induced brain damage through in vivo experiments. Methods This study constructed rat models of drinking water fluorosis using 50 mg/L, 100 mg/L, and 150 mg/L fluoride, and observed the occurrence of dental fluorosis in the rats. Subsequently, we measured the fluoride content in rat blood, urine, and bones, and measured the rat learning and memory abilities. Furthermore, oxidative stress products, inflammatory factor levels, and acetylcholinesterase (AchE) and choline acetyltransferase (ChAT) activity were detected. The pathological structural changes to the rat bones and brain tissue were observed. The SIRT1, BDNF, TrkB, and apoptotic protein levels were determined using western blotting. Results All rats in the fluoride exposure groups exhibited dental fluorosis; decreased learning and memory abilities; and higher urinary fluoride, bone fluoride, blood fluoride, oxidative stress product, and inflammatory factor levels compared to the control group. The fluoride-exposed rat brain tissue had abnormal AchE and ChAT activity, sparsely arranged hippocampal neurons, blurred cell boundaries, significantly fewer astrocytes, and swollen cells. Furthermore, the nucleoli were absent from the fluoride-exposed rat brain tissue, which also contained folded neuron membranes, deformed mitochondria, absent cristae, vacuole formation, and pyknotic and hyperchromatic chromatin. The fluoride exposure groups had lower SIRT1, BDNF, and TrkB protein levels and higher apoptotic protein levels than the control group, which were closely related to the fluoride dose. The findings demonstrated that excessive fluoride caused brain damage and affected learning and memory abilities. Discussion Currently, there is no effective treatment method for the tissue damage caused by fluorosis. Therefore, the effective method for preventing and treating fluorosis damage is to control fluoride intake.
Collapse
Affiliation(s)
- Feiqing Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Yanju Li
- Department of Hematology, Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Dongxin Tang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Bo Yang
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Tingting Tian
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Mengxian Tian
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Na Meng
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Wei Xie
- Medical Research Center, The First Affiliated Hospital of Guizhou University of Traditional Chinese Medicine, Guiyang, Guizhou Province, China
| | - Chike Zhang
- Department of Hematology, Affiliated Hospital of Guizhou Medical University, Guiyang, Guizhou Province, China
| | - Zhixu He
- National & Guizhou Joint Engineering Laboratory for Cell Engineering and Biomedicine Technique, Guiyang, Guizhou Province, China
| | - Xiaodong Zhu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Neurological Institute, Tianjin Medical University General Hospital, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Yang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- National & Guizhou Joint Engineering Laboratory for Cell Engineering and Biomedicine Technique, Guiyang, Guizhou Province, China
| |
Collapse
|
44
|
Liu C, You J, Wang K, Zhang S, Huang Y, Xu M, Ming D. Decoding the EEG patterns induced by sequential finger movement for brain-computer interfaces. Front Neurosci 2023; 17:1180471. [PMID: 37706155 PMCID: PMC10495835 DOI: 10.3389/fnins.2023.1180471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Accepted: 07/26/2023] [Indexed: 09/15/2023] Open
Abstract
Objective In recent years, motor imagery-based brain-computer interfaces (MI-BCIs) have developed rapidly due to their great potential in neurological rehabilitation. However, the controllable instruction set limits its application in daily life. To extend the instruction set, we proposed a novel movement-intention encoding paradigm based on sequential finger movement. Approach Ten subjects participated in the offline experiment. During the experiment, they were required to press a key sequentially [i.e., Left→Left (LL), Right→Right (RR), Left→Right (LR), and Right→Left (RL)] using the left or right index finger at about 1 s intervals under an auditory prompt of 1 Hz. The movement-related cortical potential (MRCP) and event-related desynchronization (ERD) features were used to investigate the electroencephalography (EEG) variation induced by the sequential finger movement tasks. Twelve subjects participated in an online experiment to verify the feasibility of the proposed paradigm. Main results As a result, both the MRCP and ERD features showed the specific temporal-spatial EEG patterns of different sequential finger movement tasks. For the offline experiment, the average classification accuracy of the four tasks was 71.69%, with the highest accuracy of 79.26%. For the online experiment, the average accuracies were 83.33% and 82.71% for LL-versus-RR and LR-versus-RL, respectively. Significance This paper demonstrated the feasibility of the proposed sequential finger movement paradigm through offline and online experiments. This study would be helpful for optimizing the encoding method of motor-related EEG information and providing a promising approach to extending the instruction set of the movement intention-based BCIs.
Collapse
Affiliation(s)
- Chang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Jia You
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Shanshan Zhang
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| | - Yining Huang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
- International School for Optoelectronic Engineering, Qilu University of Technology (Shandong Academy of Sciences), Jinan, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- School of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
45
|
Yuan X, Kang Y, Dong J, Li R, Ye J, Fan Y, Han J, Yu J, Ni G, Ji X, Ming D. Self-triggered thermoelectric nanoheterojunction for cancer catalytic and immunotherapy. Nat Commun 2023; 14:5140. [PMID: 37612298 PMCID: PMC10447553 DOI: 10.1038/s41467-023-40954-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Accepted: 08/17/2023] [Indexed: 08/25/2023] Open
Abstract
The exogenous excitation requirement and electron-hole recombination are the key elements limiting the application of catalytic therapies. Here a tumor microenvironment (TME)-specific self-triggered thermoelectric nanoheterojunction (Bi0.5Sb1.5Te3/CaO2 nanosheets, BST/CaO2 NSs) with self-built-in electric field facilitated charge separation is fabricated. Upon exposure to TME, the CaO2 coating undergoes rapid hydrolysis, releasing Ca2+, H2O2, and heat. The resulting temperature difference on the BST NSs initiates a thermoelectric effect, driving reactive oxygen species production. H2O2 not only serves as a substrate supplement for ROS generation but also dysregulates Ca2+ channels, preventing Ca2+ efflux. This further exacerbates calcium overload-mediated therapy. Additionally, Ca2+ promotes DC maturation and tumor antigen presentation, facilitating immunotherapy. It is worth noting that the CaO2 NP coating hydrolyzes very slowly in normal cells, releasing Ca2+ and O2 without causing any adverse effects. Tumor-specific self-triggered thermoelectric nanoheterojunction combined catalytic therapy, ion interference therapy, and immunotherapy exhibit excellent antitumor performance in female mice.
Collapse
Affiliation(s)
- Xue Yuan
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Yong Kang
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Jinrui Dong
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Ruiyan Li
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Jiamin Ye
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Yueyue Fan
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Jingwen Han
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Junhui Yu
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Guangjian Ni
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| | - Xiaoyuan Ji
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China.
- Medical College, Linyi University, 276000, Linyi, China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Medical College, Tianjin University, 300072, Tianjin, China
| |
Collapse
|
46
|
Sun Y, Duan M, An L, Liu S, Ming D. Abnormal attentional bias in individuals with suicidal ideation during an emotional Stroop task: an event-related potential study. Front Psychiatry 2023; 14:1118602. [PMID: 37674549 PMCID: PMC10477597 DOI: 10.3389/fpsyt.2023.1118602] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/08/2022] [Accepted: 08/04/2023] [Indexed: 09/08/2023] Open
Abstract
Introduction There is increasing evidence that suicidal individuals exhibit an attentional bias toward negative or suicide-related stimuli, but the underlying neural mechanism remains unclear. This study aimed to investigate the neural mechanism of attentional bias toward emotional stimuli using a modified emotional Stroop task (EST) and to further explore the influencing factor of abnormal attention processing by identifying whether mental disorders or suicidal ideation contributes to attention processing disruptions. Methods Fourteen students with suicidal ideation and mental disorders (SIMDs), sixteen students with suicidal ideation but no mental disorders (SINMDs), and fourteen sex- and age-matched healthy controls (HCs) were recruited. Moreover, 64-channel electroencephalography (EEG) data and behavioral responses were recorded simultaneously during the EST. Participants were instructed to respond to the ink color for various types of words (positive, neutral, negative, and suicide) while ignoring their meanings. Event-related potentials (ERPs) were analyzed to evaluate attention to the stimuli. Spearman correlations between clinical psychological assessment scales and ERP signatures were analyzed to determine the risk factors for suicide. Results The results showed that the SIMD group exhibited longer early posterior negativity (EPN) latency compared to the SINMD and HC groups, indicating that early attention processing was affected during the EST, and the automatic and rapid processing of emotional information decreased. Furthermore, P300 latency for positive words was positively correlated with current suicidal ideation in the SINMD group, suggesting that delayed responses or additional processing to positive information may lead individuals with suicidal ideation to an incorrect interpretation of external events. Conclusions Generally, our findings suggest that the neural characteristics of the SIMD group differed from those of the SINMD and HC groups. EPN latency and P300 latency during the EST may be suicide-related neurophysiological indicators. These results provide neurophysiological signatures of suicidal behavior.
Collapse
Affiliation(s)
- Yiwei Sun
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Moxin Duan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Li An
- School of Education, Tianjin University, Tianjin, China
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, China
- Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, China
| |
Collapse
|
47
|
Miao Z, Zhao M, Zhang X, Ming D. LMDA-Net:A lightweight multi-dimensional attention network for general EEG-based brain-computer interfaces and interpretability. Neuroimage 2023; 276:120209. [PMID: 37269957 DOI: 10.1016/j.neuroimage.2023.120209] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 05/05/2023] [Accepted: 05/30/2023] [Indexed: 06/05/2023] Open
Abstract
Electroencephalography (EEG)-based brain-computer interfaces (BCIs) pose a challenge for decoding due to their low spatial resolution and signal-to-noise ratio. Typically, EEG-based recognition of activities and states involves the use of prior neuroscience knowledge to generate quantitative EEG features, which may limit BCI performance. Although neural network-based methods can effectively extract features, they often encounter issues such as poor generalization across datasets, high predicting volatility, and low model interpretability. To address these limitations, we propose a novel lightweight multi-dimensional attention network, called LMDA-Net. By incorporating two novel attention modules designed specifically for EEG signals, the channel attention module and the depth attention module, LMDA-Net is able to effectively integrate features from multiple dimensions, resulting in improved classification performance across various BCI tasks. LMDA-Net was evaluated on four high-impact public datasets, including motor imagery (MI) and P300-Speller, and was compared with other representative models. The experimental results demonstrate that LMDA-Net outperforms other representative methods in terms of classification accuracy and predicting volatility, achieving the highest accuracy in all datasets within 300 training epochs. Ablation experiments further confirm the effectiveness of the channel attention module and the depth attention module. To facilitate an in-depth understanding of the features extracted by LMDA-Net, we propose class-specific neural network feature interpretability algorithms that are suitable for evoked responses and endogenous activities. By mapping the output of the specific layer of LMDA-Net to the time or spatial domain through class activation maps, the resulting feature visualizations can provide interpretable analysis and establish connections with EEG time-spatial analysis in neuroscience. In summary, LMDA-Net shows great potential as a general decoding model for various EEG tasks.
Collapse
Affiliation(s)
- Zhengqing Miao
- State Key Laboratory of Precision Measuring Technology and Instruments, School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin 300072, China.
| | - Meirong Zhao
- State Key Laboratory of Precision Measuring Technology and Instruments, School of Precision Instrument and Opto-electronics Engineering, Tianjin University, Tianjin 300072, China.
| | - Xin Zhang
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, School of Precision Instruments and Optoelectronics Engineering, Tianjin University, China; Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China.
| | - Dong Ming
- Laboratory of Neural Engineering and Rehabilitation, Department of Biomedical Engineering, School of Precision Instruments and Optoelectronics Engineering, Tianjin University, China; Tianjin International Joint Research Center for Neural Engineering, Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin 300072, China.
| |
Collapse
|
48
|
Meng L, Zhang T, Zhao X, Wang D, Xu R, Yang A, Ming D. A quantitative lower limb function assessment method based on fusion of surface EMG and inertial data in stroke patients during cycling task. Biomed Signal Process Control 2023. [DOI: 10.1016/j.bspc.2023.104880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
49
|
Si X, He H, Yu J, Ming D. Cross-Subject Emotion Recognition Brain-Computer Interface Based on fNIRS and DBJNet. Cyborg Bionic Syst 2023; 4:0045. [PMID: 37519929 PMCID: PMC10374245 DOI: 10.34133/cbsystems.0045] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 07/05/2023] [Indexed: 08/01/2023] Open
Abstract
Functional near-infrared spectroscopy (fNIRS) is a noninvasive brain imaging technique that has gradually been applied in emotion recognition research due to its advantages of high spatial resolution, real time, and convenience. However, the current research on emotion recognition based on fNIRS is mainly limited to within-subject, and there is a lack of related work on emotion recognition across subjects. Therefore, in this paper, we designed an emotion evoking experiment with videos as stimuli and constructed the fNIRS emotion recognition database. On this basis, deep learning technology was introduced for the first time, and a dual-branch joint network (DBJNet) was constructed, creating the ability to generalize the model to new participants. The decoding performance obtained by the proposed model shows that fNIRS can effectively distinguish positive versus neutral versus negative emotions (accuracy is 74.8%, F1 score is 72.9%), and the decoding performance on the 2-category emotion recognition task of distinguishing positive versus neutral (accuracy is 89.5%, F1 score is 88.3%), negative versus neutral (accuracy is 91.7%, F1 score is 91.1%) proved fNIRS has a powerful ability to decode emotions. Furthermore, the results of the ablation study of the model structure demonstrate that the joint convolutional neural network branch and the statistical branch achieve the highest decoding performance. The work in this paper is expected to facilitate the development of fNIRS affective brain-computer interface.
Collapse
Affiliation(s)
- Xiaopeng Si
- Academy of Medical Engineering and Translational Medicine,
Tianjin University, Tianjin 300072, People’s Republic of China
- Tianjin Key Laboratory of Brain Science and Neural Engineering,
Tianjin University, Tianjin 300072, People’s Republic of China
| | - Huang He
- Academy of Medical Engineering and Translational Medicine,
Tianjin University, Tianjin 300072, People’s Republic of China
- Tianjin Key Laboratory of Brain Science and Neural Engineering,
Tianjin University, Tianjin 300072, People’s Republic of China
| | - Jiayue Yu
- Tianjin Key Laboratory of Brain Science and Neural Engineering,
Tianjin University, Tianjin 300072, People’s Republic of China
- Tianjin International Engineering Institute,
Tianjin University, Tianjin 300072, People’s Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine,
Tianjin University, Tianjin 300072, People’s Republic of China
- Tianjin Key Laboratory of Brain Science and Neural Engineering,
Tianjin University, Tianjin 300072, People’s Republic of China
| |
Collapse
|
50
|
Jiang Z, An X, Liu S, Yin E, Yan Y, Ming D. Beyond alpha band: prestimulus local oscillation and interregional synchrony of the beta band shape the temporal perception of the audiovisual beep-flash stimulus. J Neural Eng 2023. [PMID: 37419108 DOI: 10.1088/1741-2552/ace551] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/09/2023]
Abstract
OBJECTIVE 
Sensory integration is modulated by local prestimulus ongoing oscillatory activity which was suggested to play a role in organizing general neural processes such as attention and neuronal excitability and relatively longer inter-areal poststimulus phase coupling, especially in the 8-12 Hz alpha band. Previous work has examined the modulation effect of phase in audiovisual temporal integration, but there is no unified conclusion whether there is phasic modulation in the visual leading condition (sound-flash pairs). Moreover, it is unknown whether temporal integration is also subject to prestimulus inter-areal phase coupling between localizer-defined auditory and visual regions. APPROACH Here, we recorded brain activity with EEG while human participants of both sexes performed a simultaneity judgment (SJ) task with the beep-flash stimuli to explore the functional role of the ongoing local oscillation and inter-areal coupling in temporal integration.
Main results:
We found that the power and ITC of the alpha-band are larger in synchronous response in both the visual and auditory leading conditions in their respective occipital and central channels, suggesting that neuronal excitability and attention play a role in temporal integration. Critically, the simultaneous judgment was modulated by the phases of low beta (14-20 Hz) oscillations quantified by the phase bifurcation index (PBI). Posthoc Rayleigh test indicated that the beta phase encodes different time information rather than neuronal excitability. Furthermore, we also found the stronger spontaneous high beta (21-28 Hz) phasic coupling between audiovisual cortices for synchronous response in auditory leading condition. SIGNIFICANCE Together, these results demonstrate that spontaneous local low-frequency (< 30 Hz) neural oscillations and functional connectivity between auditory and visual brain regions especially in the beta band collectively influence audiovisual temporal integration.
.
Collapse
Affiliation(s)
- Zeliang Jiang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, 300072, CHINA
| | - Xingwei An
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, 300072, CHINA
| | - Shuang Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, 300072, CHINA
| | - Erwei Yin
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, Tianjin, 300072, CHINA
| | - Ye Yan
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, Tianjin, 300072, CHINA
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, No. 92, Weijin Road, Nankai District, Tianjin, Tianjin, 300072, CHINA
| |
Collapse
|