1
|
Shahsavari Baboukani P, Graversen C, Alickovic E, Østergaard J. Speech to noise ratio improvement induces nonlinear parietal phase synchrony in hearing aid users. Front Neurosci 2022; 16:932959. [PMID: 36017182 PMCID: PMC9396236 DOI: 10.3389/fnins.2022.932959] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2022] [Accepted: 06/29/2022] [Indexed: 11/13/2022] Open
Abstract
ObjectivesComprehension of speech in adverse listening conditions is challenging for hearing-impaired (HI) individuals. Noise reduction (NR) schemes in hearing aids (HAs) have demonstrated the capability to help HI to overcome these challenges. The objective of this study was to investigate the effect of NR processing (inactive, where the NR feature was switched off, vs. active, where the NR feature was switched on) on correlates of listening effort across two different background noise levels [+3 dB signal-to-noise ratio (SNR) and +8 dB SNR] by using a phase synchrony analysis of electroencephalogram (EEG) signals.DesignThe EEG was recorded while 22 HI participants fitted with HAs performed a continuous speech in noise (SiN) task in the presence of background noise and a competing talker. The phase synchrony within eight regions of interest (ROIs) and four conventional EEG bands was computed by using a multivariate phase synchrony measure.ResultsThe results demonstrated that the activation of NR in HAs affects the EEG phase synchrony in the parietal ROI at low SNR differently than that at high SNR. The relationship between conditions of the listening task and phase synchrony in the parietal ROI was nonlinear.ConclusionWe showed that the activation of NR schemes in HAs can non-linearly reduce correlates of listening effort as estimated by EEG-based phase synchrony. We contend that investigation of the phase synchrony within ROIs can reflect the effects of HAs in HI individuals in ecological listening conditions.
Collapse
Affiliation(s)
- Payam Shahsavari Baboukani
- Department of Electronic Systems, Aalborg University, Aalborg, Denmark
- *Correspondence: Payam Shahsavari Baboukani
| | - Carina Graversen
- Integrative Neuroscience, Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
- Department of Health Science and Technology, Center for Neuroplasticity and Pain (CNAP), Aalborg University, Aalborg, Denmark
| | - Emina Alickovic
- Eriksholm Research Centre, Snekkersten, Denmark
- Department of Electrical Engineering, Linköping University, Linköping, Sweden
| | - Jan Østergaard
- Department of Electronic Systems, Aalborg University, Aalborg, Denmark
| |
Collapse
|
2
|
|
3
|
Zhou T, Yu T, Li Z, Zhou X, Wen J, Li X. Functional mapping of language-related areas from natural, narrative speech during awake craniotomy surgery. Neuroimage 2021; 245:118720. [PMID: 34774771 DOI: 10.1016/j.neuroimage.2021.118720] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/06/2021] [Revised: 10/22/2021] [Accepted: 11/09/2021] [Indexed: 10/19/2022] Open
Abstract
Accurate localization of brain regions responsible for language and cognitive functions in epilepsy patients is important. Electrocorticography (ECoG)-based real-time functional mapping (RTFM) has been shown to be a safer alternative to electrical cortical stimulation mapping (ESM), which is currently the clinical/gold standard. Conventional methods for analyzing RTFM data mostly account for the ECoG signal in certain frequency bands, especially high gamma. Compared to ESM, they have limited accuracy when assessing channel responses. In the present study, we developed a novel RTFM method based on tensor component analysis (TCA) to address the limitations of current estimation methods. Our approach analyzes the whole frequency spectrum of the ECoG signal during natural continuous speech. We construct third-order tensors that contain multichannel time-frequency information and use TCA to extract low-dimensional temporal, spectral and spatial modes. Temporal modulation scores (correlation values) are then calculated between the time series of voice envelope features and TCA-estimated temporal courses, and significant temporal modulation determines which components' channel weightings are displayed to the neurosurgeon as a guide for follow-up ESM. In our experiments, data from thirteen patients with refractory epilepsy were recorded during preoperative evaluation for their epileptogenic zones (EZs), which were located adjacent to the eloquent cortex. Our results showed higher detection accuracy of our proposed method in a narrative speech task, suggesting that our method complements ESM and is an improvement over the prior RTFM method. To our knowledge, this is the first TCA-based method to pinpoint language-specific brain regions during continuous speech that uses whole-band ECoG.
Collapse
Affiliation(s)
- Tianyi Zhou
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University at Zhuhai 519087, China.
| | - Tao Yu
- Beijing Institute of Functional Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing 100053, China.
| | - Zheng Li
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University at Zhuhai 519087, China.
| | - Xiaoxia Zhou
- Beijing Institute of Functional Neurosurgery, Xuanwu Hospital, Capital Medical University, Beijing 100053, China.
| | - Jianbin Wen
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| | - Xiaoli Li
- Center for Cognition and Neuroergonomics, State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University at Zhuhai 519087, China; State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Beijing 100875, China.
| |
Collapse
|
4
|
Delfino E, Pastore A, Zucchini E, Cruz MFP, Ius T, Vomero M, D'Ausilio A, Casile A, Skrap M, Stieglitz T, Fadiga L. Prediction of Speech Onset by Micro-Electrocorticography of the Human Brain. Int J Neural Syst 2021; 31:2150025. [PMID: 34130614 DOI: 10.1142/s0129065721500258] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Recent technological advances show the feasibility of offline decoding speech from neuronal signals, paving the way to the development of chronically implanted speech brain computer interfaces (sBCI). Two key steps that still need to be addressed for the online deployment of sBCI are, on the one hand, the definition of relevant design parameters of the recording arrays, on the other hand, the identification of robust physiological markers of the patient's intention to speak, which can be used to online trigger the decoding process. To address these issues, we acutely recorded speech-related signals from the frontal cortex of two human patients undergoing awake neurosurgery for brain tumors using three different micro-electrocorticographic ([Formula: see text]ECoG) devices. First, we observed that, at the smallest investigated pitch (600[Formula: see text][Formula: see text]m), neighboring channels are highly correlated, suggesting that more closely spaced electrodes would provide some redundant information. Second, we trained a classifier to recognize speech-related motor preparation from high-gamma oscillations (70-150[Formula: see text]Hz), demonstrating that these neuronal signals can be used to reliably predict speech onset. Notably, our model generalized both across subjects and recording devices showing the robustness of its performance. These findings provide crucial information for the design of future online sBCI.
Collapse
Affiliation(s)
- Emanuela Delfino
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Aldo Pastore
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Elena Zucchini
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Maria Francisca Porto Cruz
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering (IMTEK), University of Freiburg, Georges-Köhler-Allee 102, Freiburg im Breisgau 79110, Germany
| | - Tamara Ius
- Struttura Complessa di Neurochirurgia, Azienda Ospedaliero-Universitaria Santa Maria, della Misericordia, Piazzale Santa Maria, della Misericordia 15, Udine 33100, Italy
| | - Maria Vomero
- Bioelectronic Systems Laboratory, Columbia University, 500 West 120th Street, New York, NY 10027, USA
| | - Alessandro D'Ausilio
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Antonino Casile
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| | - Miran Skrap
- Struttura Complessa di Neurochirurgia, Azienda Ospedaliero-Universitaria Santa Maria, della Misericordia, Piazzale Santa Maria, della Misericordia 15, Udine 33100, Italy
| | - Thomas Stieglitz
- Laboratory for Biomedical Microtechnology, Department of Microsystems Engineering (IMTEK), University of Freiburg, Georges-Köhler-Allee 102, Freiburg im Breisgau 79110, Germany.,BrainLinks-BrainTools Center, University of Freiburg, Georges-Köhler-Allee 80, Freiburg im Breisgau 79110, Germany
| | - Luciano Fadiga
- Center for Translational Neurophysiology, Istituto Italiano di Tecnologia, Via Fossato di Mortara 17-19, Ferrara 44121, Italy.,Section of Physiology, University of Ferrara, Via Fossato di Mortara 17-19, Ferrara 44121, Italy
| |
Collapse
|
5
|
Wan W, Cui X, Gao Z, Gu Z. Frontal EEG-Based Multi-Level Attention States Recognition Using Dynamical Complexity and Extreme Gradient Boosting. Front Hum Neurosci 2021; 15:673955. [PMID: 34140885 PMCID: PMC8204057 DOI: 10.3389/fnhum.2021.673955] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2021] [Accepted: 04/26/2021] [Indexed: 01/25/2023] Open
Abstract
Measuring and identifying the specific level of sustained attention during continuous tasks is essential in many applications, especially for avoiding the terrible consequences caused by reduced attention of people with special tasks. To this end, we recorded EEG signals from 42 subjects during the performance of a sustained attention task and obtained resting state and three levels of attentional states using the calibrated response time. EEG-based dynamical complexity features and Extreme Gradient Boosting (XGBoost) classifier were proposed as the classification model, Complexity-XGBoost, to distinguish multi-level attention states with improved accuracy. The maximum average accuracy of Complexity-XGBoost were 81.39 ± 1.47% for four attention levels, 80.42 ± 0.84% for three attention levels, and 95.36 ± 2.31% for two attention levels in 5-fold cross-validation. The proposed method is compared with other models of traditional EEG features and different classification algorithms, the results confirmed the effectiveness of the proposed method. We also found that the frontal EEG dynamical complexity measures were related to the changing process of response during sustained attention task. The proposed dynamical complexity approach could be helpful to recognize attention status during important tasks to improve safety and efficiency, and be useful for further brain-computer interaction research in clinical research or daily practice, such as the cognitive assessment or neural feedback treatment of individuals with attention deficit hyperactivity disorders, Alzheimer’s disease, and other diseases which affect the sustained attention function.
Collapse
Affiliation(s)
- Wang Wan
- State Key Laboratory of Bioelectronics, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China
| | - Xingran Cui
- Key Laboratory of Child Development and Learning Science, Ministry of Education, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China.,Institute of Biomedical Devices (Suzhou), Southeast University, Suzhou, China
| | - Zhilin Gao
- State Key Laboratory of Bioelectronics, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China
| | - Zhongze Gu
- State Key Laboratory of Bioelectronics, School of Biological Science & Medical Engineering, Southeast University, Nanjing, China.,Institute of Biomedical Devices (Suzhou), Southeast University, Suzhou, China
| |
Collapse
|
6
|
Wang Y, Wan C, Zhang Y, Zhou Y, Wang H, Yan F, Song D, Du R, Wang Q, Huang L. Detecting Connected Consciousness During Propofol-Induced Anesthesia Using EEG Based Brain Decoding. Int J Neural Syst 2021; 31:2150021. [PMID: 33970056 DOI: 10.1142/s0129065721500210] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Connected consciousness refers to the state when external stimuli can enter into the stream of our consciousness experience. Emerging evidence suggests that although patients may not respond behaviorally to external stimuli during anesthesia, they may be aware of their surroundings. In this work, we investigated whether EEG based brain decoding could be used for detecting connected consciousness in the absence of behavioral responses during propofol infusion. A total of 14 subjects participated in our experiment. Subjects were asked to discriminate two types of auditory stimuli with a finger press during an ultraslow propofol infusion. We trained an EEG based brain decoding model using data collected in the awakened state using the same auditory stimuli and tested the model on data collected during the propofol infusion. The model provided a correct classification rate (CCR) of [Formula: see text]% when subjects were able to respond to the stimuli during the propofol infusion. The CCR dropped to [Formula: see text]% when subjects ceased responding and further decreased to [Formula: see text]% when we increased the propofol concentration by another 0.2 [Formula: see text]g/ml. After terminating the propofol infusion, we observed that the CCR rebounded to [Formula: see text]% before the subjects regained consciousness. With the classification results, we provided evidence that loss of consciousness is a gradual process and may progress from full consciousness to connected consciousness and then to disconnected consciousness.
Collapse
Affiliation(s)
- Yubo Wang
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| | - Chenghao Wan
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| | - Yun Zhang
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| | - Yu Zhou
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| | - Haidong Wang
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| | - Fei Yan
- Department of Anesthesiology and Center for Brain Science, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, P. R. China
| | - Dawei Song
- Department of Anesthesiology and Center for Brain Science, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, P. R. China
| | - Ruini Du
- Department of Anesthesiology and Center for Brain Science, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, P. R. China
| | - Qiang Wang
- Department of Anesthesiology and Center for Brain Science, The First Affiliated Hospital of Xi'an Jiaotong University, Xi'an, P. R. China
| | - Liyu Huang
- School of Life Science and Technology, Xidian University, Xi'an, P. R. China
| |
Collapse
|
7
|
Zhu Y, Wang X, Mathiak K, Toiviainen P, Ristaniemi T, Xu J, Chang Y, Cong F. Altered EEG Oscillatory Brain Networks During Music-Listening in Major Depression. Int J Neural Syst 2020; 31:2150001. [PMID: 33353528 DOI: 10.1142/s0129065721500015] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
To examine the electrophysiological underpinnings of the functional networks involved in music listening, previous approaches based on spatial independent component analysis (ICA) have recently been used to ongoing electroencephalography (EEG) and magnetoencephalography (MEG). However, those studies focused on healthy subjects, and failed to examine the group-level comparisons during music listening. Here, we combined group-level spatial Fourier ICA with acoustic feature extraction, to enable group comparisons in frequency-specific brain networks of musical feature processing. It was then applied to healthy subjects and subjects with major depressive disorder (MDD). The music-induced oscillatory brain patterns were determined by permutation correlation analysis between individual time courses of Fourier-ICA components and musical features. We found that (1) three components, including a beta sensorimotor network, a beta auditory network and an alpha medial visual network, were involved in music processing among most healthy subjects; and that (2) one alpha lateral component located in the left angular gyrus was engaged in music perception in most individuals with MDD. The proposed method allowed the statistical group comparison, and we found that: (1) the alpha lateral component was activated more strongly in healthy subjects than in the MDD individuals, and that (2) the derived frequency-dependent networks of musical feature processing seemed to be altered in MDD participants compared to healthy subjects. The proposed pipeline appears to be valuable for studying disrupted brain oscillations in psychiatric disorders during naturalistic paradigms.
Collapse
Affiliation(s)
- Yongjie Zhu
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology 116024, Dalian, P. R. China.,Faculty of Information Technology, University of Jyväskylä 40014, Jyväskylä, Finland.,Department of Computer Science, University of Helsinki, Finland
| | - Xiaoyu Wang
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology 116024, Dalian, P. R. China
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen, Pauwelsstraße 30, D-52074 Aachen, Germany
| | - Petri Toiviainen
- Department of Music, Art and Culture Studies, University of Jyväskylä 40014, Jyväskylä, Finland
| | - Tapani Ristaniemi
- Faculty of Information Technology, University of Jyväskylä 40014, Jyväskylä, Finland
| | - Jing Xu
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, P. R. China
| | - Yi Chang
- Department of Neurology and Psychiatry, First Affiliated Hospital, Dalian Medical University, Dalian, P. R. China
| | - Fengyu Cong
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology 116024, Dalian, P. R. China.,Faculty of Information Technology, University of Jyväskylä 40014, Jyväskylä, Finland.,School of Artificial Intelligence, Faculty of Electronic Information and Electrical Engineering, Dalian University of Technology, Dalian, P. R. China.,Key Laboratory of Integrated Circuit and Biomedical Electronic System, Liaoning Province Dalian University of Technology, Dalian, P. R. China
| |
Collapse
|
8
|
Zhu Y, Zhang C, Poikonen H, Toiviainen P, Huotilainen M, Mathiak K, Ristaniemi T, Cong F. Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening. Brain Topogr 2020; 33:289-302. [PMID: 32124110 PMCID: PMC7182636 DOI: 10.1007/s10548-020-00758-5] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 02/20/2020] [Indexed: 01/15/2023]
Abstract
Recently, exploring brain activity based on functional networks during naturalistic stimuli especially music and video represents an attractive challenge because of the low signal-to-noise ratio in collected brain data. Although most efforts focusing on exploring the listening brain have been made through functional magnetic resonance imaging (fMRI), sensor-level electro- or magnetoencephalography (EEG/MEG) technique, little is known about how neural rhythms are involved in the brain network activity under naturalistic stimuli. This study exploited cortical oscillations through analysis of ongoing EEG and musical feature during freely listening to music. We used a data-driven method that combined music information retrieval with spatial Fourier Independent Components Analysis (spatial Fourier-ICA) to probe the interplay between the spatial profiles and the spectral patterns of the brain network emerging from music listening. Correlation analysis was performed between time courses of brain networks extracted from EEG data and musical feature time series extracted from music stimuli to derive the musical feature related oscillatory patterns in the listening brain. We found brain networks of musical feature processing were frequency-dependent. Musical feature time series, especially fluctuation centroid and key feature, were associated with an increased beta activation in the bilateral superior temporal gyrus. An increased alpha oscillation in the bilateral occipital cortex emerged during music listening, which was consistent with alpha functional suppression hypothesis in task-irrelevant regions. We also observed an increased delta-beta oscillatory activity in the prefrontal cortex associated with musical feature processing. In addition to these findings, the proposed method seems valuable for characterizing the large-scale frequency-dependent brain activity engaged in musical feature processing.
Collapse
Affiliation(s)
- Yongjie Zhu
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology, Dalian, 116024, China.,Faculty of Information Technology, University of Jyväskylä, Jyväskylä, 40014, Finland
| | - Chi Zhang
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology, Dalian, 116024, China
| | - Hanna Poikonen
- Institute of Learning Sciences and Higher Education, ETH Zürich, Zürich, Switzerland
| | - Petri Toiviainen
- Department of Music, Art and Culture Studies, University of Jyväskylä, Jyväskylä, 40014, Finland
| | - Minna Huotilainen
- CICERO Learning Network and Cognitive Brain Research Unit, Faculty of Educational Sciences, University of Helsinki, Helsinki, 00014, Finland
| | - Klaus Mathiak
- Department of Psychiatry, Psychotherapy and Psychosomatics, Medical Faculty, RWTH Aachen, Pauwelsstraße 30, Aachen, 52074, Germany
| | - Tapani Ristaniemi
- Faculty of Information Technology, University of Jyväskylä, Jyväskylä, 40014, Finland
| | - Fengyu Cong
- School of Biomedical Engineering, Faculty of Electronic and Electrical Engineering, Dalian University of Technology, Dalian, 116024, China. .,Faculty of Information Technology, University of Jyväskylä, Jyväskylä, 40014, Finland.
| |
Collapse
|