1
|
Israsena P, Pan-Ngum S. A CNN-Based Deep Learning Approach for SSVEP Detection Targeting Binaural Ear-EEG. Front Comput Neurosci 2022; 16:868642. [PMID: 35664916 PMCID: PMC9160186 DOI: 10.3389/fncom.2022.868642] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/03/2022] [Accepted: 04/19/2022] [Indexed: 11/13/2022] Open
Abstract
This paper discusses a machine learning approach for detecting SSVEP at both ears with minimal channels. SSVEP is a robust EEG signal suitable for many BCI applications. It is strong at the visual cortex around the occipital area, but the SNR gets worse when detected from other areas of the head. To make use of SSVEP measured around the ears following the ear-EEG concept, especially for practical binaural implementation, we propose a CNN structure coupled with regressed softmax outputs to improve accuracy. Evaluating on a public dataset, we studied classification performance for both subject-dependent and subject-independent trainings. It was found that with the proposed structure using a group training approach, a 69.21% accuracy was achievable. An ITR of 6.42 bit/min given 63.49 % accuracy was recorded while only monitoring data from T7 and T8. This represents a 12.47% improvement from a single ear implementation and illustrates potential of the approach to enhance performance for practical implementation of wearable EEG.
Collapse
Affiliation(s)
- Pasin Israsena
- National Electronics and Computer Technology Center (NECTEC), National Science and Technology Development Agency (NSTDA), Pathumthani, Thailand
- *Correspondence: Pasin Israsena
| | - Setha Pan-Ngum
- Department of Computer Engineering, Faculty of Engineering, Chulalongkorn University, Bangkok, Thailand
| |
Collapse
|
2
|
Considering the effect of correlation between the channels in multivariate detectors for evoked responses in the electroencephalogram. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2021.103111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022]
|
3
|
Zanotelli T, Soares QB, Simpson DM, Miranda de Sá AMFL, Mendes EMAM, Felix LB. Choosing multichannel objective response detectors for multichannel auditory steady-state responses. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2021.102599] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
|
4
|
Granados Barbero R, De Vos A, Wouters J. The identification of predominant auditory steady-state response brain sources in electroencephalography using denoising source separation. Eur J Neurosci 2021; 53:3688-3709. [PMID: 33811405 DOI: 10.1111/ejn.15219] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2020] [Revised: 01/26/2021] [Accepted: 03/29/2021] [Indexed: 12/24/2022]
Abstract
Different approaches have been used to extract auditory steady-state responses (ASSRs) from electroencephalography (EEG) recordings, including region-related electrode configurations (electrode level) and the manual placement of equivalent current dipoles (source level). Inherent limitations of these approaches are the assumption of the anatomical origin and the omission of activity generated by secondary sources. Data-driven methods such as independent component analysis (ICA) seem to avoid these limitations but only to face new others such as the presence of ASSRs with similar properties in different components and the manual selection protocol to select and classify the most relevant components carrying ASSRs. We propose the novel approach of applying a spatial filter to these components in order to extract the most relevant information. We aimed to develop a method based on the reproducibility across trials that performs reliably in low-signal-to-noise ratio (SNR) scenarios using denoising source separation (DSS). DSS combined with ICA successfully reduced the number of components and extracted the most relevant ASSR at 4, 10 and 20 Hz stimulation in group and individual level studies of EEG adolescent data. The anatomical brain location for these low stimulation frequencies showed results in cortical areas with relatively small dispersion. However, for 40 and 80 Hz, results with regard to the number of components and the anatomical origin were less clear. At all stimulation frequencies the outcome measures were consistent with literature, and the partial rejection of inter-subject variability led to more accurate results and higher SNRs. These findings are promising for future applications in group comparison involving pathologies.
Collapse
Affiliation(s)
- Raúl Granados Barbero
- Research Group Experimental ORL, Department of Neurosciences, KU Leuven-University of Leuven, Leuven, Belgium
| | - Astrid De Vos
- Research Group Experimental ORL, Department of Neurosciences, KU Leuven-University of Leuven, Leuven, Belgium.,Parenting and Special Education Research Unit, Faculty of Psychology and Educational Sciences, KU Leuven-University of Leuven, Leuven, Belgium
| | - Jan Wouters
- Research Group Experimental ORL, Department of Neurosciences, KU Leuven-University of Leuven, Leuven, Belgium
| |
Collapse
|
5
|
Kwak NS, Lee SW. Error Correction Regression Framework for Enhancing the Decoding Accuracies of Ear-EEG Brain-Computer Interfaces. IEEE TRANSACTIONS ON CYBERNETICS 2020; 50:3654-3667. [PMID: 31295141 DOI: 10.1109/tcyb.2019.2924237] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Ear-electroencephalography (EEG) is a promising tool for practical brain-computer interface (BCI) applications because it is more unobtrusive, comfortable, and mobile than a typical scalp-EEG system. However, an ear-EEG has a natural constraint of electrode location (e.g., limited in or around the ear) for acquiring informative brain signals sufficiently. Achieving reliable performance of ear-EEG in specific BCI paradigms that do not utilize brain signals on the temporal lobe around the ear is difficult. For example, steady-state visual evoked potentials (SSVEPs), which are mainly generated in the occipital area, have a significantly attenuated and distorted amplitude in ear-EEG. Therefore, preserving the high level of decoding accuracy is challenging and essential for SSVEP BCI based on ear-EEG. In this paper, we first investigate linear and nonlinear regression methods to increase the decoding accuracy of ear-EEG regarding SSVEP paradigm by utilizing the estimated target EEG signals on the occipital area. Then, we investigate an ensemble method to consider the prediction variability of the regression methods. Finally, we propose an error correction regression (ECR) framework to reduce the prediction errors by adding an additional nonlinear regression process (i.e., kernel ridge regression). We evaluate the ECR framework in terms of single session, session-to-session transfer, and subject-transfer decoding. We also validate the online decoding ability of the proposed framework with a short-time window size. The average accuracies are observed to be 91.11±9.14%, 90.52±8.67%, 86.96±12.13%, and 78.79±12.59%. This paper demonstrates that SSVEP BCI based on ear-EEG can achieve reliable performance with the proposed ECR framework.
Collapse
|
6
|
Improving the power of objective response detection of evoked responses in noise by using average and product of magnitude-squared coherence of two different signals. Med Biol Eng Comput 2019; 57:2203-2214. [PMID: 31399896 DOI: 10.1007/s11517-019-02020-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2019] [Accepted: 07/24/2019] [Indexed: 10/26/2022]
Abstract
Objective response detection (ORD) techniques such as the magnitude-squared coherence (MSC) are mathematical methods tailored to detect potentials evoked by an external periodic stimulation. The performance of the MSC is directly proportional to the signal-to-noise ratio (SNR) of the recorded signal and the time spent for collecting data. An alternative to increasing the performance of detection techniques without increasing data recording time is to use the information from more than one signal simultaneously. In this context, this work proposes two new detection techniques based on the average and on the product of MSCs of two different signals. The critical values and detection probabilities were obtained theoretically and using a Monte Carlo simulation. The performances of the new detectors were evaluated using synthetic data and electroencephalogram (EEG) signals during photo and auditory stimulation. For the synthetic signals, the two proposed detectors exhibited a higher detection rate when compared to the rate of the traditional MSC technique. When applied to EEG signals, these detectors resulted in an increase of the mean detection rate in relation to MSC for visual and auditory stimulation of at least 25% and 13.21%, respectively. The proposed detectors may be considered as promising tools for clinical applications. Graphical Abstract.
Collapse
|
7
|
Wang KW, Chang HH, Hsu CC, Chen KC, Hsieh JC, Li LPH, Lee PL, Shiao AS. Extractions of steady-state auditory evoked fields in normal subjects and tinnitus patients using complementary ensemble empirical mode decomposition. Biomed Eng Online 2015. [PMID: 26210316 PMCID: PMC4514968 DOI: 10.1186/s12938-015-0062-0] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Auditory steady-state response (ASSR) induced by repetitive auditory stimulus is commonly used for audiometric testing. ASSR can be measured using electro-encephalography (EEG) and magnetoencephalography (MEG), referred to as steady-state auditory evoked potential (SSAEP) and steady-state auditory evoked field (SSAEF), respectively. However, the signal level of SSAEP and SSAEF are weak so that signal processing technique is required to increase its signal-to-noise ratio. In this study, a complementary ensemble empirical mode decomposition (CEEMD)-based approach is proposed in MEG study and the extraction of SSAEF has been demonstrated in normal subjects and tinnitus patients. METHODS The CEEMD utilizes noise assisted data analysis (NADA) approach by adding positive and negative noise to decompose MEG signals into complementary intrinsic mode functions (IMF). Ten subjects (five normal and five tinnitus patients) were studied. The auditory stimulus was designed as 1 kHz carrier frequency with 37 Hz modulation frequency. Two channels in the vicinities of right and left temporal areas were chosen as channel-of-interests (COI) and decomposed into IMFs. The spatial distribution of each IMF was correlated with a pair of left- and right-hemisphere spatial templates, designed from each subject's N100m responses in pure-tone auditory stimulation. IMFs with spatial distributions highly correlated with spatial templates were identified using K-means and those SSAEF-related IMFs were used to reconstruct noise-suppressed SSAEFs. RESULTS The current strengths estimated from CEEMD processed SSAEF showed neural activities greater or comparable to those processed by conventional filtering method. Both the normal and tinnitus groups showed the phenomenon of right-hemisphere dominance. The mean current strengths of auditory-induced neural activities in tinnitus group were larger than the normal group. CONCLUSIONS The present study proposes an effective method for SSAEF extraction. The enhanced SSAEF in tinnitus group echoes the decreased inhibition in tinnitus's central auditory structures as reported in previous studies.
Collapse
Affiliation(s)
- Kuo-Wei Wang
- Department of Electrical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taiwan. .,Department of Medical Imaging, Landseed Hospital, No. 77, Kuan-Tai Rd., Taoyuan, Taiwan.
| | - Hsiao-Huang Chang
- Department of Electrical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taiwan. .,Cardiovascular Surgery Division, Surgery Department, Taipei Veterans General Hospital, No. 201, Sec. 2, Shipai Rd., Taipei, Taiwan.
| | - Chuan-Chih Hsu
- Department of Electrical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taiwan. .,Division of Cardiovascular Surgery, Department of Surgery, Taipei Medical University Hospital, No. 252, Wu-Hsing St., Taipei, Taiwan.
| | - Kuang-Chao Chen
- Department of Otolaryngology, Cheng-Hsin General Hospital, No. 45, Chenghsin St., Taipei, Taiwan.
| | - Jen-Chuen Hsieh
- Institute of Brain Science, National Yang-Ming University, No. 155, Sec. 2, Linong St., Taipei, Taiwan.
| | - Lieber Po-Hung Li
- Department of Otolaryngology, Cheng-Hsin General Hospital, No. 45, Chenghsin St., Taipei, Taiwan.
| | - Po-Lei Lee
- Department of Electrical Engineering, National Central University, No. 300, Jhongda Rd., Jhongli City, Taiwan. .,Center for Dynamical Biomarkers and Translational Medicine, National Central University, No. 300, Jhongda Rd., Jhongli, Taiwan.
| | - An-Suey Shiao
- Department of Otolaryngology, Taipei Veterans General Hospital, No. 201, Sec. 2, Shipai Rd., Taipei, Taiwan.
| |
Collapse
|
8
|
Prado-Gutierrez P, Castro-Fariñas A, Morgado-Rodriguez L, Velarde-Reyes E, Martínez AD, Martínez-Montes E. Habituation of Auditory Steady State Responses Evoked by Amplitude-Modulated Acoustic Signals in Rats. Audiol Res 2015; 5:113. [PMID: 26557360 PMCID: PMC4627118 DOI: 10.4081/audiores.2015.113] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2014] [Revised: 10/17/2014] [Accepted: 11/19/2014] [Indexed: 11/29/2022] Open
Abstract
Generation of the auditory steady state responses (ASSR) is commonly explained by the linear combination of random background noise activity and the stationary response. Based on this model, the decrease of amplitude that occurs over the sequential averaging of epochs of the raw data has been exclusively linked to the cancelation of noise. Nevertheless, this behavior might also reflect the non-stationary response of the ASSR generators. We tested this hypothesis by characterizing the ASSR time course in rats with different auditory maturational stages. ASSR were evoked by 8-kHz tones of different supra-threshold intensities, modulated in amplitude at 115 Hz. Results show that the ASSR amplitude habituated to the sustained stimulation and that dishabituation occurred when deviant stimuli were presented. ASSR habituation increased as animals became adults, suggesting that the ability to filter acoustic stimuli with no-relevant temporal information increased with age. Results are discussed in terms of the current model of the ASSR generation and analysis procedures. They might have implications for audiometric tests designed to assess hearing in subjects who cannot provide reliable results in the psychophysical trials.
Collapse
Affiliation(s)
- Pavel Prado-Gutierrez
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso , Chile ; Cuban Neuroscience Center , Havana, Cuba
| | | | | | | | - Agustín D Martínez
- Centro Interdisciplinario de Neurociencia de Valparaíso, Universidad de Valparaíso , Chile
| | | |
Collapse
|
9
|
Hoon Lee J, Min Lee S, Jin Byeon H, Sook Hong J, Suk Park K, Lee SH. CNT/PDMS-based canal-typed ear electrodes for inconspicuous EEG recording. J Neural Eng 2014; 11:046014. [PMID: 24963747 DOI: 10.1088/1741-2560/11/4/046014] [Citation(s) in RCA: 53] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Current electroencephalogram (EEG) monitoring systems typically require cumbersome electrodes that must be pasted on a scalp, making a private recording of an EEG in a public place difficult. We have developed a small, user friendly, biocompatible electrode with a good appearance for inconspicuous EEG monitoring. APPROACH We fabricated carbon nanotube polydimethylsiloxane (CNT/PDMS)-based canal-type ear electrodes (CEE) for EEG recording. These electrodes have an additional function, triggering sound stimulation like earphones and recording EEG simultaneously for auditory brain-computer interface (BCI). The electrode performance was evaluated by a standard EEG measurement paradigm, including the detection of alpha rhythms and measurements of N100 auditory evoked potential (AEP), steady-state visual evoked potential (SSVEP) and auditory steady-state response (ASSR). Furthermore, the bio- and skin-compatibility of CNT/PDMS were tested. MAIN RESULTS All feasibility studies were successfully recorded with the fabricated electrodes, and the biocompatibility of CNT/PDMS was also proved. SIGNIFICANCE These electrodes could be used to monitor EEG clinically, in ubiquitous health care and in brain-computer interfaces.
Collapse
Affiliation(s)
- Joong Hoon Lee
- Department of Bio-convergence Engineering, College of Health Science, Korea University, Seoul 136-100, Korea
| | | | | | | | | | | |
Collapse
|
10
|
|
11
|
Cheah LA, Hou M. Real-time detection of auditory steady-state responses. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2011; 2010:1382-5. [PMID: 21096337 DOI: 10.1109/iembs.2010.5626731] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Detection of the auditory steady-state responses (ASSRs) is a difficult task, its main technical impediment is no other than the excessively lengthy recording time required for the estimation process due to the extremely low signal-to-noise ratio (SNR). To improve the detection rate of ASSRs, a new observer-based real-time ASSR detector is derived as an alternate solution to the existing methods. The ASSR detector has a simple structure, and provides fast and reliable signal detection. Simulation and experimental recorded data were used to evaluate the performances of the proposed approach. Compared with the conventional methods, the proposed method requires shorter recording time which could be proven as a valuable hearing screening or diagnostic tool.
Collapse
Affiliation(s)
- L A Cheah
- Department of Engineering, University of Hull, HU6 7RX, UK.
| | | |
Collapse
|
12
|
Zanotelli T, Santos Filho SA, Tierra-Criollo CJ. Optimum principal components for spatial filtering of EEG to detect imaginary movement by coherence. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2010; 2010:3646-3649. [PMID: 21096852 DOI: 10.1109/iembs.2010.5627418] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/30/2023]
Abstract
Several techniques have been used to improve the signal-to-noise ratio to increase the detection rate of Event Related Potentials (ERPs). This work investigates the application of spatial filtering based on principal component analysis (PCA) to detect ERP due to left-hand index finger movement imagination. The EEG signals were recorded of central derivations (C4, C2, Cz, C1 and C3), positioned according to 10-10 International System. The optimal spatial filter was found by using the first principal component and the ERP detection was obtained by magnitude squared coherence technique. The best detection rate, by using original signal (without filtering), was obtained at C2 derivation, with 54.73% for significance level of 5%. For the same significance level, the detection rate of the filtered signal was drastically improved to 96.84%. Results suggest that spatial filter by using PCA might be a very useful tool in assisting the ERP detection for movement imagination for applications on brain machine interface.
Collapse
Affiliation(s)
- T Zanotelli
- Biomedical Engineering Studies and Research Group (NEPEB), Department of Electrical Engineering, Federal University of Minas Gerais, Brazil.
| | | | | |
Collapse
|
13
|
Van Dun B, Wouters J, Moonen M. Optimal electrode selection for multi-channel electroencephalogram based detection of auditory steady-state responses. THE JOURNAL OF THE ACOUSTICAL SOCIETY OF AMERICA 2009; 126:254-268. [PMID: 19603882 DOI: 10.1121/1.3133872] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/28/2023]
Abstract
Auditory steady-state responses (ASSRs) are used for hearing threshold estimation at audiometric frequencies. Hearing impaired newborns, in particular, benefit from this technique as it allows for a more precise diagnosis than traditional techniques, and a hearing aid can be better fitted at an early age. However, measurement duration of current single-channel techniques is still too long for clinical widespread use. This paper evaluates the practical performance of a multi-channel electroencephalogram (EEG) processing strategy based on a detection theory approach. A minimum electrode set is determined for ASSRs with frequencies between 80 and 110 Hz using eight-channel EEG measurements of ten normal-hearing adults. This set provides a near-optimal hearing threshold estimate for all subjects and improves response detection significantly for EEG data with numerous artifacts. Multi-channel processing does not significantly improve response detection for EEG data with few artifacts. In this case, best response detection is obtained when noise-weighted averaging is applied on single-channel data. The same test setup (eight channels, ten normal-hearing subjects) is also used to determine a minimum electrode setup for 10-Hz ASSRs. This configuration allows to record near-optimal signal-to-noise ratios for 80% of subjects.
Collapse
Affiliation(s)
- Bram Van Dun
- ExpORL, Katholieke Universiteit Leuven, Leuven, Belgium.
| | | | | |
Collapse
|
14
|
Van Dun B, Rombouts G, Wouters J, Moonen M. A Procedural Framework for Auditory Steady-State Response Detection. IEEE Trans Biomed Eng 2009. [DOI: 10.1109/tbme.2008.2008395] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
15
|
|
16
|
Van Dun B, Verstraeten S, Alaerts J, Luts H, Moonen M, Wouters J. A flexible research platform for multi-channel auditory steady-state response measurements. J Neurosci Methods 2007; 169:239-48. [PMID: 18215424 DOI: 10.1016/j.jneumeth.2007.12.002] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2007] [Revised: 11/25/2007] [Accepted: 12/06/2007] [Indexed: 11/30/2022]
Abstract
The possibilities of currently commercially available auditory steady-state response (ASSR) devices are mostly limited to avoid unintentional misuse and to guarantuee patient safety as such. Some setups, e.g. do not allow the application of high intensities or the use of own stimuli. Moreover, most devices generally only allow data collection using maximal two EEG channels. The freedom to modify and extend the accompagnying software and hardware is very restricted or inexistent. As a result, these devices are not suited for research and several clinically diagnostic purposes. In this paper, a research platform for multi-channel ASSR measurements is presented, referred to as SOMA (setup ORL for multi-channel ASSR). The setup allows multi-channel measurements and the use of own stimuli. It can be easily extended to facilitate new measurement protocols and real-time signal processing. The mobile setup is based on an inexpensive multi-channel RME soundcard and software is written in C++. Both hardware and software of the setup are described. An evaluation study with nine normal-hearing subjects shows no significant performance differences between a reference and the proposed platform. SOMA presents a flexible and modularly extensible mobile high-end multi-channel ASSR test platform.
Collapse
Affiliation(s)
- Bram Van Dun
- ExpORL, Katholieke Universiteit Leuven, Herestraat 49/721, B-3000 Leuven, Belgium.
| | | | | | | | | | | |
Collapse
|