Concealed, Unobtrusive Ear-Centered EEG Acquisition: cEEGrids for Transparent EEG

Real-Time Audio Processing of Real-Life Soundscapes for EEG Analysis: ERPs Based on Natural Sound Onsets

With smartphone-based mobile electroencephalography (EEG), we can investigate sound perception beyond the lab. To understand sound perception in the real world, we need to relate naturally occurring sounds to EEG data. For this, EEG and audio information need to be synchronized precisely, only then it is possible to capture fast and transient evoked neural responses and relate them to individual sounds. We have developed Android applications (AFEx and Record-a) that allow for the concurrent acquisition of EEG data and audio features, i.e., sound onsets, average signal power (RMS), and power spectral density (PSD) on smartphone. In this paper, we evaluate these apps by computing event-related potentials (ERPs) evoked by everyday sounds. One participant listened to piano notes (played live by a pianist) and to a home-office soundscape. Timing tests showed a stable lag and a small jitter (< 3 ms) indicating a high temporal precision of the system. We calculated ERPs to sound onsets and observed the typical P1-N1-P2 complex of auditory processing. Furthermore, we show how to relate information on loudness (RMS) and spectra (PSD) to brain activity. In future studies, we can use this system to study sound processing in everyday life.

Recent Advances and Current Trends in Brain-Computer Interface (BCI) Research and Their Applications

Brain-Computer Interface (BCI) provides direct communication between the brain and an external device. BCI systems have become a trendy field of research in recent years. These systems can be used in a variety of applications to help both disabled and healthy people. Concerning significant BCI progress, we may assume that these systems are not very far from real-world applications. This review has taken into account current trends in BCI research. In this survey, one hundred most cited articles from the WOS database were selected over the last four years. This survey is divided into several sectors. These sectors are Medicine, Communication and Control, Entertainment, and Other BCI applications. The application area, recording method, signal acquisition types, and countries of origin have been identified in each article. This survey provides an overview of the BCI articles published from 2016 to 2020 and their current trends and advances in different application areas.

Mobile BCI dataset of scalp- and ear-EEGs with ERP and SSVEP paradigms while standing, walking, and running

We present a mobile dataset obtained from electroencephalography (EEG) of the scalp and around the ear as well as from locomotion sensors by 24 participants moving at four different speeds while performing two brain-computer interface (BCI) tasks. The data were collected from 32-channel scalp-EEG, 14-channel ear-EEG, 4-channel electrooculography, and 9-channel inertial measurement units placed at the forehead, left ankle, and right ankle. The recording conditions were as follows: standing, slow walking, fast walking, and slight running at speeds of 0, 0.8, 1.6, and 2.0 m/s, respectively. For each speed, two different BCI paradigms, event-related potential and steady-state visual evoked potential, were recorded. To evaluate the signal quality, scalp- and ear-EEG data were qualitatively and quantitatively validated during each speed. We believe that the dataset will facilitate BCIs in diverse mobile environments to analyze brain activities and evaluate the performance quantitatively for expanding the use of practical BCIs.

Hearables, in-ear sensing devices for bio-signal acquisition: a narrative review

INTRODUCTION

Hearables are ear devices used for multiple purposes including ubiquitous/remote monitoring of vital signals. This can support early detection, prevention, and management of urgent/non-urgent healthcare needs. This review therefore seeks to analyse the challenges and capabilities of hearables used to monitor human physiological signals.

AREAS COVERED

Studies were identified via search (Medline, Embase, Web of Science, Cochrane Library, Scopus) and conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses. Bias assessment used the Mixed Methods Appraisal Tool 2018 and Quality Assessment of Diagnostic Accuracy Studies 2nd Edition. 92/631 studies met the inclusion criteria and were qualitatively analysed. The outcomes, applications, advantages and limitations were discussed according to the vital signal measured. The bias risk ranged from low to high, with most studies facing moderate to high risk in subject selection due to small sample sizes.

EXPERT OPINION

: Most studies reported good outcomes for ear signal acquisition compared to reference devices. To improve practicability and implementation, wireless connectivity, battery life, impact of motion/environmental artifacts and comfort need to be addressed going forward. Hearable technologies have also shown potential synergies with hearing aids. In future, multimodal ear-sensing devices opens the possibility of comprehensive health monitoring within daily life.

Neural tracking to go: auditory attention decoding and saliency detection with mobile EEG

OBJECTIVE

Neuro-steered assistive technologies have been suggested to offer a major advancement in future devices like neuro-steered hearing aids. Auditory attention decoding methods would in that case allow for identification of an attended speaker within complex auditory environments, exclusively from neural data. Decoding the attended speaker using neural information has so far only been done in controlled laboratory settings. Yet, it is known that ever-present factors like distraction and movement are reflected in the neural signal parameters related to attention.

APPROACH

Thus, in the current study we applied a two-competing speaker paradigm to investigate performance of a commonly applied EEG-based auditory attention decoding (AAD) model outside of the laboratory during leisure walking and distraction. Unique environmental sounds were added to the auditory scene and served as distractor events.

MAIN RESULTS

The current study shows, for the first time, that the attended speaker can be accurately decoded during natural movement. At a temporal resolution of as short as 5-seconds and without artifact attenuation, decoding was found to be significantly above chance level. Further, as hypothesized, we found a decrease in attention to the to-be-attended and the to-be-ignored speech stream after the occurrence of a salient event. Additionally, we demonstrate that it is possible to predict neural correlates of distraction with a computational model of auditory saliency based on acoustic features.

CONCLUSION

Taken together, our study shows that auditory attention tracking outside of the laboratory in ecologically valid conditions is feasible and a step towards the development of future neural-steered hearing aids.

Pocketable Labs for Everyone: Synchronized Multi-Sensor Data Streaming and Recording on Smartphones with the Lab Streaming Layer

The streaming and recording of smartphone sensor signals is desirable for mHealth, telemedicine, environmental monitoring and other applications. Time series data gathered in these fields typically benefit from the time-synchronized integration of different sensor signals. However, solutions required for this synchronization are mostly available for stationary setups. We hope to contribute to the important emerging field of portable data acquisition by presenting open-source Android applications both for the synchronized streaming (Send-a) and recording (Record-a) of multiple sensor data streams. We validate the applications in terms of functionality, flexibility and precision in fully mobile setups and in hybrid setups combining mobile and desktop hardware. Our results show that the fully mobile solution is equivalent to well-established desktop versions. With the streaming application Send-a and the recording application Record-a, purely smartphone-based setups for mobile research and personal health settings can be realized on off-the-shelf Android devices.

Wearable electroencephalography for ultra-long-term seizure monitoring: a systematic review and future prospects

INTRODUCTION

: Wearable electroencephalography (EEG) for objective seizure counting might transform the clinical management of epilepsy. Non-EEG modalities have been validated for the detection of convulsive seizures, but there is still an unmet need for the detection of non-convulsive seizures.

AREAS COVERED

: The main objective of this systematic review was to explore the current status on wearable surface- and subcutaneous EEG for long-term seizure monitoring in epilepsy. We included 17 studies and evaluated the progress on the field, including device specifications, intended populations, and main results on the published studies including diagnostic accuracy measures. Furthermore, we examine the hurdles for widespread clinical implementation. This systematic review and expert opinion both consults the PRISMA guidelines and reflects on the future perspectives of this emerging field.

EXPERT OPINION

: Wearable EEG for long-term seizure monitoring is an emerging field, with plenty of proposed devices and proof-of-concept clinical validation studies. The possible implications of these devices are immense including objective seizure counting and possibly forecasting. However, the true clinical value of the devices, including effects on patient important outcomes and clinical decision making is yet to be unveiled and large-scale clinical validation trials are called for.

A high-density 256-channel cap for dry electroencephalography

High‐density electroencephalography (HD‐EEG) is currently limited to laboratory environments since state‐of‐the‐art electrode caps require skilled staff and extensive preparation. We propose and evaluate a 256‐channel cap with dry multipin electrodes for HD‐EEG. We describe the designs of the dry electrodes made from polyurethane and coated with Ag/AgCl. We compare in a study with 30 volunteers the novel dry HD‐EEG cap to a conventional gel‐based cap for electrode‐skin impedances, resting state EEG, and visual evoked potentials (VEP). We perform wearing tests with eight electrodes mimicking cap applications on real human and artificial skin. Average impedances below 900 kΩ for 252 out of 256 dry electrodes enables recording with state‐of‐the‐art EEG amplifiers. For the dry EEG cap, we obtained a channel reliability of 84% and a reduction of the preparation time of 69%. After exclusion of an average of 16% (dry) and 3% (gel‐based) bad channels, resting state EEG, alpha activity, and pattern reversal VEP can be recorded with less than 5% significant differences in all compared signal characteristics metrics. Volunteers reported wearing comfort of 3.6 ± 1.5 and 4.0 ± 1.8 for the dry and 2.5 ± 1.0 and 3.0 ± 1.1 for the gel‐based cap prior and after the EEG recordings, respectively (scale 1–10). Wearing tests indicated that up to 3,200 applications are possible for the dry electrodes. The 256‐channel HD‐EEG dry electrode cap overcomes the principal limitations of HD‐EEG regarding preparation complexity and allows rapid application by not medically trained persons, enabling new use cases for HD‐EEG.

Detecting impaired language processing in patients with mild cognitive impairment using around-the-ear cEEgrid electrodes

Mild cognitive impairment (MCI) is the term used to identify those individuals with subjective and objective cognitive decline but with preserved activities of daily living and an absence of dementia. Although MCI can impact functioning in different cognitive domains, most notably episodic memory, relatively little is known about the comprehension of language in MCI. In this study, we used around-the-ear electrodes (cEEGrids) to identify impairments during language comprehension in patients with MCI. In a group of 23 patients with MCI and 23 age-matched controls, language comprehension was tested in a two-word phrase paradigm. We examined the oscillatory changes following word onset as a function of lexico-semantic single-word retrieval (e.g., swrfeq vs. swift) and multiword binding processes (e.g., horse preceded by swift vs. preceded by swrfeq). Electrophysiological signatures (as measured by the cEEGrids) were significantly different between patients with MCI and controls. In controls, lexical retrieval was associated with a rebound in the alpha/beta range, and binding was associated with a post-word alpha/beta suppression. In contrast, both the single-word retrieval and multiword binding signatures were absent in the MCI group. The signatures observed using cEEGrids in controls were comparable with those signatures obtained with a full-cap EEG setup. Importantly, our findings suggest that patients with MCI have impaired electrophysiological signatures for comprehending single words and multiword phrases. Moreover, cEEGrid setups provide a noninvasive and sensitive clinical tool for detecting early impairments in language comprehension in MCI.

EEG and behavioral correlates of attentional processing while walking and navigating naturalistic environments

The capacity to regulate one's attention in accordance with fluctuating task demands and environmental contexts is an essential feature of adaptive behavior. Although the electrophysiological correlates of attentional processing have been extensively studied in the laboratory, relatively little is known about the way they unfold under more variable, ecologically-valid conditions. Accordingly, this study employed a 'real-world' EEG design to investigate how attentional processing varies under increasing cognitive, motor, and environmental demands. Forty-four participants were exposed to an auditory oddball task while (1) sitting in a quiet room inside the lab, (2) walking around a sports field, and (3) wayfinding across a university campus. In each condition, participants were instructed to either count or ignore oddball stimuli. While behavioral performance was similar across the lab and field conditions, oddball count accuracy was significantly reduced in the campus condition. Moreover, event-related potential components (mismatch negativity and P3) elicited in both 'real-world' settings differed significantly from those obtained under laboratory conditions. These findings demonstrate the impact of environmental factors on attentional processing during simultaneously-performed motor and cognitive tasks, highlighting the value of incorporating dynamic and unpredictable contexts within naturalistic designs.

Revisión de electroencefalografía portable y su aplicabilidad en neurociencias

La electroencefalografía (EEG) es una técnica que permite registrar la actividad eléctrica del cerebro y ha sido estudiada durante los últimos cien años en diferentes ámbitos de la neurociencia. En los últimos años se ha investigado y desarrollado equipos de medición que sean portables y que permitan una buena calidad de la señal, por lo cual se realizó una revisión bibliográfica de las compañías fabricantes de algunos dispositivos de electroencefalografía portable disponibles en el mercado, se exponen sus características principales, algunos trabajos encontrados que fueron realizados con los dispositivos, comparaciones entre los mismos y una discusión acerca de las ventajas y desventajas de sus características. Finalmente se concluye que a la hora de comprar un dispositivo para electroencefalografía portable es necesario tener en cuenta el uso que se le va a dar y el costo-beneficio que tiene el equipo de acuerdo con sus características. Encephalography is a technique that allows the recording of electrical activity of the brain and has been studied during the last hundred years in different areas of neuroscience. For several years, measuring equipment that are portable and that allow a good signal quality to have been researched and developed, so a literature review of the manufacturing companies of some of portable electroencephalography devices available on the market was carried out: Its main features are exposed, as well as some of the work found that were made with those, comparisons between them and a discussion about the advantages and disadvantages of their features. It is concluded that, when a portable encephalography device is bought, it’s necessary to take into consideration the use that it will be having and the cost-benefit that the device has according to its features.

The Arch Electrode: A Novel Dry Electrode Concept for Improved Wearing Comfort

Electroencephalography (EEG) is increasingly used for repetitive and prolonged applications like neurofeedback, brain computer interfacing, and long-term intermittent monitoring. Dry-contact electrodes enable rapid self-application. A common drawback of existing dry electrodes is the limited wearing comfort during prolonged application. We propose a novel dry Arch electrode. Five semi-circular arches are arranged parallelly on a common baseplate. The electrode substrate material is a flexible thermoplastic polyurethane (TPU) produced by additive manufacturing. A chemical coating of Silver/Silver-Chloride (Ag/AgCl) is applied by electroless plating using a novel surface functionalization method. Arch electrodes were manufactured and validated in terms of mechanical durability, electrochemical stability, in vivo applicability, and signal characteristics. We compare the results of the dry arch electrodes with dry pin-shaped and conventional gel-based electrodes. 21-channel EEG recordings were acquired on 10 male and 5 female volunteers. The tests included resting state EEG, alpha activity, and a visual evoked potential. Wearing comfort was rated by the subjects directly after application, as well as at 30 min and 60 min of wearing. Our results show that the novel plating technique provides a well-adhering electrically conductive and electrochemically stable coating, withstanding repetitive strain and bending tests. The signal quality of the Arch electrodes is comparable to pin-shaped dry electrodes. The average channel reliability of the Arch electrode setup was 91.9 ± 9.5%. No considerable differences in signal characteristics have been observed for the gel-based, dry pin-shaped, and arch-shaped electrodes after the identification and exclusion of bad channels. The comfort was improved in comparison to pin-shaped electrodes and enabled applications of over 60 min duration. Arch electrodes required individual adaptation of the electrodes to the orientation and hairstyle of the volunteers. This initial preparation time of the 21-channel cap increased from an average of 5 min for pin-like electrodes to 15 min for Arch electrodes and 22 min for gel-based electrodes. However, when re-applying the arch electrode cap on the same volunteer, preparation times of pin-shaped and arch-shaped electrodes were comparable. In summary, our results indicate the applicability of the novel Arch electrode and coating for EEG acquisition. The novel electrode enables increased comfort for prolonged dry-contact measurement.

Getting More from the Sleep Recording

Sleep studies have typically followed criteria established many decades ago, but emerging technologies allow signal analyses that go far beyond the scoring rules for manual analysis of sleep recordings. These technologies may apply to the analysis of signals obtained in standard polysomnography in addition to novel signals more recently developed that provide both direct and indirect measures of sleep and breathing in the ambulatory setting. Automated analysis of signals such as electroencephalogram and oxygen saturation, in addition to heart rate and rhythm, provides a wealth of additional information on sleep and breathing disturbances and their potential for comorbidity.

Flex-Printed Ear-EEG Sensors for Adequate Sleep Staging at Home

A comfortable, discrete and robust recording of the sleep EEG signal at home is a desirable goal but has been difficult to achieve. We investigate how well flex-printed electrodes are suitable for sleep monitoring tasks in a smartphone-based home environment. The cEEGrid ear-EEG sensor has already been tested in the laboratory for measuring night sleep. Here, 10 participants slept at home and were equipped with a cEEGrid and a portable amplifier (mBrainTrain, Serbia). In addition, the EEG of Fpz, EOG_L and EOG_R was recorded. All signals were recorded wirelessly with a smartphone. On average, each participant provided data for M = 7.48 h. An expert sleep scorer created hypnograms and annotated grapho-elements according to AASM based on the EEG of Fpz, EOG_L and EOG_R twice, which served as the baseline agreement for further comparisons. The expert scorer also created hypnograms using bipolar channels based on combinations of cEEGrid channels only, and bipolar cEEGrid channels complemented by EOG channels. A comparison of the hypnograms based on frontal electrodes with the ones based on cEEGrid electrodes (κ = 0.67) and the ones based on cEEGrid complemented by EOG channels (κ = 0.75) both showed a substantial agreement, with the combination including EOG channels showing a significantly better outcome than the one without (p = 0.006). Moreover, signal excerpts of the conventional channels containing grapho-elements were correlated with those of the cEEGrid in order to determine the cEEGrid channel combination that optimally represents the annotated grapho-elements. The results show that the grapho-elements were well-represented by the front-facing electrode combinations. The correlation analysis of the grapho-elements resulted in an average correlation coefficient of 0.65 for the most suitable electrode configuration of the cEEGrid. The results confirm that sleep stages can be identified with electrodes placement around the ear. This opens up opportunities for miniaturized ear-EEG systems that may be self-applied by users.

EEG miniaturization limits for stimulus decoding with EEG sensor networks

Objective. Unobtrusive electroencephalography (EEG) monitoring in everyday life requires the availability of highly miniaturized EEG devices (mini-EEGs), which ideally consist of a wireless node with a small scalp area footprint, in which the electrodes, amplifier and wireless radio are embedded. By attaching a multitude of mini-EEGs at relevant positions on the scalp, a wireless 'EEG sensor network' (WESN) can be formed. However, each mini-EEG in the network only has access to its own local electrodes, thereby recording local scalp potentials with short inter-electrode distances. This is unlike using traditional cap-EEG, which by the virtue of re-referencing can measure EEG across arbitrarily large distances on the scalp. We evaluate the implications and limitations of such far-driven miniaturization on neural decoding performance.Approach. We collected 255-channel EEG data in an auditory attention decoding (AAD) task. As opposed to previous studies with a lower channel density, this new high-density dataset allows emulation of mini-EEGs with inter-electrode distances down to 1 cm in order to identify and quantify the lower bound on miniaturization for EEG-based stimulus decoding.Main results. We demonstrate that the performance remains reasonably stable for inter-electrode distances down to 3 cm, but decreases quickly for shorter distances if the mini-EEG nodes can be placed at optimal scalp locations and orientations selected by a data-driven algorithm.Significance. The results indicate the potential for the use of mini-EEGs in a WESN context for AAD applications and provide guidance on inter-electrode distances while designing such devices for neuro-steered hearing devices.

Looking for consistency in an uncertain world: test-retest reliability of neurophysiological and behavioral readouts in autism

BACKGROUND

Autism spectrum disorders (ASD) are associated with altered sensory processing and perception. Scalp recordings of electrical brain activity time-locked to sensory events (event-related potentials; ERPs) provide precise information on the time-course of related altered neural activity, and can be used to model the cortical loci of the underlying neural networks. Establishing the test-retest reliability of these sensory brain responses in ASD is critical to their use as biomarkers of neural dysfunction in this population.

METHODS

EEG and behavioral data were acquired from 33 children diagnosed with ASD aged 6-9.4 years old, while they performed a child-friendly task at two different time-points, separated by an average of 5.2 months. In two blocked conditions, participants responded to the occurrence of an auditory target that was either preceded or not by repeating visual stimuli. Intraclass correlation coefficients (ICCs) were used to assess test-retest reliability of measures of sensory (auditory and visual) ERPs and performance, for the two experimental conditions. To assess the degree of reliability of the variability of responses within individuals, this analysis was performed on the variance of the measurements, in addition to their means. This yielded a total of 24 measures for which ICCs were calculated.

RESULTS

The data yielded significant good ICC values for 10 of the 24 measurements. These spanned across behavioral and ERPs data, experimental conditions, and mean as well as variance measures. Measures of the visual evoked responses accounted for a disproportionately large number of the significant ICCs; follow-up analyses suggested that the contribution of a greater number of trials to the visual compared to the auditory ERP partially accounted for this.

CONCLUSIONS

This analysis reveals that sensory ERPs and related behavior can be highly reliable across multiple measurement time-points in ASD. The data further suggest that the inter-trial and inter-participant variability reported in the ASD literature likely represents replicable individual participant neural processing differences. The stability of these neuronal readouts supports their use as biomarkers in clinical and translational studies on ASD. Given the minimum interval between test/retest sessions across our cohort, we also conclude that for the tested age-range of ~ 6 to 9.4 years, these reliability measures are valid for at least a 3-month interval. Limitations related to EEG task demands and study length in the context of a clinical trial are considered.

Measuring Correlates of Mental Workload During Simulated Driving Using cEEGrid Electrodes: A Test-Retest Reliability Analysis

The EEG reflects mental processes, especially modulations in the alpha and theta frequency bands are associated with attention and the allocation of mental resources. EEG has also been used to study mental processes while driving, both in real environments and in virtual reality. However, conventional EEG methods are of limited use outside of controlled laboratory settings. While modern EEG technologies offer hardly any restrictions for the user, they often still have limitations in measurement reliability. We recently showed that low-density EEG methods using film-based round the ear electrodes (cEEGrids) are well-suited to map mental processes while driving a car in a driving simulator. In the present follow-up study, we explored aspects of ecological and internal validity of the cEEGrid measurements. We analyzed longitudinal data of 127 adults, who drove the same driving course in a virtual environment twice at intervals of 12-15 months while the EEG was recorded. Modulations in the alpha and theta frequency bands as well as within behavioral parameters (driving speed and steering wheel angular velocity) which were highly consistent over the two measurement time points were found to reflect the complexity of the driving task. At the intraindividual level, small to moderate (albeit significant) correlations were observed in about 2/3 of the participants, while other participants showed significant deviations between the two measurements. Thus, the test-retest reliability at the intra-individual level was rather low and challenges the value of the application for diagnostic purposes. However, across all participants the reliability and ecological validity of cEEGrid electrodes were satisfactory in the context of driving-related parameters.

Computer-assisted EEG diagnostic review for idiopathic generalized epilepsy

Epilepsy diagnosis can be costly, time-consuming, and not uncommonly inaccurate. The reference standard diagnostic monitoring is continuous video-electroencephalography (EEG) monitoring, ideally capturing all events or concordant interictal discharges. Automating EEG data review would save time and resources, thus enabling more people to receive reference standard monitoring and also potentially heralding a more quantitative approach to therapeutic outcomes. There is substantial research into the automated detection of seizures and epileptic activity from EEG. However, automated detection software is not widely used in the clinic, and despite numerous published algorithms, few methods have regulatory approval for detecting epileptic activity from EEG. This study reports on a deep learning algorithm for computer-assisted EEG review. Deep convolutional neural networks were trained to detect epileptic discharges using a preexisting dataset of over 6000 labelled events in a cohort of 103 patients with idiopathic generalized epilepsy (IGE). Patients underwent 24-hour ambulatory outpatient EEG, and all data were curated and confirmed independently by two epilepsy specialists (Seneviratne et al., 2016). The resulting automated detection algorithm was then used to review diagnostic scalp EEG for seven patients (four with IGE and three with events mimicking seizures) to validate performance in a clinical setting. The automated detection algorithm showed state-of-the-art performance for detecting epileptic activity from clinical EEG, with mean sensitivity of >95% and corresponding mean false positive rate of 1 detection per minute. Importantly, diagnostic case studies showed that the automated detection algorithm reduced human review time by 80%-99%, without compromising event detection or diagnostic accuracy. The presented results demonstrate that computer-assisted review can increase the speed and accuracy of EEG assessment and has the potential to greatly improve therapeutic outcomes. This article is part of the Special Issue "NEWroscience 2018".

The Virtual Reality Lab: Realization and Application of Virtual Sound Environments

To assess perception with and performance of modern and future hearing devices with advanced adaptive signal processing capabilities, novel evaluation methods are required that go beyond already established methods. These novel methods will simulate to a certain extent the complexity and variability of acoustic conditions and acoustic communication styles in real life. This article discusses the current state and the perspectives of virtual reality technology use in the lab for designing complex audiovisual communication environments for hearing assessment and hearing device design and evaluation. In an effort to increase the ecological validity of lab experiments, that is, to increase the degree to which lab data reflect real-life hearing-related function, and to support the development of improved hearing-related procedures and interventions, this virtual reality lab marks a transition from conventional (audio-only) lab experiments to the field. The first part of the article introduces and discusses the notion of the communication loop as a theoretical basis for understanding the factors that are relevant for acoustic communication in real life. From this, requirements are derived that allow an assessment of the extent to which a virtual reality lab reflects these factors, and which may be used as a proxy for ecological validity. The most important factor of real-life communication identified is a closed communication loop among the actively behaving participants. The second part of the article gives an overview of the current developments towards a virtual reality lab at Oldenburg University that aims at interactive and reproducible testing of subjects with and without hearing devices in challenging communication conditions. The extent to which the virtual reality lab in its current state meets the requirements defined in the first part is discussed, along with its limitations and potential further developments. Finally, data are presented from a qualitative study that compared subject behavior and performance in two audiovisual environments presented in the virtual reality lab-a street and a cafeteria-with the corresponding field environments. The results show similarities and differences in subject behavior and performance between the lab and the field, indicating that the virtual reality lab in its current state marks a step towards more ecological validity in lab-based hearing and hearing device research, but requires further development towards higher levels of ecological validity.

Transcranial Auricular Vagus Nerve Stimulation (taVNS) and Ear-EEG: Potential for Closed-Loop Portable Non-invasive Brain Stimulation

No matter how hard we concentrate, our attention fluctuates – a fact that greatly affects our success in completing a current task. Here, we review work from two methods that, in a closed-loop manner, have the potential to ameliorate these fluctuations. Ear-EEG can measure electric brain activity from areas in or around the ear, using small and thus portable hardware. It has been shown to capture the state of attention with high temporal resolution. Transcutaneous auricular vagus nerve stimulation (taVNS) comes with the same advantages (small and light) and critically current research suggests that it is possible to influence ongoing brain activity that has been linked to attention. Following the review of current work on ear-EEG and taVNS we suggest that a combination of the two methods in a closed-loop system could serve as a potential application to modulate attention.

Ambulatory EEG Usefulness in Epilepsy Management

SUMMARY

Long-term video-EEG monitoring has been the gold standard for diagnosis of epileptic and nonepileptic events. Medication changes, safety, and a lack of recording EEG in one's habitual environment may interfere with diagnostic representation and subsequently affect management. Some spells defy standard EEG because of ultradian and circadian times of occurrence, manifest nocturnal expression of epileptiform activity, and require classification for clarifying diagnostic input to identify optimal treatment. Some patients may be unaware of seizures, have frequent events, or subclinical seizures that require quantification before optimal management. The influence on antiseizure drug management and clinical drug research can be enlightened by long-term outpatient ambulatory EEG monitoring. With recent governmental shifts to focus on mobile health, ambulatory EEG monitoring has grown beyond diagnostic capabilities to target the dynamic effects of medical and nonmedical treatment for patients with epilepsy in their natural environment. Furthermore, newer applications in ambulatory monitoring include additional physiologic parameters (e.g., sleep, detection of myogenic signals, etc.) and extend treatment relevance to patients beyond seizure reduction alone addressing comorbid conditions. It is with this focus in mind that we direct our discussion on the present and future aspects of using ambulatory EEG monitoring in the treatment of patients with epilepsy.

Custom-Fitted In- and Around-the-Ear Sensors for Unobtrusive and On-the-Go EEG Acquisitions: Development and Validation

OBJECTIVES

This paper aims to validate the performance and physical design of a wearable, unobtrusive ear-centered electroencephalography (EEG) device, dubbed "EARtrodes", using early and late auditory evoked responses. Results would also offer a proof-of-concept for the device to be used as a concealed brain-computer interface (BCI).

DESIGN

The device is composed of a custom-fitted earpiece and an ergonomic behind-the-ear piece with embedded electrodes made of a soft and flexible combination of silicone rubber and carbon fibers. The location of the conductive silicone electrodes inside the ear canal and the optimal geometry of the behind-the-ear piece were obtained through morphological and geometrical analysis of the human ear canal and the region around-the-ear. An entirely conductive generic earpiece was also developed to assess the potential of a universal, more affordable solution.

RESULTS

Early latency results illustrate the conductive silicone electrodes' capability to record quality EEG signals, comparable to those obtained with traditional gold-plated electrodes. Additionally, late latency results demonstrate EARtrodes' capacity to reliably detect decision-making processes from the ear.

CONCLUSIONS

EEG results validate the performance of EARtrodes as a circum-aural and intra-aural EEG recording system adapted for a wide range of applications in audiology, neuroscience, clinical research, and as an unobtrusive BCI.

Mobile ear-EEG to study auditory attention in everyday life

Most research investigating auditory perception is conducted in controlled laboratory settings, potentially restricting its generalizability to the complex acoustic environment outside the lab. The present study, in contrast, investigated auditory attention with long-term recordings (> 6 h) beyond the lab using a fully mobile, smartphone-based ear-centered electroencephalography (EEG) setup with minimal restrictions for participants. Twelve participants completed iterations of two variants of an oddball task where they had to react to target tones and to ignore standard tones. A rapid variant of the task (tones every 2 s, 5 min total time) was performed seated and with full focus in the morning, around noon and in the afternoon under controlled conditions. A sporadic variant (tones every minute, 160 min total time) was performed once in the morning and once in the afternoon while participants followed their normal office day routine. EEG data, behavioral data, and movement data (with a gyroscope) were recorded and analyzed. The expected increased amplitude of the P3 component in response to the target tone was observed for both the rapid and the sporadic oddball. Miss rates were lower and reaction times were faster in the rapid oddball compared to the sporadic one. The movement data indicated that participants spent most of their office day at relative rest. Overall, this study demonstrated that it is feasible to study auditory perception in everyday life with long-term ear-EEG.

A review of wearable and unobtrusive sensing technologies for chronic disease management

With the rapidly increasing number of patients with chronic disease, numerous recent studies have put great efforts into achieving long-term health monitoring and patient management. Specifically, chronic diseases including cardiovascular disease, chronic respiratory disease and brain disease can threaten patients' health conditions over a long period of time, thus effecting their daily lives. Vital health parameters, such as heart rate, respiratory rate, SpO2 and blood pressure, are closely associated with patients’ conditions. Wearable devices and unobtrusive sensing technologies can detect such parameters in a convenient way and provide timely predictions on health condition deterioration by tracking these biomedical signals and health parameters. In this paper, we review current advancements in wearable devices and unobtrusive sensing technologies that can provides possible tools and technological supports for chronic disease management. Current challenges and future directions of related techniques are addressed accordingly.

A Real-Time Movement Artifact Removal Method for Ambulatory Brain-Computer Interfaces

Recently, practical brain-computer interfaces (BCIs) have been widely investigated for detecting human intentions in real world. However, performance differences still exist between the laboratory and the real world environments. One of the main reasons for such differences comes from the user's unstable physical states (e.g., human movements are not strictly controlled), which produce unexpected signal artifacts. Hence, to minimize the performance degradation of electroencephalography (EEG)-based BCIs, we present a novel artifact removal method named constrained independent component analysis with online learning (cIOL). The cIOL can find and reject the noise-like components related to human body movements (i.e., movement artifacts) in the EEG signals. To obtain movement information, isolated electrodes are used to block electrical signals from the brain using high-resistance materials. We estimate artifacts with movement information using constrained independent component analysis from EEG signals and then extract artifact-free signals using online learning in each sample. In addition, the cIOL is evaluated by signal processing under 16 different experimental conditions (two types of EEG devices × two BCI paradigms × four different walking speeds). The experimental results show that the cIOL has the highest accuracy in both scalp- and ear-EEG, and has the highest signal-to-noise ratio in scalp-EEG among the state-of-the-art methods, except for the case of steady-state visual evoked potential at 2.0 m/s with superposition problem.

VME-DWT: An Efficient Algorithm for Detection and Elimination of Eye Blink From Short Segments of Single EEG Channel

OBJECTIVE

Recent advances in development of low-cost single-channel electroencephalography (EEG) headbands have opened new possibilities for applications in health monitoring and brain-computer interface (BCI) systems. These recorded EEG signals, however, are often contaminated by eye blink artifacts that can yield the fallacious interpretation of the brain activity. This paper proposes an efficient algorithm, VME-DWT, to remove eye blinks in a short segment of the single EEG channel.

METHOD

The proposed algorithm: (a) locates eye blink intervals using Variational Mode Extraction (VME) and (b) filters only contaminated EEG interval using an automatic Discrete Wavelet Transform (DWT) algorithm. The performance of VME-DWT is compared with an automatic Variational Mode Decomposition (AVMD) and a DWT-based algorithms, proposed for suppressing eye blinks in a short segment of the single EEG channel.

RESULTS

The VME-DWT detects and filters 95% of the eye blinks from the contaminated EEG signals with SNR ranging from -8 to +3 dB. The VME-DWT shows superiority to the AVMD and DWT with the higher mean value of correlation coefficient (0.92 vs. 0.83, 0.58) and lower mean value of RRMSE (0.42 vs. 0.59, 0.87).

SIGNIFICANCE

The VME-DWT can be a suitable algorithm for removal of eye blinks in low-cost single-channel EEG systems as it is: (a) computationally-efficient, the contaminated EEG signal is filtered in millisecond time resolution, (b) automatic, no human intervention is required, (c) low-invasive, EEG intervals without contamination remained unaltered, and (d) low-complexity, without need to the artifact reference.

Electro-Encephalography and Electro-Oculography in Aeronautics: A Review Over the Last Decade (2010-2020)

Electro-encephalography (EEG) and electro-oculography (EOG) are methods of electrophysiological monitoring that have potentially fruitful applications in neuroscience, clinical exploration, the aeronautical industry, and other sectors. These methods are often the most straightforward way of evaluating brain oscillations and eye movements, as they use standard laboratory or mobile techniques. This review describes the potential of EEG and EOG systems and the application of these methods in aeronautics. For example, EEG and EOG signals can be used to design brain-computer interfaces (BCI) and to interpret brain activity, such as monitoring the mental state of a pilot in determining their workload. The main objectives of this review are to, (i) offer an in-depth review of literature on the basics of EEG and EOG and their application in aeronautics; (ii) to explore the methodology and trends of research in combined EEG-EOG studies over the last decade; and (iii) to provide methodological guidelines for beginners and experts when applying these methods in environments outside the laboratory, with a particular focus on human factors and aeronautics. The study used databases from scientific, clinical, and neural engineering fields. The review first introduces the characteristics and the application of both EEG and EOG in aeronautics, undertaking a large review of relevant literature, from early to more recent studies. We then built a novel taxonomy model that includes 150 combined EEG-EOG papers published in peer-reviewed scientific journals and conferences from January 2010 to March 2020. Several data elements were reviewed for each study (e.g., pre-processing, extracted features and performance metrics), which were then examined to uncover trends in aeronautics and summarize interesting methods from this important body of literature. Finally, the review considers the advantages and limitations of these methods as well as future challenges.

Assessment of changes in the electrical activity of the brain during general anesthesia using portable electroencephalography

Introduction: The analysis of the electrical activity of the brain using scalp electrodes with electroencephalography (EEG) could reveal the depth of anesthesia of a patient during surgery. However, conventional EEG equipment, due to its price and size, are not a practical option for the operating room and the commercial units used in surgery do not provide access to the electrical activity. The availability of low-cost portable technologies could provide for further research on the brain activity under general anesthesia and facilitate our quest for new markers of depth of anesthesia. Objective: To assess the capabilities of a portable EEG technology to capture brain rhythms associated with the state of consciousness and the general anesthesia status of surgical patients anesthetized with propofol. Methods: Observational, cross-sectional trial that reviewed 10 EEG recordings captured using OpenBCI portable low-cost technology, in female patients undergoing general anesthesia with propofol. The signal from the frontal electrodes was analyzed with spectral analysis and the results were compared against the reports in the literature. Results: The signal captured with frontal electrodes, particularly α rhythm, enabled the distinction between resting with eyes closed and with eyes opened in a conscious state, and sustained anesthesia during surgery. Conclusions: It is possible to differentiate a resting state from sustained anesthesia, replicating previous findings with conventional technologies. These results pave the way to the use of portable technologies such as the OpenBCI tool, to explore the brain dynamics during anesthesia.

The Modulation of Cognitive Performance with Transcranial Alternating Current Stimulation: A Systematic Review of Frequency-Specific Effects

Transcranial alternating current stimulation (tACS) is a non-invasive brain stimulation technique that allows the manipulation of intrinsic brain oscillations. Numerous studies have applied tACS in the laboratory to enhance cognitive performance. With this systematic review, we aim to provide an overview of frequency-specific tACS effects on a range of cognitive functions in healthy adults. This may help to transfer stimulation protocols to real-world applications. We conducted a systematic literature search on PubMed and Cochrane databases and considered tACS studies in healthy adults (age > 18 years) that focused on cognitive performance. The search yielded n = 109 studies, of which n = 57 met the inclusion criteria. The results indicate that theta-tACS was beneficial for several cognitive functions, including working memory, executive functions, and declarative memory. Gamma-tACS enhanced performance in both auditory and visual perception but it did not change performance in tasks of executive functions. For attention, the results were less consistent but point to an improvement in performance with alpha- or gamma-tACS. We discuss these findings and point to important considerations that would precede a transfer to real-world applications.

Does the electrode amplification style matter? A comparison of active and passive EEG system configurations during standing and walking

It has been stated that active-transmission electrodes should improve signal quality in mobile EEG recordings. However, few studies have directly compared active- and passive-transmission electrodes during a mobile task. In this repeated measurement study, we investigated the performance of active and passive signal transmission electrodes with the same amplifier system in their respective typical configurations, during a mobile auditory task. The task was an auditory discrimination (1,000 vs. 800 Hz; counterbalanced) oddball task using approximately 560 trials (15% targets) for each condition. Eighteen participants performed the auditory oddball task both while standing and walking in an outdoor environment. While walking, there was a significant decrease in P3 amplitude, post-trial rejection trial numbers, and signal-to-noise ratio (SNR). No significant differences were found in signal quality between the two electrode configurations. SNR and P3 amplitude were test-retest reliable between recordings. We conclude that adequate use of a passive EEG electrode system achieves signal quality equivalent to that of an active system during a mobile task.

Unsupervised automatic seizure detection for focal-onset seizures recorded with behind-the-ear EEG using an anomaly-detecting generative adversarial network

BACKGROUND AND OBJECTIVE

Epilepsy is a neurological disorder of the brain, which involves recurrent seizures. An encephalogram (EEG) is a gold standard method in the detection and analysis of epileptic seizures. However, the standard EEG recording system is too obstructive to be used in daily life. Behind-the-ear EEG is an alternative approach to record EEG conveniently. Previous researchers applied machine learning to automatically detect seizures with EEG, but the epileptic EEG waveform contains subtle changes that are difficult to be identified. Furthermore, the extremely small proportion of ictal events in the long-term monitoring may cause the imbalance problem and, consequently, poor prediction performance in supervised learning approaches. In this study, we present an automatic seizure detection algorithm with a generative adversarial network (GAN) trained by unsupervised learning and evaluated it with behind-the-ear EEG.

METHODS

We recorded behind-the-ear EEGs from 12 patients who have various types of epilepsy. Data were reviewed separately by two epileptologists, who determined the onsets and ends of seizures. First, we conducted unsupervised learning with the normal records for the GAN to learn the representation of normal states. Second, we performed automatic seizure detection with the trained GAN as an anomaly detector. Last, we combined the Gram matrix with other anomaly losses to improve detection performance.

RESULTS

The proposed approach achieved detection performance with an area under the receiver operating curve of 0.939 and sensitivity of 96.3% with a false alarm rate of 0.14 per hour in the test dataset. In addition, we confirmed distinguishability with the distribution of the anomaly scores in terms of EEG frequency bands.

CONCLUSIONS

It is expected that the proposed anomaly detection via GAN with the behind-the-ear EEG can be effectively used for long-term seizure monitoring in daily life.

The Sensitivity of Ear-EEG: Evaluating the Source-Sensor Relationship Using Forward Modeling

Ear-EEG allows to record brain activity in every-day life, for example to study natural behaviour or unhindered social interactions. Compared to conventional scalp-EEG, ear-EEG uses fewer electrodes and covers only a small part of the head. Consequently, ear-EEG will be less sensitive to some cortical sources. Here, we perform realistic electromagnetic simulations to compare cEEGrid ear-EEG with 128-channel cap-EEG. We compute the sensitivity of ear-EEG for different cortical sources, and quantify the expected signal loss of ear-EEG relative to cap-EEG. Our results show that ear-EEG is most sensitive to sources in the temporal cortex. Furthermore, we show how ear-EEG benefits from a multi-channel configuration (i.e. cEEGrid). The pipelines presented here can be adapted to any arrangement of electrodes and can therefore provide an estimate of sensitivity to cortical regions, thereby increasing the chance of successful experiments using ear-EEG.

Flex-printed forehead EEG sensors (fEEGrid) for long-term EEG acquisition

OBJECTIVE

In this report we present the fEEGrid, an electrode array applied to the forehead that allows convenient long-term recordings of electroencephalography (EEG) signals over many hours.

APPROACH

Twenty young, healthy participants wore the fEEGrid and completed traditional EEG paradigms in two sessions on the same day. The sessions were eight hours apart, participants performed the same tasks in an early and a late session. For the late session fEEGrid data were concurrently recorded with traditional cap EEG data.

MAIN RESULTS

Our analyses show that typical event-related potentials responses were captured reliably by the fEEGrid. Single-trial analyses revealed that classification was possible above chance level for auditory and tactile oddball paradigms. We also found that the signal quality remained high and impedances did not deteriorate, but instead improved over the course of the day. Regarding wearing comfort, all participants indicated that the fEEGrid was comfortable to wear and did not cause any pain even after 8 h of wearing it.

SIGNIFICANCE

We show in this report, that high quality EEG signals can be captured with the fEEGrid reliably, even in long-term recording scenarios and with a signal quality that may be considered suitable for online brain-computer Interface applications.

Highly Porous Platinum Electrodes for Dry Ear-EEG Measurements

The interest in dry electroencephalography (EEG) electrodes has increased in recent years, especially as everyday suitability earplugs for measuring drowsiness or focus of auditory attention. However, the challenge is still the need for a good electrode material, which is reliable and can be easily processed for highly personalized applications. Laser processing, as used here, is a fast and very precise method to produce personalized electrode configurations that meet the high requirements of in-ear EEG electrodes. The arrangement of the electrodes on the flexible and compressible mats allows an exact alignment to the ear mold and contributes to high wearing comfort, as no edges or metal protrusions are present. For better transmission properties, an adapted coating process for surface enlargement of platinum electrodes is used, which can be controlled precisely. The resulting porous platinum-copper alloy is chemically very stable, shows no exposed copper residues, and enlarges the effective surface area by 40. In a proof-of-principle experiment, these porous platinum electrodes could be used to measure the Berger effect in a dry state using just one ear of a test person. Their signal-to-noise ratio and the frequency transfer function is comparable to gel-based silver/silver chloride electrodes.

Noninvasive detection of focal seizures in ambulatory patients

Reliably detecting focal seizures without secondary generalization during daily life activities, chronically, using convenient portable or wearable devices, would offer patients with active epilepsy a number of potential benefits, such as providing more reliable seizure count to optimize treatment and seizure forecasting, and triggering alarms to promote safeguarding interventions. However, no generic solution is currently available to reach these objectives. A number of biosignals are sensitive to specific forms of focal seizures, in particular heart rate and its variability for seizures affecting the neurovegetative system, and accelerometry for those responsible for prominent motor activity. However, most studies demonstrate high rates of false detection or poor sensitivity, with only a minority of patients benefiting from acceptable levels of accuracy. To tackle this challenging issue, several lines of technological progress are envisioned, including multimodal biosensing with cross‐modal analytics, a combination of embedded and distributed self‐aware machine learning, and ultra–low‐power design to enable appropriate autonomy of such sophisticated portable solutions.

Studying brain activity during word-by-word interactions using wireless EEG

We introduce here the word-by-word paradigm, a dynamic setting, in which two people take turns in producing a single sentence. This task requires a high degree of coordination between the partners and the simplicity of the task allows us to study with sufficient experimental control behavioral and neural processes that underlie this controlled interaction. For this study, 13 pairs of individuals engaged in a scripted word-by-word interaction, while we recorded the neural activity of both participants simultaneously using wireless EEG. To study expectation building, different semantic contexts were primed for each participant. Semantically unexpected continuations were introduced in 25% of all sentences. In line with the hypothesis, we observed amplitude differences for the P200-N400-P600 ERPs for unexpected compared to expected words. Moreover, we could successfully assess speech and reaction times. Our results show that it is possible to measure ERPs and RTs to semantically unexpected words in a dyadic interactive scenario.

Hearing the needs of clinical users

In the past 10 years, brain-computer interfaces (BCIs) for controlling assistive devices have seen tremendous progress with respect to reliability and learnability, and numerous exemplary applications were demonstrated to be controllable by a BCI. Yet, BCI-controlled applications are hardly used for patients with neurologic or neurodegenerative disease. Such patient groups are considered potential end-users of BCI, specifically for replacing or improving lost function. We argue that BCI research and development still faces a translational gap, i.e., the knowledge of how to bring BCIs from the laboratory to the field is insufficient. BCI-controlled applications lack usability and accessibility; both constitute two sides of one coin, which is the key to use in daily life and to prevent nonuse. To increase usability, we suggest rigorously adopting the user-centered design in applied BCI research and development. To provide accessibility, assistive technology (AT) experts, providers, and other stakeholders have to be included in the user-centered process. BCI experts have to ensure the transfer of knowledge to AT professionals, and listen to the needs of primary, secondary, and tertiary end-users of BCI technology. Addressing both, usability and accessibility, in applied BCI research and development will bridge the translational gap and ensure that the needs of clinical end-users are heard, understood, addressed, and fulfilled.

Self-health monitoring and wearable neurotechnologies

Brain-computer interfaces and wearable neurotechnologies are now used to measure real-time neural and physiologic signals from the human body and hold immense potential for advancements in medical diagnostics, prevention, and intervention. Given the future role that wearable neurotechnologies will likely serve in the health sector, a critical state-of-the-art assessment is necessary to gain a better understanding of their current strengths and limitations. In this chapter we present wearable electroencephalography systems that reflect groundbreaking innovations and improvements in real-time data collection and health monitoring. We focus on specifications reflecting technical advantages and disadvantages, discuss their use in fundamental and clinical research, their current applications, limitations, and future directions. While many methodological and ethical challenges remain, these systems host the potential to facilitate large-scale data collection far beyond the reach of traditional research laboratory settings.

Evaluating Mental Load During Realistic Driving Simulations by Means of Round the Ear Electrodes

Film based round the ear electrodes (cEEGrids) provide both, the accessibility of unobtrusive mobile EEG as well as a rapid EEG application in stationary settings when extended measurements are not possible. In a large-scale evaluation of driving abilities of older adults (N > 350) in a realistic driving simulation, we evaluated to what extent mental demands can be measured using cEEGrids in a completely unrestricted environment. For a first frequency-based analysis, the driving scenario was subdivided into different street segments with respect to their task loads (low, medium, high) that was a priori rated by an expert. Theta activity increased with task load but no change in Alpha power was found. Effects gained clarity after removing pink noise effects, that were potentially high in this data set due to motion artifacts. Theta fraction increased with task load and Alpha fraction decreased. We mapped this effect to specific street segments by applying a track-frequency analysis. Whilst participants drove with constant speed and without high steering wheel activity, Alpha was high and theta low. The reverse was the case in sections that required either high activity or increased attentional allocation to the driving context. When calculating mental demands for different street segments based on EEG, this measure is highly significant correlated with the experts' rating of task load. Deviances can be explained by specific features within the segments. Thus, modulations in spectral power of the EEG were validly reflected in the cEEGrids data. All findings were in line with the prominent literature in the field. The results clearly demonstrate the usability of this low-density EEG method for application in real-world settings where an increase in ecological validity might outweigh the loss of certain aspects of internal validity.

Effects of Different Re-referencing Methods on Spontaneously Generated Ear-EEG

In recent years, electroencephalography (EEG) measured around the ears, called ear-EEG, has been introduced to develop unobtrusive and ambulatory EEG-based applications. When measuring ear-EEGs, the availability of a reference site is restricted due to the miniaturized device structure, and therefore a reference electrode is generally placed near the recording electrodes. As the electrical brain activity recorded at a reference electrode closely placed to recording electrodes may significantly cancel or influence the brain activity recorded by the recording electrodes, an appropriate re-referencing method is often required to mitigate the impact of the reference brain activity. In this study, therefore, we systematically investigated the impact of different re-referencing methods on ear-EEGs spontaneously generated from endogenous paradigms. To this end, we used two ear-EEG datasets recorded behind both ears while subjects performed an alpha modulation task [eyes-closed (EC) and eyes-open (EO)] and two mental tasks [mental arithmetic (MA) and mental singing (MS)]. The measured ear-EEGs were independently re-referenced using five different methods: (i) all-mean, (ii) contralateral-mean, (iii) ipsilateral-mean, (iv) contralateral-bipolar, and (v) ipsilateral-bipolar. We investigated the changes in alpha power during EO and EC tasks, as well as event-related (de) synchronization (ERD/ERS) during MA and MS. To evaluate the effects of re-referencing methods on ear-EEGs, we estimated the signal-to-noise ratios (SNRs) of the two ear-EEG datasets, and assessed the classification performance of the two mental tasks (MA vs. MS). Overall patterns of changes in alpha power and ERD/ERS were similar among the five re-referencing methods, but the contralateral-mean method showed statistically higher SNRs than did the other methods for both ear-EEG datasets, except in the contralateral-bipolar method for the two mental tasks. In concordance with the SNR results, classification performance was also statistically higher for the contralateral-mean method than it was for the other re-referencing methods. The results suggest that employing contralateral mean information can be an efficient way to re-reference spontaneously generated ear-EEGs, thereby maximizing the reliability of ear-EEG-based applications in endogenous paradigms.

Decoding Selective Attention in Normal Hearing Listeners and Bilateral Cochlear Implant Users With Concealed Ear EEG

Electroencephalography (EEG) data can be used to decode an attended speech source in normal-hearing (NH) listeners using high-density EEG caps, as well as around-the-ear EEG devices. The technology may find application in identifying the target speaker in a cocktail party like scenario and steer speech enhancement algorithms in cochlear implants (CIs). However, the worse spectral resolution and the electrical artifacts introduced by a CI may limit the applicability of this approach to CI users. The goal of this study was to investigate whether selective attention can be decoded in CI users using an around-the-ear EEG system (cEEGrid). The performances of high-density cap EEG recordings and cEEGrid EEG recordings were compared in a selective attention paradigm using an envelope tracking algorithm. Speech from two audio books was presented through insert earphones to NH listeners and via direct audio cable to the CI users. 10 NH listeners and 10 bilateral CI users participated in the study. Participants were instructed to attend to one out of the two concurrent speech streams while data were recorded by a 96-channel scalp EEG and an 18-channel cEEGrid setup simultaneously. Reconstruction performance was evaluated by means of parametric correlations between the reconstructed speech and both, the envelope of the attended and the unattended speech stream. Results confirm the feasibility to decode selective attention by means of single-trial EEG data in NH and CI users using a high-density EEG. All NH listeners and 9 out of 10 CI achieved high decoding accuracies. The cEEGrid was successful in decoding selective attention in 5 out of 10 NH listeners. The same result was obtained for CI users.

Epidural recordings in cochlear implant users

OBJECTIVE

In the long term it is desirable for CI users to control their device via brain signals. A possible strategy is the use of auditory evoked potentials (AEPs). Several studies have shown the suitability of auditory paradigms for such an approach. However, these investigations are based on non-invasive recordings. When thinking about everyday life applications, it would be more convenient to use implanted electrodes for signal acquisition. Ideally, the electrodes would be directly integrated into the CI. Further it is to be expected that invasively recorded signals have higher signal quality and are less affected by artifacts.

APPROACH

In this project we investigated the feasibility of implanting epidural electrodes temporarily during CI surgery and the possibility to record AEPs in the course of several days after implantation. Intraoperatively, auditory brainstem responses were recorded, whereas various kinds of AEPs were recorded postoperatively. After a few days the epidural electrodes were removed.

MAIN RESULTS

Data sets of ten subjects were obtained. Invasively recorded potentials were compared subjectively and objectively to clinical standard recordings using surface electrodes. Especially the cortical evoked response audiometry depicted clearer N1 waves for the epidural electrodes which were also visible at lower stimulation intensities compared to scalp electrodes. Furthermore the signal was less disturbed by artifacts. The objective quality measure (based on data sets of six patients) showed a significant better signal quality for the epidural compared to the scalp recordings.

SIGNIFICANCE

Altogether the approach revealed to be feasible and well tolerated by the patients. The epidural recordings showed a clearly better signal quality than the scalp recordings with AEPs being clearer recognizable. The results of the present study suggest that including epidural recording electrodes in future CI systems will improve the everyday life applicability of auditory closed loop systems for CI subjects.

Acquisition of Subcortical Auditory Potentials With Around-the-Ear cEEGrid Technology in Normal and Hearing Impaired Listeners

Even though the principles of recording brain electrical activity remain unchanged since their discovery, their acquisition has seen major improvements. The cEEGrid, a recently developed flex-printed multi-channel sensory array, can be placed around the ear and successfully record well-known cortical electrophysiological potentials such as late auditory evoked potentials (AEPs) or the P300. Due to its fast and easy application as well as its long-lasting signal recording window, the cEEGrid technology offers great potential as a flexible and ‘wearable’ solution for the acquisition of neural correlates of hearing. Early potentials of auditory processing such as the auditory brainstem response (ABR) are already used in clinical assessment of sensorineural hearing disorders and envelope following responses (EFR) have shown promising results in the diagnosis of suprathreshold hearing deficits. This study evaluates the suitability of the cEEGrid electrode configuration to capture these AEPs. cEEGrid potentials were recorded and compared to cap-EEG potentials for young normal-hearing listeners and older listeners with high-frequency sloping audiograms to assess whether the recordings are adequately sensitive for hearing diagnostics. ABRs were elicited by presenting clicks (70 and 100-dB peSPL) and stimulation for the EFRs consisted of 120 Hz amplitude-modulated white noise carriers presented at 70-dB SPL. Data from nine bipolar cEEGrid channels and one classical cap-EEG montage (earlobes to vertex) were analysed and outcome measures were compared. Results show that the cEEGrid is able to record ABRs and EFRs with comparable shape to those recorded using a conventional cap-EEG recording montage and the same amplifier. Signal strength is lower but can still produce responses above the individual neural electrophysiological noise floor. This study shows that the application of the cEEGrid can be extended to the acquisition of early auditory evoked potentials.

Look at me when I'm talking to you: Selective attention at a multisensory cocktail party can be decoded using stimulus reconstruction and alpha power modulations

Recent work using electroencephalography has applied stimulus reconstruction techniques to identify the attended speaker in a cocktail party environment. The success of these approaches has been primarily based on the ability to detect cortical tracking of the acoustic envelope at the scalp level. However, most studies have ignored the effects of visual input, which is almost always present in naturalistic scenarios. In this study, we investigated the effects of visual input on envelope-based cocktail party decoding in two multisensory cocktail party situations: (a) Congruent AV-facing the attended speaker while ignoring another speaker represented by the audio-only stream and (b) Incongruent AV (eavesdropping)-attending the audio-only speaker while looking at the unattended speaker. We trained and tested decoders for each condition separately and found that we can successfully decode attention to congruent audiovisual speech and can also decode attention when listeners were eavesdropping, i.e., looking at the face of the unattended talker. In addition to this, we found alpha power to be a reliable measure of attention to the visual speech. Using parieto-occipital alpha power, we found that we can distinguish whether subjects are attending or ignoring the speaker's face. Considering the practical applications of these methods, we demonstrate that with only six near-ear electrodes we can successfully determine the attended speech. This work extends the current framework for decoding attention to speech to more naturalistic scenarios, and in doing so provides additional neural measures which may be incorporated to improve decoding accuracy.

A Novel Wearable EEG and ECG Recording System for Stress Assessment

Suffering from continuous stress can lead to serious psychological and even physical disorders. Objective stress assessment methods using noninvasive physiological responses such as heart rate variability (HRV) and electroencephalograms (EEG) have therefore been proposed for effective stress management. In this study, a novel wearable device that can measure electrocardiograms (ECG) and EEG simultaneously was designed to enable continuous stress monitoring in daily life. The developed system is easily worn by hanging from both ears, is lightweight (i.e., 42.5 g), and exhibits an excellent noise performance of 0.12 μVrms. Significant time and frequency features of HRV and EEG were found in two different stressors, namely the Stroop color word and mental arithmetic tests, using 14 young subjects. Stressor situations were classified using various HRV and EEG feature selections and a support vector machine technique. The five-fold cross-validation results obtained when using both EEG and HRV features showed the best performance with an accuracy of 87.5%, which demonstrated the requirement for simultaneous HRV and EEG measurements.

A Riemannian Modification of Artifact Subspace Reconstruction for EEG Artifact Handling

Artifact Subspace Reconstruction (ASR) is an adaptive method for the online or offline correction of artifacts comprising multichannel electroencephalography (EEG) recordings. It repeatedly computes a principal component analysis (PCA) on covariance matrices to detect artifacts based on their statistical properties in the component subspace. We adapted the existing ASR implementation by using Riemannian geometry for covariance matrix processing. EEG data that were recorded on smartphone in both outdoors and indoors conditions were used for evaluation (N = 27). A direct comparison between the original ASR and Riemannian ASR (rASR) was conducted for three performance measures: reduction of eye-blinks (sensitivity), improvement of visual-evoked potentials (VEPs) (specificity), and computation time (efficiency). Compared to ASR, our rASR algorithm performed favorably on all three measures. We conclude that rASR is suitable for the offline and online correction of multichannel EEG data acquired in laboratory and in field conditions.

Hearables: Automatic Overnight Sleep Monitoring With Standardized In-Ear EEG Sensor

OBJECTIVE

Advances in sensor miniaturization and computational power have served as enabling technologies for monitoring human physiological conditions in real-world scenarios. Sleep disruption may impact neural function, and can be a symptom of both physical and mental disorders. This study proposes wearable in-ear electroencephalography (ear-EEG) for overnight sleep monitoring as a 24/7 continuous and unobtrusive technology for sleep quality assessment in the community.

METHODS

A total of 22 healthy participants took part in overnight sleep monitoring with simultaneous ear-EEG and conventional full polysomnography recordings. The ear-EEG data were analyzed in the both structural complexity and spectral domains. The extracted features were used for automatic sleep stage prediction through supervized machine learning, whereby the PSG data were manually scored by a sleep clinician.

RESULTS

The agreement between automatic sleep stage prediction based on ear-EEG from a single in-ear sensor and the hypnogram based on the full PSG was 74.1% in the accuracy over five sleep stage classification. This is supported by a substantial agreement in the kappa metric (0.61).

CONCLUSION

The in-ear sensor is feasible for monitoring overnight sleep outside the sleep laboratory and also mitigates technical difficulties associated with PSG. It, therefore, represents a 24/7 continuously wearable alternative to conventional cumbersome and expensive sleep monitoring.

SIGNIFICANCE

The "standardized" one-size-fits-all viscoelastic in-ear sensor is a next generation solution to monitor sleep-this technology promises to be a viable method for readily wearable sleep monitoring in the community, a key to affordable healthcare and future eHealth.

Effects of directional sound processing and listener's motivation on EEG responses to continuous noisy speech: Do normal-hearing and aided hearing-impaired listeners differ?

OBJECTIVE

It has been suggested that the next major advancement in hearing aid (HA) technology needs to include cognitive feedback from the user to control HA functionality. In order to enable automatic brainwave-steered HA adjustments, attentional processes underlying speech-in-noise perception in aided hearing-impaired individuals need to be better understood. Here, we addressed the influence of two important factors for the listening performance of HA users - hearing aid processing and motivation - by analysing ongoing neural responses during long-term listening to continuous noisy speech.

METHODS

Sixteen normal-hearing (NH) and 15 linearly aided hearing-impaired (aHI) participants listened to an audiobook recording embedded in realistic speech babble noise at individually adjusted signal-to-noise ratios (SNRs). A HA simulator was used for simulating a directional microphone setting as well as for providing individual amplification. To assess listening performance behaviourally, participants answered questions about the contents of the audiobook. We manipulated (1) the participants' motivation by offering a monetary reward for good listening performance in one half of the measurements and (2) the SNR by engaging/disengaging the directional microphone setting. During the speech-in-noise task, electroencephalography (EEG) signals were recorded using wireless, mobile hardware. EEG correlates of listening performance were investigated using EEG impulse responses, as estimated using the cross-correlation between the recorded EEG signal and the temporal envelope of the audiobook at the output of the HA simulator.

RESULTS

At the behavioural level, we observed better performance for the NH listeners than for the aHI listeners. Furthermore, the directional microphone setting led to better performance for both participant groups, and when the directional microphone setting was disengaged motivation also improved the performance of the aHI participants. Analysis of the EEG impulse responses showed faster N1P2 responses for both groups and larger N2 peak amplitudes for the aHI group when the directional microphone setting was activated, but no physiological correlates of motivation.

SIGNIFICANCE

The results of this study indicate that motivation plays an important role for speech understanding in noise. In terms of neuro-steered HAs, our results suggest that the latency of attentional processes is influenced by HA-induced stimulus changes, which can potentially be used for inferring benefit from noise suppression processing automatically. Further research is necessary to identify the neural correlates of motivation as an exclusive top-down process and to combine such features with HA-driven ones for online HA adjustments.