Source-Modeling Auditory Processes of EEG Data Using EEGLAB and Brainstorm

Changes in visually and auditory attended audiovisual speech processing in cochlear implant users: A longitudinal ERP study

Limited auditory input, whether caused by hearing loss or by electrical stimulation through a cochlear implant (CI), can be compensated by the remaining senses. Specifically for CI users, previous studies reported not only improved visual skills, but also altered cortical processing of unisensory visual and auditory stimuli. However, in multisensory scenarios, it is still unclear how auditory deprivation (before implantation) and electrical hearing experience (after implantation) affect cortical audiovisual speech processing. Here, we present a prospective longitudinal electroencephalography (EEG) study which systematically examined the deprivation- and CI-induced alterations of cortical processing of audiovisual words by comparing event-related potentials (ERPs) in postlingually deafened CI users before and after implantation (five weeks and six months of CI use). A group of matched normal-hearing (NH) listeners served as controls. The participants performed a word-identification task with congruent and incongruent audiovisual words, focusing their attention on either the visual (lip movement) or the auditory speech signal. This allowed us to study the (top-down) attention effect on the (bottom-up) sensory cortical processing of audiovisual speech. When compared to the NH listeners, the CI candidates (before implantation) and the CI users (after implantation) exhibited enhanced lipreading abilities and an altered cortical response at the N1 latency range (90-150 ms) that was characterized by a decreased theta oscillation power (4-8 Hz) and a smaller amplitude in the auditory cortex. After implantation, however, the auditory-cortex response gradually increased and developed a stronger intra-modal connectivity. Nevertheless, task efficiency and activation in the visual cortex was significantly modulated in both groups by focusing attention on the visual as compared to the auditory speech signal, with the NH listeners additionally showing an attention-dependent decrease in beta oscillation power (13-30 Hz). In sum, these results suggest remarkable deprivation effects on audiovisual speech processing in the auditory cortex, which partially reverse after implantation. Although even experienced CI users still show distinct audiovisual speech processing compared to NH listeners, pronounced effects of (top-down) direction of attention on (bottom-up) audiovisual processing can be observed in both groups. However, NH listeners but not CI users appear to show enhanced allocation of cognitive resources in visually as compared to auditory attended audiovisual speech conditions, which supports our behavioural observations of poorer lipreading abilities and reduced visual influence on audition in NH listeners as compared to CI users.

The effects of aging and hearing impairment on listening in noise

The study investigates age-related decline in listening abilities, particularly in noisy environments, where the challenge lies in extracting meaningful information from variable sensory input (figure-ground segregation). The research focuses on peripheral and central factors contributing to this decline using a tone-cloud-based figure detection task. Results based on behavioral measures and event-related brain potentials (ERPs) indicate that, despite delayed perceptual processes and some deterioration in attention and executive functions with aging, the ability to detect sound sources in noise remains relatively intact. However, even mild hearing impairment significantly hampers the segregation of individual sound sources within a complex auditory scene. The severity of the hearing deficit correlates with an increased susceptibility to masking noise. The study underscores the impact of hearing impairment on auditory scene analysis and highlights the need for personalized interventions based on individual abilities.

The neurophysiology of closed-loop auditory stimulation in sleep: A magnetoencephalography study

Closed-loop auditory stimulation (CLAS) is a brain modulation technique in which sounds are timed to enhance or disrupt endogenous neurophysiological events. CLAS of slow oscillation up-states in sleep is becoming a popular tool to study and enhance sleep's functions, as it increases slow oscillations, evokes sleep spindles and enhances memory consolidation of certain tasks. However, few studies have examined the specific neurophysiological mechanisms involved in CLAS, in part because of practical limitations to available tools. To evaluate evidence for possible models of how sound stimulation during brain up-states alters brain activity, we simultaneously recorded electro- and magnetoencephalography in human participants who received auditory stimulation across sleep stages. We conducted a series of analyses that test different models of pathways through which CLAS of slow oscillations may affect widespread neural activity that have been suggested in literature, using spatial information, timing and phase relationships in the source-localized magnetoencephalography data. The results suggest that auditory information reaches ventral frontal lobe areas via non-lemniscal pathways. From there, a slow oscillation is created and propagated. We demonstrate that while the state of excitability of tissue in auditory cortex and frontal ventral regions shows some synchrony with the electroencephalography (EEG)-recorded up-states that are commonly used for CLAS, it is the state of ventral frontal regions that is most critical for slow oscillation generation. Our findings advance models of how CLAS leads to enhancement of slow oscillations, sleep spindles and associated cognitive benefits and offer insight into how the effectiveness of brain stimulation techniques can be improved.

Electroencephalography spectral coherence analysis during cycle ergometry in low- and high-tolerant individuals

The main objective of this study was to further understanding of the patterns of spectral connectivity during exercise in low- and high-tolerant individuals. Thirty-nine healthy individuals (i.e., 17 low- and 22 high-tolerant participants) took part in the present study. A state-of-the-art portable electroencephalography system was used to measure the brain's electrical activity during an incremental exercise test performed until the point of volitional exhaustion on a cycle ergometer. Spectral coherence was used to explore the patterns of connectivity in the frontal, central, and parietal regions of the brain. Physiological, perceptual, and affective responses were assessed throughout the exercise bout. The spontaneous eyeblink rate was also calculated prior to commencement and upon completion of the exercise trial as an indirect assessment of the dopaminergic system. The present findings indicate that high-tolerant individuals reported lower levels of perceived activation, especially during the preliminary stages of the exercise test. Participants in the high-tolerance group also reported greater levels of remembered pleasure upon completion of the exercise test. The data also revealed that high-tolerant individuals exhibited increased connectivity of theta waves between frontal, central, and parietal electrode sites and increased connectivity of beta waves, primarily within the parietal cortex. Correlational analysis indicated the possibility that low- and high-tolerant individuals make use of different neural networks to process and regulate their psychophysiological state during exercise-related situations. This strategy could potentially represent a conscious decision to downregulate affective arousal and facilitate the neural control of working muscles during situations of physical stress.

Phase-amplitude coupling of Go/Nogo task-related neuronal oscillation decreases for humans with insufficient sleep

Phase-amplitude coupling (PAC) across frequency might be associated with the long-range synchronization of brain networks, facilitating the spatiotemporal integration of multiple cell assemblies for information transmission during inhibitory control. However, sleep problems may affect these cortical information transmissions based on cross-frequency PAC, especially when humans work in environments of social isolation. This study aimed to evaluate changes in the theta-beta/gamma PAC of task-related electroencephalography (EEG) for humans with insufficient sleep. Here, we monitored the EEG signals of 60 healthy volunteers and 18 soldiers in the normal environment, performing a Go/Nogo task. Soldiers also participated in the same test in isolated cabins. These measures demonstrated theta-beta PACs between the frontal and central-parietal, and robust theta-gamma PACs between the frontal and occipital cortex. Unfortunately, these PACs significantly decreased when humans experienced insufficient sleep, which was positively correlated with the behavioral performance of inhibitory control. The evaluation of theta-beta/gamma PAC of Go/Nogo task-related EEG is necessary to help understand the different influences of sleep problems in humans.

Speech Reception in Young Children with Autism Is Selectively Indexed by a Neural Oscillation Coupling Anomaly

Communication difficulties are one of the core criteria in diagnosing autism spectrum disorder (ASD), and are often characterized by speech reception difficulties, whose biological underpinnings are not yet identified. This deficit could denote atypical neuronal ensemble activity, as reflected by neural oscillations. Atypical cross-frequency oscillation coupling, in particular, could disrupt the joint tracking and prediction of dynamic acoustic stimuli, a dual process that is essential for speech comprehension. Whether such oscillatory anomalies already exist in very young children with ASD, and with what specificity they relate to individual language reception capacity is unknown. We collected neural activity data using electroencephalography (EEG) in 64 very young children with and without ASD (mean age 3; 17 females, 47 males) while they were exposed to naturalistic-continuous speech. EEG power of frequency bands typically associated with phrase-level chunking (δ, 1-3 Hz), phonemic encoding (low-γ, 25-35 Hz), and top-down control (β, 12-20 Hz) were markedly reduced in ASD relative to typically developing (TD) children. Speech neural tracking by δ and θ (4-8 Hz) oscillations was also weaker in ASD compared with TD children. After controlling gaze-pattern differences, we found that the classical θ/γ coupling was replaced by an atypical β/γ coupling in children with ASD. This anomaly was the single most specific predictor of individual speech reception difficulties in ASD children. These findings suggest that early interventions (e.g., neurostimulation) targeting the disruption of β/γ coupling and the upregulation of θ/γ coupling could improve speech processing coordination in young children with ASD and help them engage in oral interactions.SIGNIFICANCE STATEMENT Very young children already present marked alterations of neural oscillatory activity in response to natural speech at the time of autism spectrum disorder (ASD) diagnosis. Hierarchical processing of phonemic-range and syllabic-range information (θ/γ coupling) is disrupted in ASD children. Abnormal bottom-up (low-γ) and top-down (low-β) coordination specifically predicts speech reception deficits in very young ASD children, and no other cognitive deficit.

Visuospatial attention revamps cortical processing of sound amid audiovisual uncertainty

Selective attentional biases arising from one sensory modality manifest in others. The effects of visuospatial attention, important in visual object perception, are unclear in the auditory domain during audiovisual (AV) scene processing. We investigate temporal and spatial factors that underlie such transfer neurally. Auditory encoding of random tone pips in AV scenes was addressed via a temporal response function model (TRF) of participants' electroencephalogram (N = 30). The spatially uninformative pips were associated with spatially distributed visual contrast reversals ("flips"), through asynchronous probabilistic AV temporal onset distributions. Participants deployed visuospatial selection on these AV stimuli to perform a task. A late (~300 ms) cross-modal influence over the neural representation of pips was found in the original and a replication study (N = 21). Transfer depended on selected visual input being (i) presented during or shortly after a related sound, in relatively limited temporal distributions (<165 ms); (ii) positioned across limited (1:4) visual foreground to background ratios. Neural encoding of auditory input, as a function of visual input, was largest at visual foreground quadrant sectors and lowest at locations opposite to the target. The results indicate that ongoing neural representations of sounds incorporate visuospatial attributes for auditory stream segregation, as cross-modal transfer conveys information that specifies the identity of multisensory signals. A potential mechanism is by enhancing or recalibrating the tuning properties of the auditory populations that represent them as objects. The results account for the dynamic evolution under visual attention of multisensory integration, specifying critical latencies at which relevant cortical networks operate.

Effects of noise and noise reduction on audiovisual speech perception in cochlear implant users: An ERP study

OBJECTIVE

Hearing with a cochlear implant (CI) is difficult in noisy environments, but the use of noise reduction algorithms, specifically ForwardFocus, can improve speech intelligibility. The current event-related potentials (ERP) study examined the electrophysiological correlates of this perceptual improvement.

METHODS

Ten bimodal CI users performed a syllable-identification task in auditory and audiovisual conditions, with syllables presented from the front and stationary noise presented from the sides. Brainstorm was used for spatio-temporal evaluation of ERPs.

RESULTS

CI users revealed an audiovisual benefit as reflected by shorter response times and greater activation in temporal and occipital regions at P2 latency. However, in auditory and audiovisual conditions, background noise hampered speech processing, leading to longer response times and delayed auditory-cortex-activation at N1 latency. Nevertheless, activating ForwardFocus resulted in shorter response times, reduced listening effort and enhanced superior-frontal-cortex-activation at P2 latency, particularly in audiovisual conditions.

CONCLUSIONS

ForwardFocus enhances speech intelligibility in audiovisual speech conditions by potentially allowing the reallocation of attentional resources to relevant auditory speech cues.

SIGNIFICANCE

This study shows for CI users that background noise and ForwardFocus differentially affect spatio-temporal cortical response patterns, both in auditory and audiovisual speech conditions.

Distinguishing Fine Structure and Summary Representation of Sound Textures from Neural Activity

The auditory system relies on both local and summary representations; acoustic local features exceeding system constraints are compacted into a set of summary statistics. Such compression is pivotal for sound-object recognition. Here, we assessed whether computations subtending local and statistical representations of sounds could be distinguished at the neural level. A computational auditory model was employed to extract auditory statistics from natural sound textures (i.e., fire, rain) and to generate synthetic exemplars where local and statistical properties were controlled. Twenty-four human participants were passively exposed to auditory streams while the electroencephalography (EEG) was recorded. Each stream could consist of short, medium, or long sounds to vary the amount of acoustic information. Short and long sounds were expected to engage local or summary statistics representations, respectively. Data revealed a clear dissociation. Compared with summary-based ones, auditory-evoked responses based on local information were selectively greater in magnitude in short sounds. Opposite patterns emerged for longer sounds. Neural oscillations revealed that local features and summary statistics rely on neural activity occurring at different temporal scales, faster (beta) or slower (theta-alpha). These dissociations emerged automatically without explicit engagement in a discrimination task. Overall, this study demonstrates that the auditory system developed distinct coding mechanisms to discriminate changes in the acoustic environment based on fine structure and summary representations.

Effects of social presence on behavioral, neural, and physiological aspects of empathy for pain

In mediated interactions (e.g. video calls), less information is available about the other. To investigate how this affects our empathy for one another, we conducted an electroencephalogram study, in which 30 human participants observed 1 of 5 targets undergoing painful electric stimulation, once in a direct interaction and once in a live, video-mediated interaction. We found that observers were as accurate in judging others' pain and showed as much affective empathy via video as in a direct encounter. While mu suppression, a common neural marker of empathy, was not sensitive to others' pain, theta responses to others' pain as well as skin conductance coupling between participants were reduced in the video-mediated condition. We conclude that physical proximity with its rich social cues is important for nuanced physiological resonance with the other's experience. More studies are warranted to confirm these results and to understand their behavioral significance for remote social interactions.

Altered neural oscillations underlying visuospatial processing in cerebral visual impairment

Visuospatial processing deficits are commonly observed in individuals with cerebral visual impairment, even in cases where visual acuity and visual field functions are intact. Cerebral visual impairment is a brain-based visual disorder associated with the maldevelopment of central visual pathways and structures. However, the neurophysiological basis underlying higher-order perceptual impairments in this condition has not been clearly identified, which in turn poses limits on developing rehabilitative interventions. Using combined eye tracking and EEG recordings, we assessed the profile and performance of visual search on a naturalistic virtual reality-based task. Participants with cerebral visual impairment and controls with neurotypical development were instructed to search, locate and fixate on a specific target placed among surrounding distractors at two levels of task difficulty. We analysed evoked (phase-locked) and induced (non-phase-locked) components of broadband (4-55 Hz) neural oscillations to uncover the neurophysiological basis of visuospatial processing. We found that visual search performance in cerebral visual impairment was impaired compared to controls (as indexed by outcomes of success rate, reaction time and gaze error). Analysis of neural oscillations revealed markedly reduced early-onset evoked theta [4-6 Hz] activity (within 0.5 s) regardless of task difficulty. Moreover, while induced alpha activity increased with task difficulty in controls, this modulation was absent in the cerebral visual impairment group identifying a potential neural correlate related to deficits with visual search and distractor suppression. Finally, cerebral visual impairment participants also showed a sustained induced gamma response [30-45 Hz]. We conclude that impaired visual search performance in cerebral visual impairment is associated with substantial alterations across a wide range of neural oscillation frequencies. This includes both evoked and induced components suggesting the involvement of feedforward and feedback processing as well as local and distributed levels of neural processing.

Beta resting-state functional connectivity predicts tactile spatial acuity

Tactile perception is a complex phenomenon that is processed by multiple cortical regions via the primary somatosensory cortex (S1). Although somatosensory gating in the S1 using paired-pulse stimulation can predict tactile performance, the functional relevance of cortico-cortical connections to tactile perception remains unclear. We investigated the mechanisms by which corticocortical and local networks predict tactile spatial acuity in 42 adults using magnetoencephalography (MEG). Resting-state MEG was recorded with the eyes open, whereas evoked responses were assessed using single- and paired-pulse electrical stimulation. Source data were used to estimate the S1-seed resting-state functional connectivity (rs-FC) in the whole brain and the evoked response in the S1. Two-point discrimination threshold was assessed using a custom-made device. The beta rs-FC revealed a negative correlation between the discrimination threshold and S1-superior parietal lobule, S1-inferior parietal lobule, and S1-superior temporal gyrus connection (all P < 0.049); strong connectivity was associated with better performance. Somatosensory gating of N20m was also negatively correlated with the discrimination threshold (P = 0.015), with weak gating associated with better performance. This is the first study to demonstrate that specific beta corticocortical networks functionally support tactile spatial acuity as well as the local inhibitory network.

Early maturation of sound duration processing in the infant's brain

The ability to process sound duration is crucial already at a very early age for laying the foundation for the main functions of auditory perception, such as object perception and music and language acquisition. With the availability of age-appropriate structural anatomical templates, we can reconstruct EEG source activity with much-improved reliability. The current study capitalized on this possibility by reconstructing the sources of event-related potential (ERP) waveforms sensitive to sound duration in 4- and 9-month-old infants. Infants were presented with short (200 ms) and long (300 ms) sounds equiprobable delivered in random order. Two temporally separate ERP waveforms were found to be modulated by sound duration. Generators of these waveforms were mainly located in the primary and secondary auditory areas and other language-related regions. The results show marked developmental changes between 4 and 9 months, partly reflected by scalp-recorded ERPs, but appearing in the underlying generators in a far more nuanced way. The results also confirm the feasibility of the application of anatomical templates in developmental populations.

Crossmodal plasticity following short-term monocular deprivation

A brief period of monocular deprivation (MD) induces short-term plasticity of the adult visual system. Whether MD elicits neural changes beyond visual processing is yet unclear. Here, we assessed the specific impact of MD on neural correlates of multisensory processes. Neural oscillations associated with visual and audio-visual processing were measured for both the deprived and the non-deprived eye. Results revealed that MD changed neural activities associated with visual and multisensory processes in an eye-specific manner. Selectively for the deprived eye, alpha synchronization was reduced within the first 150 ms of visual processing. Conversely, gamma activity was enhanced in response to audio-visual events only for the non-deprived eye within 100-300 ms after stimulus onset. The analysis of gamma responses to unisensory auditory events revealed that MD elicited a crossmodal upweight for the non-deprived eye. Distributed source modeling suggested that the right parietal cortex played a major role in neural effects induced by MD. Finally, visual and audio-visual processing alterations emerged for the induced component of the neural oscillations, indicating a prominent role of feedback connectivity. Results reveal the causal impact of MD on both unisensory (visual and auditory) and multisensory (audio-visual) processes and, their frequency-specific profiles. These findings support a model in which MD increases excitability to visual events for the deprived eye and audio-visual and auditory input for the non-deprived eye.

Speech prosody supports speaker selection and auditory stream segregation in a multi-talker situation

To process speech in a multi-talker environment, listeners need to segregate the mixture of incoming speech streams and focus their attention on one of them. Potentially, speech prosody could aid the segregation of different speakers, the selection of the desired speech stream, and detecting targets within the attended stream. For testing these issues, we recorded behavioral responses and extracted event-related potentials and functional brain networks from electroencephalographic signals recorded while participants listened to two concurrent speech streams, performing a lexical detection and a recognition memory task in parallel. Prosody manipulation was applied to the attended speech stream in one group of participants and to the ignored speech stream in another group. Naturally recorded speech stimuli were either intact, synthetically F0-flattened, or prosodically suppressed by the speaker. Results show that prosody - especially the parsing cues mediated by speech rate - facilitates stream selection, while playing a smaller role in auditory stream segmentation and target detection.

Acoustic deprivation modulates central gain in human auditory brainstem and cortex

Beyond reduced audibility, there is convincing evidence that the auditory system adapts according to the principles of homeostatic plasticity in response to a hearing loss. Such compensatory changes include modulation of central auditory gain mechanisms. Earplugging is a common experimental method that has been used to introduce a temporary, reversible hearing loss that induces changes consistent with central gain modulation. In the present study, young, normal-hearing adult participants wore a unilateral earplug for two weeks, during which we measured changes in the acoustic reflex threshold (ART), loudness perception, and cortically-evoked (40 Hz) auditory steady-state response (ASSR) to assess potential modulation in central gain with reduced peripheral input. The ART decreased on average by 8 to 10 dB during the treatment period, with modest increases in loudness perception after one week but not after two weeks of earplug use. Significant changes in both the magnitude and hemispheric laterality of source-localized cortical ASSR measures revealed asymmetrical changes in stimulus-driven cortical activity over time. The ART results following unilateral earplugging are consistent with the literature and suggest that homeostatic plasticity is evident in the brainstem. The novel findings from the cortical ASSR in the present study indicates that reduced peripheral input induces adaptive homeostatic plasticity reflected as both an increase in central gain in the auditory brainstem and reduced cortical activity ipsilateral to the deprived ear. Both the ART and the novel use of the 40-Hz ASSR provide sensitive measures of central gain modulation in the brainstem and cortex of young, normal hearing listeners, and thus may be useful in future studies with other clinical populations.

Central-positive complexes in ECT-induced seizures: Possible evidence for thalamocortical mechanisms

OBJECTIVE

Central-positive complexes (CPCs) are elicited during electroconvulsive therapy (ECT) as generalized high-amplitude waveforms with maximum positive voltage over the vertex. While these complexes have been qualitatively assessed in previous literature, quantitative analyses are lacking. This study aims to characterize CPCs across temporal, spatial, and spectral domains.

METHODS

High-density 64-electrode electroencephalogram (EEG) recordings during 50 seizures acquired from 11 patients undergoing right unilateral ECT allowed for evaluation of spatiotemporal characteristics of CPCs via source localization and spectral analysis.

RESULTS

Peak-amplitude CPC scalp topology was consistent across seizures, showing maximal positive polarity over the midline fronto-central region and maximal negative polarity over the suborbital regions. The sources of these peak potentials were localized to the bilateral medial thalamus and cingulate cortical regions. Delta, beta, and gamma oscillations were correlated with the peak amplitude of CPCs during seizures induced during ketamine, whereas delta and gamma oscillations were associated with CPC peaks during etomidate anesthesia (excluding the dose-charge titration).

CONCLUSIONS

Our findings demonstrate the consistency of CPC presence across participant, stimulus charge, time, and anesthetic agent, with peaks localized to bilateral medial thalamus and cingulate cortical regions and associated with delta, beta, and gamma band oscillations (depending on the anesthetic condition).

SIGNIFICANCE

The consistency and reproducibility of CPCs offers ECT as a new avenue for studying the dynamics of generalized seizure activity and thalamocortical networks.

Psychophysiological mechanisms underlying the effects of outdoor green and virtual green exercise during self-paced walking

Physical activity in the presence of nature can lead to additional, more distinct mental health benefits such as lower stress and anxiety levels and an overall better psychological state when compared to indoor physical activity. Interestingly, the brain mechanisms underlying the effects of green exercise (GE) and virtual green exercise (VGE) on psychological responses are hitherto under-researched. The present study sought to deepen our understanding of the brain mechanisms underlying the effects of GE and VGE during self-paced walking. Thirty individuals took part in the present study. Two experimental (i.e., GE and VGE) and a control condition (CO) were administered in a randomized and counterbalanced order. Participants were asked to walk for ¼ mile at a pace of their choosing and self-report their psychological states at various timepoints during the exercise trials. Heart rate variability and the brain's electrical activity were monitored continuously throughout the experimental protocol. An accelerometer was used to identify the beginning and end of each step. The results indicate that both experimental manipulations were sufficient to influence the majority of psychological and psychophysiological parameters. The most pronounced effects were identified for GE when compared to CO and VGE. VGE was also sufficient to evoke positive emotions and partially reallocate attention externally, although such effects were less pronounced than those observed for GE. The brain mechanisms underlying the abovementioned psychophysiological responses may be associated with significant changes in theta activity throughout the cerebral cortex as well as increased connectivity in the frontal and parietal areas.

Effects of individualized brain anatomies and EEG electrode positions on inferred activity of the primary auditory cortex

Due to its high temporal resolution and non-invasive nature, electroencephalography (EEG) is considered a method of great value for the field of auditory cognitive neuroscience. In performing source space analyses, localization accuracy poses a bottleneck, which precise forward models based on individualized attributes such as subject anatomy or electrode locations aim to overcome. Yet acquiring anatomical images or localizing EEG electrodes requires significant additional funds and processing time, making it an oftentimes inaccessible asset. Neuroscientific software offers template solutions, on which analyses can be based. For localizing the source of auditory evoked responses, we here compared the results of employing such template anatomies and electrode positions versus the subject-specific ones, as well as combinations of the two. All considered cases represented approaches commonly used in electrophysiological studies. We considered differences between two commonly used inverse solutions (dSPM, sLORETA) and targeted the primary auditory cortex; a notoriously small cortical region that is located within the lateral sulcus, thus particularly prone to errors in localization. Through systematical comparison of early evoked component metrics and spatial leakage, we assessed how the individualization steps impacted the analyses outcomes. Both electrode locations as well as subject anatomies were found to have an effect, which though varied based on the configuration considered. When comparing the inverse solutions, we moreover found that dSPM more consistently benefited from individualization of subject morphologies compared to sLORETA, suggesting it to be the better choice for auditory cortex localization.

The global neuronal workspace as a broadcasting network

A new strategy for moving forward in the characterization of the global neuronal workspace (GNW) is proposed. According to Dehaene, Changeux, and colleagues (Dehaene, 2014, pp. 304, 312; Dehaene & Changeux, 2004, 2005), broadcasting is the main function of the GNW. However, the dynamic network properties described by recent graph theoretic GNW models are consistent with many large-scale communication processes that are different from broadcasting. We propose to apply a different graph theoretic approach, originally developed for optimizing information dissemination in communication networks, which can be used to identify the pattern of frequency and phase-specific directed functional connections that the GNW would exhibit only if it were a broadcasting network.

Detection of Brain Network Communities During Natural Speech Comprehension From Functionally Aligned EEG Sources

In recent years, electroencephalograph (EEG) studies on speech comprehension have been extended from a controlled paradigm to a natural paradigm. Under the hypothesis that the brain can be approximated as a linear time-invariant system, the neural response to natural speech has been investigated extensively using temporal response functions (TRFs). However, most studies have modeled TRFs in the electrode space, which is a mixture of brain sources and thus cannot fully reveal the functional mechanism underlying speech comprehension. In this paper, we propose methods for investigating the brain networks of natural speech comprehension using TRFs on the basis of EEG source reconstruction. We first propose a functional hyper-alignment method with an additive average method to reduce EEG noise. Then, we reconstruct neural sources within the brain based on the EEG signals to estimate TRFs from speech stimuli to source areas, and then investigate the brain networks in the neural source space on the basis of the community detection method. To evaluate TRF-based brain networks, EEG data were recorded in story listening tasks with normal speech and time-reversed speech. To obtain reliable structures of brain networks, we detected TRF-based communities from multiple scales. As a result, the proposed functional hyper-alignment method could effectively reduce the noise caused by individual settings in an EEG experiment and thus improve the accuracy of source reconstruction. The detected brain networks for normal speech comprehension were clearly distinctive from those for non-semantically driven (time-reversed speech) audio processing. Our result indicates that the proposed source TRFs can reflect the cognitive processing of spoken language and that the multi-scale community detection method is powerful for investigating brain networks.

Analysis of pilots' EEG map in take-off and landing tasks

The take-off and landing phases are considered the critical stages of aircraft flight. To ensure flight efficiency and safety in the critical stages, this research proposes a method for analyzing and monitoring pilot flight status by β-wave. The focus of the study is β potential changes on the EEG map. First, the proportion of β-wave in the electroencephalogram (EEG) of pilots during take-off and landing increases significantly. Second, the EEG map accurately and intuitively reflects the spatial distribution of potential changes in brain regions. Finally, correlation and machine learning are used for further research of β-wave. The conclusions show that the significant changes in the β-wave caused by take-off and landing can be seen in the EEG map to identify and adjust the pilot's state. Therefore, this research provides more accurate and effective reference information (like the EEG map, correlation and machine learning) for efficient and safe flight training in the critical stages.

Aging-Related Dissociation of Spatial and Temporal N400 in Sentence-Level Semantic Processing: Evidence From Source Analyses

Age-related differences in sentence-level lexical-semantic processes have been extensively studied, based on the N400 component of event-related potential (ERP). However, there is still a lack of understanding in this regard at the brain-region level. This study explores aging effects on sentence-level semantic processing by comparing the characteristics of the N400 ERP component and brain engagement patterns within individual N400 time windows for two age groups (16 younger adults aged 24.38 ± 3.88 years and 15 older adults aged 67.00 ± 5.04 years) during sentence processing with different plausibility conditions. Our results demonstrated that the N400 effect according to the plausibility condition occurred in different temporal windows in the two age groups, with a delay in the older group. Moreover, it was identified that there was a distinct difference between the groups in terms of the source location of the condition-dependent N400 effect even though no significant difference was derived in its magnitude itself at the sensor-level. Interestingly, the source analysis results indicated that the two groups involved different functional networks to resolve the same semantic violations: the younger group activated the regions corresponding to the typical lexical-semantic network more, whereas the older group recruited the regions belonging to the multiple-demand network more. The findings of this study could be used as a basis for understanding the aging brain in a linguistic context.

Side-of-Implantation Effect on Functional Asymmetry in the Auditory Cortex of Single-Sided Deaf Cochlear-Implant Users

Cochlear implants (CIs) allow to restore the hearing function in profoundly deaf individuals. Due to the degradation of the stimulus by CI signal processing, implanted individuals with single-sided deafness (SSD) have the specific challenge that the input highly differs between their ears. The present study compared normal-hearing (NH) listeners (N = 10) and left- and right-ear implanted SSD CI users (N = 10 left, N = 9 right), to evaluate cortical speech processing between CI- and NH-ears and to explore for side-of-implantation effects. The participants performed a two-deviant oddball task, separately with the left and the right ear. Auditory event-related potentials (ERPs) in response to syllables were compared between proficient and non-proficient CI users, as well as between CI and NH ears. The effect of the side of implantation was analysed on the sensor and the source level. CI proficiency could be distinguished based on the ERP amplitudes of the N1 and the P3b. Moreover, syllable processing via the CI ear, when compared to the NH ear, resulted in attenuated and delayed ERPs. In addition, the left-ear implanted SSD CI users revealed an enhanced functional asymmetry in the auditory cortex than right-ear implanted SSD CI users, regardless of whether the syllables were perceived via the CI or the NH ear. Our findings reveal that speech-discrimination proficiency in SSD CI users can be assessed by N1 and P3b ERPs. The results contribute to a better understanding of the rehabilitation success in SSD CI users by showing that cortical speech processing in SSD CI users is affected by CI-related stimulus degradation and experience-related functional changes in the auditory cortex.

Neural Networks to Recognize Patterns in Topographic Images of Cortical Electrical Activity of Patients with Neurological Diseases

Software such as EEGLab has enabled the treatment and visualization of the tracing and cortical topography of the electroencephalography (EEG) signals. In particular, the topography of the cortical electrical activity is represented by colors, which make it possible to identify functional differences between cortical areas and to associate them with various diseases. The use of cortical topography with EEG origin in the investigation of diseases is often not used due to the representation of colors making it difficult to classify the disease. Thus, the analyses have been carried out, mainly, based on the EEG tracings. Therefore, a computer system that recognizes disease patterns through cortical topography can be a solution to the diagnostic aid. In view of this, this study compared five models of Convolutional Neural Networks (CNNs), namely: Inception v3, SqueezeNet, LeNet, VGG-16 and VGG-19, in order to know the patterns in cortical topography images obtained with EEG, in Parkinson's disease, Depression and Bipolar Disorder. SqueezeNet performed better in the 3 diseases analyzed, with Parkinson's disease being better evaluated for Accuracy (88.89%), Precison (86.36%), Recall (91.94%) and F1 Score (89.06%), the other CNNs had less performance. In the analysis of the values of the Area under ROC Curve (AUC), SqueezeNet reached (93.90%) for Parkinson's disease, (75.70%) for Depression and (72.10%) for Bipolar Disorder. We understand that there is the possibility of classifying neurological diseases from cortical topographies with the use of CNNs and, thus, creating a computational basis for the implementation of software for screening and possible diagnostic assistance.

The timecourse of multisensory speech processing in unilaterally stimulated cochlear implant users revealed by ERPs

•

Both normal-hearing (NH) and cochlear implant (CI) users show a clear benefit in multisensory speech processing.

•

Group differences in ERP topographies and cortical source activation suggest distinct audiovisual speech processing in CI users when compared to NH listeners.

•

Electrical neuroimaging, including topographic and ERP source analysis, provides a suitable tool to study the timecourse of multisensory speech processing in CI users.

A cochlear implant (CI) is an auditory prosthesis which can partially restore the auditory function in patients with severe to profound hearing loss. However, this bionic device provides only limited auditory information, and CI patients may compensate for this limitation by means of a stronger interaction between the auditory and visual system. To better understand the electrophysiological correlates of audiovisual speech perception, the present study used electroencephalography (EEG) and a redundant target paradigm. Postlingually deafened CI users and normal-hearing (NH) listeners were compared in auditory, visual and audiovisual speech conditions. The behavioural results revealed multisensory integration for both groups, as indicated by shortened response times for the audiovisual as compared to the two unisensory conditions. The analysis of the N1 and P2 event-related potentials (ERPs), including topographic and source analyses, confirmed a multisensory effect for both groups and showed a cortical auditory response which was modulated by the simultaneous processing of the visual stimulus. Nevertheless, the CI users in particular revealed a distinct pattern of N1 topography, pointing to a strong visual impact on auditory speech processing. Apart from these condition effects, the results revealed ERP differences between CI users and NH listeners, not only in N1/P2 ERP topographies, but also in the cortical source configuration. When compared to the NH listeners, the CI users showed an additional activation in the visual cortex at N1 latency, which was positively correlated with CI experience, and a delayed auditory-cortex activation with a reversed, rightward functional lateralisation. In sum, our behavioural and ERP findings demonstrate a clear audiovisual benefit for both groups, and a CI-specific alteration in cortical activation at N1 latency when auditory and visual input is combined. These cortical alterations may reflect a compensatory strategy to overcome the limited CI input, which allows the CI users to improve the lip-reading skills and to approximate the behavioural performance of NH listeners in audiovisual speech conditions. Our results are clinically relevant, as they highlight the importance of assessing the CI outcome not only in auditory-only, but also in audiovisual speech conditions.

Directionality of the injected current targeting the P20/N20 source determines the efficacy of 140 Hz transcranial alternating current stimulation (tACS)-induced aftereffects in the somatosensory cortex

Interindividual anatomical differences in the human cortex can lead to suboptimal current directions and may result in response variability of transcranial electrical stimulation methods. These differences in brain anatomy require individualized electrode stimulation montages to induce an optimal current density in the targeted area of each individual subject. We aimed to explore the possible modulatory effects of 140 Hz transcranial alternating current stimulation (tACS) on the somatosensory cortex using personalized multi-electrode stimulation montages. In two randomized experiments using either tactile finger or median nerve stimulation, we measured by evoked potentials the plasticity aftereffects and oscillatory power changes after 140 Hz tACS at 1.0 mA as compared to sham stimulation (n = 17, male = 9). We found a decrease in the power of oscillatory mu-rhythms during and immediately after tactile discrimination tasks, indicating an engagement of the somatosensory system during stimulus encoding. On a group level both the oscillatory power and the evoked potential amplitudes were not modulated by tACS neither after tactile finger stimulation nor after median nerve stimulation as compared to sham stimulation. On an individual level we could however demonstrate that lower angular difference (i.e., differences between the injected current vector in the target region and the source orientation vector) is associated with significantly higher changes in both P20/N20 and N30/P30 source activities. Our findings suggest that the higher the directionality of the injected current correlates to the dipole orientation the greater the tACS-induced aftereffects are.

Ear-EEG compares well to cap-EEG in recording auditory ERPs: a quantification of signal loss

Objective:Ear-EEG (Electroencephalography) allows to record brain activity using only a few electrodes located close to the ear. Ear-EEG is comfortable and easy to apply, facilitating beyond-the-lab EEG recordings in everyday life. With the unobtrusive setup, a person wearing it can blend in, allowing unhindered EEG recordings in social situations. However, compared to classical cap-EEG, only a small part of the head is covered with electrodes. Most scalp positions that are known from established EEG research are not covered by ear-EEG electrodes, making the comparison between the two approaches difficult and might hinder the transition from cap-based lab studies to ear-based beyond-the-lab studies.Approach:We here provide a reference data-set comparing ear-EEG and cap-EEG directly for four different auditory event-related potentials (ERPs): N100, MMN, P300 and N400. We show how the ERPs are reflected when using only electrodes around the ears.Main results:We find that significant condition differences for all ERP-components could be recorded using only ear-electrodes. The effect sizes were moderate to high on the single subject level. Morphology and temporal evolution of signals recorded from around-the-ear resemble highly those from standard scalp-EEG positions. We found a reduction in effect size (signal loss) for the ear-EEG electrodes compared to cap-EEG of 21-44%. The amount of signal loss depended on the ERP-component; we observed the lowest percentage signal loss for the N400 and the highest percentage signal loss for the N100. Our analysis further shows that no single channel position around the ear is optimal for recording all ERP-components or all participants, speaking in favor of multi-channel ear-EEG solutions.Significance:Our study provides reference results for future studies employing ear-EEG.

Is sensor space analysis good enough? Spatial patterns as a tool for assessing spatial mixing of EEG/MEG rhythms

Analyzing non-invasive recordings of electroencephalography (EEG) and magnetoencephalography (MEG) directly in sensor space, using the signal from individual sensors, is a convenient and standard way of working with this type of data. However, volume conduction introduces considerable challenges for sensor space analysis. While the general idea of signal mixing due to volume conduction in EEG/MEG is recognized, the implications have not yet been clearly exemplified. Here, we illustrate how different types of activity overlap on the level of individual sensors. We show spatial mixing in the context of alpha rhythms, which are known to have generators in different areas of the brain. Using simulations with a realistic 3D head model and lead field and data analysis of a large resting-state EEG dataset, we show that electrode signals can be differentially affected by spatial mixing by computing a sensor complexity measure. While prominent occipital alpha rhythms result in less heterogeneous spatial mixing on posterior electrodes, central electrodes show a diversity of rhythms present. This makes the individual contributions, such as the sensorimotor mu-rhythm and temporal alpha rhythms, hard to disentangle from the dominant occipital alpha. Additionally, we show how strong occipital rhythms can contribute the majority of activity to frontal channels, potentially compromising analyses that are solely conducted in sensor space. We also outline specific consequences of signal mixing for frequently used assessment of power, power ratios and connectivity profiles in basic research and for neurofeedback application. With this work, we hope to illustrate the effects of volume conduction in a concrete way, such that the provided practical illustrations may be of use to EEG researchers to in order to evaluate whether sensor space is an appropriate choice for their topic of investigation.

Functional and structural brain network correlates of visual hallucinations in Lewy body dementia

Visual hallucinations are a common feature of Lewy body dementia. Previous studies have shown that visual hallucinations are highly specific in differentiating Lewy body dementia from Alzheimer’s disease dementia and Alzheimer–Lewy body mixed pathology cases. Computational models propose that impairment of visual and attentional networks is aetiologically key to the manifestation of visual hallucinations symptomatology. However, there is still a lack of experimental evidence on functional and structural brain network abnormalities associated with visual hallucinations in Lewy body dementia.

We used EEG source localization and network based statistics to assess differential topographical patterns in Lewy body dementia between 25 participants with visual hallucinations and 17 participants without hallucinations. Diffusion tensor imaging was used to assess structural connectivity between thalamus, basal forebrain and cortical regions belonging to the functionally affected network component in the hallucinating group, as assessed with network based statistics. The number of white matter streamlines within the cortex and between subcortical and cortical regions was compared between hallucinating and not hallucinating groups and correlated with average EEG source connectivity of the affected subnetwork. Moreover, modular organization of the EEG source network was obtained, compared between groups and tested for correlation with structural connectivity.

Network analysis showed that compared to non-hallucinating patients, those with hallucinations feature consistent weakened connectivity within the visual ventral network, and between this network and default mode and ventral attentional networks, but not between or within attentional networks. The occipital lobe was the most functionally disconnected region. Structural analysis yielded significantly affected white matter streamlines connecting the cortical regions to the nucleus basalis of Meynert and the thalamus in hallucinating compared to not hallucinating patients. The number of streamlines in the tract between the basal forebrain and the cortex correlated with cortical functional connectivity in non-hallucinating patients, while a correlation emerged for the white matter streamlines connecting the functionally affected cortical regions in the hallucinating group.

This study proposes, for the first time, differential functional networks between hallucinating and not hallucinating Lewy body dementia patients, and provides empirical evidence for existing models of visual hallucinations. Specifically, the outcome of the present study shows that the hallucinating condition is associated with functional network segregation in Lewy body dementia and supports the involvement of the cholinergic system as proposed in the current literature.

Modality-specific tracking of attention and sensory statistics in the human electrophysiological spectral exponent

A hallmark of electrophysiological brain activity is its 1/f-like spectrum - power decreases with increasing frequency. The steepness of this 'roll-off' is approximated by the spectral exponent, which in invasively recorded neural populations reflects the balance of excitatory to inhibitory neural activity (E:I balance). Here, we first establish that the spectral exponent of non-invasive electroencephalography (EEG) recordings is highly sensitive to general (i.e., anaesthesia-driven) changes in E:I balance. Building on the EEG spectral exponent as a viable marker of E:I, we then demonstrate its sensitivity to the focus of selective attention in an EEG experiment during which participants detected targets in simultaneous audio-visual noise. In addition to these endogenous changes in E:I balance, EEG spectral exponents over auditory and visual sensory cortices also tracked auditory and visual stimulus spectral exponents, respectively. Individuals' degree of this selective stimulus-brain coupling in spectral exponents predicted behavioural performance. Our results highlight the rich information contained in 1/f-like neural activity, providing a window into diverse neural processes previously thought to be inaccessible in non-invasive human recordings.

Modality-specific tracking of attention and sensory statistics in the human electrophysiological spectral exponent

A hallmark of electrophysiological brain activity is its 1/f-like spectrum - power decreases with increasing frequency. The steepness of this 'roll-off' is approximated by the spectral exponent, which in invasively recorded neural populations reflects the balance of excitatory to inhibitory neural activity (E:I balance). Here, we first establish that the spectral exponent of non-invasive electroencephalography (EEG) recordings is highly sensitive to general (i.e., anaesthesia-driven) changes in E:I balance. Building on the EEG spectral exponent as a viable marker of E:I, we then demonstrate its sensitivity to the focus of selective attention in an EEG experiment during which participants detected targets in simultaneous audio-visual noise. In addition to these endogenous changes in E:I balance, EEG spectral exponents over auditory and visual sensory cortices also tracked auditory and visual stimulus spectral exponents, respectively. Individuals' degree of this selective stimulus-brain coupling in spectral exponents predicted behavioural performance. Our results highlight the rich information contained in 1/f-like neural activity, providing a window into diverse neural processes previously thought to be inaccessible in non-invasive human recordings.

Visual search performance in cerebral visual impairment is associated with altered alpha band oscillations

Individuals with cerebral visual impairment (CVI) often present with deficits related to visuospatial processing. However, the neurophysiological basis underlying these higher order perceptual dysfunctions have not been clearly identified. We assessed visual search performance using a novel virtual reality based task paired with eye tracking to simulate the exploration of a naturalistic scene (a virtual toy box). This was combined with electroencephalography (EEG) recordings and an analysis pipeline focusing on time frequency decomposition of alpha oscillatory activity. We found that individuals with CVI showed an overall impairment in visual search performance (as indexed by decreased success rate, as well as increased reaction time, visual search area, and gaze error) compared to controls with neurotypical development. Analysis of captured EEG activity following stimulus onset revealed that in the CVI group, there was a distinct lack of strong and well defined posterior alpha desynchronization; an important signal involved in the coordination of neural activity related to visual processing. Finally, an exploratory analysis revealed that in CVI, the magnitude of alpha desynchronization was associated with impaired visual search performance as well as decreased volume of specific thalamic nuclei implicated in visual processing. These results suggest that impairments in visuospatial processing related to visual search in CVI are associated with alterations in alpha band oscillations as well as early neurological injury at the level of visual thalamic nuclei.

Team Flow Is a Unique Brain State Associated with Enhanced Information Integration and Interbrain Synchrony

Team flow occurs when a group functions in a high task engagement to achieve a goal, commonly seen in performance and sports. Team flow can enable enhanced positive experiences, as compared with individual flow or regular socializing. However, the neural basis for this enhanced behavioral state remains unclear. Here, we identified neural correlates (NCs) of team flow in human participants using a music rhythm task with electroencephalogram hyperscanning. Experimental manipulations held the motor task constant while disrupting the corresponding hedonic music to interfere with the flow state or occluding the partner's positive feedback to impede team interaction. We validated these manipulations by using psychometric ratings and an objective measure for the depth of flow experience, which uses the auditory-evoked potential (AEP) of a task-irrelevant stimulus. Spectral power analysis at both the scalp sensors and anatomic source levels revealed higher β-γ power specific to team flow in the left middle temporal cortex (L-MTC). Causal interaction analysis revealed that the L-MTC is downstream in information processing and receives information from areas encoding the flow or social states. The L-MTC significantly contributes to integrating information. Moreover, we found that team flow enhances global interbrain integrated information (II) and neural synchrony. We conclude that the NCs of team flow induce a distinct brain state. Our results suggest a neurocognitive mechanism to create this unique experience.

Causal role of frontal-midline theta in cognitive effort: a pilot study

Frontal-midline theta (FMT) oscillations are increased in amplitude during cognitive control tasks. Since these tasks often conflate cognitive control and cognitive effort, it remains unknown if FMT amplitude maps onto cognitive control or effort. To address this gap, we utilized the glucose facilitation effect to manipulate cognitive effort without changing cognitive control demands. We performed a single-blind, crossover human study in which we provided participants with a glucose drink (control session: volume-matched water) to reduce cognitive effort and improve performance on a visuospatial working memory task. Following glucose consumption, participants performed the working memory task at multiple time points of a 3-h window to sample across the rise and fall of blood glucose. Using high-density electroencephalography (EEG), we calculated FMT amplitude during the delay period of the working memory task. Source localization analysis revealed that FMT oscillations originated from bilateral prefrontal cortex. We found that glucose increased working memory accuracy during the high working memory load condition but decreased FMT amplitude. The decrease in FMT amplitude coincided with both peak blood glucose elevation and peak performance enhancement for glucose relative to water. Therefore, the positive association between glucose consumption and task performance provided causal evidence that the amplitude of FMT oscillations may correspond to cognitive effort, rather than cognitive control. Due to the COVID-19 pandemic, data collection was terminated prematurely; the preliminary nature of these findings due to small sample size should be contextualized by rigorous experimental design and use of a novel causal perturbation to dissociate cognitive effort and cognitive control.NEW & NOTEWORTHY We investigated whether frontal-midline theta (FMT) oscillations tracked with cognitive control or cognitive effort by simultaneous manipulation of cognitive control demands in a working memory task and causal perturbation of cognitive effort using glucose consumption. Facilitation of performance from glucose consumption corresponded with decreased FMT amplitude, which provided preliminary causal evidence for a relationship between FMT amplitude with cognitive effort.

Rhythmic Modulation of Visual Perception by Continuous Rhythmic Auditory Stimulation

At any given moment our sensory systems receive multiple, often rhythmic, inputs from the environment. Processing of temporally structured events in one sensory modality can guide both behavioral and neural processing of events in other sensory modalities, but whether this occurs remains unclear. Here, we used human electroencephalography (EEG) to test the cross-modal influences of a continuous auditory frequency-modulated (FM) sound on visual perception and visual cortical activity. We report systematic fluctuations in perceptual discrimination of brief visual stimuli in line with the phase of the FM-sound. We further show that this rhythmic modulation in visual perception is related to an accompanying rhythmic modulation of neural activity recorded over visual areas. Importantly, in our task, perceptual and neural visual modulations occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. As such, the results provide a critical validation for the existence and functional role of cross-modal entrainment and demonstrates its utility for organizing the perception of multisensory stimulation in the natural environment.SIGNIFICANCE STATEMENT Our sensory environment is filled with rhythmic structures that are often multi-sensory in nature. Here, we show that the alignment of neural activity to the phase of an auditory frequency-modulated (FM) sound has cross-modal consequences for vision: yielding systematic fluctuations in perceptual discrimination of brief visual stimuli that are mediated by accompanying rhythmic modulation of neural activity recorded over visual areas. These cross-modal effects on visual neural activity and perception occurred without any abrupt and salient onsets in the energy of the auditory stimulation and without any rhythmic structure in the visual stimulus. The current work shows that continuous auditory fluctuations in the natural environment can provide a pacing signal for neural activity and perception across the senses.

An Analytical Framework of Tonal and Rhythmic Hierarchy in Natural Music Using the Multivariate Temporal Response Function

Even without formal training, humans experience a wide range of emotions in response to changes in musical features, such as tonality and rhythm, during music listening. While many studies have investigated how isolated elements of tonal and rhythmic properties are processed in the human brain, it remains unclear whether these findings with such controlled stimuli are generalizable to complex stimuli in the real world. In the current study, we present an analytical framework of a linearized encoding analysis based on a set of music information retrieval features to investigate the rapid cortical encoding of tonal and rhythmic hierarchies in natural music. We applied this framework to a public domain EEG dataset (OpenMIIR) to deconvolve overlapping EEG responses to various musical features in continuous music. In particular, the proposed framework investigated the EEG encoding of the following features: tonal stability, key clarity, beat, and meter. This analysis revealed a differential spatiotemporal neural encoding of beat and meter, but not of tonal stability and key clarity. The results demonstrate that this framework can uncover associations of ongoing brain activity with relevant musical features, which could be further extended to other relevant measures such as time-resolved emotional responses in future studies.

Advances in Electrical Source Imaging: A Review of the Current Approaches, Applications and Challenges

Brain source localization has been consistently implemented over the recent years to elucidate complex brain operations, pairing the high temporal resolution of the EEG with the high spatial estimation of the estimated sources. This review paper aims to present the basic principles of Electrical source imaging (ESI) in the context of the recent progress for solving the forward and the inverse problems, and highlight the advantages and limitations of the different approaches. As such, a synthesis of the current state-of-the-art methodological aspects is provided, offering a complete overview of the present advances with regard to the ESI solutions. Moreover, the new dimensions for the analysis of the brain processes are indicated in terms of clinical and cognitive ESI applications, while the prevailing challenges and limitations are thoroughly discussed, providing insights for future approaches that could help to alleviate methodological and technical shortcomings.

A novel approach of CNN for human motor imagery recognition using the virtual electrode pairs

In order to develop an efficient brain-computer interface system, the brain activity measured by electroencephalography needs to be accurately decoded. In this paper, a motor imagery classification approach is proposed, combining virtual electrodes on the cortex layer with a convolutional neural network; this can effectively improve the decoding performance of the brain-computer interface system. A three layer (cortex, skull, and scalp) head volume conduction model was established by using the symmetric boundary element method to map the scalp signal to the cortex area. Nine pairs of virtual electrodes were created on the cortex layer, and the features of the time and frequency sequence from the virtual electrodes were extracted by performing time-frequency analysis. Finally, the convolutional neural network was used to classify motor imagery tasks. The results show that the proposed approach is convergent in both the training model and the test model. Based on the Physionet motor imagery database, the averaged accuracy can reach 98.32% for a single subject, while the averaged values of accuracy, Kappa, precision, recall, and F1-score on the group-wise are 96.23%, 94.83%, 96.21%, 96.13%, and 96.14%, respectively. Based on the High Gamma database, the averaged accuracy has achieved 96.37% and 91.21% at the subject and group levels, respectively. Moreover, this approach is superior to those of other studies on the same database, which suggests robustness and adaptability to individual variability.

Native non-prototypicality in vowel perception induces prominent neuromagnetic mismatch intensities in non-native speakers: a pilot study

Neural mismatch response resulting from the difference between prediction and observation is related to change detection and discrimination. Robust neuromagnetic brain activity of auditory mismatch-related perception occurs in response to non-prototypical vowels in across-category contrasts for first-language speakers. However, whether this non-prototypicality effect applies to within-category vowel perception remains to be elucidated. Here, healthy Japanese adults (n = 7) were subjected to magnetoencephalography (MEG) while watching a silent movie, and passively listened to synthesized English vowels /i/. We observed the source-level mismatch effect to the mid-high near-front vowel deviant [ɪ] with the most non-prototypical, unspecified feature in the participants' native language system. The mismatch effect recruited the left posterior superior temporal sulcus with a peak latency of 225 ms post-stimulus onset. We further studied whether a longer F1 distance between vowel pairs would increase mismatch-activated intensities, however, we did not observe neuromagnetic changes when the prototypical anchor standard [i] was compared with three non-prototypical deviants differing in first resonance frequency (F1) values. Our results indicate that an F1 increase in within-category upper front vowel perception is a strong activator of mismatch responses measured by source-level activated intensities for non-native listeners.

Who said what? The effects of speech tempo on target detection and information extraction in a multi-talker situation: An ERP and functional connectivity study

People with normal hearing can usually follow one of the several concurrent speakers. Speech tempo affects both the separation of concurrent speech streams and information extraction from them. The current study varied the tempo of two concurrent speech streams to investigate these processes in a multi-talker situation. Listeners performed a target-detection and a content-tracking task, while target-related ERPs and functional brain networks sensitive to speech tempo were extracted from the EEG signal. At slower than normal speech tempo, building the two streams required longer processing times, and possibly the utilization of higher-order, for example, syntactic and semantic cues. The observed longer reaction times and higher connectivity strength in a theta band network associated with frontal control over auditory/speech processing are compatible with this notion. With increasing tempo, target detection performance decreased and the N2b and the P3b amplitudes increased. These data suggest an increased need for strictly allocating target-detection-related resources at higher tempo. This was also reflected by the observed increase in the strength of gamma-band networks within and between frontal, temporal, and cingular areas. At the fastest tested speech tempo, there was a sharp drop in recognition memory performance, while target detection performance increased compared to the normal speech tempo. This was accompanied by a significant increase in the strength of a low alpha network associated with the suppression of task-irrelevant speech. These results suggest that participants prioritized the immediate target detection task over the continuous content tracking, likely due to some capacity limit reached the fastest speech tempo.

Rhythm Complexity Modulates Behavioral and Neural Dynamics During Auditory–Motor Synchronization

We addressed how rhythm complexity influences auditory–motor synchronization in musically trained individuals who perceived and produced complex rhythms while EEG was recorded. Participants first listened to two-part auditory sequences (Listen condition). Each part featured a single pitch presented at a fixed rate; the integer ratio formed between the two rates varied in rhythmic complexity from low (1:1) to moderate (1:2) to high (3:2). One of the two parts occurred at a constant rate across conditions. Then, participants heard the same rhythms as they synchronized their tapping at a fixed rate (Synchronize condition). Finally, they tapped at the same fixed rate (Motor condition). Auditory feedback from their taps was present in all conditions. Behavioral effects of rhythmic complexity were evidenced in all tasks; detection of missing beats (Listen) worsened in the most complex (3:2) rhythm condition, and tap durations (Synchronize) were most variable and least synchronous with stimulus onsets in the 3:2 condition. EEG power spectral density was lowest at the fixed rate during the 3:2 rhythm and greatest during the 1:1 rhythm (Listen and Synchronize). ERP amplitudes corresponding to an N1 time window were smallest for the 3:2 rhythm and greatest for the 1:1 rhythm (Listen). Finally, synchronization accuracy (Synchronize) decreased as amplitudes in the N1 time window became more positive during the high rhythmic complexity condition (3:2). Thus, measures of neural entrainment corresponded to synchronization accuracy, and rhythmic complexity modulated the behavioral and neural measures similarly.

Local syntactic violations evoke fast mismatch-related neural activity detected by optical neuroimaging

It remains to be investigated whether syntax-related mismatch activity would be evoked in event-related optical signals by syntactic violations that deviate from our language knowledge and expectations. In the current study, we have employed fast optical neuroimaging with a frequency-domain oximeter to examine whether syntactic violations of English bare infinitives in the non-finite complement clause would trigger syntax-related mismatch effects. Recorded sentences of bare or full infinitive structures (without or with the 'to' infinitival marker) with syntactically correct or incorrect versions and non-syntactic lexical items (verbs) were presented to native speakers of English (n = 8) during silent movie viewing as a passive oddball task. The analysis of source strength (i.e., minimum norm current amplitudes) revealed that the syntactic category violations of bare object infinitives led to significantly more robust optical mismatch effects than the other syntactic violation and non-structural, lexical elements. This mismatch response had a peak latency of 186 ms in the left anterior superior temporal gyrus. In combination with our prior MEG report (Kubota et al. in Neurosci Lett 662:195-204, 2018), the present optical neuroimaging findings show that syntactic marking (unmarked-to-marked) violations of the bare object infinitive against the rule of the mental grammar enhance the signal strength exactly in the same manner seen with MEG scanning, including the peak latency of mismatch activity and the activated area of the brain.

Progesterone modulates theta oscillations in the frontal-parietal network

The neuroactive metabolites of the steroid hormones progesterone (P4) and testosterone (T) are GABAergic modulators that influence cognition, yet, the specific effect of P4 and T on brain network activity remains poorly understood. Here, we investigated if a fundamental oscillatory network activity pattern, often related to cognitive control, frontal midline theta (FMT) oscillations, are modulated by steroids hormones, P4 and T. We measured the concentration of P4 and T using salivary enzyme immunoassay and FMT oscillations using high-density electroencephalography (EEG) during eyes-open resting-state in 55 healthy women and men. Electrical brain activity was analyzed using Fourier analysis, aperiodic signal fitting, and beamformer source localization. Steroid hormone concentrations and biological sex were used as predictors for scalp and source-estimated amplitude of theta oscillations. Elevated concentrations of P4 predicted increased amplitude of FMT oscillations across both sexes, and no relationship was found with T. The positive correlation with P4 was specific to the frontal midline electrodes and survived correction for the background aperiodic signal of the brain. Using source localization, FMT oscillations were localized to the frontal-parietal network (FPN). Additionally, theta amplitude within the FPN, but not the default mode network, positively correlated with P4 concentration. Our results suggest that P4 concentration modulates brain activity via upregulation of theta oscillations in the FPN.

Distinct Oscillatory Dynamics Underlie Different Components of Hierarchical Cognitive Control

Hierarchical cognitive control enables us to execute actions guided by abstract goals. Previous research has suggested that neuronal oscillations at different frequency bands are associated with top-down cognitive control; however, whether distinct neural oscillations have similar or different functions for cognitive control is not well understood. The aim of the current study was to investigate the oscillatory neuronal mechanisms underlying two distinct components of hierarchical cognitive control: the level of abstraction of a rule, and the number of rules that must be maintained (set-size). We collected EEG data in 31 men and women who performed a hierarchical cognitive control task that varied in levels of abstraction and set-size. Results from time-frequency analysis in frontal electrodes showed an increase in theta amplitude for increased set-size, whereas an increase in δ was associated with increased abstraction. Both theta and δ amplitude correlated with behavioral performance in the tasks but in an opposite manner: theta correlated with response time slowing when the number of rules increased, whereas δ correlated with response time when rules became more abstract. Phase-amplitude coupling analysis revealed that δ phase-coupled with β amplitude during conditions with a higher level of abstraction, whereby beta band may potentially represent motor output that was guided by the δ phase. These results suggest that distinct neural oscillatory mechanisms underlie different components of hierarchical cognitive control.SIGNIFICANCE STATEMENT Cognitive control allows us to perform immediate actions while maintaining more abstract, overarching goals in mind and to choose between competing actions. We found distinct oscillatory signatures that correspond to two different components of hierarchical control: the level of abstraction of a rule and the number of rules in competition. An increase in the level of abstraction was associated with δ oscillations, whereas theta oscillations were observed when the number of rules increased. Oscillatory amplitude correlated with behavioral performance in the task. Finally, the expression of β amplitude was coordinated via the phase of δ oscillations, and theta phase-coupled with γ amplitude. These results suggest that distinct neural oscillatory mechanisms underlie different components of hierarchical cognitive control.

Expectancy effects in the EEG during joint and spontaneous word-by-word sentence production in German

Our aim in the present study is to measure neural correlates during spontaneous interactive sentence production. We present a novel approach using the word-by-word technique from improvisational theatre, in which two speakers jointly produce one sentence. This paradigm allows the assessment of behavioural aspects, such as turn-times, and electrophysiological responses, such as event-related-potentials (ERPs). Twenty-five participants constructed a cued but spontaneous four-word German sentence together with a confederate, taking turns for each word of the sentence. In 30% of the trials, the confederate uttered an unexpected gender-marked article. To complete the sentence in a meaningful way, the participant had to detect the violation and retrieve and utter a new fitting response. We found significant increases in response times after unexpected words and - despite allowing unscripted language production and naturally varying speech material - successfully detected significant N400 and P600 ERP effects for the unexpected word. The N400 EEG activity further significantly predicted the response time of the subsequent turn. Our results show that combining behavioural and neuroscientific measures of verbal interactions while retaining sufficient experimental control is possible, and that this combination provides promising insights into the mechanisms of spontaneous spoken dialogue.