Low-Frequency Oscillations Code Speech during Verbal Working Memory

Lower nonword syllable sequence repetition accuracy in adults who stutter is related to differences in audio-motor oscillations

OBJECTIVE

The goal of this study was to use independent component analysis (ICA) of high-density electroencephalography (EEG) to investigate whether differences in audio-motor neural oscillations are related to nonword syllable repetition accuracy in a group of adults who stutter compared to typically fluent speakers.

METHODS

EEG was recorded using 128 channels from 23 typically fluent speakers and 23 adults who stutter matched for age, sex, and handedness. EEG was recorded during delayed, 2 and 4 bilabial nonword syllable repetition conditions. Scalp-topography, dipole source estimates, and power spectral density (PSD) were computed for each independent component (IC) and used to cluster similar ICs across participants. Event-related spectral perturbations (ERSPs) were computed for each IC cluster to examine changes over time in the repetition conditions and to examine how dynamic changes in ERSPs are related to syllable repetition accuracy.

RESULTS

Findings indicated significantly lower accuracy on a measure of percentage correct trials in the AWS group and for a normalized measure of syllable load performance across conditions. Analysis of ERSPs revealed significantly lower alpha/beta ERD in left and right μ ICs and in left and right posterior temporal lobe α ICs in AWS compared to TFS (CC p < 0.05). Pearson correlations with %CT for frequency across time showed strong relationships with accuracy (FWE<0.05) during maintenance in the TFS group and during execution in the AWS group.

CONCLUSIONS

Findings implicate lower alpha/beta ERD (8-30 Hz) during syllable encoding over posterior temporal ICs and execution in left temporal/sensorimotor components. Strong correlations with accuracy and interindividual differences in ∼6-8 Hz ERSPs during execution implicate differences in motor and auditory-sensory monitoring during syllable sequence execution in AWS.

Brain-wide human oscillatory local field potential activity during visual working memory

Oscillatory activity in the local field potential (LFP) is thought to be a marker of cognitive processes. To understand how it differentiates tasks and brain areas in humans, we recorded LFPs in 15 adults with intracranial depth electrodes, as they performed visual-spatial and shape working memory tasks. Stimulus appearance produced widespread, broad-band activation, including in occipital, parietal, temporal, insular, and prefrontal cortex, and the amygdala and hippocampus. Occipital cortex was characterized by most elevated power in the high-gamma (100-150 Hz) range during the visual stimulus presentation. The most consistent feature of the delay period was a systematic pattern of modulation in the beta frequency (16-40 Hz), which included a decrease in power of variable timing across areas, and rebound during the delay period. These results reveal the widespread nature of oscillatory activity across a broad brain network and region-specific signatures of oscillatory processes associated with visual working memory.

Harmonic memory signals in the human cerebral cortex induced by semantic relatedness of words

When we memorize multiple words simultaneously, semantic relatedness among those words assists memory. For example, the information about "apple", "banana," and "orange" will be connected via a common concept of "fruits" and become easy to retain and recall. Neural mechanisms underlying this semantic integration in verbal working memory remain unclear. Here I used electroencephalography (EEG) and investigated neural signals when healthy human participants memorized five nouns semantically related (Sem trial) or not (NonSem trial). The regularity of oscillatory signals (8-30 Hz) during the retention period was found to be lower in NonSem than Sem trials, indicating that memorizing words unrelated to each other induced a non-harmonic (irregular) waveform in the temporal cortex. These results suggest that (i) semantic features of a word are retained as a set of neural oscillations at specific frequencies and (ii) memorizing words sharing a common semantic feature produces harmonic brain responses through a resonance or integration (sharing) of the oscillatory signals.

Lateralization and Time-Course of Cortical Phonological Representations during Syllable Production

Spoken language contains information at a broad range of timescales, from phonetic distinctions on the order of milliseconds to semantic contexts which shift over seconds to minutes. It is not well understood how the brain's speech production systems combine features at these timescales into a coherent vocal output. We investigated the spatial and temporal representations in cerebral cortex of three phonological units with different durations: consonants, vowels, and syllables. Electrocorticography (ECoG) recordings were obtained from five participants while speaking single syllables. We developed a novel clustering and Kalman filter-based trend analysis procedure to sort electrodes into temporal response profiles. A linear discriminant classifier was used to determine how strongly each electrode's response encoded phonological features. We found distinct time-courses of encoding phonological units depending on their duration: consonants were represented more during speech preparation, vowels were represented evenly throughout trials, and syllables during production. Locations of strongly speech-encoding electrodes (the top 30% of electrodes) likewise depended on phonological element duration, with consonant-encoding electrodes left-lateralized, vowel-encoding hemispherically balanced, and syllable-encoding right-lateralized. The lateralization of speech-encoding electrodes depended on onset time, with electrodes active before or after speech production favoring left hemisphere and those active during speech favoring the right. Single-electrode speech classification revealed cortical areas with preferential encoding of particular phonemic elements, including consonant encoding in the left precentral and postcentral gyri and syllable encoding in the right middle frontal gyrus. Our findings support neurolinguistic theories of left hemisphere specialization for processing short-timescale linguistic units and right hemisphere processing of longer-duration units.

Brain-wide human oscillatory LFP activity during visual working memory

Oscillatory activity is thought to be a marker of cognitive processes, although its role and distribution across the brain during working memory has been a matter of debate. To understand how oscillatory activity differentiates tasks and brain areas in humans, we recorded local field potentials (LFPs) in 12 adults as they performed visual-spatial and shape-matching memory tasks. Tasks were designed to engage working memory processes at a range of delay intervals between stimulus delivery and response initiation. LFPs were recorded using intracranial depth electrodes implanted to localize seizures for management of intractable epilepsy. Task-related LFP power analyses revealed an extensive network of cortical regions that were activated during the presentation of visual stimuli and during their maintenance in working memory, including occipital, parietal, temporal, insular, and prefrontal cortical areas, and subcortical structures including the amygdala and hippocampus. Across most brain areas, the appearance of a stimulus produced broadband power increase, while gamma power was evident during the delay interval of the working memory task. Notable differences between areas included that occipital cortex was characterized by elevated power in the high gamma (100-150 Hz) range during the 500 ms of visual stimulus presentation, which was less pronounced or absent in other areas. A decrease in power centered in beta frequency (16-40 Hz) was also observed after the stimulus presentation, whose magnitude differed across areas. These results reveal the interplay of oscillatory activity across a broad network, and region-specific signatures of oscillatory processes associated with visual working memory.

Machine learning analysis reveals aberrant dynamic changes in amplitude of low-frequency fluctuations among patients with retinal detachment

Background

There is increasing evidence that patients with retinal detachment (RD) have aberrant brain activity. However, neuroimaging investigations remain focused on static changes in brain activity among RD patients. There is limited knowledge regarding the characteristics of dynamic brain activity in RD patients.

Aim

This study evaluated changes in dynamic brain activity among RD patients, using a dynamic amplitude of low-frequency fluctuation (dALFF), k-means clustering method and support vector machine (SVM) classification approach.

Methods

We investigated inter-group disparities of dALFF indices under three different time window sizes using resting-state functional magnetic resonance imaging (rs-fMRI) data from 23 RD patients and 24 demographically matched healthy controls (HCs). The k-means clustering method was performed to analyze specific dALFF states and related temporal properties. Additionally, we selected altered dALFF values under three distinct conditions as classification features for distinguishing RD patients from HCs using an SVM classifier.

Results

RD patients exhibited dynamic changes in local intrinsic indicators of brain activity. Compared with HCs, RD patients displayed increased dALFF in the bilateral middle frontal gyrus, left putamen (Putamen_L), left superior occipital gyrus (Occipital_Sup_L), left middle occipital gyrus (Occipital_Mid_L), right calcarine (Calcarine_R), right middle temporal gyrus (Temporal_Mid_R), and right inferior frontal gyrus (Frontal_Inf_Tri_R). Additionally, RD patients showed significantly decreased dALFF values in the right superior parietal gyrus (Parietal_Sup_R) and right paracentral lobule (Paracentral_Lobule_R) [two-tailed, voxel-level p < 0.05, Gaussian random field (GRF) correction, cluster-level p < 0.05]. For dALFF, we derived 3 or 4 states of ALFF that occurred repeatedly. There were differences in state distribution and state properties between RD and HC groups. The number of transitions between the dALFF states was higher in the RD group than in the HC group. Based on dALFF values in various brain regions, the overall accuracies of SVM classification were 97.87, 100, and 93.62% under three different time windows; area under the curve values were 0.99, 1.00, and 0.95, respectively. No correlation was found between hamilton anxiety (HAMA) scores and regional dALFF.

Conclusion

Our findings offer important insights concerning the neuropathology that underlies RD and provide robust evidence that dALFF, a local indicator of brain activity, may be useful for clinical diagnosis.

Aberrant neurophysiological signaling associated with speech impairments in Parkinson's disease

Difficulty producing intelligible speech is a debilitating symptom of Parkinson's disease (PD). Yet, both the robust evaluation of speech impairments and the identification of the affected brain systems are challenging. Using task-free magnetoencephalography, we examine the spectral and spatial definitions of the functional neuropathology underlying reduced speech quality in patients with PD using a new approach to characterize speech impairments and a novel brain-imaging marker. We found that the interactive scoring of speech impairments in PD (N = 59) is reliable across non-expert raters, and better related to the hallmark motor and cognitive impairments of PD than automatically-extracted acoustical features. By relating these speech impairment ratings to neurophysiological deviations from healthy adults (N = 65), we show that articulation impairments in patients with PD are associated with aberrant activity in the left inferior frontal cortex, and that functional connectivity of this region with somatomotor cortices mediates the influence of cognitive decline on speech deficits.

ROSE: A Neurocomputational Architecture for Syntax

A comprehensive model of natural language processing in the brain must accommodate four components: representations, operations, structures and encoding. It further requires a principled account of how these different components mechanistically, and causally, relate to each another. While previous models have isolated regions of interest for structure-building and lexical access, and have utilized specific neural recording measures to expose possible signatures of syntax, many gaps remain with respect to bridging distinct scales of analysis that map onto these four components. By expanding existing accounts of how neural oscillations can index various linguistic processes, this article proposes a neurocomputational architecture for syntax, termed the ROSE model (Representation, Operation, Structure, Encoding). Under ROSE, the basic data structures of syntax are atomic features, types of mental representations (R), and are coded at the single-unit and ensemble level. Elementary computations (O) that transform these units into manipulable objects accessible to subsequent structure-building levels are coded via high frequency broadband γ activity. Low frequency synchronization and cross-frequency coupling code for recursive categorial inferences (S). Distinct forms of low frequency coupling and phase-amplitude coupling (δ-θ coupling via pSTS-IFG; θ-γ coupling via IFG to conceptual hubs in lateral and ventral temporal cortex) then encode these structures onto distinct workspaces (E). Causally connecting R to O is spike-phase/LFP coupling; connecting O to S is phase-amplitude coupling; connecting S to E is a system of frontotemporal traveling oscillations; connecting E back to lower levels is low-frequency phase resetting of spike-LFP coupling. This compositional neural code has important implications for algorithmic accounts, since it makes concrete predictions for the appropriate level of study for psycholinguistic parsing models. ROSE is reliant on neurophysiologically plausible mechanisms, is supported at all four levels by a range of recent empirical research, and provides an anatomically precise and falsifiable grounding for the basic property of natural language syntax: hierarchical, recursive structure-building.

Hyperintensities of middle frontal gyrus in patients with diabetic optic neuropathy: a dynamic amplitude of low-frequency fluctuation study

Diabetic optic neuropathy (DON) is a diverse complication of diabetes and its pathogenesis has not been fully elucidated. The purpose of this study was to explore dynamic cerebral activity changes in DON patients using dynamic amplitude of low-frequency fluctuation (dALFF). In total, 22 DON patients and 22 healthy controls were enrolled. The dALFF approach was used in all participants to investigate dynamic intrinsic brain activity differences between the two groups. Compared with HCs, DON patients exhibited significantly increased dALFF variability in the right middle frontal gyrus (P < 0.01). Conversely, DON patients exhibited obviously decreased dALFF variability in the right precuneus (P < 0.01). We also found that there were significant negative correlations between HADS scores and dALFF values of the right middle frontal gyrus in the DON patients (r = -0.6404, P <0.01 for anxiety and r = -0.6346, P <0.01 for depression; HADS, Hospital Anxiety and Depression Scale). Abnormal variability of dALFF was observed in specific areas of the cerebrum in DON patients, which may contribute to distinguishing patients with DON from HCs and a better understanding of DON, hyperintensities of right middle frontal gyrus may be potential diagnostic marker for DON.

Dependence of Working Memory on Coordinated Activity Across Brain Areas

Neural signatures of working memory (WM) have been reported in numerous brain areas, suggesting a distributed neural substrate for memory maintenance. In the current manuscript we provide an updated review of the literature focusing on intracranial neurophysiological recordings during WM in primates. Such signatures of WM include changes in firing rate or local oscillatory power within an area, along with measures of coordinated activity between areas based on synchronization between oscillations. In comparing the ability of various neural signatures in any brain area to predict behavioral performance, we observe that synchrony between areas is more frequently and robustly correlated with WM performance than any of the within-area neural signatures. We further review the evidence for alteration of inter-areal synchrony in brain disorders, consistent with an important role for such synchrony during behavior. Additionally, results of causal studies indicate that manipulating synchrony across areas is especially effective at influencing WM task performance. Each of these lines of research supports the critical role of inter-areal synchrony in WM. Finally, we propose a framework for interactions between prefrontal and sensory areas during WM, incorporating a range of experimental findings and offering an explanation for the observed link between intra-areal measures and WM performance.

Imagined speech can be decoded from low- and cross-frequency intracranial EEG features

Reconstructing intended speech from neural activity using brain-computer interfaces holds great promises for people with severe speech production deficits. While decoding overt speech has progressed, decoding imagined speech has met limited success, mainly because the associated neural signals are weak and variable compared to overt speech, hence difficult to decode by learning algorithms. We obtained three electrocorticography datasets from 13 patients, with electrodes implanted for epilepsy evaluation, who performed overt and imagined speech production tasks. Based on recent theories of speech neural processing, we extracted consistent and specific neural features usable for future brain computer interfaces, and assessed their performance to discriminate speech items in articulatory, phonetic, and vocalic representation spaces. While high-frequency activity provided the best signal for overt speech, both low- and higher-frequency power and local cross-frequency contributed to imagined speech decoding, in particular in phonetic and vocalic, i.e. perceptual, spaces. These findings show that low-frequency power and cross-frequency dynamics contain key information for imagined speech decoding.

Dynamic Changes of Amplitude of Low-Frequency Fluctuations in Patients With Diabetic Retinopathy

Background: Growing evidence demonstrate that diabetic retinopathy (DR) patients have a high risk of cognitive decline and exhibit abnormal brain activity. However, neuroimaging studies thus far have focused on static cerebral activity changes in DR patients. The characteristics of dynamic cerebral activity in patients with DR are poorly understood.

Purpose: The purpose of the study was to investigate the dynamic cerebral activity changes in patients with DR using the dynamic amplitude of low-frequency fluctuation (dALFF) method.

Materials and methods: Thirty-four DR patients (18 men and 16 women) and 38 healthy controls (HCs) (18 males and 20 females) closely matched in age, sex, and education were enrolled in this study. The dALFF method was used to investigate dynamic intrinsic brain activity differences between the DR and HC groups.

Results: Compared with HCs, DR patients exhibited increased dALFF variability in the right brainstem, left cerebellum_8, left cerebellum_9, and left parahippocampal gyrus. In contrast, DR patients exhibited decreased dALFF variability in the left middle occipital gyrus and right middle occipital gyrus.

Conclusion: Our study highlighted that DR patients showed abnormal variability of dALFF in the visual cortices, cerebellum, and parahippocampal gyrus. These findings suggest impaired visual and motor and memory function in DR individuals. Thus, abnormal dynamic spontaneous brain activity might be involved in the pathophysiology of DR.

Oscillatory brain activity and maintenance of verbal and visual working memory: A systematic review

Brain oscillations likely play a significant role in the storage of information in working memory (WM). Despite the wide popularity of the topic, current attempts to summarize the research in the field are narrative reviews. We address this gap by providing a descriptive systematic review, in which we investigated oscillatory correlates of maintenance of verbal and visual information in WM. The systematic approach enabled us to challenge some common views popularized by previous research. The identified literature (100 EEG/MEG studies) highlighted the importance of theta oscillations in verbal WM: frontal midline theta enhanced with load in most verbal studies, while more equivocal results have been obtained in visual studies. Increasing WM load affected alpha activity in most studies, but the direction of the effect was inconsistent: the ratio of studies that found alpha increase versus decrease with increasing load was 80/20% in the verbal WM domain and close to 60/40% in the visual domain. Alpha asymmetry (left < right) was a common finding in both verbal and visual WM studies. Beta and gamma activity studies yielded the least convincing data: a diversity in the spatial and frequency distribution of beta activity prevented us from making a coherent conclusion; gamma rhythm was virtually neglected in verbal WM studies with no systematic support for sustained gamma changes during the delay in EEG studies in general.

Observation and assessment of acoustic contamination of electrophysiological brain signals during speech production and sound perception

OBJECTIVE

A current challenge of neurotechnologies is to develop speech brain-computer interfaces aiming at restoring communication in people unable to speak. To achieve a proof of concept of such system, neural activity of patients implanted for clinical reasons can be recorded while they speak. Using such simultaneously recorded audio and neural data, decoders can be built to predict speech features using features extracted from brain signals. A typical neural feature is the spectral power of field potentials in the high-gamma frequency band, which happens to overlap the frequency range of speech acoustic signals, especially the fundamental frequency of the voice. Here, we analyzed human electrocorticographic and intracortical recordings during speech production and perception as well as a rat microelectrocorticographic recording during sound perception. We observed that several datasets, recorded with different recording setups, contained spectrotemporal features highly correlated with those of the sound produced by or delivered to the participants, especially within the high-gamma band and above, strongly suggesting a contamination of electrophysiological recordings by the sound signal. This study investigated the presence of acoustic contamination and its possible source.

APPROACH

We developed analysis methods and a statistical criterion to objectively assess the presence or absence of contamination-specific correlations, which we used to screen several datasets from five centers worldwide.

MAIN RESULTS

Not all but several datasets, recorded in a variety of conditions, showed significant evidence of acoustic contamination. Three out of five centers were concerned by the phenomenon. In a recording showing high contamination, the use of high-gamma band features dramatically facilitated the performance of linear decoding of acoustic speech features, while such improvement was very limited for another recording showing no significant contamination. Further analysis and in vitro replication suggest that the contamination is caused by the mechanical action of the sound waves onto the cables and connectors along the recording chain, transforming sound vibrations into an undesired electrical noise affecting the biopotential measurements.

SIGNIFICANCE

Although this study does not per se question the presence of speech-relevant physiological information in the high-gamma range and above (multiunit activity), it alerts on the fact that acoustic contamination of neural signals should be proofed and eliminated before investigating the cortical dynamics of these processes. To this end, we make available a toolbox implementing the proposed statistical approach to quickly assess the extent of contamination in an electrophysiological recording (https://doi.org/10.5281/zenodo.3929296).

Transformation of speech sequences in human sensorimotor circuits

When we hear a series of words, it is not only the auditory pathways of our brains that respond, but also the pathways that organize speech and action. What is the purpose of “motor” activity during language perception? We recorded electrical signals from the surfaces of the brain as people heard, mentally rehearsed, and spoke natural sentences. We found that human motor pathways generated precise, time-locked representations of sentences during listening. When listening was complete, the motor activity transformed to a distinct representation while people repeated the sentence in their heads and as they spoke the sentence aloud. Thus, motor circuits generate representations that can bridge from perception to short-term memory of spoken language.

After we listen to a series of words, we can silently replay them in our mind. Does this mental replay involve a reactivation of our original perceptual dynamics? We recorded electrocorticographic (ECoG) activity across the lateral cerebral cortex as people heard and then mentally rehearsed spoken sentences. For each region, we tested whether silent rehearsal of sentences involved reactivation of sentence-specific representations established during perception or transformation to a distinct representation. In sensorimotor and premotor cortex, we observed reliable and temporally precise responses to speech; these patterns transformed to distinct sentence-specific representations during mental rehearsal. In contrast, we observed less reliable and less temporally precise responses in prefrontal and temporoparietal cortex; these higher-order representations, which were sensitive to sentence semantics, were shared across perception and rehearsal of the same sentence. The mental rehearsal of natural speech involves the transformation of stimulus-locked speech representations in sensorimotor and premotor cortex, combined with diffuse reactivation of higher-order semantic representations.