Cortical tracking of speech in noise accounts for reading strategies in children

Anatomical and behavioural correlates of auditory perception in developmental dyslexia

Developmental dyslexia is typically associated with difficulties in basic auditory processing and manipulating speech sounds. However, the neuroanatomical correlates of auditory difficulties in developmental dyslexia and their contribution to individual clinical phenotypes are still unknown. Recent intracranial electrocorticography findings associated processing of sound amplitude rises and speech sounds with posterior and middle superior temporal gyrus (STG), respectively. We hypothesize that regional STG anatomy will relate to specific auditory abilities in developmental dyslexia and that auditory processing abilities will relate to behavioral difficulties with speech and reading. One hundred and ten children (78 developmental dyslexia, 32 typically developing, age 7-15 years) completed amplitude rise time and speech-in-noise discrimination tasks. They also underwent a battery of cognitive tests. Anatomical MRI scans were used to identify regions in which local cortical gyrification complexity correlated with auditory behaviour. Behaviourally, amplitude rise time but not speech-in-noise performance was impaired in developmental dyslexia. Neurally, amplitude rise time and speech-in-noise performance correlated with gyrification in posterior and middle STG, respectively. Furthermore, amplitude rise time significantly contributed to reading impairments in developmental dyslexia, while speech in noise only explained variance in phonological awareness. Finally, amplitude rise time and speech-in-noise performance were not correlated, and each task was correlated with distinct neuropsychological measures, emphasizing their unique contributions to developmental dyslexia. Overall, we provide a direct link between the neurodevelopment of the left STG and individual variability in auditory processing abilities in neurotypical and dyslexic populations.

Individual differences in the consistency of neural and behavioural responses to speech sounds

There are documented individual differences among adults in the consistency of speech sound processing, both at neural and behavioural levels. Some adults show more consistent neural responses to speech sounds than others, as measured by an event-related potential called the frequency-following response (FFR); similarly, some adults show more consistent behavioural responses to native speech sounds than others, as measured by two-alternative forced choice (2AFC) and visual analog scaling (VAS) tasks. Adults also differ in how successfully they can perceive non-native speech sounds. Interestingly, it remains unclear whether these differences are related within individuals. In the current study, native English-speaking adults completed native phonetic perception tasks (2AFC and VAS), a non-native (German) phonetic perception task, and an FFR recording session. From these tasks, we derived measures of the consistency of participants' neural and behavioural responses to native speech as well as their non-native perception ability. We then examined the relationships among individual differences in these measures. Analysis of the behavioural measures revealed that more consistent responses to native sounds predicted more successful perception of unfamiliar German sounds. Analysis of neural and behavioural data did not reveal clear relationships between FFR consistency and our phonetic perception measures. This multimodal work furthers our understanding of individual differences in speech processing among adults, and may eventually lead to individualized approaches for enhancing non-native language acquisition in adulthood.

Simultaneous EEG recording of cortical tracking of speech and movement kinematics

RATIONALE

Cortical activity is coupled with streams of sensory stimulation. The coupling with the temporal envelope of heard speech is known as the cortical tracking of speech (CTS), and that with movement kinematics is known as the corticokinematic coupling (CKC). Simultaneous measurement of both couplings is desirable in clinical settings, but it is unknown whether the inherent dual-tasking condition has an impact on CTS or CKC.

AIM

We aim to determine whether and how CTS and CKC levels are affected when recorded simultaneously.

METHODS

Twenty-three healthy young adults underwent 64-channel EEG recordings while listening to stories and while performing repetitive finger-tapping movements in 3 conditions: separately (audio- or tapping-only) or simultaneously (audio-tapping). CTS and CKC values were estimated using coherence analysis between each EEG signal and speech temporal envelope (CTS) or finger acceleration (CKC). CTS was also estimated as the reconstruction accuracy of a decoding model.

RESULTS

Across recordings, CTS assessed with reconstruction accuracy was significant in 85 % of the subjects at phrasal frequency (0.5 Hz) and in 68 % at syllabic frequencies (4-8 Hz), and CKC was significant in over 85 % of the subjects at movement frequency and its first harmonic. Comparing CTS and CKC values evaluated in separate recordings to those in simultaneous recordings revealed no significant difference and moderate-to-high levels of correlation.

CONCLUSION

Despite the subtle behavioral effects, CTS and CKC are not evidently altered by the dual-task setting inherent to recording them simultaneously and can be evaluated simultaneously using EEG in clinical settings.

Early language experience modulates the tradeoff between acoustic-temporal and lexico-semantic cortical tracking of speech

Cortical tracking of speech is relevant for the development of speech perception skills. However, no study to date has explored whether and how cortical tracking of speech is shaped by accumulated language experience, the central question of this study. In 35 bilingual children (6-year-old) with considerably bigger experience in one language, we collected electroencephalography data while they listened to continuous speech in their two languages. Cortical tracking of speech was assessed at acoustic-temporal and lexico-semantic levels. Children showed more robust acoustic-temporal tracking in the least experienced language, and more sensitive cortical tracking of semantic information in the most experienced language. Additionally, and only for the most experienced language, acoustic-temporal tracking was specifically linked to phonological abilities, and lexico-semantic tracking to vocabulary knowledge. Our results indicate that accumulated linguistic experience is a relevant maturational factor for the cortical tracking of speech at different levels during early language acquisition.

Atypical low-frequency cortical encoding of speech identifies children with developmental dyslexia

Slow cortical oscillations play a crucial role in processing the speech amplitude envelope, which is perceived atypically by children with developmental dyslexia. Here we use electroencephalography (EEG) recorded during natural speech listening to identify neural processing patterns involving slow oscillations that may characterize children with dyslexia. In a story listening paradigm, we find that atypical power dynamics and phase-amplitude coupling between delta and theta oscillations characterize dyslexic versus other child control groups (typically-developing controls, other language disorder controls). We further isolate EEG common spatial patterns (CSP) during speech listening across delta and theta oscillations that identify dyslexic children. A linear classifier using four delta-band CSP variables predicted dyslexia status (0.77 AUC). Crucially, these spatial patterns also identified children with dyslexia when applied to EEG measured during a rhythmic syllable processing task. This transfer effect (i.e., the ability to use neural features derived from a story listening task as input features to a classifier based on a rhythmic syllable task) is consistent with a core developmental deficit in neural processing of speech rhythm. The findings are suggestive of distinct atypical neurocognitive speech encoding mechanisms underlying dyslexia, which could be targeted by novel interventions.

Atypical beta-band effects in children with dyslexia in response to rhythmic audio-visual speech

OBJECTIVE

Previous studies have reported atypical delta phase in children with dyslexia, and that delta phase modulates the amplitude of the beta-band response via delta-beta phase-amplitude coupling (PAC). Accordingly, the atypical delta-band effects in children with dyslexia may imply related atypical beta-band effects, particularly regarding delta-beta PAC. Our primary objective was to explore beta-band oscillations in children with and without dyslexia, to explore potentially atypical effects in the beta band in dyslexic children.

METHODS

We collected EEG data during a rhythmic speech paradigm from 51 children (21 control; 30 dyslexia). We then assessed beta-band phase entrainment, beta-band angular velocity, beta-band power responses and delta-beta PAC.

RESULTS

We found significant beta-band phase entrainment for control children but not for dyslexic children. Furthermore, children with dyslexia exhibited significantly faster beta-band angular velocity and significantly greater beta-band power. Delta-beta PAC was comparable in both groups.

CONCLUSION

Atypical beta-band effects were observed in children with dyslexia. However, delta-beta PAC was comparable in both dyslexic and control children.

SIGNIFICANCE

These findings offer further insights into the neurophysiological basis of atypical rhythmic speech processing by children with dyslexia, suggesting the involvement of a wide range of frequency bands.

Neural responses to natural and enhanced speech edges in children with and without dyslexia

Sensory-neural studies indicate that children with developmental dyslexia show impairments in processing acoustic speech envelope information. Prior studies suggest that this arises in part from reduced sensory sensitivity to amplitude rise times (ARTs or speech "edges") in the envelope, accompanied by less accurate neural encoding of low-frequency envelope information. Accordingly, enhancing these characteristics of the speech envelope may enhance neural speech processing in children with dyslexia. Here we applied an envelope modulation enhancement (EME) algorithm to a 10-min story read in child-directed speech (CDS), enhancing ARTs and also enhancing low-frequency envelope information. We compared neural speech processing (as measured using MEG) for the EME story with the same story read in natural CDS for 9-year-old children with and without dyslexia. The EME story affected neural processing in the power domain for children with dyslexia, particularly in the delta band (0.5-4 Hz) in the superior temporal gyrus. This may suggest that prolonged experience with EME speech could ameliorate some of the impairments shown in natural speech processing by children with dyslexia.

Impaired neural entrainment to low frequency amplitude modulations in English-speaking children with dyslexia or dyslexia and DLD

Neural synchronization to amplitude-modulated noise at three frequencies (2 Hz, 5 Hz, 8 Hz) thought to be important for syllable perception was investigated in English-speaking school-aged children. The theoretically-important delta-band (∼2Hz, stressed syllable level) was included along with two syllable-level rates. The auditory steady state response (ASSR) was recorded using EEG in 36 7-to-12-year-old children. Half of the sample had either dyslexia or dyslexia and DLD (developmental language disorder). In comparison to typically-developing children, children with dyslexia or with dyslexia and DLD showed reduced ASSRs for 2 Hz stimulation but similar ASSRs at 5 Hz and 8 Hz. These novel data for English ASSRs converge with prior data suggesting that children with dyslexia have atypical synchrony between brain oscillations and incoming auditory stimulation at ∼ 2 Hz, the rate of stressed syllable production across languages. This atypical synchronization likely impairs speech processing, phonological processing, and possibly syntactic processing, as predicted by Temporal Sampling theory.

Cortical tracking of lexical speech units in a multi-talker background is immature in school-aged children

Children have more difficulty perceiving speech in noise than adults. Whether this difficulty relates to an immature processing of prosodic or linguistic elements of the attended speech is still unclear. To address the impact of noise on linguistic processing per se, we assessed how babble noise impacts the cortical tracking of intelligible speech devoid of prosody in school-aged children and adults. Twenty adults and twenty children (7-9 years) listened to synthesized French monosyllabic words presented at 2.5 Hz, either randomly or in 4-word hierarchical structures wherein 2 words formed a phrase at 1.25 Hz, and 2 phrases formed a sentence at 0.625 Hz, with or without babble noise. Neuromagnetic responses to words, phrases and sentences were identified and source-localized. Children and adults displayed significant cortical tracking of words in all conditions, and of phrases and sentences only when words formed meaningful sentences. In children compared with adults, the cortical tracking was lower for all linguistic units in conditions without noise. In the presence of noise, the cortical tracking was similarly reduced for sentence units in both groups, but remained stable for phrase units. Critically, when there was noise, adults increased the cortical tracking of monosyllabic words in the inferior frontal gyri and supratemporal auditory cortices but children did not. This study demonstrates that the difficulties of school-aged children in understanding speech in a multi-talker background might be partly due to an immature tracking of lexical but not supra-lexical linguistic units.

Individuals' preference on reading pathways influences the involvement of neural pathways in phonological learning

Introduction

Existing behavioral and neuroimaging studies revealed inter-individual variability in the selection of the two phonological routes in word reading. However, it is not clear how individuals' preferred reading pathways/strategies modulate the involvement of a certain brain region for phonological learning in a new language, and consequently affect their behavioral performance on phonological access.

Methods

To address this question, the present study recruited a group of native Chinese speakers to learn two sets of artificial language characters, respectively, in addressed-phonology training (i.e., whole-word mapping) and assembled-phonology training conditions (i.e., grapheme-to-phoneme mapping).

Results

Behavioral results showed that the more lexical pathways participants preferred, the better they performed on newly-acquired addressed characters relative to assembled characters. More importantly, neuroimaging results showed that participants who preferred lexical pathway in phonological access show less involvement of brain regions for addressed phonology (e.g., the bilateral orbitofrontal cortex and right pars triangularis) in the processing of newly-acquired addressed characters.

Conclusion

These results indicated that phonological access via the preferred pathway required less neural resources to achieve better behavioral performance. These above results provide direct neuroimaging evidence for the influence of reading pathway preference on phonological learning.

Decoding of speech information using EEG in children with dyslexia: Less accurate low-frequency representations of speech, not "Noisy" representations

The amplitude envelope of speech carries crucial low-frequency acoustic information that assists linguistic decoding. The sensory-neural Temporal Sampling (TS) theory of developmental dyslexia proposes atypical encoding of speech envelope information < 10 Hz, leading to atypical phonological representations. Here a backward linear TRF model and story listening were employed to estimate the speech information encoded in the electroencephalogram in the canonical delta, theta and alpha bands by 9-year-old children with and without dyslexia. TRF decoding accuracy provided an estimate of how faithfully the children's brains encoded low-frequency envelope information. Between-group analyses showed that the children with dyslexia exhibited impaired reconstruction of speech information in the delta band. However, when the quality of speech encoding for each child was estimated using child-by-child decoding models, then the dyslexic children did not differ from controls. This suggests that children with dyslexia encode neither "noisy" nor "normal" representations of the speech signal, but different representations.

Neurodevelopmental oscillatory basis of speech processing in noise

Humans' extraordinary ability to understand speech in noise relies on multiple processes that develop with age. Using magnetoencephalography (MEG), we characterize the underlying neuromaturational basis by quantifying how cortical oscillations in 144 participants (aged 5-27 years) track phrasal and syllabic structures in connected speech mixed with different types of noise. While the extraction of prosodic cues from clear speech was stable during development, its maintenance in a multi-talker background matured rapidly up to age 9 and was associated with speech comprehension. Furthermore, while the extraction of subtler information provided by syllables matured at age 9, its maintenance in noisy backgrounds progressively matured until adulthood. Altogether, these results highlight distinct behaviorally relevant maturational trajectories for the neuronal signatures of speech perception. In accordance with grain-size proposals, neuromaturational milestones are reached increasingly late for linguistic units of decreasing size, with further delays incurred by noise.

Speech perception deficits and the effect of envelope-enhanced story listening combined with phonics intervention in pre-readers at risk for dyslexia

Developmental dyslexia is considered to be most effectively addressed with preventive phonics-based interventions, including grapheme-phoneme coupling and blending exercises. These intervention types require intact speech perception abilities, given their large focus on exercises with auditorily presented phonemes. Yet some children with (a risk for) dyslexia experience problems in this domain due to a poorer sensitivity to rise times, i.e., rhythmic acoustic cues present in the speech envelope. As a result, the often subtle speech perception problems could potentially constrain an optimal response to phonics-based interventions in at-risk children. The current study therefore aimed (1) to extend existing research by examining the presence of potential speech perception deficits in pre-readers at cognitive risk for dyslexia when compared to typically developing peers and (2) to explore the added value of a preventive auditory intervention for at-risk pre-readers, targeting rise time sensitivity, on speech perception and other reading-related skills. To obtain the first research objective, we longitudinally compared speech-in-noise perception between 28 5-year-old pre-readers with and 30 peers without a cognitive risk for dyslexia during the second half of the third year of kindergarten. The second research objective was addressed by exploring growth in speech perception and other reading-related skills in an independent sample of 62 at-risk 5-year-old pre-readers who all combined a 12-week preventive phonics-based intervention (GraphoGame-Flemish) with an auditory story listening intervention. In half of the sample, story recordings contained artificially enhanced rise times (GG-FL_EE group, n = 31), while in the other half, stories remained unprocessed (GG-FL_NE group, n = 31; Clinical Trial Number S60962-https://www.uzleuven.be/nl/clinical-trial-center). Results revealed a slower speech-in-noise perception growth in the at-risk compared to the non-at-risk group, due to an emerged deficit at the end of kindergarten. Concerning the auditory intervention effects, both intervention groups showed equal growth in speech-in-noise perception and other reading-related skills, suggesting no boost of envelope-enhanced story listening on top of the effect of combining GraphoGame-Flemish with listening to unprocessed stories. These findings thus provide evidence for a link between speech perception problems and dyslexia, yet do not support the potential of the auditory intervention in its current form.

Atypical delta-band phase consistency and atypical preferred phase in children with dyslexia during neural entrainment to rhythmic audio-visual speech

•

Children with and without dyslexia showed consistent phase entrainment.

•

Dyslexic children had significantly reduced delta band phase consistency.

•

Dyslexic children had a different preferred phase in delta compared to controls.

•

The dyslexic brain showed faster pre-stimulus delta band angular velocity.

According to the sensory-neural Temporal Sampling theory of developmental dyslexia, neural sampling of auditory information at slow rates (<10 Hz, related to speech rhythm) is atypical in dyslexic individuals, particularly in the delta band (0.5–4 Hz). Here we examine the underlying neural mechanisms related to atypical sampling using a simple repetitive speech paradigm. Fifty-one children (21 control children [15M, 6F] and 30 children with dyslexia [16M, 14F]) aged 9 years with or without developmental dyslexia watched and listened as a ‘talking head’ repeated the syllable “ba” every 500 ms, while EEG was recorded. Occasionally a syllable was “out of time”, with a temporal delay calibrated individually and adaptively for each child so that it was detected around 79.4% of the time by a button press. Phase consistency in the delta (rate of stimulus delivery), theta (speech-related) and alpha (control) bands was evaluated for each child and each group. Significant phase consistency was found for both groups in the delta and theta bands, demonstrating neural entrainment, but not the alpha band. However, the children with dyslexia showed a different preferred phase and significantly reduced phase consistency compared to control children, in the delta band only. Analysis of pre- and post-stimulus angular velocity of group preferred phases revealed that the children in the dyslexic group showed an atypical response in the delta band only. The delta-band pre-stimulus angular velocity (−130 ms to 0 ms) for the dyslexic group appeared to be significantly faster compared to the control group. It is concluded that neural responding to simple beat-based stimuli may provide a unique neural marker of developmental dyslexia. The automatic nature of this neural response may enable new tools for diagnosis, as well as opening new avenues for remediation.

Neural sampling of the speech signal at different timescales by children with dyslexia

Phonological difficulties characterize individuals with dyslexia across languages. Currently debated is whether these difficulties arise from atypical neural sampling of (or entrainment to) auditory information in speech at slow rates (<10 Hz, related to speech rhythm), faster rates, or neither. MEG studies with adults suggest that atypical sampling in dyslexia affects faster modulations in the neurophysiological gamma band, related to phoneme-level representation. However, dyslexic adults have had years of reduced experience in converting graphemes to phonemes, which could itself cause atypical gamma-band activity. The present study was designed to identify specific linguistic timescales at which English children with dyslexia may show atypical entrainment. Adopting a developmental focus, we hypothesized that children with dyslexia would show atypical entrainment to the prosodic and syllable-level information that is exaggerated in infant-directed speech and carried primarily by amplitude modulations <10 Hz. MEG was recorded in a naturalistic story-listening paradigm. The modulation bands related to different types of linguistic information were derived directly from the speech materials, and lagged coherence at multiple temporal rates spanning 0.9-40 Hz was computed. Group differences in lagged speech-brain coherence between children with dyslexia and control children were most marked in neurophysiological bands corresponding to stress and syllable-level information (<5 Hz in our materials), and phoneme-level information (12-40 Hz). Functional connectivity analyses showed network differences between groups in both hemispheres, with dyslexic children showing significantly reduced global network efficiency. Global network efficiency correlated with dyslexic children's oral language development and with control children's reading development. These developmental data suggest that dyslexia is characterized by atypical neural sampling of auditory information at slower rates. They also throw new light on the nature of the gamma band temporal sampling differences reported in MEG dyslexia studies with adults.

The role of reading experience in atypical cortical tracking of speech and speech-in-noise in dyslexia

Dyslexia is a frequent developmental disorder in which reading acquisition is delayed and that is usually associated with difficulties understanding speech in noise. At the neuronal level, children with dyslexia were reported to display abnormal cortical tracking of speech (CTS) at phrasal rate. Here, we aimed to determine if abnormal tracking relates to reduced reading experience, and if it is modulated by the severity of dyslexia or the presence of acoustic noise. We included 26 school-age children with dyslexia, 26 age-matched controls and 26 reading-level matched controls. All were native French speakers. Children's brain activity was recorded with magnetoencephalography while they listened to continuous speech in noiseless and multiple noise conditions. CTS values were compared between groups, conditions and hemispheres, and also within groups, between children with mild and severe dyslexia. Syllabic CTS was significantly reduced in the right superior temporal gyrus in children with dyslexia compared with controls matched for age but not for reading level. Severe dyslexia was characterized by lower rapid automatized naming (RAN) abilities compared with mild dyslexia, and phrasal CTS lateralized to the right hemisphere in children with mild dyslexia and all control groups but not in children with severe dyslexia. Finally, an alteration in phrasal CTS was uncovered in children with dyslexia compared with age-matched controls in babble noise conditions but not in other less challenging listening conditions (non-speech noise or noiseless conditions); no such effect was seen in comparison with reading-level matched controls. Overall, our results confirmed the finding of altered neuronal basis of speech perception in noiseless and babble noise conditions in dyslexia compared with age-matched peers. However, the absence of alteration in comparison with reading-level matched controls demonstrates that such alterations are associated with reduced reading level, suggesting they are merely driven by reduced reading experience rather than a cause of dyslexia. Finally, our result of altered hemispheric lateralization of phrasal CTS in relation with altered RAN abilities in severe dyslexia is in line with a temporal sampling deficit of speech at phrasal rate in dyslexia.

Neural tracking in infants - An analytical tool for multisensory social processing in development

Humans are born into a social environment and from early on possess a range of abilities to detect and respond to social cues. In the past decade, there has been a rapidly increasing interest in investigating the neural responses underlying such early social processes under naturalistic conditions. However, the investigation of neural responses to continuous dynamic input poses the challenge of how to link neural responses back to continuous sensory input. In the present tutorial, we provide a step-by-step introduction to one approach to tackle this issue, namely the use of linear models to investigate neural tracking responses in electroencephalographic (EEG) data. While neural tracking has gained increasing popularity in adult cognitive neuroscience over the past decade, its application to infant EEG is still rare and comes with its own challenges. After introducing the concept of neural tracking, we discuss and compare the use of forward vs. backward models and individual vs. generic models using an example data set of infant EEG data. Each section comprises a theoretical introduction as well as a concrete example using MATLAB code. We argue that neural tracking provides a promising way to investigate early (social) processing in an ecologically valid setting.