Impact of associative word learning on phonotactic processing in 6-month-old infants: A combined EEG and fNIRS study

Six-month-old infants' perception of structural regularities in speech

In order to acquire grammar, infants need to extract regularities from the linguistic input. From birth, infants can detect regularities in speech based on identity relations, and show strong neural activation to syllable sequences containing adjacent repetitions of identical syllables (e.g. ABB: mubaba). Meanwhile, newborns' neural responses to sequences of different syllables (e.g. ABC: mubage, i.e. diversity-based relations) do not differ from baseline. However, this latter ability needs to emerge during development, as most linguistic units, such as words, are composed of highly variable sequences. As infants begin to learn their first word forms at 6 months, we hypothesize that the ability to represent sequences of different syllables might become important for them at this age. Using near-infrared spectroscopy (NIRS), we measured 6-month-old infants' brain responses to repetition- and diversity-based sequences in the bilateral temporal, parietal and frontal areas. We found that 6-month-olds discriminated the repetition- and diversity-based structures in frontal and parietal regions, and exhibited equally strong activation to both grammars as compared to baseline. These results show that by 6 months of age, infants encode sequences with diversity-based structures. They thus provide the earliest evidence that prelexical infants represent difference in speech stimuli, which behavioral studies first attest at 11 months of age.

Longitudinal fNIRS and EEG metrics of habituation and novelty detection are correlated in 1-18-month-old infants

INTRODUCTION

. Habituation and novelty detection are two fundamental and widely studied neurocognitive processes. Whilst neural responses to repetitive and novel sensory input have been well-documented across a range of neuroimaging modalities, it is not yet fully understood how well these different modalities are able to describe consistent neural response patterns. This is particularly true for infants and young children, as different assessment modalities might show differential sensitivity to underlying neural processes across age. Thus far, many neurodevelopmental studies are limited in either sample size, longitudinal scope or breadth of measures employed, impeding investigations of how well common developmental trends can be captured via different methods.

METHOD

. This study assessed habituation and novelty detection in N = 204 infants using EEG and fNIRS measured in two separate paradigms, but within the same study visit, at 1, 5 and 18 months of age in an infant cohort in rural Gambia. EEG was acquired during an auditory oddball paradigm during which infants were presented with Frequent, Infrequent and Trial Unique sounds. In the fNIRS paradigm, infants were familiarised to a sentence of infant-directed speech, novelty detection was assessed via a change in speaker. Indices for habituation and novelty detection were extracted for both EEG and NIRS RESULTS: . We found evidence for weak to medium positive correlations between responses on the fNIRS and the EEG paradigms for indices of both habituation and novelty detection at most age points. Habituation indices correlated across modalities at 1 month and 5 months but not 18 months of age, and novelty responses were significantly correlated at 5 months and 18 months, but not at 1 month. Infants who showed robust habituation responses also showed robust novelty responses across both assessment modalities.

DISCUSSION

. This study is the first to examine concurrent correlations across two neuroimaging modalities across several longitudinal age points. Examining habituation and novelty detection, we show that despite the use of two different testing modalities, stimuli and timescale, it is possible to extract common neural metrics across a wide age range in infants. We suggest that these positive correlations might be strongest at times of greatest developmental change.

Investigation of functional near-infrared spectroscopy signal quality and development of the hemodynamic phase correlation signal

Significance: There is a longstanding recommendation within the field of fNIRS to use oxygenated (HbO 2 ) and deoxygenated (HHb) hemoglobin when analyzing and interpreting results. Despite this, many fNIRS studies do focus onHbO 2 only. Previous work has shown thatHbO 2 on its own is susceptible to systemic interference and results may mostly reflect that rather than functional activation. Studies using bothHbO 2 and HHb to draw their conclusions do so with varying methods and can lead to discrepancies between studies. The combination ofHbO 2 and HHb has been recommended as a method to utilize both signals in analysis. Aim: We present the development of the hemodynamic phase correlation (HPC) signal to combineHbO 2 and HHb as recommended to utilize both signals in the analysis. We use synthetic and experimental data to evaluate how the HPC and current signals used for fNIRS analysis compare. Approach: About 18 synthetic datasets were formed using resting-state fNIRS data acquired from 16 channels over the frontal lobe. To simulate fNIRS data for a block-design task, we superimposed a synthetic task-related hemodynamic response to the resting state data. This data was used to develop an HPC-general linear model (GLM) framework. Experiments were conducted to investigate the performance of each signal at different SNR and to investigate the effect of false positives on the data. Performance was based on each signal's mean T -value across channels. Experimental data recorded from 128 participants across 134 channels during a finger-tapping task were used to investigate the performance of multiple signals [HbO 2 , HHb, HbT, HbD, correlation-based signal improvement (CBSI), and HPC] on real data. Signal performance was evaluated on its ability to localize activation to a specific region of interest. Results: Results from varying the SNR show that the HPC signal has the highest performance for high SNRs. The CBSI performed the best for medium-low SNR. The next analysis evaluated how false positives affect the signals. The analyses evaluating the effect of false positives showed that the HPC and CBSI signals reflect the effect of false positives onHbO 2 and HHb. The analysis of real experimental data revealed that the HPC and HHb signals provide localization to the primary motor cortex with the highest accuracy. Conclusions: We developed a new hemodynamic signal (HPC) with the potential to overcome the current limitations of usingHbO 2 and HHb separately. Our results suggest that the HPC signal provides comparable accuracy to HHb to localize functional activation while at the same time being more robust against false positives.

Viewing neurovascular coupling through the lens of combined EEG-fNIRS: A systematic review of current methods

Neurovascular coupling is a key physiological mechanism that occurs in the healthy human brain, and understanding this process has implications for understanding the aging and neuropsychiatric populations. Combined electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has emerged as a promising, noninvasive tool for probing neurovascular interactions in humans. However, the utility of this approach critically depends on the methodological quality used for multimodal integration. Despite a growing number of combined EEG-fNIRS applications reported in recent years, the methodological rigor of past studies remains unclear, limiting the accurate interpretation of reported findings and hindering the translational application of this multimodal approach. To fill this knowledge gap, we critically evaluated various methodological aspects of previous combined EEG-fNIRS studies performed in healthy individuals. A literature search was conducted using PubMed and PsycINFO on June 28, 2021. Studies involving concurrent EEG and fNIRS measurements in awake and healthy individuals were selected. After screening and eligibility assessment, 96 studies were included in the methodological evaluation. Specifically, we critically reviewed various aspects of participant sampling, experimental design, signal acquisition, data preprocessing, outcome selection, data analysis, and results presentation reported in these studies. Altogether, we identified several notable strengths and limitations of the existing EEG-fNIRS literature. In light of these limitations and the features of combined EEG-fNIRS, recommendations are made to improve and standardize research practices to facilitate the use of combined EEG-fNIRS when studying healthy neurovascular coupling processes and alterations in neurovascular coupling among various populations.

Vocal brain development in infants of mothers with serious mental illness (CAPRI-Voc): study protocol

INTRODUCTION

Improving the lives of children and adolescents with parental mental illness (CAPRI) remains an urgent political and public health concern for the UK and European Union. Recurrent parental mental illness is believed to lead to fractures in the family, academic and social lives of these children, yet interventions are poorly targeted and non-specific. Part of an interdisciplinary programme of work (the CAPRI Programme; grant number: 682741), CAPRI-Voc aims to achieve two goals: first, to test the feasibility of our longitudinal imaging paradigm in mother-infant pairs where the mother has a diagnosis of severe mental illness. Second, to compare development of vocal processing in these infants with infants in the general population.

METHODS AND ANALYSIS

Recruitment of 100 infants of mothers with mental illness, alongside 50 infants of healthy mothers. Both cohorts of infants will undergo functional near infrared spectroscopy (fNIRS) brain imaging at three time points: 9, 12 and 18 months to explore differences between cohorts in their neural responses to vocal stimuli in our language paradigm. Mothers will complete an interview and psychological questionnaires. We shall also complete an infant developmental battery and mother-child interaction play session. Data on recruitment, retention and dropout will be recorded.

ETHICS AND DISSEMINATION

It will be made clear that fNIRS is a safe, non-invasive technology widely used in infant clinical and psychological research. We shall reassure mothers that no definitive causal link exists between maternal mental illness and language development in infants, and that individual data will only exist as part of the wider dataset. As the study includes both children and vulnerable adults, all research staff will complete National Health Service (NHS) Safeguarding level 3 training. Dissemination will be via direct feedback to stakeholders, patient and advisory groups, and through presentations at conferences, journal publications and university/NHS trust communications. The study was approved through North West-Greater Manchester West Research Ethics Committee (17/NW/0074) and Health Research Authority (212715).

Interdisciplinary Approaches to the Study of Listening Effort in Young Children with Cochlear Implants

Very early bilateral implantation is thought to significantly reduce the attentional effort required to acquire spoken language, and consequently offer a profound improvement in quality of life. Despite the early intervention, however, auditory and communicative outcomes in children with cochlear implants remain poorer than in hearing children. The distorted auditory input via the cochlear implants requires more auditory attention resulting in increased listening effort and fatigue. Listening effort and fatigue may critically affect attention to speech, and in turn language processing, which may help to explain the variation in language and communication abilities. However, measuring attention to speech and listening effort is demanding in infants and very young children. Three objective techniques for measuring listening effort are presented in this paper that may address the challenges of testing very young and/or uncooperative children with cochlear implants: pupillometry, electroencephalography, and functional near-infrared spectroscopy. We review the studies of listening effort that used these techniques in paediatric populations with hearing loss, and discuss potential benefits of the systematic evaluation of listening effort in these populations.

Development of the N400 for Word Learning in the First 2 Years of Life: A Systematic Review

The N400 ERP component is a direct neural index of word meaning. Studies show that the N400 component is already present in early infancy, albeit often delayed. Many researchers capitalize on this finding, using the N400 component to better understand how early language acquisition unfolds. However, variability in how researchers quantify the N400 makes it difficult to set clear predictions or build theory. Not much is known about how the N400 component develops in the first 2 years of life in terms of its latency and topographical distributions, nor do we know how task parameters affect its appearance. In the current paper we carry out a systematic review, comparing over 30 studies that report the N400 component as a proxy of semantic processing elicited in infants between 0 and 24 months old who listened to linguistic stimuli. Our main finding is that there is large heterogeneity across semantic-priming studies in reported characteristics of the N400, both with respect to latency and to distributions. With age, the onset of the N400 insignificantly decreases, while its offset slightly increases. We also examined whether the N400 appears different for recently-acquired novel words vs. existing words: both situations reveal heterogeneity across studies. Finally, we inspected whether the N400 was modulated differently with studies using a between-subject design. In infants with more proficient language skills the N400 was more often present or showed itself here with earlier latency, compared to their peers; but no consistent patterns were observed for distribution characteristics of the N400. One limitation of the current review is that we compared studies that widely differed in choice of EEG recordings, pre-processing steps and quantification of the N400, all of which could affect the characteristics of the infant N400. The field is still missing research that systematically tests development of the N400 using the same paradigm across infancy.

Behavioral and Neurodynamic Effects of Word Learning on Phonotactic Repair

Processes governing the creation, perception and production of spoken words are sensitive to the patterns of speech sounds in the language user's lexicon. Generative linguistic theory suggests that listeners infer constraints on possible sound patterning from the lexicon and apply these constraints to all aspects of word use. In contrast, emergentist accounts suggest that these phonotactic constraints are a product of interactive associative mapping with items in the lexicon. To determine the degree to which phonotactic constraints are lexically mediated, we observed the effects of learning new words that violate English phonotactic constraints (e.g., srigin) on phonotactic perceptual repair processes in nonword consonant-consonant-vowel (CCV) stimuli (e.g., /sre/). Subjects who learned such words were less likely to "repair" illegal onset clusters (/sr/) and report them as legal ones (/∫r/). Effective connectivity analyses of MRI-constrained reconstructions of simultaneously collected magnetoencephalography (MEG) and EEG data showed that these behavioral shifts were accompanied by changes in the strength of influences of lexical areas on acoustic-phonetic areas. These results strengthen the interpretation of previous results suggesting that phonotactic constraints on perception are produced by top-down lexical influences on speech processing.

Language Familiarity and Proficiency Leads to Differential Cortical Processing During Translation Between Distantly Related Languages

In the midst of globalization, English is regarded as an international language, or Lingua Franca, but learning it as a second language (L2) remains still difficult to speakers of other languages. This is true especially for the speakers of languages distantly related to English such as Japanese. In this sense, exploring neural basis for translation between the first language (L1) and L2 is of great interest. There have been relatively many previous researches revealing brain activation patterns during translations between L1 and English as L2. These studies, which focused on language translation with close or moderate linguistic distance (LD), have suggested that the Broca area (BA 44/45) and the dorsolateral prefrontal cortex (DLPFC; BA 46) may play an important role on translation. However, the neural mechanism of language translation between Japanese and English, having large LD, has not been clarified. Thus, we used functional near infrared spectroscopy (fNIRS) to investigate the brain activation patterns during word translation between Japanese and English. We also assessed the effects of translation directions and word familiarity. All participants’ first language was Japanese and they were learning English. Their English proficiency was advanced or elementary. We selected English and Japanese words as stimuli based on the familiarity for Japanese people. Our results showed that the brain activation patterns during word translation largely differed depending on their English proficiency. The advanced group elicited greater activation on the left prefrontal cortex around the Broca’s area while translating words with low familiarity, but no activation was observed while translating words with high familiarity. On the other hand, the elementary group evoked greater activation on the left temporal area including the superior temporal gyrus (STG) irrespective of the word familiarity. These results suggested that different cognitive process could be involved in word translation corresponding to English proficiency in Japanese learners of English. These difference on the brain activation patterns between the advanced and elementary group may reflect the difference on the cognitive loads depending on the levels of automatization in one’s language processing.

The challenge of learning a new language in adulthood: Evidence from a multi-methodological neuroscientific approach

Being proficient in several foreign languages is an essential part of every-day life. In contrast to childhood, learning a new language can be highly challenging for adults. The present study aims at investigating neural mechanisms supporting very initial foreign language learning in adulthood. For this reason, subjects underwent an implicit semantic associative training in which they had to learn new pseudoword-picture pairings. Learning success was measured via a recognition experiment presenting learned versus new pseudoword-picture pairings. Neural correlates were assessed by an innovative multi-methodological approach simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Results indicate memory-related processes based on familiarity and mechanisms of cognitive control to be present during initial vocabulary learning. Findings underline the fascinating plasticity of the adult brain during foreign language learning, even after a short semantic training of only 18 minutes as well as the importance of comparing evidence from different neuroscientific methods and behavioral data.

Inner versus Overt Speech Production: Does This Make a Difference in the Developing Brain?

Studies in adults showed differential neural processing between overt and inner speech. So far, it is unclear whether inner and overt speech are processed differentially in children. The present study examines the pre-activation of the speech network in order to disentangle domain-general executive control from linguistic control of inner and overt speech production in 6- to 7-year-olds by simultaneously applying electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). Children underwent a picture-naming task in which the pure preparation of a subsequent speech production and the actual execution of speech can be differentiated. The preparation phase does not represent speech per se but it resembles the setting up of the language production network. Only the fNIRS revealed a larger activation for overt, compared to inner, speech over bilateral prefrontal to parietal regions during the preparation phase. Findings suggest that the children's brain can prepare the subsequent speech production. The preparation for overt and inner speech requires different domain-general executive control. In contrast to adults, the children´s brain did not show differences between inner and overt speech when a concrete linguistic content occurs and a concrete execution is required. This might indicate that domain-specific executive control processes are still under development.

In the absence of visual input: Electrophysiological evidence of infants' mapping of labels onto auditory objects

Despite the prominence of non-visual semantic features for some words (e.g., siren or thunder), little is known about when and how the meanings of those words that refer to auditory objects can be acquired in early infancy. With associative learning being an important mechanism of word learning, we ask the question whether associations between sounds and words lead to similar learning effects as associations between visual objects and words. In an event-related potential (ERP) study, 10- to 12-month-old infants were presented with pairs of environmental sounds and pseudowords in either a consistent (where sound-word mapping can occur) or inconsistent manner. Subsequently, the infants were presented with sound-pseudoword combinations either matching or violating the consistent pairs from the training phase. In the training phase, we observed word-form familiarity effects and pairing consistency effects for ERPs time-locked to the onset of the word. The test phase revealed N400-like effects for violated pairs as compared to matching pairs. These results indicate that associative word learning is also possible for auditory objects before infants' first birthday. The specific temporal occurrence of the N400-like effect and topological distribution of the ERPs suggests that the object's modality has an impact on how novel words are processed.

So young, yet so mature? Electrophysiological and vascular correlates of phonotactic processing in 18-month-olds

The present study investigated neural correlates of implicit phonotactic processing in 18-month-old children that just reached an important step in language development: the vocabulary spurt. Pseudowords, either phonotactically legal or illegal with respect to their native language, were acoustically presented to monolingually German raised infants. Neural activity was simultaneously assessed by means of electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The former method excellently tracks fast processing mechanisms, whereas the latter reveals brain areas recruited. Results of the present study indicate that 18-month-olds recognize the linguistic properties of their native language based on phonotactics. This manifested in an increased N400 for legal compared to illegal pseudowords in the EEG conforming to adult-like mechanisms. Unfortunately, fNIRS findings did not support this discrimination ability. Possible methodological and brain maturational reasons might explain this null finding. This study provides evidence for the advantage of a multi-methodological approach in order to get a clear picture on neural language development.

Uncovering electrophysiological and vascular signatures of implicit emotional prosody

The capability of differentiating between various emotional states in speech displays a crucial prerequisite for successful social interactions. The aim of the present study was to investigate neural processes underlying this differentiating ability by applying a simultaneous neuroscientific approach in order to gain both electrophysiological (via electroencephalography, EEG) and vascular (via functional near-infrared-spectroscopy, fNIRS) responses. Pseudowords conforming to angry, happy, and neutral prosody were presented acoustically to participants using a passive listening paradigm in order to capture implicit mechanisms of emotional prosody processing. Event-related brain potentials (ERPs) revealed a larger P200 and an increased late positive potential (LPP) for happy prosody as well as larger negativities for angry and neutral prosody compared to happy prosody around 500 ms. FNIRS results showed increased activations for angry prosody at right fronto-temporal areas. Correlation between negativity in the EEG and activation in fNIRS for angry prosody suggests analogous underlying processes resembling a negativity bias. Overall, results indicate that mechanisms of emotional and phonological encoding (P200), emotional evaluation (increased negativities) as well as emotional arousal and relevance (LPP) are present during implicit processing of emotional prosody.

Bilingual and Monolingual First Language Acquisition Experience Differentially Shapes Children's Property Term Learning: Evidence from Behavioral and Neurophysiological Measures

Studies of novel noun learning show bilingual children rely less on the Mutual Exclusivity Constraint (MEC) for word learning than monolinguals. Shifting the focus to learning novel property terms (adjectives), the present study compared 3.5- and five-year-old bilingual and monolingual preschoolers' adherence to the MEC. We found no bilingual-monolingual differences on a behavioral forced-choice task for the 3.5-year-olds, but five-year-old monolinguals adhered more to the MEC than bilinguals did. Older bilinguals adhered less to the MEC than younger ones, while there was no difference in MEC adherence between the younger and older monolinguals. In the 5-year-olds, we additionally acquired neurophysiological data using functional near-infrared spectroscopy (fNIRS) to allow for a first explorative look at potential neuronal underpinnings. The data show that, compared to bilinguals, monolinguals reveal higher activation over three brain regions (right frontal, left temporo-parietal, and left prefrontal) that may be involved in exploiting the MEC, building on conflict detection, inhibition, solution of a disjunction, and working memory processes. Taken together, our behavioral and neurophysiological findings reveal different paths towards novel property term learning depending on children's language acquisition context.

Near-infrared spectroscopy reveals neural perception of vocal emotions in human neonates

Processing affective prosody, that is the emotional tone of a speaker, is fundamental to human communication and adaptive behaviors. Previous studies have mainly focused on adults and infants; thus the neural mechanisms underlying the processing of affective prosody in newborns remain unclear. Here, we used near-infrared spectroscopy to examine the ability of 0-to-4-day-old neonates to discriminate emotions conveyed by speech prosody in their maternal language and a foreign language. Happy, fearful, and angry prosodies enhanced neural activation in the right superior temporal gyrus relative to neutral prosody in the maternal but not the foreign language. Happy prosody elicited greater activation than negative prosody in the left superior frontal gyrus and the left angular gyrus, regions that have not been associated with affective prosody processing in infants or adults. These findings suggest that sensitivity to affective prosody is formed through prenatal exposure to vocal stimuli of the maternal language. Furthermore, the sensitive neural correlates appeared more distributed in neonates than infants, indicating a high-level of neural specialization between the neonatal stage and early infancy. Finally, neonates showed preferential neural responses to positive over negative prosody, which is contrary to the "negativity bias" phenomenon established in adult and infant studies.

Can infants learn phonology in the lab? A meta-analytic answer

Two of the key tasks facing the language-learning infant lie at the level of phonology: establishing which sounds are contrastive in the native inventory, and determining what their possible syllabic positions and permissible combinations (phonotactics) are. In 2002-2003, two theoretical proposals, one bearing on how infants can learn sounds (Maye, Werker, & Gerken, 2002) and the other on phonotactics (Chambers, Onishi, & Fisher, 2003), were put forward on the pages of Cognition, each supported by two laboratory experiments, wherein a group of infants was briefly exposed to a set of pseudo-words, and plausible phonological generalizations were tested subsequently. These two papers have received considerable attention from the general scientific community, and inspired a flurry of follow-up work. In the context of questions regarding the replicability of psychological science, the present work uses a meta-analytic approach to appraise extant empirical evidence for infant phonological learning in the laboratory. It is found that neither seminal finding (on learning sounds and learning phonotactics) holds up when close methodological replications are integrated, although less close methodological replications do provide some evidence in favor of the sound learning strand of work. Implications for authors and readers of this literature are drawn out. It would be desirable that additional mechanisms for phonological learning be explored, and that future infant laboratory work employ paradigms that rely on constrained and unambiguous links between experimental exposure and measured infant behavior.