Discovering words in fluent speech: the contribution of two kinds of statistical information

Exploring neural tracking of acoustic and linguistic speech representations in individuals with post-stroke aphasia

Aphasia is a communication disorder that affects processing of language at different levels (e.g., acoustic, phonological, semantic). Recording brain activity via Electroencephalography while people listen to a continuous story allows to analyze brain responses to acoustic and linguistic properties of speech. When the neural activity aligns with these speech properties, it is referred to as neural tracking. Even though measuring neural tracking of speech may present an interesting approach to studying aphasia in an ecologically valid way, it has not yet been investigated in individuals with stroke-induced aphasia. Here, we explored processing of acoustic and linguistic speech representations in individuals with aphasia in the chronic phase after stroke and age-matched healthy controls. We found decreased neural tracking of acoustic speech representations (envelope and envelope onsets) in individuals with aphasia. In addition, word surprisal displayed decreased amplitudes in individuals with aphasia around 195 ms over frontal electrodes, although this effect was not corrected for multiple comparisons. These results show that there is potential to capture language processing impairments in individuals with aphasia by measuring neural tracking of continuous speech. However, more research is needed to validate these results. Nonetheless, this exploratory study shows that neural tracking of naturalistic, continuous speech presents a powerful approach to studying aphasia.

Prosody outweighs statistics in 6-month-old German-learning infants' speech segmentation

It is well established that infants use various cues to find words within fluent speech from about 7 to 8 months of age. Research suggests that two main mechanisms support infants' speech segmentation: prosodic cues like the word stress patterns, and distributional cues like transitional probabilities (TPs). We tested 6-month-old German-learning infants' use of prosodic and statistical cues for speech segmentation in three experiments. In Experiment 1, infants were familiarized with an artificial language string where TPs signaled either word boundaries or iambic words-a stress pattern that is disfavored in German. Experiment 2 was a control and only the test phase was presented. In Experiment 3, prosodic cues were absent in the string and only TPs signaled word boundaries. All experiments included the same conditions at test: disyllabic words with high TPs in the string, words with low TPs and words with non-co-occurring syllables. Results showed that infants relied more strongly on prosodic cues than on TPs for word segmentation. Notably, no segmentation evidence emerged when prosodic cues were absent in the string. This finding underlines early impacts of language-specific structural properties on segmentation mechanisms.

Non-adjacent dependency learning from variable input: investigating the effects of bilingualism, phonological memory, and cognitive control

Introduction

One proposed advantage of bilingualism concerns the ability to extract regularities based on frequency information (statistical learning). Specifically, it has been proposed that bilinguals have an advantage in statistical learning that particularly holds in situations of variable input. Empirical evidence on this matter is scarce. An additional question is whether a potential bilingual advantage in statistical learning can be attributed to enhancements in phonological memory and cognitive control. Previous findings on effects of bilingualism on phonological memory and cognitive control are not consistent.

Method

In the present study, we compared statistical learning from consistent and variable input in monolingual and bilingual children (Study 1) and adults (Study 2). We also explored whether phonological memory and cognitive control might account for any potential group differences found.

Results

The findings suggest that there might be some advantage of bilinguals in statistical learning, but that this advantage is not robust: It largely surfaced only in t-tests against chance for the groups separately, did not surface in the same way for children and adults, and was modulated by experiment order. Furthermore, our results provide no evidence that any enhancement in bilinguals' statistical learning was related to improved phonological memory and cognitive control: bilinguals did not outperform monolinguals on these cognitive measures and performance on these measures did not consistently relate to statistical learning outcomes.

Discussion

Taken together, these findings suggest that any potential effects of bilingualism on statistical learning probably do not involve enhanced cognitive abilities associated with bilingualism.

Seeing a talking face matters: Infants' segmentation of continuous auditory-visual speech

Visual speech cues from a speaker's talking face aid speech segmentation in adults, but despite the importance of speech segmentation in language acquisition, little is known about the possible influence of visual speech on infants' speech segmentation. Here, to investigate whether there is facilitation of speech segmentation by visual information, two groups of English-learning 7-month-old infants were presented with continuous speech passages, one group with auditory-only (AO) speech and the other with auditory-visual (AV) speech. Additionally, the possible relation between infants' relative attention to the speaker's mouth versus eye regions and their segmentation performance was examined. Both the AO and the AV groups of infants successfully segmented words from the continuous speech stream, but segmentation performance persisted for longer for infants in the AV group. Interestingly, while AV group infants showed no significant relation between the relative amount of time spent fixating the speaker's mouth versus eyes and word segmentation, their attention to the mouth was greater than that of AO group infants, especially early in test trials. The results are discussed in relation to the possible pathways through which visual speech cues aid speech perception.

Statistical Learning of Language: A Meta-Analysis Into 25 Years of Research

Statistical learning is a key concept in our understanding of language acquisition. Ample work has highlighted its role in numerous linguistic functions-yet statistical learning is not a unitary construct, and its consistency across different language properties remains unclear. In a meta-analysis of auditory-linguistic statistical learning research spanning the last 25 years, we evaluated how learning varies across different language properties in infants, children, and adults and surveyed the methodological trends in the literature. We found robust learning across stimuli (syllables, words, etc.) in infants, and across stimuli and structures (adjacent dependencies, non-adjacent dependencies, etc.) in adults, with larger effect sizes when multiple cues were present. However, the analysis also showed significant publication bias and revealed a tendency toward using a narrow range of simplified language properties, including in the strength of the transitional probabilities used during training. Bayes factor analyses revealed prevalent data insensitivity of moderators commonly hypothesized to impact learning, such as the amount of exposure and transitional probability strength, which contradict core theoretical assumptions in the field. Methodological factors, such as the tasks used at test, also significantly impacted effect sizes in adults and children, suggesting that choice of task may critically constrain current theories of how statistical learning operates. Collectively, our results suggest that auditory-linguistic statistical learning has the kind of robustness needed to play a foundational role in language acquisition, but that more research is warranted to reveal its full potential.

Spanish input accelerates bilingual infants' segmentation of English words

We asked whether increased exposure to iambs, two-syllable words with stress on the second syllable (e.g., guitar), by way of another language - Spanish - facilitates English learning infants' segmentation of iambs. Spanish has twice as many iambic words (40%) compared to English (20%). Using the Headturn Preference Procedure we tested bilingual Spanish and English learning 8-month-olds' ability to segment English iambs. Monolingual English learning infants succeed at this task only by 11 months. We showed that at 8 months, bilingual Spanish and English learning infants successfully segmented English iambs, and not simply the stressed syllable, unlike their monolingual English learning peers. At the same age, bilingual infants failed to segment Spanish iambs, just like their monolingual Spanish peers. These results cannot be explained by bilingual infants' reliance on transitional probability cues to segment words in both their native languages because statistical cues were comparable in the two languages. Instead, based on their accelerated development, we argue for autonomous but interdependent development of the two languages of bilingual infants.

Active listening

This paper introduces active listening, as a unified framework for synthesising and recognising speech. The notion of active listening inherits from active inference, which considers perception and action under one universal imperative: to maximise the evidence for our (generative) models of the world. First, we describe a generative model of spoken words that simulates (i) how discrete lexical, prosodic, and speaker attributes give rise to continuous acoustic signals; and conversely (ii) how continuous acoustic signals are recognised as words. The 'active' aspect involves (covertly) segmenting spoken sentences and borrows ideas from active vision. It casts speech segmentation as the selection of internal actions, corresponding to the placement of word boundaries. Practically, word boundaries are selected that maximise the evidence for an internal model of how individual words are generated. We establish face validity by simulating speech recognition and showing how the inferred content of a sentence depends on prior beliefs and background noise. Finally, we consider predictive validity by associating neuronal or physiological responses, such as the mismatch negativity and P300, with belief updating under active listening, which is greatest in the absence of accurate prior beliefs about what will be heard next.

Dual language statistical word segmentation in infancy: Simulating a language-mixing bilingual environment

Infants are sensitive to syllable co-occurrence probabilities when segmenting words from fluent speech. However, segmenting two languages overlapping at the syllabic level is challenging because the statistical cues across the languages are incongruent. Successful segmentation, thus, relies on infants' ability to separate language inputs and track the statistics of each language. Here, we report three experiments investigating how infants statistically segment words from two overlapping languages in a simulated language-mixing bilingual environment. In the first two experiments, we investigated whether 9.5-month-olds can use French and English phonetic markers to segment words from two overlapping artificial languages produced by one individual. After showing that infants could segment the languages when the languages were presented in isolation (Experiment 1), we presented infants with two interleaved languages differing in phonetic cues (Experiment 2). Both monolingual and bilingual infants successfully segmented words from one of the two languages-the language heard last during familiarization. In Experiment 3, a conceptual replication, we replicated the findings of Experiment 2 with a different population and with different cues. As before, when 12-month-old monolingual infants heard two interleaved languages differing in English and Finnish phonetic cues, they learned only the last language heard during familiarization. Together, our findings suggest that segmenting words in a language-mixing environment is challenging, but infants possess a nascent ability to recruit phonetic cues to segment words from one of two overlapping languages in a bilingual-like environment. A video abstract of this article can be viewed at https://www.youtube.com/watch?v=92pNcpxZguw.

Statistical Learning and Bilingualism

Purpose

Over the last 2 decades, research on statistical learning has demonstrated its importance in supporting language development. Notably, most of the research to date has focused on monolingual populations (or has not reported the language background of participants). Several recent studies, however, have begun to focus on the impact of bilingualism on statistical learning. To date, the results have been quite mixed, with a handful of studies finding differences between monolinguals and bilinguals and several other studies reporting no differences. Thus, the purpose of this manuscript is to review the literature to date on how bilingualism impacts statistical learning abilities.

Method

We review the contemporary literature, organized by the age of participants and by task when relevant.

Conclusions

We note that there are many discrepant findings within this nascent field, although some trends have emerged. For instance, differences in performance may be attributed to factors such as age of acquisition. However, we note that the state of the field does not yet permit firm clinical recommendations.

Reduplication facilitates early word segmentation

This study explores the possibility that early word segmentation is aided by infants' tendency to segment words with repeated syllables ('reduplication'). Twenty-four nine-month-olds were familiarized with passages containing one novel reduplicated word and one novel non-reduplicated word. Their central fixation times in response to these as well as new reduplicated and non-reduplicated words introduced at test showed that familiarized reduplicated words were segmented better than familiarized non-reduplicated words. These results demonstrate that infants are predisposed to segment words with repeated phonological elements, and suggest that register-specific words in infant-directed speech may have evolved in response to this learning bias.

The limits of metrical segmentation: intonation modulates infants' extraction of embedded trochees

We tested German nine-month-olds' reliance on pitch and metrical stress for segmentation. In a headturn-preference paradigm, infants were familiarized with trisyllabic words (weak-strong-weak (WSW) stress pattern) in sentence-contexts. The words were presented in one of three naturally occurring intonation conditions: one in which high pitch was aligned with the stressed syllable and two misalignment conditions (with high pitch preceding vs. following the stressed syllable). Infants were tested on the SW unit of the WSW carriers. Experiment 1 showed recognition only when the stressed syllable was high-pitched. Intonation of test items (similar vs. dissimilar to familiarization) had no influence (Experiment 2). Thus, German nine-month-olds perceive stressed syllables as word onsets only when high-pitched, although they already generalize over different pitch contours. Different mechanisms underlying this pattern of results are discussed.

Finding words and word structure in artificial speech: the development of infants' sensitivity to morphosyntactic regularities

To achieve language proficiency, infants must find the building blocks of speech and master the rules governing their legal combinations. However, these problems are linked: words are also built according to rules. Here, we explored early morphosyntactic sensitivity by testing when and how infants could find either words or within-word structure in artificial speech snippets embodying properties of morphological constructions. We show that 12-month-olds use statistical relationships between syllables to extract words from continuous streams, but find word-internal regularities only if the streams are segmented. Seven-month-olds fail both tasks. Thus, 12-month-olds infants possess the resources to analyze the internal composition of words if the speech contains segmentation information. However, 7-month-old infants may not possess them, although they can track several statistical relations. This developmental difference suggests that morphosyntactic sensitivity may require computational resources extending beyond the detection of simple statistics.

The edge factor in early word segmentation: utterance-level prosody enables word form extraction by 6-month-olds

Past research has shown that English learners begin segmenting words from speech by 7.5 months of age. However, more recent research has begun to show that, in some situations, infants may exhibit rudimentary segmentation capabilities at an earlier age. Here, we report on four perceptual experiments and a corpus analysis further investigating the initial emergence of segmentation capabilities. In Experiments 1 and 2, 6-month-olds were familiarized with passages containing target words located either utterance medially or at utterance edges. Only those infants familiarized with passages containing target words aligned with utterance edges exhibited evidence of segmentation. In Experiments 3 and 4, 6-month-olds recognized familiarized words when they were presented in a new acoustically distinct voice (male rather than female), but not when they were presented in a phonologically altered manner (missing the initial segment). Finally, we report corpus analyses examining how often different word types occur at utterance boundaries in different registers. Our findings suggest that edge-aligned words likely play a key role in infants' early segmentation attempts, and also converge with recent reports suggesting that 6-month-olds' have already started building a rudimentary lexicon.

Words and possible words in early language acquisition

In order to acquire language, infants must extract its building blocks-words-and master the rules governing their legal combinations from speech. These two problems are not independent, however: words also have internal structure. Thus, infants must extract two kinds of information from the same speech input. They must find the actual words of their language. Furthermore, they must identify its possible words, that is, the sequences of sounds that, being morphologically well formed, could be words. Here, we show that infants' sensitivity to possible words appears to be more primitive and fundamental than their ability to find actual words. We expose 12- and 18-month-old infants to an artificial language containing a conflict between statistically coherent and structurally coherent items. We show that 18-month-olds can extract possible words when the familiarization stream contains marks of segmentation, but cannot do so when the stream is continuous. Yet, they can find actual words from a continuous stream by computing statistical relationships among syllables. By contrast, 12-month-olds can find possible words when familiarized with a segmented stream, but seem unable to extract statistically coherent items from a continuous stream that contains minimal conflicts between statistical and structural information. These results suggest that sensitivity to word structure is in place earlier than the ability to analyze distributional information. The ability to compute nontrivial statistical relationships becomes fully effective relatively late in development, when infants have already acquired a considerable amount of linguistic knowledge. Thus, mechanisms for structure extraction that do not rely on extensive sampling of the input are likely to have a much larger role in language acquisition than general-purpose statistical abilities.