Neural development of networks for audiovisual speech comprehension

Prediction of Verbal Abilities From Brain Connectivity Data Across the Lifespan Using a Machine Learning Approach

Compared to nonverbal cognition such as executive or memory functions, language-related cognition generally appears to remain more stable until later in life. Nevertheless, different language-related processes, for example, verbal fluency versus vocabulary knowledge, appear to show different trajectories across the life span. One potential explanation for differences in verbal functions may be alterations in the functional and structural network architecture of different large-scale brain networks. For example, differences in verbal abilities have been linked to the communication within and between the frontoparietal (FPN) and default mode network (DMN). It, however, remains open whether brain connectivity within these networks may be informative for language performance at the individual level across the life span. Further information in this regard may be highly desirable as verbal abilities allow us to participate in daily activities, are associated with quality of life, and may be considered in preventive and interventional setups to foster cognitive health across the life span. So far, mixed prediction results based on resting-state functional connectivity (FC) and structural connectivity (SC) data have been reported for language abilities across different samples, age groups, and machine-learning (ML) approaches. Therefore, the current study set out to investigate the predictability of verbal fluency and vocabulary knowledge based on brain connectivity data in the DMN, FPN, and the whole brain using an ML approach in a lifespan sample (N = 717; age range: 18-85) from the 1000BRAINS study. Prediction performance was, thereby, systematically compared across (i) verbal [verbal fluency and vocabulary knowledge] and nonverbal abilities [processing speed and visual working memory], (ii) modalities [FC and SC data], (iii) feature sets [DMN, FPN, DMN-FPN, and whole brain], and (iv) samples [total, younger, and older aged group]. Results from the current study showed that verbal abilities could not be reliably predicted from FC and SC data across feature sets and samples. Thereby, no predictability differences emerged between verbal fluency and vocabulary knowledge across input modalities, feature sets, and samples. In contrast to verbal functions, nonverbal abilities could be moderately predicted from connectivity data, particularly SC, in the total and younger age group. Satisfactory prediction performance for nonverbal cognitive functions based on currently chosen connectivity data was, however, not encountered in the older age group. Current results, hence, emphasized that verbal functions may be more difficult to predict from brain connectivity data in domain-general cognitive networks and the whole brain compared to nonverbal abilities, particularly executive functions, across the life span. Thus, it appears warranted to more closely investigate differences in predictability between different cognitive functions and age groups.

Subtitled speech: the neural mechanisms of ticker-tape synaesthesia

The acquisition of reading modifies areas of the brain associated with vision and with language, in addition to their connections. These changes enable reciprocal translation between orthography and the sounds and meaning of words. Individual variability in the pre-existing cerebral substrate contributes to the range of eventual reading abilities, extending to atypical developmental patterns, including dyslexia and reading-related synaesthesias. The present study is devoted to the little-studied but highly informative ticker-tape synaesthesia, in which speech perception triggers the vivid and irrepressible perception of words in their written form in the mind's eye. We scanned a group of 17 synaesthetes and 17 matched controls with functional MRI, while they listened to spoken sentences, words, numbers or pseudowords (Experiment 1), viewed images and written words (Experiment 2) or were at rest (Experiment 3). First, we found direct correlates of the ticker-tape synaesthesia phenomenon: during speech perception, as ticker-tape synaesthesia was active, synaesthetes showed over-activation of left perisylvian regions supporting phonology and of the occipitotemporal visual word form area, where orthography is represented. Second, we provided support to the hypothesis that ticker-tape synaesthesia results from atypical relationships between spoken and written language processing: the ticker-tape synaesthesia-related regions overlap closely with cortices activated during reading, and the overlap of speech-related and reading-related areas is larger in synaesthetes than in controls. Furthermore, the regions over-activated in ticker-tape synaesthesia overlap with regions under-activated in dyslexia. Third, during the resting state (i.e. in the absence of current ticker-tape synaesthesia), synaesthetes showed increased functional connectivity between left prefrontal and bilateral occipital regions. This pattern might reflect a lowered threshold for conscious access to visual mental contents and might imply a non-specific predisposition to all synaesthesias with a visual content. These data provide a rich and coherent account of ticker-tape synaesthesia as a non-detrimental developmental condition created by the interaction of reading acquisition with an atypical cerebral substrate.

Beta Spectral Power during Passive Listening in Preschool Children with Specific Language Impairment

INTRODUCTION

Children with specific language impairment (SLI) have difficulties in different speech and language domains. Electrophysiological studies have documented that auditory processing in children with SLI is atypical and probably caused by delayed and abnormal auditory maturation. During the resting state, or different auditory tasks, children with SLI show low or high beta spectral power, which could be a clinical correlate for investigating brain rhythms.

METHODS

The aim of this study was to examine the electrophysiological cortical activity of the beta rhythm while listening to words and nonwords in children with SLI in comparison to typical development (TD) children. The participants were 50 children with SLI, aged 4 and 5 years, and 50 age matched TD children. The children were divided into two subgroups according to age: (1) children 4 years of age; (2) children 5 years of age.

RESULTS

The older group differed from the younger group in beta auditory processing, with increased values of beta spectral power in the right frontal, temporal, and parietal regions. In addition, children with SLI have higher beta spectral power than TD children in the bilateral temporal regions.

CONCLUSION

Complex beta auditory activation in TD and SLI children indicates the presence of early changes in functional brain connectivity.

INTRODUCTION

Children with specific language impairment (SLI) have difficulties in different speech and language domains. Electrophysiological studies have documented that auditory processing in children with SLI is atypical and probably caused by delayed and abnormal auditory maturation. During the resting state, or different auditory tasks, children with SLI show low or high beta spectral power, which could be a clinical correlate for investigating brain rhythms.

METHODS

The aim of this study was to examine the electrophysiological cortical activity of the beta rhythm while listening to words and nonwords in children with SLI in comparison to typical development (TD) children. The participants were 50 children with SLI, aged 4 and 5 years, and 50 age matched TD children. The children were divided into two subgroups according to age: (1) children 4 years of age; (2) children 5 years of age.

RESULTS

The older group differed from the younger group in beta auditory processing, with increased values of beta spectral power in the right frontal, temporal, and parietal regions. In addition, children with SLI have higher beta spectral power than TD children in the bilateral temporal regions.

CONCLUSION

Complex beta auditory activation in TD and SLI children indicates the presence of early changes in functional brain connectivity.

Watching talking faces: The development of cortical representation of visual syllables in infancy

From birth, we perceive speech by hearing and seeing people talk. In adults cortical representations of visual speech are processed in the putative temporal visual speech area (TVSA), but it remains unknown how these representations develop. We measured infants' cortical responses to silent visual syllables and non-communicative mouth movements using functional Near-Infrared Spectroscopy. Our results indicate that cortical specialisation for visual speech may emerge during infancy. The putative TVSA was active to both visual syllables and gurning around 5 months of age, and more active to gurning than to visual syllables around 10 months of age. Multivariate pattern analysis classification of distinct cortical responses to visual speech and gurning was successful at 10, but not at 5 months of age. These findings imply that cortical representations of visual speech change between 5 and 10 months of age, showing that the putative TVSA is initially broadly tuned and becomes selective with age.

Benefit of visual speech information for word comprehension in post-stroke aphasia

Aphasia is a language disorder that often involves speech comprehension impairments affecting communication. In face-to-face settings, speech is accompanied by mouth and facial movements, but little is known about the extent to which they benefit aphasic comprehension. This study investigated the benefit of visual information accompanying speech for word comprehension in people with aphasia (PWA) and the neuroanatomic substrates of any benefit. Thirty-six PWA and 13 neurotypical matched control participants performed a picture-word verification task in which they indicated whether a picture of an animate/inanimate object matched a subsequent word produced by an actress in a video. Stimuli were either audiovisual (with visible mouth and facial movements) or auditory-only (still picture of a silhouette) with audio being clear (unedited) or degraded (6-band noise-vocoding). We found that visual speech information was more beneficial for neurotypical participants than PWA, and more beneficial for both groups when speech was degraded. A multivariate lesion-symptom mapping analysis for the degraded speech condition showed that lesions to superior temporal gyrus, underlying insula, primary and secondary somatosensory cortices, and inferior frontal gyrus were associated with reduced benefit of audiovisual compared to auditory-only speech, suggesting that the integrity of these fronto-temporo-parietal regions may facilitate cross-modal mapping. These findings provide initial insights into our understanding of the impact of audiovisual information on comprehension in aphasia and the brain regions mediating any benefit.

A single case neuroimaging study of tickertape synesthesia

Reading acquisition is enabled by deep changes in the brain's visual system and language areas, and in the links subtending their collaboration. Disruption of those plastic processes commonly results in developmental dyslexia. However, atypical development of reading mechanisms may occasionally result in ticker-tape synesthesia (TTS), a condition described by Francis Galton in 1883 wherein individuals "see mentally in print every word that is uttered (…) as from a long imaginary strip of paper". While reading is the bottom-up translation of letters into speech, TTS may be viewed as its opposite, the top-down translation of speech into internally visualized letters. In a series of functional MRI experiments, we studied MK, a man with TTS. We showed that a set of left-hemispheric areas were more active in MK than in controls during the perception of normal than reversed speech, including frontoparietal areas involved in speech processing, and the Visual Word Form Area, an occipitotemporal region subtending orthography. Those areas were identical to those involved in reading, supporting the construal of TTS as upended reading. Using dynamic causal modeling, we further showed that, parallel to reading, TTS induced by spoken words and pseudowords relied on top-down flow of information along distinct lexical and phonological routes, involving the middle temporal and supramarginal gyri, respectively. Future studies of TTS should shed new light on the neurodevelopmental mechanisms of reading acquisition, their variability and their disorders.

Differences in brain functional networks for audiovisual integration during reading between children and adults

Building robust letter-to-sound correspondences is a prerequisite for developing reading capacity. However, the neural mechanisms underlying the development of audiovisual integration for reading are largely unknown. This study used functional magnetic resonance imaging in a lexical decision task to investigate functional brain networks that support audiovisual integration during reading in developing child readers (10-12 years old) and skilled adult readers (20-28 years old). The results revealed enhanced connectivity in a prefrontal-superior temporal network (including the right medial frontal gyrus, right superior frontal gyrus, and left superior temporal gyrus) in adults relative to children, reflecting the development of attentional modulation of audiovisual integration involved in reading processing. Furthermore, the connectivity strength of this brain network was correlated with reading accuracy. Collectively, this study, for the first time, elucidates the differences in brain networks of audiovisual integration for reading between children and adults, promoting the understanding of the neurodevelopment of multisensory integration in high-level human cognition.

Effect of aging on audiovisual integration: Comparison of high- and low-intensity conditions in a speech discrimination task

Audiovisual integration is an essential process that influences speech perception in conversation. However, it is still debated whether older individuals benefit more from audiovisual integration than younger individuals. This ambiguity is likely due to stimulus features, such as stimulus intensity. The purpose of the current study was to explore the effect of aging on audiovisual integration, using event-related potentials (ERPs) at different stimulus intensities. The results showed greater audiovisual integration in older adults at 320–360 ms. Conversely, at 460–500 ms, older adults displayed attenuated audiovisual integration in the frontal, fronto-central, central, and centro-parietal regions compared to younger adults. In addition, we found older adults had greater audiovisual integration at 200–230 ms under the low-intensity condition compared to the high-intensity condition, suggesting inverse effectiveness occurred. However, inverse effectiveness was not found in younger adults. Taken together, the results suggested that there was age-related dissociation in audiovisual integration and inverse effectiveness, indicating that the neural mechanisms underlying audiovisual integration differed between older adults and younger adults.

Fiber tracing and microstructural characterization among audiovisual integration brain regions in neonates compared with young adults

Audiovisual integration has been related with cognitive-processing and behavioral advantages, as well as with various socio-cognitive disorders. While some studies have identified brain regions instantiating this ability shortly after birth, little is known about the structural pathways connecting them. The goal of the present study was to reconstruct fiber tracts linking AVI regions in the newborn in-vivo brain and assess their adult-likeness by comparing them with analogous fiber tracts of young adults. We performed probabilistic tractography and compared connective probabilities between a sample of term-born neonates (N = 311; the Developing Human Connectome Project (dHCP, http://www.developingconnectome.org) and young adults (N = 311 The Human Connectome Project; https://www.humanconnectome.org/) by means of a classification algorithm. Furthermore, we computed Dice coefficients to assess between-group spatial similarity of the reconstructed fibers and used diffusion metrics to characterize neonates' AVI brain network in terms of microstructural properties, interhemispheric differences and the association with perinatal covariates and biological sex. Overall, our results indicate that the AVI fiber bundles were successfully reconstructed in a vast majority of neonates, similarly to adults. Connective probability distributional similarities and spatial overlaps of AVI fibers between the two groups differed across the reconstructed fibers. There was a rank-order correspondence of the fibers' connective strengths across the groups. Additionally, the study revealed patterns of diffusion metrics in line with early white matter developmental trajectories and a developmental advantage for females. Altogether, these findings deliver evidence of meaningful structural connections among AVI regions in the newborn in-vivo brain.

A Bayesian meta-analysis of infants' ability to perceive audio-visual congruence for speech

This paper quantifies the extent to which infants can perceive audio-visual congruence for speech information and assesses whether this ability changes with native language exposure over time. A hierarchical Bayesian robust regression model of 92 separate effect sizes extracted from 24 studies indicates a moderate effect size in a positive direction (0.35, CI [0.21: 0.50]). This result suggests that infants possess a robust ability to detect audio-visual congruence for speech. Moderator analyses, moreover, suggest that infants' audio-visual matching ability for speech emerges at an early point in the process of language acquisition and remains stable for both native and non-native speech throughout early development. A sensitivity analysis of the meta-analytic data, however, indicates that a moderate publication bias for significant results could shift the lower credible interval to include null effects. Based on these findings, we outline recommendations for new lines of enquiry and suggest ways to improve the replicability of results in future investigations.

Language Without Speech: Segregating Distinct Circuits in the Human Brain

Language is a fundamental part of human cognition. The question of whether language is processed independently of speech, however, is still heavily discussed. The absence of speech in deaf signers offers the opportunity to disentangle language from speech in the human brain. Using probabilistic tractography, we compared brain structural connectivity of adult deaf signers who had learned sign language early in life to that of matched hearing controls. Quantitative comparison of the connectivity profiles revealed that the core language tracts did not differ between signers and controls, confirming that language is independent of speech. In contrast, pathways involved in the production and perception of speech displayed lower connectivity in deaf signers compared to hearing controls. These differences were located in tracts towards the left pre-supplementary motor area and the thalamus when seeding in Broca's area, and in ipsilateral parietal areas and the precuneus with seeds in left posterior temporal regions. Furthermore, the interhemispheric connectivity between the auditory cortices was lower in the deaf than in the hearing group, underlining the importance of the transcallosal connection for early auditory processes. The present results provide evidence for a functional segregation of the neural pathways for language and speech.

Development of the Mechanisms Underlying Audiovisual Speech Perception Benefit

The natural environments in which infants and children learn speech and language are noisy and multimodal. Adults rely on the multimodal nature of speech to compensate for noisy environments during speech communication. Multiple mechanisms underlie mature audiovisual benefit to speech perception, including reduced uncertainty as to when auditory speech will occur, use of correlations between the amplitude envelope of auditory and visual signals in fluent speech, and use of visual phonetic knowledge for lexical access. This paper reviews evidence regarding infants' and children's use of temporal and phonetic mechanisms in audiovisual speech perception benefit. The ability to use temporal cues for audiovisual speech perception benefit emerges in infancy. Although infants are sensitive to the correspondence between auditory and visual phonetic cues, the ability to use this correspondence for audiovisual benefit may not emerge until age four. A more cohesive account of the development of audiovisual speech perception may follow from a more thorough understanding of the development of sensitivity to and use of various temporal and phonetic cues.

Neural Correlates of Phonetic Adaptation as Induced by Lexical and Audiovisual Context

When speech perception is difficult, one way listeners adjust is by reconfiguring phoneme category boundaries, drawing on contextual information. Both lexical knowledge and lipreading cues are used in this way, but it remains unknown whether these two differing forms of perceptual learning are similar at a neural level. This study compared phoneme boundary adjustments driven by lexical or audiovisual cues, using ultra-high-field 7-T fMRI. During imaging, participants heard exposure stimuli and test stimuli. Exposure stimuli for lexical retuning were audio recordings of words, and those for audiovisual recalibration were audio-video recordings of lip movements during utterances of pseudowords. Test stimuli were ambiguous phonetic strings presented without context, and listeners reported what phoneme they heard. Reports reflected phoneme biases in preceding exposure blocks (e.g., more reported /p/ after /p/-biased exposure). Analysis of corresponding brain responses indicated that both forms of cue use were associated with a network of activity across the temporal cortex, plus parietal, insula, and motor areas. Audiovisual recalibration also elicited significant occipital cortex activity despite the lack of visual stimuli. Activity levels in several ROIs also covaried with strength of audiovisual recalibration, with greater activity accompanying larger recalibration shifts. Similar activation patterns appeared for lexical retuning, but here, no significant ROIs were identified. Audiovisual and lexical forms of perceptual learning thus induce largely similar brain response patterns. However, audiovisual recalibration involves additional visual cortex contributions, suggesting that previously acquired visual information (on lip movements) is retrieved and deployed to disambiguate auditory perception.

Resting-state networks of the neonate brain identified using independent component analysis

Resting-state functional magnetic resonance imaging (rs-fMRI) has been successfully used to probe the intrinsic functional organization of the brain and to study brain development. Here, we implemented a combination of individual and group independent component analysis (ICA) of FSL on a 6-min resting-state data set acquired from 21 naturally sleeping term-born (age 26 ± 6.7 d), healthy neonates to investigate the emerging functional resting-state networks (RSNs). In line with the previous literature, we found evidence of sensorimotor, auditory/language, visual, cerebellar, thalmic, parietal, prefrontal, anterior cingulate as well as dorsal and ventral aspects of the default-mode-network. Additionally, we identified RSNs in frontal, parietal, and temporal regions that have not been previously described in this age group and correspond to the canonical RSNs established in adults. Importantly, we found that careful ICA-based denoising of fMRI data increased the number of networks identified with group-ICA, whereas the degree of spatial smoothing did not change the number of identified networks. Our results show that the infant brain has an established set of RSNs soon after birth.

Functional magnetic resonance imaging (fMRI) item analysis of empathy and theory of mind

In contrast to conventional functional magnetic resonance imaging (fMRI) analysis across participants, item analysis allows generalizing the observed neural response patterns from a specific stimulus set to the entire population of stimuli. In the present study, we perform an item analysis on an fMRI paradigm (EmpaToM) that measures the neural correlates of empathy and Theory of Mind (ToM). The task includes a large stimulus set (240 emotional vs. neutral videos to probe empathic responding and 240 ToM or factual reasoning questions to probe ToM), which we tested in two large participant samples (N = 178, N = 130). Both, the empathy‐related network comprising anterior insula, anterior cingulate/dorsomedial prefrontal cortex, inferior frontal gyrus, and dorsal temporoparietal junction/supramarginal gyrus (TPJ) and the ToM related network including ventral TPJ, superior temporal gyrus, temporal poles, and anterior and posterior midline regions, were observed across participants and items. Regression analyses confirmed that these activations are predicted by the empathy or ToM condition of the stimuli, but not by low‐level features such as video length, number of words, syllables or syntactic complexity. The item analysis also allowed for the selection of the most effective items to create optimized stimulus sets that provide the most stable and reproducible results. Finally, reproducibility was shown in the replication of all analyses in the second participant sample. The data demonstrate (a) the generalizability of empathy and ToM related neural activity and (b) the reproducibility of the EmpaToM task and its applicability in intervention and clinical imaging studies.

McGurk Effect by Individuals with Autism Spectrum Disorder and Typically Developing Controls: A Systematic Review and Meta-analysis

By synthesizing existing behavioural studies through a meta-analytic approach, the current study compared the performances of Autism spectrum disorder (ASD) and typically developing groups in audiovisual speech integration and investigated potential moderators that might contribute to the heterogeneity of the existing findings. In total, nine studies were included in the current study, and the pooled overall difference between the two groups was significant, g = - 0.835 (p < 0.001; 95% CI - 1.155 to - 0.516). Age and task scoring method were found to be associated with the inconsistencies of the findings reported by previous studies. These findings indicate that individuals with ASD show weaker McGurk effect than typically developing controls.

Modality-independent recruitment of inferior frontal cortex during speech processing in human infants

Despite increasing interest in the development of audiovisual speech perception in infancy, the underlying mechanisms and neural processes are still only poorly understood. In addition to regions in temporal cortex associated with speech processing and multimodal integration, such as superior temporal sulcus, left inferior frontal cortex (IFC) has been suggested to be critically involved in mapping information from different modalities during speech perception. To further illuminate the role of IFC during infant language learning and speech perception, the current study examined the processing of auditory, visual and audiovisual speech in 6-month-old infants using functional near-infrared spectroscopy (fNIRS). Our results revealed that infants recruit speech-sensitive regions in frontal cortex including IFC regardless of whether they processed unimodal or multimodal speech. We argue that IFC may play an important role in associating multimodal speech information during the early steps of language learning.

Network specialization during adolescence: Hippocampal effective connectivity in boys and girls

Adolescence is a complex period of concurrent mental and physical development that facilitates adult functioning at multiple levels. Despite the growing number of neuroimaging studies of cognitive development in adolescence focusing on regional activation patterns, there remains a paucity of information about the functional interactions across these participating regions that are critical for cognitive functioning, including memory. The current study used structural equation modeling (SEM) to determine how interactions among brain regions critical for memory change over the course of adolescence. We obtained functional MRI in 77 individuals aged 8-16 years old, divided into younger (ages 8-10) and older (ages > 11) cohorts, using an incidental encoding memory task to activate hippocampus formation and associated brain networks, as well as behavioral data on memory function. SEM was performed on the imaging data for four groups (younger girls, younger boys, older girls, and older boys) that were subsequently compared using a stacked model approach. Significant differences were seen between the models for these groups. Younger boys had a predominantly posterior distribution of connections originating in primary visual regions and terminating on multi-modal processing regions. In older boys, there was a relatively greater anterior connection distribution, with increased effective connectivity within association and multi-modal processing regions. Connection patterns in younger girls were similar to those of older boys, with a generally anterior-posterior distributed network among sensory, multi-modal, and limbic regions. In contrast, connections in older girls were widely distributed but relatively weaker. Memory performance increased with age, without a significant difference between the sexes. These findings suggest a progressive reorganization among brain regions, with a commensurate increase in efficiency of cognitive functioning, from younger to older individuals in both girls and boys, providing insight into the age- and gender-specific processes at play during this critical transition period.

Integración auditiva, visual y propioceptiva como sustrato del desarrollo del lenguaje

Introducción. El desarrollo del lenguaje es un proceso complejo considerado como marcador evolutivo del ser humano y puede ser comprendido a partir de la contribución de los sistemas sensoriales y de los eventos que ocurren en periodos críticos del desarrollo.Objetivo. Realizar una revisión de cómo se da la integración de la información auditiva, visual y propioceptiva y cómo se refleja en el desarrollo del lenguaje, destacando el papel de la interacción social como contexto que favorece este proceso.Materiales y métodos. Se utilizaron los términos MeSH “Language Development”; “Visual Perception”; “Hearing”; y “Proprioception en las bases de datos MEDLINE y Embase, limitando la búsqueda principal a artículos escritos en inglés, español y portugués.Resultados. El punto de partida lo constituye la información auditiva, la cual, en el primer año de vida, permite la discriminación de los elementos del ambiente que corresponden al lenguaje; luego un pico en su adquisición y posteriormente una etapa de máxima discriminación lingüística. La información visual proporciona la correspondencia del lenguaje en imágenes, sustrato de nominación y comprensión de palabras, además de la interpretación e imitación del componente emocional en la gesticulación. La información propioceptiva ofrece la retroalimentación de los patrones de ejecución motora empleados en la producción del lenguaje.Conclusión. El estudio del desarrollo lenguaje desde la integración sensorial ofrece nuevas perspectivas para el abordaje e intervención de sus desviaciones.

Multisensory Integration in Cochlear Implant Recipients

Speech perception is inherently a multisensory process involving integration of auditory and visual cues. Multisensory integration in cochlear implant (CI) recipients is a unique circumstance in that the integration occurs after auditory deprivation and the provision of hearing via the CI. Despite the clear importance of multisensory cues for perception, in general, and for speech intelligibility, specifically, the topic of multisensory perceptual benefits in CI users has only recently begun to emerge as an area of inquiry. We review the research that has been conducted on multisensory integration in CI users to date and suggest a number of areas needing further research. The overall pattern of results indicates that many CI recipients show at least some perceptual gain that can be attributable to multisensory integration. The extent of this gain, however, varies based on a number of factors, including age of implantation and specific task being assessed (e.g., stimulus detection, phoneme perception, word recognition). Although both children and adults with CIs obtain audiovisual benefits for phoneme, word, and sentence stimuli, neither group shows demonstrable gain for suprasegmental feature perception. Additionally, only early-implanted children and the highest performing adults obtain audiovisual integration benefits similar to individuals with normal hearing. Increasing age of implantation in children is associated with poorer gains resultant from audiovisual integration, suggesting a sensitive period in development for the brain networks that subserve these integrative functions, as well as length of auditory experience. This finding highlights the need for early detection of and intervention for hearing loss, not only in terms of auditory perception, but also in terms of the behavioral and perceptual benefits of audiovisual processing. Importantly, patterns of auditory, visual, and audiovisual responses suggest that underlying integrative processes may be fundamentally different between CI users and typical-hearing listeners. Future research, particularly in low-level processing tasks such as signal detection will help to further assess mechanisms of multisensory integration for individuals with hearing loss, both with and without CIs.

Therapy-Induced Plasticity in Chronic Aphasia Is Associated with Behavioral Improvement and Time Since Stroke

Cortical reorganization after stroke is thought to underlie functional improvement. Patterns of reorganization may differ depending on the amount of time since the stroke or the degree of improvement. We investigated these issues in a study of brain connectivity changes with aphasia therapy. Twelve individuals with chronic aphasia participated in a 6-week trial of imitation-based speech therapy. We assessed improvement on a repetition test and analyzed effective connectivity during functional magnetic resonance imaging of a speech observation task before and after therapy. Using structural equation modeling, patient networks were compared with a model derived from healthy controls performing the same task. Independent of the amount of time since the stroke, patients demonstrating behavioral improvement had networks that reorganized to be more similar to controls in two functional pathways in the left hemisphere. Independent of behavioral improvement, patients with remote infarcts (2-7 years poststroke; n = 5) also reorganized to more closely resemble controls in one of these pathways. Patients with far removed injury (>10 years poststroke; n = 3) did not show behavioral improvement and, despite similarities to the normative model and overall network heterogeneity, reorganized to be less similar to controls following therapy in a distinct right-lateralized pathway. Behavioral improvement following aphasia therapy was associated with connectivity more closely approximating that of healthy controls. Individuals who had a stroke more than a decade before testing also showed plasticity, with a few pathways becoming less like controls, possibly representing compensation. Better understanding of these mechanisms may help direct targeted brain stimulation.

Lexical-Semantic Search Under Different Covert Verbal Fluency Tasks: An fMRI Study

Background: Verbal fluency is a measure of cognitive flexibility and word search strategies that is widely used to characterize impaired cognitive function. Despite the wealth of research on identifying and characterizing distinct aspects of verbal fluency, the anatomic and functional substrates of retrieval-related search and post-retrieval control processes still have not been fully elucidated. Methods: Twenty-one native English-speaking, healthy, right-handed, adult volunteers (mean age = 31 years; range = 21-45 years; 9 F) took part in a block-design functional Magnetic Resonance Imaging (fMRI) study of free recall, covert word generation tasks when guided by phonemic (P), semantic-category (C), and context-based fill-in-the-blank sentence completion (S) cues. General linear model (GLM), Independent Component Analysis (ICA), and psychophysiological interaction (PPI) were used to further characterize the neural substrate of verbal fluency as a function of retrieval cue type. Results: Common localized activations across P, C, and S tasks occurred in the bilateral superior and left inferior frontal gyrus, left anterior cingulate cortex, bilateral supplementary motor area (SMA), and left insula. Differential task activations were centered in the occipital, temporal and parietal regions as well as the thalamus and cerebellum. The context-based fluency task, i.e., the S task, elicited higher differential brain activity in a lateralized frontal-temporal network typically engaged in complex language processing. P and C tasks elicited activation in limited pathways mainly within the left frontal regions. ICA and PPI results of the S task suggested that brain regions distributed across both hemispheres, extending beyond classical language areas, are recruited for lexical-semantic access and retrieval during sentence completion. Conclusion: Study results support the hypothesis of overlapping, as well as distinct, neural networks for covert word generation when guided by different linguistic cues. The increased demand on word retrieval is met by the concurrent recruitment of classical as well as non-classical language-related brain regions forming a large cognitive neural network. The retrieval-related search and post-retrieval control processes that subserve verbal fluency, therefore, reverberates across distinct functional networks as determined by respective task demands.

Brain regions and functional interactions supporting early word recognition in the face of input variability

Perception and cognition in infants have been traditionally investigated using habituation paradigms, assuming that babies' memories in laboratory contexts are best constructed after numerous repetitions of the very same stimulus in the absence of interference. A crucial, yet open, question regards how babies deal with stimuli experienced in a fashion similar to everyday learning situations-namely, in the presence of interfering stimuli. To address this question, we used functional near-infrared spectroscopy to test 40 healthy newborns on their ability to encode words presented in concomitance with other words. The results evidenced a habituation-like hemodynamic response during encoding in the left-frontal region, which was associated with a progressive decrement of the functional connections between this region and the left-temporal, right-temporal, and right-parietal regions. In a recognition test phase, a characteristic neural signature of recognition recruited first the right-frontal region and subsequently the right-parietal ones. Connections originating from the right-temporal regions to these areas emerged when newborns listened to the familiar word in the test phase. These findings suggest a neural specialization at birth characterized by the lateralization of memory functions: the interplay between temporal and left-frontal regions during encoding and between temporo-parietal and right-frontal regions during recognition of speech sounds. Most critically, the results show that newborns are capable of retaining the sound of specific words despite hearing other stimuli during encoding. Thus, habituation designs that include various items may be as effective for studying early memory as repeated presentation of a single word.

Temporal synchrony and audiovisual integration of speech and object stimuli in autism

BACKGROUND

Individuals with Autism Spectrum Disorders (ASD) have been shown to have multisensory integration deficits, which may lead to problems perceiving complex, multisensory environments. For example, understanding audiovisual speech requires integration of visual information from the lips and face with auditory information from the voice, and audiovisual speech integration deficits can lead to impaired understanding and comprehension. While there is strong evidence for an audiovisual speech integration impairment in ASD, it is unclear whether this impairment is due to low level perceptual processes that affect all types of audiovisual integration or if it is specific to speech processing.

METHOD

Here, we measure audiovisual integration of basic speech (i.e., consonant-vowel utterances) and object stimuli (i.e., a bouncing ball) in adolescents with ASD and well-matched controls. We calculate a temporal window of integration (TWI) using each individual's ability to identify which of two videos (one temporally aligned and one misaligned) matches auditory stimuli. The TWI measures tolerance for temporal asynchrony between the auditory and visual streams, and is an important feature of audiovisual perception.

RESULTS

While controls showed similar tolerance of asynchrony for the simple speech and object stimuli, individuals with ASD did not. Specifically, individuals with ASD showed less tolerance of asynchrony for speech stimuli compared to object stimuli. In individuals with ASD, decreased tolerance for asynchrony in speech stimuli was associated with higher ratings of autism symptom severity.

CONCLUSIONS

These results suggest that audiovisual perception in ASD may vary for speech and object stimuli beyond what can be accounted for by stimulus complexity.

Atypical audiovisual word processing in school-age children with a history of specific language impairment: an event-related potential study

Background

Visual speech cues influence different aspects of language acquisition. However, whether developmental language disorders may be associated with atypical processing of visual speech is unknown. In this study, we used behavioral and ERP measures to determine whether children with a history of SLI (H-SLI) differ from their age-matched typically developing (TD) peers in the ability to match auditory words with corresponding silent visual articulations.

Methods

Nineteen 7–13-year-old H-SLI children and 19 age-matched TD children participated in the study. Children first heard a word and then saw a speaker silently articulating a word. In half of trials, the articulated word matched the auditory word (congruent trials), while in another half, it did not (incongruent trials). Children specified whether the auditory and the articulated words matched. We examined ERPs elicited by the onset of visual stimuli (visual P1, N1, and P2) as well as ERPs elicited by the articulatory movements themselves—namely, N400 to incongruent articulations and late positive complex (LPC) to congruent articulations. We also examined whether ERP measures of visual speech processing could predict (1) children’s linguistic skills and (2) the use of visual speech cues when listening to speech-in-noise (SIN).

Results

H-SLI children were less accurate in matching auditory words with visual articulations. They had a significantly reduced P1 to the talker’s face and a smaller N400 to incongruent articulations. In contrast, congruent articulations elicited LPCs of similar amplitude in both groups of children. The P1 and N400 amplitude was significantly correlated with accuracy enhancement on the SIN task when seeing the talker’s face.

Conclusions

H-SLI children have poorly defined correspondences between speech sounds and visually observed articulatory movements that produce them.

Functional organization of the language network in three- and six-year-old children

The organization of the language network undergoes continuous changes during development as children learn to understand sentences. In the present study, functional magnetic resonance imaging and behavioral measures were utilized to investigate functional activation and functional connectivity (FC) in three-year-old (3yo) and six-year-old (6yo) children during sentence comprehension. Transitive German sentences varying the word order (subject-initial and object-initial) with case marking were presented auditorily. We selected children who were capable of processing the subject-initial sentences above chance level accuracy from each age group to ensure that we were tapping real comprehension. Both age groups showed a main effect of word order in the left posterior superior temporal gyrus (pSTG), with greater activation for object-initial compared to subject-initial sentences. However, age differences were observed in the FC between left pSTG and the left inferior frontal gyrus (IFG). The 6yo group showed stronger FC between the left pSTG and Brodmann area (BA) 44 of the left IFG compared to the 3yo group. For the 3yo group, in turn, the FC between left pSTG and left BA 45 was stronger than with left BA 44. Our study demonstrates that while task-related activation was comparable, the small behavioral differences between age groups were reflected in the underlying functional organization revealing the ongoing development of the neural language network.

•

We examined functional connectivity of sentence processing in 3- and 6-year-olds.

•

Performance-matched age groups activated left pSTG for processing complex syntax.

•

6-year-olds had stronger connectivity between left BA44 and pSTG than 3-year-olds.

•

3-year-olds had greater connectivity between left BA45 and pSTG than BA44 and pSTG.

•

Functional connectivity results could be related to behavioral performance.

Sentence understanding depends on contextual use of semantic and real world knowledge

Human language allows us to express our thoughts and ideas by combining entities, concepts and actions into multi-event episodes. Yet, the functional neuroanatomy engaged in interpretation of such high-level linguistic input remains poorly understood. Here, we used easy to detect and more subtle "borderline" anomalies to investigate the brain regions and mechanistic principles involved in the use of real-world event knowledge in language comprehension. Overall, the results showed that the processing of sentences in context engages a complex set of bilateral brain regions in the frontal, temporal and inferior parietal lobes. Easy anomalies preferentially engaged lower-order cortical areas adjacent to the primary auditory cortex. In addition, the left supramarginal gyrus and anterior temporal sulcus as well as the right posterior middle temporal gyrus contributed to the processing of easy and borderline anomalies. The observed pattern of results is explained in terms of (i) hierarchical processing along a dorsal-ventral axis and (ii) the assumption of high-order association areas serving as cortical hubs in the convergence of information in a distributed network. Finally, the observed modulation of BOLD signal in prefrontal areas provides support for their role in the implementation of executive control processes.

Visual Speech Perception in Children With Language Learning Impairments

PURPOSE

The purpose of the study was to assess the ability of children with developmental language learning impairments (LLIs) to use visual speech cues from the talking face.

METHOD

In this cross-sectional study, 41 typically developing children (mean age: 8 years 0 months, range: 4 years 5 months to 11 years 10 months) and 27 children with diagnosed LLI (mean age: 8 years 10 months, range: 5 years 2 months to 11 years 6 months) completed a silent speechreading task and a speech-in-noise task with and without visual support from the talking face. The speech-in-noise task involved the identification of a target word in a carrier sentence with a single competing speaker as a masker.

RESULTS

Children in the LLI group showed a deficit in speechreading when compared with their typically developing peers. Beyond the single-word level, this deficit became more apparent in older children. On the speech-in-noise task, a substantial benefit of visual cues was found regardless of age or group membership, although the LLI group showed an overall developmental delay in speech perception.

CONCLUSION

Although children with LLI were less accurate than their peers on the speechreading and speech-in noise-tasks, both groups were able to make equivalent use of visual cues to boost performance accuracy when listening in noise.

Sources of Confusion in Infant Audiovisual Speech Perception Research

Speech is a multimodal stimulus, with information provided in both the auditory and visual modalities. The resulting audiovisual signal provides relatively stable, tightly correlated cues that support speech perception and processing in a range of contexts. Despite the clear relationship between spoken language and the moving mouth that produces it, there remains considerable disagreement over how sensitive early language learners-infants-are to whether and how sight and sound co-occur. Here we examine sources of this disagreement, with a focus on how comparisons of data obtained using different paradigms and different stimuli may serve to exacerbate misunderstanding.

Processing of audiovisually congruent and incongruent speech in school-age children with a history of specific language impairment: a behavioral and event-related potentials study

Previous studies indicate that at least some aspects of audiovisual speech perception are impaired in children with specific language impairment (SLI). However, whether audiovisual processing difficulties are also present in older children with a history of this disorder is unknown. By combining electrophysiological and behavioral measures, we examined perception of both audiovisually congruent and audiovisually incongruent speech in school-age children with a history of SLI (H-SLI), their typically developing (TD) peers, and adults. In the first experiment, all participants watched videos of a talker articulating syllables 'ba', 'da', and 'ga' under three conditions - audiovisual (AV), auditory only (A), and visual only (V). The amplitude of the N1 (but not of the P2) event-related component elicited in the AV condition was significantly reduced compared to the N1 amplitude measured from the sum of the A and V conditions in all groups of participants. Because N1 attenuation to AV speech is thought to index the degree to which facial movements predict the onset of the auditory signal, our findings suggest that this aspect of audiovisual speech perception is mature by mid-childhood and is normal in the H-SLI children. In the second experiment, participants watched videos of audivisually incongruent syllables created to elicit the so-called McGurk illusion (with an auditory 'pa' dubbed onto a visual articulation of 'ka', and the expectant perception being that of 'ta' if audiovisual integration took place). As a group, H-SLI children were significantly more likely than either TD children or adults to hear the McGurk syllable as 'pa' (in agreement with its auditory component) than as 'ka' (in agreement with its visual component), suggesting that susceptibility to the McGurk illusion is reduced in at least some children with a history of SLI. Taken together, the results of the two experiments argue against global audiovisual integration impairment in children with a history of SLI and suggest that, when present, audiovisual integration difficulties in this population likely stem from a later (non-sensory) stage of processing.

Maturation of language networks in children: A systematic review of 22years of functional MRI

Understanding how language networks change during childhood is important for theories of cognitive development and for identifying the neural causes of language impairment. Despite this, there is currently little systematic evidence regarding the typical developmental trajectory for language from the field of neuroimaging. We reviewed functional MRI (fMRI) studies published between 1992 and 2014, and quantified the evidence for age-related changes in localisation and lateralisation of fMRI activation in the language network (excluding the cerebellum and subcortical regions). Although age-related changes differed according to task type and input modality, we identified four consistent findings concerning the typical maturation of the language system. First, activation in core semantic processing regions increases with age. Second, activation in lower-level sensory and motor regions increases with age as activation in higher-level control regions reduces. We suggest that this reflects increased automaticity of language processing as children become more proficient. Third, the posterior cingulate cortex and precuneus (regions associated with the default mode network) show increasing attenuation across childhood and adolescence. Finally, language lateralisation is established by approximately 5years of age. Small increases in leftward lateralisation are observed in frontal regions, but these are tightly linked to performance.

Don't Listen With Your Mouth Full: The Role of Facial Motor Action in Visual Speech Perception

Theories of speech perception agree that visual input enhances the understanding of speech but disagree on whether physically mimicking the speaker improves understanding. This study investigated whether facial motor mimicry facilitates visual speech perception by testing whether blocking facial motor action impairs speechreading performance. Thirty-five typically developing children (19 boys; 16 girls; M age = 7 years) completed the Revised Craig Lipreading Inventory under two conditions. While observing silent videos of 15 words being spoken, participants either held a tongue depressor horizontally with their teeth (blocking facial motor action) or squeezed a ball with one hand (allowing facial motor action). As hypothesized, blocking motor action resulted in fewer correctly understood words than that of the control task. The results suggest that facial mimicry or other methods of facial action support visual speech perception in children. Future studies on the impact of motor action on the typical and atypical development of speech perception are warranted.

Effective connectivity of visual word recognition and homophone orthographic errors

The study of orthographic errors in a transparent language like Spanish is an important topic in relation to writing acquisition. The development of neuroimaging techniques, particularly functional magnetic resonance imaging (fMRI), has enabled the study of such relationships between brain areas. The main objective of the present study was to explore the patterns of effective connectivity by processing pseudohomophone orthographic errors among subjects with high and low spelling skills. Two groups of 12 Mexican subjects each, matched by age, were formed based on their results in a series of ad hoc spelling-related out-scanner tests: a high spelling skills (HSSs) group and a low spelling skills (LSSs) group. During the f MRI session, two experimental tasks were applied (spelling recognition task and visuoperceptual recognition task). Regions of Interest and their signal values were obtained for both tasks. Based on these values, structural equation models (SEMs) were obtained for each group of spelling competence (HSS and LSS) and task through maximum likelihood estimation, and the model with the best fit was chosen in each case. Likewise, dynamic causal models (DCMs) were estimated for all the conditions across tasks and groups. The HSS group's SEM results suggest that, in the spelling recognition task, the right middle temporal gyrus, and, to a lesser extent, the left parahippocampal gyrus receive most of the significant effects, whereas the DCM results in the visuoperceptual recognition task show less complex effects, but still congruent with the previous results, with an important role in several areas. In general, these results are consistent with the major findings in partial studies about linguistic activities but they are the first analyses of statistical effective brain connectivity in transparent languages.

Audiovisual integration for speech during mid-childhood: electrophysiological evidence

Previous studies have demonstrated that the presence of visual speech cues reduces the amplitude and latency of the N1 and P2 event-related potential (ERP) components elicited by speech stimuli. However, the developmental trajectory of this effect is not yet fully mapped. We examined ERP responses to auditory, visual, and audiovisual speech in two groups of school-age children (7-8-year-olds and 10-11-year-olds) and in adults. Audiovisual speech led to the attenuation of the N1 and P2 components in all groups of participants, suggesting that the neural mechanisms underlying these effects are functional by early school years. Additionally, while the reduction in N1 was largest over the right scalp, the P2 attenuation was largest over the left and midline scalp. The difference in the hemispheric distribution of the N1 and P2 attenuation supports the idea that these components index at least somewhat disparate neural processes within the context of audiovisual speech perception.

Neural pathways for visual speech perception

This paper examines the questions, what levels of speech can be perceived visually, and how is visual speech represented by the brain? Review of the literature leads to the conclusions that every level of psycholinguistic speech structure (i.e., phonetic features, phonemes, syllables, words, and prosody) can be perceived visually, although individuals differ in their abilities to do so; and that there are visual modality-specific representations of speech qua speech in higher-level vision brain areas. That is, the visual system represents the modal patterns of visual speech. The suggestion that the auditory speech pathway receives and represents visual speech is examined in light of neuroimaging evidence on the auditory speech pathways. We outline the generally agreed-upon organization of the visual ventral and dorsal pathways and examine several types of visual processing that might be related to speech through those pathways, specifically, face and body, orthography, and sign language processing. In this context, we examine the visual speech processing literature, which reveals widespread diverse patterns of activity in posterior temporal cortices in response to visual speech stimuli. We outline a model of the visual and auditory speech pathways and make several suggestions: (1) The visual perception of speech relies on visual pathway representations of speech qua speech. (2) A proposed site of these representations, the temporal visual speech area (TVSA) has been demonstrated in posterior temporal cortex, ventral and posterior to multisensory posterior superior temporal sulcus (pSTS). (3) Given that visual speech has dynamic and configural features, its representations in feedforward visual pathways are expected to integrate these features, possibly in TVSA.

Dissociating Cortical Activity during Processing of Native and Non-Native Audiovisual Speech from Early to Late Infancy

Initially, infants are capable of discriminating phonetic contrasts across the world's languages. Starting between seven and ten months of age, they gradually lose this ability through a process of perceptual narrowing. Although traditionally investigated with isolated speech sounds, such narrowing occurs in a variety of perceptual domains (e.g., faces, visual speech). Thus far, tracking the developmental trajectory of this tuning process has been focused primarily on auditory speech alone, and generally using isolated sounds. But infants learn from speech produced by people talking to them, meaning they learn from a complex audiovisual signal. Here, we use near-infrared spectroscopy to measure blood concentration changes in the bilateral temporal cortices of infants in three different age groups: 3-to-6 months, 7-to-10 months, and 11-to-14-months. Critically, all three groups of infants were tested with continuous audiovisual speech in both their native and another, unfamiliar language. We found that at each age range, infants showed different patterns of cortical activity in response to the native and non-native stimuli. Infants in the youngest group showed bilateral cortical activity that was greater overall in response to non-native relative to native speech; the oldest group showed left lateralized activity in response to native relative to non-native speech. These results highlight perceptual tuning as a dynamic process that happens across modalities and at different levels of stimulus complexity.

The development of sensorimotor influences in the audiovisual speech domain: some critical questions

Speech researchers have long been interested in how auditory and visual speech signals are integrated, and the recent work has revived interest in the role of speech production with respect to this process. Here, we discuss these issues from a developmental perspective. Because speech perception abilities typically outstrip speech production abilities in infancy and childhood, it is unclear how speech-like movements could influence audiovisual speech perception in development. While work on this question is still in its preliminary stages, there is nevertheless increasing evidence that sensorimotor processes (defined here as any motor or proprioceptive process related to orofacial movements) affect developmental audiovisual speech processing. We suggest three areas on which to focus in future research: (i) the relation between audiovisual speech perception and sensorimotor processes at birth, (ii) the pathways through which sensorimotor processes interact with audiovisual speech processing in infancy, and (iii) developmental change in sensorimotor pathways as speech production emerges in childhood.

Children with a history of SLI show reduced sensitivity to audiovisual temporal asynchrony: an ERP study

PURPOSE

The authors examined whether school-age children with a history of specific language impairment (H-SLI), their peers with typical development (TD), and adults differ in sensitivity to audiovisual temporal asynchrony and whether such difference stems from the sensory encoding of audiovisual information.

METHOD

Fifteen H-SLI children, 15 TD children, and 15 adults judged whether a flashed explosion-shaped figure and a 2-kHz pure tone occurred simultaneously. The stimuli were presented at 0-, 100-, 200-, 300-, 400-, and 500-ms temporal offsets. This task was combined with EEG recordings.

RESULTS

H-SLI children were profoundly less sensitive to temporal separations between auditory and visual modalities compared with their TD peers. Those H-SLI children who performed better at simultaneity judgment also had higher language aptitude. TD children were less accurate than adults, revealing a remarkably prolonged developmental course of the audiovisual temporal discrimination. Analysis of early event-related potential components suggested that poor sensory encoding was not a key factor in H-SLI children's reduced sensitivity to audiovisual asynchrony.

CONCLUSIONS

Audiovisual temporal discrimination is impaired in H-SLI children and is still immature during mid-childhood in TD children. The present findings highlight the need for further evaluation of the role of atypical audiovisual processing in the development of SLI.

Limited plastic potential of the left ventral premotor cortex in speech articulation: evidence from intraoperative awake mapping in glioma patients

OBJECTIVES

Despite previous lesional and functional neuroimaging studies, the actual role of the left ventral premotor cortex (vPMC), i.e., the lateral part of the precentral gyrus, is still poorly known.

EXPERIMENTAL DESIGN

We report a series of eight patients with a glioma involving the left vPMC, who underwent awake surgery with intraoperative cortical and subcortical language mapping. The function of the vPMC, its subcortical connections, and its reorganization potential are investigated in the light of surgical findings and language outcome after resection.

PRINCIPAL OBSERVATIONS

Electrostimulation of both the vPMC and subcortical white matter tract underneath the vPMC, that is, the anterior segment of the lateral part of the superior longitudinal fascicle (SLF), induced speech production disturbances with anarthria in all cases. Moreover, although some degrees of redistribution of the vPMC have been found in four patients, allowing its partial resection with no permanent speech disorders, this area was nonetheless still detected more medially in the precentral gyrus in the eight patients, despite its invasion by the glioma. Moreover, a direct connection of the vPMC with the SLF was preserved in all cases.

CONCLUSIONS

Our original data suggest that the vPMC plays a crucial role in the speech production network and that its plastic potential is limited. We propose that this limitation is due to an anatomical constraint, namely the necessity for the left vPMC to remain connected to the lateral SLF. Beyond fundamental implications, such knowledge may have clinical applications, especially in surgery for tumors involving this cortico-subcortical circuit.

Audio-visual speech perception: a developmental ERP investigation

Being able to see a talking face confers a considerable advantage for speech perception in adulthood. However, behavioural data currently suggest that children fail to make full use of these available visual speech cues until age 8 or 9. This is particularly surprising given the potential utility of multiple informational cues during language learning. We therefore explored this at the neural level. The event-related potential (ERP) technique has been used to assess the mechanisms of audio-visual speech perception in adults, with visual cues reliably modulating auditory ERP responses to speech. Previous work has shown congruence-dependent shortening of auditory N1/P2 latency and congruence-independent attenuation of amplitude in the presence of auditory and visual speech signals, compared to auditory alone. The aim of this study was to chart the development of these well-established modulatory effects over mid-to-late childhood. Experiment 1 employed an adult sample to validate a child-friendly stimulus set and paradigm by replicating previously observed effects of N1/P2 amplitude and latency modulation by visual speech cues; it also revealed greater attenuation of component amplitude given incongruent audio-visual stimuli, pointing to a new interpretation of the amplitude modulation effect. Experiment 2 used the same paradigm to map cross-sectional developmental change in these ERP responses between 6 and 11 years of age. The effect of amplitude modulation by visual cues emerged over development, while the effect of latency modulation was stable over the child sample. These data suggest that auditory ERP modulation by visual speech represents separable underlying cognitive processes, some of which show earlier maturation than others over the course of development.

Brain repair after stroke--a novel neurological model

Following stroke, patients are commonly left with debilitating motor and speech impairments. This article reviews the state of the art in neurological repair for stroke and proposes a new model for the future. We suggest that stroke treatment--from the time of the ictus itself to living with the consequences--must be fundamentally neurological, from limiting the extent of injury at the outset, to repairing the consequent damage. Our model links brain and behaviour by targeting brain circuits, and we illustrate the model though action observation treatment, which aims to enhance brain network connectivity. The model is based on the assumptions that the mechanisms of neural repair inherently involve cellular and circuit plasticity, that brain plasticity is a synaptic phenomenon that is largely stimulus-dependent, and that brain repair required both physical and behavioural interventions that are tailored to reorganize specific brain circuits. We review current approaches to brain repair after stroke and present our new model, and discuss the biological foundations, rationales, and data to support our novel approach to upper-extremity and language rehabilitation. We believe that by enhancing plasticity at the level of brain network interactions, this neurological model for brain repair could ultimately lead to a cure for stroke.

Two faces, two languages: an fMRI study of bilingual picture naming

This fMRI study explores how nonlinguistic cues modulate lexical activation in the bilingual brain. We examined the influence of face race on bilingual language production in a picture-naming paradigm. Chinese-English bilinguals were presented with pictures of objects and images of faces (Asian or Caucasian). Participants named the picture in their first or second language (Chinese or English) in separate blocks. Face race and naming language were either congruent (e.g., naming in Chinese when seeing an Asian face) or incongruent (e.g., naming in English when seeing an Asian face). Our results revealed that face cues facilitate naming when the socio-cultural identity of the face is congruent with the naming language. The congruence effects are reflected as effective integration of lexical and facial cues in key brain regions including IFG, MFG, ACC, and caudate. Implications of the findings in light of theories of language processing and cultural priming are discussed.

Electrophysiological correlates of connotative meaning in healthy children

The affective, connotative meaning of words can be statistically quantified by the semantic differential technique. Words that are located clearly on one of the three dimensions called "Evaluation", "Potency", and "Activity" were used as visual stimuli in a topographic event related potential study (ERP). Stimuli had been statistically defined in a group of 249 children (Skrandies, Jpn Psychol Res 53: 65-76, 2011). We investigated electrical brain activity in 19 healthy children with normal intelligence and reading skills between 11 and 15 years of age. Words that belonged to different semantic classes were presented at random on a monitor, and EEG was measured from 30 channels. Evoked potentials were computed offline for each semantic class. In the ERP data we observed significant effects of word class on component latency, field strength and topography. Similar as with adult subjects such effects occurred at small latency of about 115 ms after word presentation. The language-evoked components in children were similar but not identical to those reported previously for various groups of adults. Our data show that visually evoked brain activity is modulated by connotative meaning of the stimuli at early processing stages not only in adults but also in children.

The neurobiology of receptive-expressive language interdependence

With a focus on receptive language, we examine the neurobiological evidence for the interdependence of receptive and expressive language processes. While we agree that there is compelling evidence for such interdependence, we suggest that Pickering & Garrod's (P&G's) account would be enhanced by considering more-specific situations in which their model does, and does not, apply.

Hemodynamic responses to speech and music in preverbal infants

Numerous studies have provided clues about the ontogeny of lateralization of auditory processing in humans, but most have employed specific subtypes of stimuli and/or have assessed responses in discrete temporal windows. The present study used near-infrared spectroscopy (NIRS) to establish changes in hemodynamic activity in the neocortex of preverbal infants (aged 4-11 months) while they were exposed to two distinct types of complex auditory stimuli (full sentences and musical phrases). Measurements were taken from bilateral temporal regions, including both anterior and posterior superior temporal gyri. When the infant sample was treated as a homogenous group, no significant effects emerged for stimulus type. However, when infants' hemodynamic responses were categorized according to their overall changes in volume, two very clear neurophysiological patterns emerged. A high-responder group showed a pattern of early and increasing activation, primarily in the left hemisphere, similar to that observed in comparable studies with adults. In contrast, a low-responder group showed a pattern of gradual decreases in activation over time. Although age did track with responder type, no significant differences between these groups emerged for stimulus type, suggesting that the high- versus low-responder characterization generalizes across classes of auditory stimuli. These results highlight a new way to conceptualize the variable cortical blood flow patterns that are frequently observed across infants and stimuli, with hemodynamic response volumes potentially serving as an early indicator of developmental changes in auditory-processing sensitivity.