Brain activation modulated by sentence comprehension

Pupillometry reveals resting state alpha power correlates with individual differences in adult auditory language comprehension

Although individual differences in adult language processing are well-documented, the neural basis of this variability remains largely unexplored. The current study addressed this gap in the literature by examining the relationship between resting state alpha activity and individual differences in auditory language comprehension. Alpha oscillations modulate cortical excitability, facilitating efficient information processing in the brain. While resting state alpha oscillations have been tied to individual differences in cognitive performance, their association with auditory language comprehension is less clear. Participants in the study were 80 healthy adults with a mean age of 25.8 years (SD = 7.2 years). Resting state alpha activity was acquired using electroencephalography while participants looked at a benign stimulus for 3 min. Participants then completed a language comprehension task that involved listening to 'syntactically simple' subject-relative clause sentences and 'syntactically complex' object-relative clause sentences. Pupillometry measured real-time processing demand changes, with larger pupil dilation indicating increased processing loads. Replicating past research, comprehending object relative clauses, compared to subject relative clauses, was associated with lower accuracy, slower reaction times, and larger pupil dilation. Resting state alpha power was found to be positively correlated with the pupillometry data. That is, participants with higher resting state alpha activity evidenced larger dilation during sentence comprehension. This effect was more pronounced for the 'complex' object sentences compared to the 'simple' subject sentences. These findings suggest the brain's capacity to generate a robust resting alpha rhythm contributes to variability in processing demands associated with auditory language comprehension, especially when faced with challenging syntactic structures. More generally, the study demonstrates that the intrinsic functional architecture of the brain likely influences individual differences in language comprehension.

Involvement of the anterior insula and frontal operculum during wh-question comprehension of wh-in-situ Korean language

In this research, we employed functional magnetic resonance imaging (fMRI) to examine the neurological basis for understanding wh-questions in wh-in-situ languages such as Korean, where wh-elements maintain their original positions instead of moving explicitly within the sentence. Our hypothesis centered on the role of the salience and attention network in comprehending wh-questions in wh-in-situ languages, such as the discernment of wh-elements, the demarcation between interrogative types, and the allocation of cognitive resources towards essential constituents vis-à-vis subordinate elements in order to capture the speaker's communicative intent. We explored subject and object wh-questions and scrambled wh-questions, contrasting them with yes/no questions in Korean. Increased activation was observed in the left anterior insula and bilateral frontal operculum, irrespective of the wh-position or scrambling of wh-element. These results suggest the interaction between the salience and attentional system and the syntactic linguistic system, particularly the left anterior insula and bilateral frontal operculum, in comprehending wh-questions in wh-in-situ languages.

Cortical specialization associated with native speech category acquisition in early infancy

This study investigates neural processes in infant speech processing, with a focus on left frontal brain regions and hemispheric lateralization in Mandarin-speaking infants' acquisition of native tonal categories. We tested 2- to 6-month-old Mandarin learners to explore age-related improvements in tone discrimination, the role of inferior frontal regions in abstract speech category representation, and left hemisphere lateralization during tone processing. Using a block design, we presented four Mandarin tones via [ta] and measured oxygenated hemoglobin concentration with functional near-infrared spectroscopy. Results showed age-related improvements in tone discrimination, greater involvement of frontal regions in older infants indicating abstract tonal representation development and increased bilateral activation mirroring native adult Mandarin speakers. These findings contribute to our broader understanding of the relationship between native speech acquisition and infant brain development during the critical period of early language learning.

One right can make a left: sentence processing in the right hemisphere after perinatal stroke

When brain regions that are critical for a cognitive function in adulthood are irreversibly damaged at birth, what patterns of plasticity support the successful development of that function in an alternative location? Here we investigate the consistency of language organization in the right hemisphere (RH) after a left hemisphere (LH) perinatal stroke. We analyzed fMRI data collected during an auditory sentence comprehension task on 14 people with large cortical LH perinatal arterial ischemic strokes (left hemisphere perinatal stroke (LHPS) participants) and 11 healthy sibling controls using a "top voxel" approach that allowed us to compare the same number of active voxels across each participant and in each hemisphere for controls. We found (1) LHPS participants consistently recruited the same RH areas that were a mirror-image of typical LH areas, and (2) the RH areas recruited in LHPS participants aligned better with the strongly activated LH areas of the typically developed brains of control participants (when flipped images were compared) than the weakly activated RH areas. Our findings suggest that the successful development of language processing in the RH after a LH perinatal stroke may in part depend on recruiting an arrangement of frontotemporal areas reflective of the typical dominant LH.

Pausing behavior of late bilingual and monolingual English speakers

This study examined the differences in the pausing behavior between native and non-native English speakers. Specifically, it examined the location and duration of pauses in relation to the syntactic and lexical complexity of the clauses in which these pauses occur and the nature of the prosodic phrasing of the utterances containing pauses. Speech samples from 10 native (L1) English and 10 Mandarin non-native English speakers from the Archive of L1 and L2 Scripted and Spontaneous Transcripts and Recordings (ALLSSTAR) were included in the analysis. The results showed that lower-level prosodic boundaries and syntactically complex phrases were associated with significantly longer pause duration in the L2 speech. Additionally, phrases with less frequent words tended to induce longer pauses. These findings suggest that insufficient knowledge of the L2 syntax, lexicon, and prosody might determine the location and duration of pauses and ultimately affect the speech fluency of L2 speakers.

Is beta in agreement with the relatives? Using relative clause sentences to investigate MEG beta power dynamics during sentence comprehension

There remains some debate about whether beta power effects observed during sentence comprehension reflect ongoing syntactic unification operations (beta-syntax hypothesis), or instead reflect maintenance or updating of the sentence-level representation (beta-maintenance hypothesis). In this study, we used magnetoencephalography to investigate beta power neural dynamics while participants read relative clause sentences that were initially ambiguous between a subject- or an object-relative reading. An additional condition included a grammatical violation at the disambiguation point in the relative clause sentences. The beta-maintenance hypothesis predicts a decrease in beta power at the disambiguation point for unexpected (and less preferred) object-relative clause sentences and grammatical violations, as both signal a need to update the sentence-level representation. While the beta-syntax hypothesis also predicts a beta power decrease for grammatical violations due to a disruption of syntactic unification operations, it instead predicts an increase in beta power for the object-relative clause condition because syntactic unification at the point of disambiguation becomes more demanding. We observed decreased beta power for both the agreement violation and object-relative clause conditions in typical left hemisphere language regions, which provides compelling support for the beta-maintenance hypothesis. Mid-frontal theta power effects were also present for grammatical violations and object-relative clause sentences, suggesting that violations and unexpected sentence interpretations are registered as conflicts by the brain's domain-general error detection system.

Modality-Specificity of the Neural Correlates of Linguistic and Non-Linguistic Demand

Imaging studies of language processing in clinical populations can be complicated to interpret for several reasons, one being the difficulty of matching the effortfulness of processing across individuals or tasks. To better understand how effortful linguistic processing is reflected in functional activity, we investigated the neural correlates of task difficulty in linguistic and non-linguistic contexts in the auditory modality and then compared our findings to a recent analogous experiment in the visual modality in a different cohort. Nineteen neurologically normal individuals were scanned with fMRI as they performed a linguistic task (semantic matching) and a non-linguistic task (melodic matching), each with two levels of difficulty. We found that left hemisphere frontal and temporal language regions, as well as the right inferior frontal gyrus, were modulated by linguistic demand and not by non-linguistic demand. This was broadly similar to what was previously observed in the visual modality. In contrast, the multiple demand (MD) network, a set of brain regions thought to support cognitive flexibility in many contexts, was modulated neither by linguistic demand nor by non-linguistic demand in the auditory modality. This finding was in striking contradistinction to what was previously observed in the visual modality, where the MD network was robustly modulated by both linguistic and non-linguistic demand. Our findings suggest that while the language network is modulated by linguistic demand irrespective of modality, modulation of the MD network by linguistic demand is not inherent to linguistic processing, but rather depends on specific task factors.

Dimensionality and Ramping: Signatures of Sentence Integration in the Dynamics of Brains and Deep Language Models

A sentence is more than the sum of its words: its meaning depends on how they combine with one another. The brain mechanisms underlying such semantic composition remain poorly understood. To shed light on the neural vector code underlying semantic composition, we introduce two hypotheses: (1) the intrinsic dimensionality of the space of neural representations should increase as a sentence unfolds, paralleling the growing complexity of its semantic representation; and (2) this progressive integration should be reflected in ramping and sentence-final signals. To test these predictions, we designed a dataset of closely matched normal and jabberwocky sentences (composed of meaningless pseudo words) and displayed them to deep language models and to 11 human participants (5 men and 6 women) monitored with simultaneous MEG and intracranial EEG. In both deep language models and electrophysiological data, we found that representational dimensionality was higher for meaningful sentences than jabberwocky. Furthermore, multivariate decoding of normal versus jabberwocky confirmed three dynamic patterns: (1) a phasic pattern following each word, peaking in temporal and parietal areas; (2) a ramping pattern, characteristic of bilateral inferior and middle frontal gyri; and (3) a sentence-final pattern in left superior frontal gyrus and right orbitofrontal cortex. These results provide a first glimpse into the neural geometry of semantic integration and constrain the search for a neural code of linguistic composition.SIGNIFICANCE STATEMENT Starting from general linguistic concepts, we make two sets of predictions in neural signals evoked by reading multiword sentences. First, the intrinsic dimensionality of the representation should grow with additional meaningful words. Second, the neural dynamics should exhibit signatures of encoding, maintaining, and resolving semantic composition. We successfully validated these hypotheses in deep neural language models, artificial neural networks trained on text and performing very well on many natural language processing tasks. Then, using a unique combination of MEG and intracranial electrodes, we recorded high-resolution brain data from human participants while they read a controlled set of sentences. Time-resolved dimensionality analysis showed increasing dimensionality with meaning, and multivariate decoding allowed us to isolate the three dynamical patterns we had hypothesized.

Right hemisphere and metaphor comprehension: A connectionist perspective

Metaphor comprehension is a cognitively complex task, with evidence pointing to the engagement of multiple cerebral areas. In addition, the involvement of the right hemisphere appears to vary with cognitive effort. Therefore, the interconnecting pathways of such distributed cortical centers should be taken into account when studying this topic. Despite this, the potential contribution of white matter fasciculi has received very little attention in the literature to date and is not mentioned in most metaphor comprehension studies. To highlight the probable implications of the right inferior fronto-occipital fasciculus, right superior longitudinal system, and callosal radiations, we bring together findings from different research fields. The aim is to describe important insights enabled by the cross-fertilization of functional neuroimaging, clinical findings, and structural connectivity.

The human language system, including its inferior frontal component in "Broca's area," does not support music perception

Language and music are two human-unique capacities whose relationship remains debated. Some have argued for overlap in processing mechanisms, especially for structure processing. Such claims often concern the inferior frontal component of the language system located within "Broca's area." However, others have failed to find overlap. Using a robust individual-subject fMRI approach, we examined the responses of language brain regions to music stimuli, and probed the musical abilities of individuals with severe aphasia. Across 4 experiments, we obtained a clear answer: music perception does not engage the language system, and judgments about music structure are possible even in the presence of severe damage to the language network. In particular, the language regions' responses to music are generally low, often below the fixation baseline, and never exceed responses elicited by nonmusic auditory conditions, like animal sounds. Furthermore, the language regions are not sensitive to music structure: they show low responses to both intact and structure-scrambled music, and to melodies with vs. without structural violations. Finally, in line with past patient investigations, individuals with aphasia, who cannot judge sentence grammaticality, perform well on melody well-formedness judgments. Thus, the mechanisms that process structure in language do not appear to process music, including music syntax.

How can graph theory inform the dual-stream model of speech processing? a resting-state fMRI study of post-stroke aphasia

The dual-stream model of speech processing has been proposed to represent the cortical networks involved in speech comprehension and production. Although it is arguably the prominent neuroanatomical model of speech processing, it is not yet known if the dual-stream model represents actual intrinsic functional brain networks. Furthermore, it is unclear how disruptions after a stroke to the functional connectivity of the dual-stream model's regions are related to specific types of speech production and comprehension impairments seen in aphasia. To address these questions, in the present study, we examined two independent resting-state fMRI datasets: (1) 28 neurotypical matched controls and (2) 28 chronic left-hemisphere stroke survivors with aphasia collected at another site. Structural MRI, as well as language and cognitive behavioral assessments, were collected. Using standard functional connectivity measures, we successfully identified an intrinsic resting-state network amongst the dual-stream model's regions in the control group. We then used both standard functional connectivity analyses and graph theory approaches to determine how the functional connectivity of the dual-stream network differs in individuals with post-stroke aphasia, and how this connectivity may predict performance on clinical aphasia assessments. Our findings provide strong evidence that the dual-stream model is an intrinsic network as measured via resting-state MRI, and that weaker functional connectivity of the hub nodes of the dual-stream network defined by graph theory methods, but not overall average network connectivity, is weaker in the stroke group than in the control participants. Also, the functional connectivity of the hub nodes predicted specific types of impairments on clinical assessments. In particular, the relative strength of connectivity of the right hemisphere's homologues of the left dorsal stream hubs to the left dorsal hubs versus right ventral stream hubs is a particularly strong predictor of post-stroke aphasia severity and symptomology.

Functional near-infrared spectroscopy shows that object relative clauses are more difficult to process than subject relative clauses in Turkish

It was suggested that processing subject relative clauses (SRCs) is universally easier than processing object relative clauses (ORCs) based on the studies carried out in head-initial languages such as English and German. However, studies in head-final languages such as Chinese and Basque contradicted this claim. Turkish is also a head-final language. Existing relative clause processing literature in Turkish is based solely on behavioural metrics. Even though an ORC processing disadvantage was suggested for Turkish, the results were not conclusive. Therefore, we aimed to investigate the neural dynamics of relative clause processing in Turkish. We asked 14 native Turkish speakers to answer yes/no questions about 24 sentences each containing either a SRC or ORC while their prefrontal hemodynamic activity was recorded with functional near-infrared spectroscopy. Our findings revealed hemodynamic activity in the lateral portions of the left prefrontal cortex for both conditions. However, hemodynamic activity was more widespread in prefrontal regions in ORC compared to SRC condition. Even though the behavioural metrics failed to produce a significant difference between the conditions, direct ORC > SRC contrast revealed significant activity in the left inferior frontal cortex, a region heavily involved in language processing, as well as in left and right dorsolateral prefrontal cortices, which are also known to be involved in language processing-related and conflict monitoring-related processes, respectively. Our findings indicate that processing ORCs is more difficult and requires further prefrontal resources than processing SRCs in Turkish, thus refuting the head-directionality-based explanations of relative clause processing asymmetries.

The role of left temporo-parietal and inferior frontal cortex in comprehending syntactically complex sentences: A brain stimulation study

BACKGROUND AND OBJECTIVES

Syntactic competence relies on a left-lateralized network converging on hubs in inferior-frontal and posterior-temporal cortices. We address the question whether anodal transcranial direct current stimulation (a-tDCS) over these hubs can modulate comprehension of sentences, whose syntactic complexity systematically varied along the factors embedding depths and canonicity. Semantic content and length of the sentences were kept identical and forced choice picture matching was required after the full sentence had been presented.

METHODS

We used a single-blind, within-subject, sham-controlled design, applying a-tDCS targeting left posterior tempo-parietal (TP) and left inferior frontal cortex (FC). Stimulation sites were determined by individual neuro-navigation. 20 participants were included of whom 19 entered the analysis. Results were analysed using (generalized) mixed models. In a pilot-experiment in another group of 20 participants we validated the manipulation of syntactic complexity by the two factors embedding depth and argument-order.

RESULTS

Reaction times increased and accuracy decreased with higher embedding depth and non-canonical argument order in both experiments. Notably a-tDCS over TP enhanced sentence-to-picture matching, while FC-stimulation showed no consistent effect. Moreover, the analysis disclosed a session effect, indicating improvements of task performance especially regarding speed.

CONCLUSIONS

We conclude that the posterior 'hub' of the neuronal network affording syntactic analysis represents a 'bottleneck', likely due to working-memory capacity and the challenges of mapping semantic to syntactic information allowing for role assignment. While this does not challenge the role of left inferior-frontal cortex for syntax processing and novel-grammar learning, the application of highly established syntactic rules during sentence comprehension may be considered optimized, thus not augmentable by a-tDCS in the uncompromised network.

SIGNIFICANCE STATEMENT

Anodal transcranial direct current stimulation (a-tDCS) over left temporo-parietal cortex enhances comprehension of complex sentences in uncompromised young speakers. Since a-tDCS over left frontal cortex did not elicit any change, the 'bottleneck' for the understanding of complex sentences seems to be the posterior, temporo-parietal rather than the anterior inferior-frontal 'hub' of language processing. Regarding the attested role of inferior-frontal cortex in syntax processing, we suggest that its function is optimized in competent young speakers, preventing further enhancement by (facilitatory) tDCS. Results shed light on the functional anatomy of syntax processing during sentence comprehension; moreover, they open perspectives for research in the lesioned language network of people with syntactic deficits due to aphasia.

Syntactic and Semantic Processing in Japanese Sentence Reading: A Research Using Functional Near-Infrared Spectroscopy (fNIRS)

In order to examine whether syntactic processing is a necessary prerequisite for semantic integration in Japanese, cortical activation was monitored while participants engaged in silent reading task. Congruous sentences (CON), semantic violation sentences (V-SEM), and syntactic violation sentences (V-SYN) were presented in the experiment. The participants' oxygenated hemoglobin concentration changes during the reading task were measured using functional near-infrared spectroscopy. The results suggest that the CON sentences did not require additional cognitive load on syntactic processing or semantic processing. The V-SEM sentences demanded great cognitive load on semantic processing. Besides, it also elicited great cognitive load on syntactic processing. The V-SYN sentences induced great cognitive load on syntactic processing, but it did not induce additional load on semantic processing. These evidence demonstrates that, in Japanese language processing, the difficultness of semantic processing could influence the difficultness of syntactic processing, while the difficultness of syntactic processing would not influence the difficultness of semantic processing. Our findings are suggestive of the possibility that in Japanese language reading, semantic processing precedes syntactic processing, or semantic processing and syntactic processing are in parallel.

A subject relative clause preference in a split-ergative language: ERP evidence from Georgian

A fascinating descriptive property of human language processing whose explanation is still debated is that subject-gap relative clauses are easier to process than object-gap relative clauses, across a broad range of languages with different properties. However, recent work suggests that this generalization does not hold in Basque, an ergative language, and has motivated an alternative generalization in which the preference is for gaps in morphologically unmarked positions-subjects in nominative-accusative languages, and objects and intransitive subjects in ergative-absolutive languages. Here we examined whether this generalization extends to another ergative-absolutive language, Georgian. ERP and self-paced reading results show a large anterior negativity and slower reading times when a relative clause is disambiguated to an object relative vs a subject relative. These data thus suggest that in at least some ergative-absolutive languages, the classic descriptive generalization-that object relative clauses are more costly than subject relative clauses-still holds.

Longitudinal changes in functional connectivity in speech motor networks in apraxia of speech after stroke

Objective

The cerebral substrates of apraxia of speech (AOS) recovery remain unclear. Resting state fMRI post stroke can inform on altered functional connectivity (FC) within cortical language networks. Some initial studies report reduced FC between bilateral premotor cortices in patients with AOS, with lowest FC in patients with the most severe AOS. However, longitudinal FC studies in stroke are lacking. The aims of the present longitudinal study in early post stroke patients with AOS were (i) to compare connectivity strength in AOS patients to that in left hemisphere (LH) lesioned stroke patients without a speech-language impairment, (ii) to investigate the relation between FC and severity of AOS, aphasia and non-verbal oral apraxia (NVOA) and (iii) to investigate longitudinal changes in FC, from the subacute phase to the chronic phase to identify predictors of AOS recovery.

Methods

Functional connectivity measures and comprehensive speech-language assessments were obtained at 4 weeks and 6 months after stroke in nine patients with AOS after a LH stroke and in six LH lesioned stroke patients without speech-language impairment. Functional connectivity was investigated in a network for speech production: inferior frontal gyrus (IFG), anterior insula (aINS), and ventral premotor cortex (vPMC), all bilaterally to investigate signs of adaptive or maladaptive changes in both hemispheres.

Results

Interhemispheric vPMC connectivity was significantly reduced in patients with AOS compared to LH lesioned patients without speech-language impairment. At 6 months, the AOS severity was associated with interhemispheric aINS and vPMC connectivity. Longitudinal changes in FC were found in individuals, whereas no significant longitudinal change in FC was found at the group level. Degree of longitudinal AOS recovery was strongly associated with interhemispheric IFG connectivity strength at 4 weeks.

Conclusion

Early interhemispheric IFG connectivity may be a strong predictor of AOS recovery. The results support the importance of interhemispheric vPMC connection in speech motor planning and severity of AOS and suggest that also bilateral aINS connectivity may have an impact on AOS severity. These findings need to be validated in larger cohorts.

Hearing voices in the head: Two meta-analyses on structural correlates of auditory hallucinations in schizophrenia

Past voxel-based morphometry (VBM) studies demonstrate reduced grey matter volume (GMV) in schizophrenia (SZ) patients' brains in various cortical and subcortical regions. Probably due to SZ symptoms' heterogeneity, these results are often inconsistent and difficult to integrate. We hypothesized that focusing on auditory verbal hallucinations (AVH) - one of the most common SZ symptoms - would allow reducing heterogeneity and discovering further compelling evidence of SZ neural correlates. We carried out two voxel-based meta-analyses of past studies that investigated the structural correlates of AVH in SZ. The review of whole-brain VBM studies published until June 2022 in PubMed and PsychInfo databases yielded (a) 13 studies on correlations between GMV and AVH severity in SZ patients (n = 472; 86 foci), and (b) 11 studies involving comparisons between hallucinating SZ patients (n = 504) and healthy controls (n = 524; 74 foci). Data were analyzed using the Activation Likelihood Estimation method. AVH severity was associated with decreased GMV in patients' left superior temporal gyrus (STG) and left posterior insula. Compared with healthy controls, hallucinating SZ patients showed reduced GMV on the left anterior insula and left inferior frontal gyrus (IFG). Our findings revealed important structural dysfunctions in a left lateralized cluster of brain regions, including the insula and temporo-frontal regions, that significantly contribute to the severity and persistence of AVH. Structural atrophy found in circuits involved in generating and perceiving speech, as well as in auditory signal processing, might reasonably be considered a biological marker of AVH in SZ.

Theta activity in semantic priming under visual crowding as revealed by magnetoencephalography

Crowding refers to impaired object recognition of peripheral visual targets caused by nearby flankers. It has been shown that the response to a word was faster when it was preceded by a semantically related than unrelated crowded prime, demonstrating that semantic priming survives crowding. This study examines neural correlates of semantic priming under visual crowding using magnetoencephalography with four conditions: prime (isolated, crowded) x prime-target relationship (related, unrelated). Participants judged whether the target was a word or a nonword. We found significant differences in θ activity at the left inferior frontal gyrus (IFG) for both isolated and crowded primes when comparing the unrelated and related conditions, although the activation was delayed with the crowded prime compared to the isolated prime. The locations within the IFG were also different: theta-band activation was at BA 45 in the isolated condition and at BA 47 in the crowded condition. Phase-locking-value analysis revealed that bilateral IFG was more synchronized with unrelated prime-target pairs than related pairs regardless of whether the primes were isolated or crowded, indicating the recruitment of the right hemisphere when the prime-target semantic relationship was remote. Finally, the distinct waveform patterns found in the isolated and crowded conditions from both the source localization and PLV analysis suggest different neural mechanisms for processing semantic information with isolated primes versus crowded primes.

The posterior middle temporal gyrus serves as a hub in syntactic comprehension: A model on the syntactic neural network

Neuroimaging studies have revealed a distributed neural network involving multiple fronto-temporal regions that are active during syntactic processing. Here, we investigated how these regions work collaboratively to support syntactic comprehension by examining the behavioral relevance of the global functional integration of the syntax network (SN). We found that individuals with a stronger resting-state within-network integration in the left posterior middle temporal gyrus (lpMTG) were better at syntactic comprehension. Furthermore, the pair-wise functional connectivity between the lpMTG and the Broca's area, the middle frontal gyrus, and the angular and supramarginal gyri was positively correlated with participants' syntactic processing ability. In short, our study reveals the behavioral significance of intrinsic functional integration of the SN in syntactic comprehension, and provides empirical evidence for the hub-like role of the lpMTG. We proposed a neural model for syntactic comprehension highlighting the hub of the SN and its interactions with other regions in the network.

Sensory experience modulates the reorganization of auditory regions for executive processing

Crossmodal plasticity refers to the reorganisation of sensory cortices in the absence of their typical main sensory input. Understanding this phenomenon provides insights into brain function and its potential for change and enhancement. Using fMRI, we investigated how early deafness influences crossmodal plasticity and the organisation of executive functions in the adult human brain. Deaf (N = 25; age: mean = 41.68, range = 19-66, SD = 14.38; 16 female, 9 male) and hearing (N = 20; age: mean= 37.50, range= 18-66, SD= 16.85; 15 female, 5 male) participants performed four visual tasks tapping into different components of executive processing: task switching, working memory, planning and inhibition. Our results show that deaf individuals specifically recruit "auditory" regions during task switching. Neural activity in superior temporal regions, most significantly in the right hemisphere, are good predictors of behavioural performance during task switching in the group of deaf individuals, highlighting the functional relevance of the observed cortical reorganisation. Our results show executive processing in typically sensory regions, suggesting that the development and ultimate role of brain regions are influenced by perceptual environmental experience.

Functional Connectome Dynamics After Mild Traumatic Brain Injury According to Age and Sex

Neural and cognitive deficits after mild traumatic brain injury (mTBI) are paralleled by changes in resting state functional correlation (FC) networks that mirror post-traumatic pathophysiology effects on functional outcomes. Using functional magnetic resonance images acquired both acutely and chronically after injury (∼1 week and ∼6 months post-injury, respectively), we map post-traumatic FC changes across 136 participants aged 19-79 (52 females), both within and between the brain's seven canonical FC networks: default mode, dorsal attention, frontoparietal, limbic, somatomotor, ventral attention, and visual. Significant sex-dependent FC changes are identified between (A) visual and limbic, and between (B) default mode and somatomotor networks. These changes are significantly associated with specific functional recovery patterns across all cognitive domains (p < 0.05, corrected). Changes in FC between default mode, somatomotor, and ventral attention networks, on the one hand, and both temporal and occipital regions, on the other hand, differ significantly by age group (p < 0.05, corrected), and are paralleled by significant sex differences in cognitive recovery independently of age at injury (p < 0.05, corrected). Whereas females' networks typically feature both significant (p < 0.036, corrected) and insignificant FC changes, males more often exhibit significant FC decreases between networks (e.g., between dorsal attention and limbic, visual and limbic, default-mode and somatomotor networks, p < 0.0001, corrected), all such changes being accompanied by significantly weaker recovery of cognitive function in males, particularly older ones (p < 0.05, corrected). No significant FC changes were found across 35 healthy controls aged 66-92 (20 females). Thus, male sex and older age at injury are risk factors for significant FC alterations whose patterns underlie post-traumatic cognitive deficits. This is the first study to map, systematically, how mTBI impacts FC between major human functional networks.

The Effects of Working Memory Capacity in Metaphor and Metonymy Comprehension in Mandarin-English Bilinguals’ Minds: An fMRI Study

This study investigated the role of working memory capacity (WMC) in metaphoric and metonymic processing in Mandarin–English bilinguals’ minds. It also explored the neural correlations between metaphor and metonymy computations. We adopted an event-related functional magnetic resonance imaging (fMRI) design, which consisted of 21 English dialogic sets of stimuli and 5 conditions: systematic literal, circumstantial literal, metaphor, systematic metonymy, and circumstantial metonymy, all contextualized in daily conversations. Similar fronto-temporal networks were found for the figurative language processing patterns: the superior temporal gyrus (STG) for metaphorical comprehension, and the inferior parietal junction (IPJ) for metonymic processing. Consistent brain regions have been identified in previous studies in the homologue right hemisphere of better WMC bilinguals. The degree to which bilateral strategies that bilinguals with better WMC or larger vocabulary size resort to is differently modulated by subtypes of metonymies. In particular, when processing circumstantial metonymy, the cuneus (where putamen is contained) is activated as higher-span bilinguals filter out irrelevant information, resorting to inhibitory control use. Cingulate gyrus activation has also been revealed in better WMC bilinguals, reflecting their mental flexibility to adopt the subjective perspective of critical figurative items with self-control. It is hoped that this research provides a better understanding of Mandarin–English bilinguals’ English metaphoric and metonymic processing in Taiwan.

A Weak Shadow of Early Life Language Processing Persists in the Right Hemisphere of the Mature Brain

Studies of language organization show a striking change in cerebral dominance for language over development: We begin life with a left hemisphere (LH) bias for language processing, which is weaker than that in adults and which can be overcome if there is a LH injury. Over development this LH bias becomes stronger and can no longer be reversed. Prior work has shown that this change results from a significant reduction in the magnitude of language activation in right hemisphere (RH) regions in adults compared to children. Here we investigate whether the spatial distribution of language activation, albeit weaker in magnitude, still persists in homotopic RH regions of the mature brain. Children aged 4-13 (n = 39) and young adults (n = 14) completed an auditory sentence comprehension fMRI (functional magnetic resonance imaging) task. To equate neural activity across the hemispheres, we applied fixed cutoffs for the number of active voxels that would be included in each hemisphere for each participant. To evaluate homotopicity, we generated left-right flipped versions of each activation map, calculated spatial overlap between the LH and RH activity in frontal and temporal regions, and tested for mean differences in the spatial overlap values between the age groups. We found that, in children as well as in adults, there was indeed a spatially intact shadow of language activity in the right frontal and temporal regions homotopic to the LH language regions. After a LH stroke in adulthood, recovering early-life activation in these regions might assist in enhancing recovery of language abilities.

The Elephant in the Room: A Systematic Review of Stimulus Control in Neuro-Measurement Studies on Figurative Language Processing

The processing of metaphors and idioms has been the subject of neuroscientific research for several decades. However, results are often contradictory, which can be traced back to inconsistent terminology and stimulus control. In this systematic review of research methods, we analyse linguistic aspects of 116 research papers which used EEG, fMRI, PET, MEG, or NIRS to investigate the neural processing of the two figurative subtypes metaphor and idiom. We critically examine the theoretical foundations as well as stimulus control by performing a systematic literature synthesis according to the PRISMA guidelines. We explicitly do not analyse the findings of the studies but instead focus on four primary aspects: definitions of figurative language and its subtypes, linguistic theory behind the studies, control for factors influencing figurative language processing, and the relationship between theoretical and operational definitions. We found both a lack and a broad variety in existing definitions and operationalisation, especially in regard to familiarity and conventionality. We identify severe obstacles in the comparability and validation potential of the results of the papers in our review corpus. We propose the development of a consensus in fundamental terminology and more transparency in the reporting of stimulus design in the research on figurative language processing.

Developmental changes in neural lateralization for visual-spatial function: Evidence from a line-bisection task

Studies of hemispheric specialization have traditionally cast the left hemisphere as specialized for language and the right hemisphere for spatial function. Much of the supporting evidence for this separation of function comes from studies of healthy adults and those who have sustained lesions to the right or left hemisphere. However, we know little about the developmental origins of lateralization. Recent evidence suggests that the young brain represents language bilaterally, with 4-6-year-olds activating the left-hemisphere regions known to support language in adults as well as homotopic regions in the right hemisphere. This bilateral pattern changes over development, converging on left-hemispheric activation in late childhood. In the present study, we ask whether this same developmental trajectory is observed in a spatial task that is strongly right-lateralized in adults-the line bisection (or "Landmark") task. We examined fMRI activation among children ages 5-11 years as they were asked to judge which end of a bisected vertical line was longer. We found that young children showed bilateral activation, with activation in the same areas of the right hemisphere as has been shown among adults, as well as in the left hemisphere homotopic regions. By age 10, activation was right-lateralized. This strongly resembles the developmental trajectory for language, moving from bilateral to lateralized activation. We discuss potential underlying mechanisms and suggest that understanding the development of lateralization for a range of cognitive functions can play a crucial role in understanding general principles of how and why the brain comes to lateralize certain functions.

Tool use and language share syntactic processes and neural patterns in the basal ganglia

[Figure: see text].

Measuring the Domain Specificity of Workload Using EEG: Auditory and Visual Domains in Rotary-Wing Simulated Flight

OBJECTIVE

The overarching objective was to evaluate whether workload sensory-domain specificity could be identified through electroencephalogram (EEG) recordings during simulated rotary-wing operations.

BACKGROUND

Rotary-wing aviators experience workload from different sensory domains, although predominantly through auditory and visual domains. Development of real-time monitoring tools using psychophysiological indices, such as EEG recordings, could enable identification of aviator overload in real time.

METHOD

Two studies were completed, both of which recorded EEG, task performance, and self-report data. In Study 1, 16 individuals completed a basic auditory and a basic visual laboratory task where workload was manipulated. In Study 2, 23 Army aviators completed simulated aviation flights where workload was manipulated within auditory and visual sensory domains.

RESULTS

Results from Study 1 found differences in frontal alpha activity during the auditory task, and that alpha and beta activities were associated with perceived workload. Frontal theta activity was found to differ during the visual task while frontal alpha was associated with perceived workload. Study 2 found support for frontal beta activity and the ratio of beta to alpha + theta to differentiate level of workload within the auditory domain.

CONCLUSION

There is likely a role of frontal alpha and beta activities in response to workload manipulations within the auditory domain; however, this role becomes more equivocal when examined in a multifaceted flight scenario.

APPLICATION

Results from this study provide a basis for understanding changes in EEG activity when workload is manipulated in sensory domains that can be used in furthering the development of real-time monitoring tools.

Multiple-brain systems dynamically interact during tonic and phasic states to support language integrity in temporal lobe epilepsy

•

Unique brain dynamics occur during language task in left temporal lobe epilepsy (TLE).

•

Multiple brain systems interact to implement compensated language status in TLE.

•

Tonic/rest dynamics exert influence and may prime the level of phasic/task dynamics.

•

Multi-network integrations are compensatory in patients with lower language skills.

An epileptogenic focus in the dominant temporal lobe can result in the reorganization of language systems in order to compensate for compromised functions. We studied the compensatory reorganization of language in the setting of left temporal lobe epilepsy (TLE), taking into account the interaction of language (L) with key non-language (NL) networks such as dorsal attention (DAN), fronto-parietal (FPN) and cingulo-opercular (COpN), with these systems providing cognitive resources helpful for successful language performance.

We applied tools from dynamic network neuroscience to functional MRI data collected from 23 TLE patients and 23 matched healthy controls during the resting state (RS) and a sentence completion (SC) task to capture how the functional architecture of a language network dynamically changes and interacts with NL systems in these two contexts.

We provided evidence that the brain areas in which core language functions reside dynamically interact with non-language functional networks to carry out linguistic functions. We demonstrated that abnormal integrations between the language and DAN existed in TLE, and were present both in tonic as well as phasic states. This integration was considered to reflect the entrainment of visual attention systems to the systems dedicated to lexical semantic processing. Our data made clear that the level of baseline integrations between the language subsystems and certain NL systems (e.g., DAN, FPN) had a crucial influence on the general level of task integrations between L/NL systems, with this a normative finding not unique to epilepsy. We also revealed that a broad set of task L/NL integrations in TLE are predictive of language competency, indicating that these integrations are compensatory for patients with lower overall language skills.

We concluded that RS establishes the broad set of L/NL integrations available and primed for use during task, but that the actual use of those interactions in the setting of TLE depended on the level of language skill. We believe our analyses are the first to capture the potential compensatory role played by dynamic network reconfigurations between multiple brain systems during performance of a complex language task, in addition to testing for characteristics in both the phasic/task and tonic/resting state that are necessary to achieve language competency in the setting of temporal lobe pathology. Our analyses highlighted the intra- versus inter-system communications that form the basis of unique language processing in TLE, pointing to the dynamic reconfigurations that provided the broad multi-system support needed to maintain language skill and competency.

The "Narratives" fMRI dataset for evaluating models of naturalistic language comprehension

The "Narratives" collection aggregates a variety of functional MRI datasets collected while human subjects listened to naturalistic spoken stories. The current release includes 345 subjects, 891 functional scans, and 27 diverse stories of varying duration totaling ~4.6 hours of unique stimuli (~43,000 words). This data collection is well-suited for naturalistic neuroimaging analysis, and is intended to serve as a benchmark for models of language and narrative comprehension. We provide standardized MRI data accompanied by rich metadata, preprocessed versions of the data ready for immediate use, and the spoken story stimuli with time-stamped phoneme- and word-level transcripts. All code and data are publicly available with full provenance in keeping with current best practices in transparent and reproducible neuroimaging.

Relative Clause Effects at the Matrix Verb Depend on Type of Intervening Material

Although a large literature demonstrates that object-extracted relative clauses (ORCs) are harder to process than subject-extracted relative clauses (SRCs), there is less agreement regarding where during processing this difficulty emerges, as well as how best to explain these effects. An eye-tracking study by Staub, Dillon, and Clifton (2017) demonstrated that readers experience more processing difficulty at the matrix verb for ORCs than for SRCs when the matrix verb immediately follows the relative clause (RC), but the difficulty is eliminated if a prepositional phrase (PP) intervenes. A careful examination of Staub et al.'s materials reveals that the types of PPs used in the experiment were a mixture of locative and temporal PPs. This is important in that locative PPs can modify either a noun phrase or a verb phrase (VP), whereas temporal PPs typically modify VPs, resulting in systematic differences in PP attachment across ORCs versus SRCs. In the current eye-tracking experiment, we systematically manipulated RC type and PP type in the same sentences used by Staub et al. The manipulation of PP type resulted in a crossover pattern at the matrix verb such that there was a trend for reading times to be longer for ORCs than SRCs when the PP was locative, but reading times were longer for SRCs than ORCs when the PP was temporal. These results provide important information regarding the locus of RC-processing effects and highlight the importance of carefully considering how intervening material might unintentionally alter the structure or the meaning of a sentence.

An ERP study of hemispheric differences in perceptual representations of language reveals meaning attribution in the right hemisphere and constituents of the N400-effect

Recent findings have revealed that the right hemisphere (RH) is uniquely involved in integrating perceptual information from linguistic input to simulate a mental model of that input. We extend on these findings by testing whether meaning is generated from such models. Participants (N = 37) heard auditory passages describing the visuospatial arrangement of elements into a perceptual representation of a familiar object, then judged whether a laterally-presented target word matched the object. We found a central N400-effect for left visual-field targets, suggesting that meaning was also accessible to the RH. There was no statistical difference for right visual-field targets. Principle component analysis of the data revealed that the N400-effect was driven by positive components. Consequently, the results suggest that i) RH contributions to language comprehension include integrative and perceptual processes that enable overall meaning to be generated from representations of discourse, and ii) positive ERP components may produce N400-effects.

Syntactic and Semantic Influences on the Time Course of Relative Clause Processing: The Role of Language Dominance

We conducted a visual world eye-tracking experiment with highly proficient Spanish-English bilingual adults to investigate the effects of relative language dominance, operationalized as a continuous, multidimensional variable, on the time course of relative clause processing in the first-learned language, Spanish. We found that participants exhibited two distinct processing preferences: a semantically driven preference to assign agency to referents of lexically animate noun phrases and a syntactically driven preference to interpret relative clauses as subject-extracted. Spanish dominance was found to exert a distinct influence on each of these preferences, gradiently attenuating the semantic preference while gradiently exaggerating the syntactic preference. While these results might be attributable to particular properties of Spanish and English, they also suggest a possible generalization that greater dominance in a language increases reliance on language-specific syntactic processing strategies while correspondingly decreasing reliance on more domain-general semantic processing strategies.

Non-Contact Measurement of Motion Sickness Using Pupillary Rhythms from an Infrared Camera

Both physiological and neurological mechanisms are reflected in pupillary rhythms via neural pathways between the brain and pupil nerves. This study aims to interpret the phenomenon of motion sickness such as fatigue, anxiety, nausea and disorientation using these mechanisms and to develop an advanced non-contact measurement method from an infrared webcam. Twenty-four volunteers (12 females) experienced virtual reality content through both two-dimensional and head-mounted device interpretations. An irregular pattern of the pupillary rhythms, demonstrated by an increasing mean and standard deviation of pupil diameter and decreasing pupillary rhythm coherence ratio, was revealed after the participants experienced motion sickness. The motion sickness was induced while watching the head-mounted device as compared to the two-dimensional virtual reality, with the motion sickness strongly related to the visual information processing load. In addition, the proposed method was verified using a new experimental dataset for 23 participants (11 females), with a classification performance of 89.6% (n = 48) and 80.4% (n = 46) for training and test sets using a support vector machine with a radial basis function kernel, respectively. The proposed method was proven to be capable of quantitatively measuring and monitoring motion sickness in real-time in a simple, economical and contactless manner using an infrared camera.

The cortical organization of listening effort: New insight from functional near-infrared spectroscopy

Everyday challenges impact our ability to hear and comprehend spoken language with ease, such as accented speech (source factors), spectral degradation (transmission factors), complex or unfamiliar language use (message factors), and predictability (context factors). Auditory degradation and linguistic complexity in the brain and behavior have been well investigated, and several computational models have emerged. The work here provides a novel test of the hypotheses that listening effort is partially reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe, and partially reliant on hierarchical linguistic computation in the brain's left hemisphere. We specifically hypothesize that these models are robust and can be applied in ecologically relevant and coarse-grain contexts that rigorously control for acoustic and linguistic listening challenges. Using functional near-infrared spectroscopy during an auditory plausibility judgment task, we show the hierarchical cortical organization for listening effort in the frontal and left temporal-parietal brain regions. In response to increasing levels of cognitive demand, we found (i) poorer comprehension, (ii) slower reaction times, (iii) increasing levels of perceived mental effort, (iv) increasing levels of brain activity in the prefrontal cortex, (v) hierarchical modulation of core language processing regions that reflect increasingly higher-order auditory-linguistic processing, and (vi) a correlation between participants' mental effort ratings and their performance on the task. Our results demonstrate that listening effort is partly reliant on higher cognitive auditory attention and working memory mechanisms in the frontal lobe and partly reliant on hierarchical linguistic computation in the brain's left hemisphere. Further, listening effort is driven by a voluntary, motivation-based attention system for which our results validate the use of a single-item post-task questionnaire for measuring perceived levels of mental effort and predicting listening performance. We anticipate our study to be a starting point for more sophisticated models of listening effort and even cognitive neuroplasticity in hearing aid and cochlear implant users.

Development of bilateral parietal activation for complex visual-spatial function: Evidence from a visual-spatial construction task

The neural representation of visual-spatial functions has traditionally been ascribed to the right hemisphere, but little is known about these representations in children, including whether and how lateralization of function changes over the course of development. Some studies suggest bilateral activation early in life that develops toward right-lateralization in adulthood, while others find evidence of right-hemispheric dominance in both children and adults. We used a complex visual-spatial construction task to examine the nature of lateralization and its developmental time course in children ages 5-11 years. Participants were shown two puzzle pieces and were asked whether the pieces could fit together to make a square; responses required either mental translation of the pieces (Translation condition) or both mental translation and rotation of the pieces (Rotation condition). Both conditions were compared to a matched Luminance control condition that was similar in terms of visual content and difficulty but required no spatial analysis. Group and single-subject analyses revealed that the Rotation and Translation conditions elicited strongly bilateral activation in the same parietal and occipital locations as have been previously found for adults. These findings show that visual-spatial construction consistently elicits robust bilateral activation from age 5 through adulthood. This challenges the idea that spatial functions are all right-lateralized, either during early development or in adulthood. More generally, these findings provide insights into the developmental course of lateralization across different spatial skills and how this may be influenced by the computational requirements of the particular functions involved.

Stable brain loci for the processing of complex syntax: A review of the current neuroimaging evidence

We conducted a retrospective review of fMRI studies of complex syntax, in order to study the stability of the neural bases of mechanisms engaged in syntactic processing. Our review set out rigorous selection criteria of studies which we discuss, including transparency and minimality of the contrasts between stimuli, and the presence of whole brain analyses corrected for multiple comparisons. Seventeen studies with 316 participants survived our sieve. We mapped the 65 resulting maxima onto JuBrain, a state-of-the-art cytoarchitectonic brain atlas (Amunts et al., 2020), and a sharp picture emerged: syntactic displacement operations (a k a MOVE) produce highly consistent results, activating left Broca's region across-the-board and unambiguously; to a somewhat lesser extent, maxima clustered in left posterior brain regions, including the STS/STG. The few studies of syntactic tree-building operations (a k a MERGE) produce a murkier picture regarding the involvement of the left IFG. We conclude that the extant data decisively point to the JuBrain-defined Broca's region as the main locus of complex receptive syntax in healthy people; the STS/STG also are involved, but to a lesser extent.

Reduced brain activation during spoken language processing in children with developmental language disorder and children with 22q11.2 deletion syndrome

Language difficulties of children with Developmental Language Disorder (DLD) have been associated with multiple underlying factors and are still poorly understood. One way of investigating the mechanisms of DLD language problems is to compare language-related brain activation patterns of children with DLD to those of a population with similar language difficulties and a uniform etiology. Children with 22q11.2 deletion syndrome (22q11DS) constitute such a population. Here, we conducted an fMRI study, in which children (6-10yo) with DLD and 22q11DS listened to speech alternated with reversed speech. We compared language laterality and language-related brain activation levels with those of typically developing (TD) children who performed the same task. The data revealed no significant differences between groups in language lateralization, but task-related activation levels were lower in children with language impairment than in TD children in several nodes of the language network. We conclude that language impairment in children with DLD and in children with 22q11DS may involve (partially) overlapping cortical areas.

Hierarchical syntactic processing is beyond mere associating: Functional magnetic resonance imaging evidence from a novel artificial grammar

Grammar is central to any natural language. In the past decades, the artificial grammar of the AⁿBⁿ type in which a pair of associated elements can be nested in the other pair was considered as a desirable model to mimic human language syntax without semantic interference. However, such a grammar relies on mere associating mechanisms, thus insufficient to reflect the hierarchical nature of human syntax. Here, we test how the brain imposes syntactic hierarchies according to the category relations on linearized sequences by designing a novel artificial “Hierarchical syntactic structure‐building Grammar” (HG), and compare this to the AⁿBⁿ grammar as a “Nested associating Grammar” (NG) based on multilevel associations. Thirty‐six healthy German native speakers were randomly assigned to one of the two grammars. Both groups performed a grammaticality judgment task on auditorily presented word sequences generated by the corresponding grammar in the scanner after a successful explicit behavioral learning session. Compared to the NG group, we found that the HG group showed a (a) significantly higher involvement of Brodmann area (BA) 44 in Broca's area and the posterior superior temporal gyrus (pSTG); and (b) qualitatively distinct connectivity between the two regions. Thus, the present study demonstrates that the build‐up process of syntactic hierarchies on the basis of category relations critically relies on a distinctive left‐hemispheric syntactic network involving BA 44 and pSTG. This indicates that our novel artificial grammar can constitute a suitable experimental tool to investigate syntax‐specific processes in the human brain.

The Functional Reorganization of Language Network Modules in Glioma Patients: New Insights From Resting State fMRI Study

Background

Prior investigations of language functions have focused on the response profiles of particular brain regions. However, the specialized and static view of language processing does not explain numerous observations of functional recovery following brain surgery. To investigate the dynamic alterations of functional connectivity (FC) within language network (LN) in glioma patients, we explored a new flexible model based on the neuroscientific hypothesis of core-periphery organization in LN.

Methods

Group-level LN mapping was determined from 109 glioma patients and forty-two healthy controls (HCs) using independent component analysis (ICA). FC and mean network connectivity (mNC: l/rFCw, FCb, and FCg) were compared between patients and HCs. Correlations between mNC and tumor volume (TV) were calculated.

Results

We identified ten separate LN modules from ICA. Compared to HCs, glioma patients showed a significant reduction in language network functional connectivity (LNFC), with a distinct pattern modulated by tumor position. Left hemisphere gliomas had a broader impact on FC than right hemisphere gliomas, with more reduced edges away from tumor sites (p=0.011). mNC analysis revealed a significant reduction in all indicators of FC except for lFCw in right hemisphere gliomas. These alterations were associated with TV in a double correlative relationship depending on the tumor position across hemispheres.

Conclusion

Our findings emphasize the importance of considering the modulatory effects of core-periphery mechanisms from a network perspective. Preoperative evaluation of changes in LN caused by gliomas could provide the surgeon a reference to optimize resection while maintaining functional balance.

The current international consensus criteria can lead to under and over-diagnosis of primary progressive aphasia variants

In the field of primary progressive aphasia (PPA), the most recent international consensus criteria of 2011 for diagnosis and variant classification have been shown not to capture accurately the whole range of PPA patients. Up to 30-40% of PPA patients appear not to satisfy the criteria of the three 'classical' PPA variants (non-fluent/agrammatic, logopenic, semantic) and are labelled either 'mixed PPA' or 'unclassifiable PPA'. Based on the PPA literature since 2011, this article discusses why patients might be under-diagnosed with respect to the three PPA variants, thus leading to the default concept of 'mixed/unclassifiable PPA' and, conversely, why the non-fluent/agrammatic variant appears to be over-diagnosed. It analyses and attempts to show how to resolve these issues, and it accordingly proposes clinical criteria, which are more inclusive to diminish the proportion of so-called mixed/unclassifiable PPA diagnoses and to reduce the proportion of questionable non-fluent/agrammatic diagnoses, which frequently correspond to progressive speech apraxia, rather than to aphasia.

Effect of corpus callosum agenesis on the language network in children and adolescents

The present study is interested in the role of the corpus callosum in the development of the language network. We, therefore, investigated language abilities and the language network using task-based fMRI in three cases of complete agenesis of the corpus callosum (ACC), three cases of partial ACC and six controls. Although the children with complete ACC revealed impaired functions in specific language domains, no child with partial ACC showed a test score below average. As a group, ACC children performed significantly worse than healthy controls in verbal fluency and naming. Furthermore, whole-brain ROI-to-ROI connectivity analyses revealed reduced intrahemispheric and right intrahemispheric functional connectivity in ACC patients as compared to controls. In addition, stronger functional connectivity between left and right temporal areas was associated with better language abilities in the ACC group. In healthy controls, no association between language abilities and connectivity was found. Our results show that ACC is associated not only with less interhemispheric, but also with less right intrahemispheric language network connectivity in line with reduced verbal abilities. The present study, thus, supports the excitatory role of the corpus callosum in functional language network connectivity and language abilities.

Talker familiarity and the accommodation of talker variability

A fundamental problem in speech perception is how (or whether) listeners accommodate variability in the way talkers produce speech. One view of the way listeners cope with this variability is that talker differences are normalized - a mapping between talker-specific characteristics and phonetic categories is computed such that speech is recognized in the context of the talker's vocal characteristics. Consistent with this view, listeners process speech more slowly when the talker changes randomly than when the talker remains constant. An alternative view is that speech perception is based on talker-specific auditory exemplars in memory clustered around linguistic categories that allow talker-independent perception. Consistent with this view, listeners become more efficient at talker-specific phonetic processing after voice identification training. We asked whether phonetic efficiency would increase with talker familiarity by testing listeners with extremely familiar talkers (family members), newly familiar talkers (based on laboratory training), and unfamiliar talkers. We also asked whether familiarity would reduce the need for normalization. As predicted, phonetic efficiency (word recognition in noise) increased with familiarity (unfamiliar < trained-on < family). However, we observed a constant processing cost for talker changes even for pairs of family members. We discuss how normalization and exemplar theories might account for these results, and constraints the results impose on theoretical accounts of phonetic constancy.

Functional connectivity hemispheric contrast (FC-HC): A new metric for language mapping

Development of a task-free method for presurgical mapping of language function is important for use in young or cognitively impaired patients. Resting state connectivity fMRI (RS-fMRI) is a task-free method that may be used to identify cognitive networks. We developed a voxelwise RS-fMRI metric, Functional Connectivity Hemispheric Contrast (FC-HC), to map the language network and determine language laterality through comparison of within-hemispheric language network connections (Integration) to cross-hemispheric connections (Segregation). For the first time, we demonstrated robustness and efficacy of a RS-fMRI metric to map language networks across five groups (total N = 243) that differed in MRI scanning parameters, fMRI scanning protocols, age, and development (typical vs pediatric epilepsy). The resting state FC-HC maps for the healthy pediatric and adult groups showed higher values in the left hemisphere, and had high agreement with standard task language fMRI; in contrast, the epilepsy patient group map was bilateral. FC-HC has strong but not perfect agreement with task fMRI and thus, may reflect related and complementary information about language plasticity and compensation.

Distinct neural correlates of linguistic demand and non-linguistic demand

In this study, we investigated how the brain responds to task difficulty in linguistic and non-linguistic contexts. This is important for the interpretation of functional imaging studies of neuroplasticity in post-stroke aphasia, because of the inherent difficulty of matching or controlling task difficulty in studies with neurological populations. Twenty neurologically normal individuals were scanned with fMRI as they performed a linguistic task and a non-linguistic task, each of which had two levels of difficulty. Critically, the tasks were matched across domains (linguistic, non-linguistic) for accuracy and reaction time, such that the differences between the easy and difficult conditions were equivalent across domains. We found that non-linguistic demand modulated the same set of multiple demand (MD) regions that have been identified in many prior studies. In contrast, linguistic demand modulated MD regions to a much lesser extent, especially nodes belonging to the dorsal attention network. Linguistic demand modulated a subset of language regions, with the left inferior frontal gyrus most strongly modulated. The right hemisphere region homotopic to Broca's area was also modulated by linguistic but not non-linguistic demand. When linguistic demand was mapped relative to non-linguistic demand, we also observed domain by difficulty interactions in temporal language regions as well as a widespread bilateral semantic network. In sum, linguistic and non-linguistic demand have strikingly different neural correlates. These findings can be used to better interpret studies of patients recovering from aphasia. Some reported activations in these studies may reflect task performance differences, while others can be more confidently attributed to neuroplasticity.

Motion Imagery-BCI Based on EEG and Eye Movement Data Fusion

Existing studies have demonstrated that eye tracking can be a complementary approach to Electroencephalogram (EEG) based brain-computer interaction (BCI), especially in improving BCI performance in visual perception and cognition. In this paper, we proposed a method to fuse EEG and eye movement data extracted from motor imagery (MI) tasks. The results of the tests showed that on the feature layer, the average MI classification accuracy from the fusion of EEG and eye movement data was higher than that of pure EEG data or pure eye movement data, respectively. Besides, we also found that the average classification accuracy from the fusion on the decision layer was higher than that from the feature layer. Additionally, when EEG data were not available for the shifting of parts of electrodes, we combined EEG data collected from the rest of the electrodes (only 50% of the original) with the eye movement data, and the average MI classification accuracy was only 1.07% lower than that from all available electrodes. This result indicated that eye movement data was feasible to compensate for the loss of the EEG data in the MI scenario. Overall our approach was proved valuable and useful for augmenting MI based BCI applications.

Decoding verbal working memory representations of Chinese characters from Broca's area

Representations of sensory working memory can be found across the entire neocortex. But how are verbal working memory (VWM) contents retained in the human brain? Here we used fMRI and multi-voxel pattern analyses to study Chinese native speakers (15 males, 13 females) memorizing Chinese characters. Chinese characters are uniquely suitable to study VWM because verbal encoding is encouraged by their complex visual appearance and monosyllabic pronunciation. We found that activity patterns in Broca's area and left premotor cortex carried information about the memorized characters. These language-related areas carried (1) significantly more information about cued characters than those not cued for memorization, (2) significantly more information on the left than the right hemisphere and (3) significantly more information about Chinese symbols than complex visual patterns which are hard to verbalize. In contrast, early visual cortex carries a comparable amount of information about cued and uncued stimuli and is thus unlikely to be involved in memory retention. This study provides evidence for verbal working memory maintenance in a distributed network of language-related brain regions, consistent with distributed accounts of WM. The results also suggest that Broca's area and left premotor cortex form the articulatory network which serves articulatory rehearsal in the retention of verbal working memory contents.

Neural Mechanisms Underlying the Dynamic Updating of Native Language

Language users encounter different sentence structures from different people in different contexts. Although syntactic variability and adults' ability to adapt to it are both widely acknowledged, the relevant mechanisms and neural substrates are unknown. We hypothesized that syntactic updating might rely on cognitive control, which can help detect and resolve mismatch between prior linguistic expectations and new language experiences that countervail those expectations and thereby assist in accurately encoding new input. Using functional neuroimaging (fMRI), we investigated updating in garden-path sentence comprehension to test the prediction that regions within the left inferior frontal cortex might be relevant neural substrates, and additionally, explored the role of regions within the multiple demand network. Participants read ambiguous and unambiguous main-verb and relative-clause sentences. Ambiguous relative-clause sentences led to a garden-path effect in the left pars opercularis within the lateral frontal cortex and the left anterior insula/frontal operculum within the multiple demand network. This effect decreased upon repeated exposure to relative-clause sentences, consistent with updating. The two regions showed several contrastive patterns, including different activation relative to baseline, correlation with performance in a cognitive control task (the Stroop task), and verb-specificity versus generality in adaptation. Together, these results offer new insight into how the brain updates native language. They demonstrate the involvement of left frontal brain regions in helping the language system adjust to new experiences, with different areas playing distinct functional roles.

When a sentence loses semantics: Selective involvement of a left anterior temporal subregion in semantic processing

Although the left anterior temporal lobe (ATL) has been associated with semantic processing, the role of this region in syntactic structure building of sentences remains a subject of debate. Functional neuroimaging studies contrasting well-formed sentences with word lists lacking syntactic structure have produced mixed results. The current functional magnetic resonance imaging study examined whether the left ATL is selectively involved in semantic processing or also plays a role in syntactic structure building by manipulating syntactic complexity and meaningfulness in a novel way. To deprive semantic/pragmatic information from a sentence, we replaced all content words with pronounceable meaningless placeholders. We conducted an experiment with a 2 × 2 factorial design with factors of SEMANTICS (natural sentences [NAT]; sentences with placeholders [SPH]) and SYNTAX (the basic Japanese Subject-Object-Verb [SOV] word order; a changed Object-Subject-Verb [OSV] word order). A main effect of SEMANTICS (NAT > SPH) was found in the left ATL, as well as in the ventral occipitotemporal regions. The opposite contrast (SPH > NAT) revealed activation in the dorsal regions encompassing Brodmann area 44, the premotor area, and the parietal cortex in the left hemisphere. We found no main effect of SYNTAX (OSV > SOV) in a subregion of the left ATL that was more responsive to natural sentences than meaningless sentences. These results indicate selective involvement of a subregion of the left ATL in semantic/pragmatic processing.