Mapping a lateralization gradient within the ventral stream for auditory speech perception

When fMRI came to Bergen and Norway - as I remember it

In this personal recollection, I review the beginning of functional magnetic resonance imaging (fMRI) research in Norway, i.e., at the University of Bergen and the Haukeland University Hospital in Bergen. Research with fMRI had already started in Bergen in 1993, and the small group of researchers involved were the first to take up this new method for studies of the brain and brain-behavior relationships. This article is a recollection of the early years of how the field started and developed in Bergen, Norway over the years, including basic as well as clinical research, and how the research also led to successful innovation and commercialization through the establishment of a MedTech company, NordicNeuroLab (NNL), that has delivered products to more than 2,000 university hospitals worldwide.

Evaluation of a Simple Clinical Language Paradigm With Respect to Sensory Independency, Functional Asymmetry, and Effective Connectivity

The present study replicates a known visual language paradigm, and extends it to a paradigm that is independent from the sensory modality of the stimuli and, hence, could be administered either visually or aurally, such that both patients with limited sight or hearing could be examined. The stimuli were simple sentences, but required the subject not only to understand the content of the sentence but also to formulate a response that had a semantic relation to the content of the presented sentence. Thereby, this paradigm does not only test perception of the stimuli, but also to some extend sentence and semantic processing, and covert speech production within one task. When the sensory base-line condition was subtracted, both the auditory and visual version of the paradigm demonstrated a broadly overlapping and asymmetric network, comprising distinct areas of the left posterior temporal lobe, left inferior frontal areas, left precentral gyrus, and supplementary motor area. The consistency of activations and their asymmetry was evaluated with a conjunction analysis, probability maps, and intraclass correlation coefficients (ICC). This underlying network was further analyzed with dynamic causal modeling (DCM) to explore whether not only the same brain areas were involved, but also the network structure and information flow were the same between the sensory modalities. In conclusion, the paradigm reliably activated the most central parts of the speech and language network with a great consistency across subjects, and independently of whether the stimuli were administered aurally or visually. However, there was individual variability in the degree of functional asymmetry between the two sensory conditions.

Low-Frequency vs. Theta Burst Transcranial Magnetic Stimulation for the Treatment of Chronic Non-fluent Aphasia in Stroke: A Proof-of-Concept Study

BACKGROUND

Although low-frequency repetitive transcranial magnetic stimulation (LF-rTMS) has shown promise in the treatment of poststroke aphasia, the efficacy of high-frequency rTMS (HF-rTMS) has yet to be determined.

PURPOSE

We investigated the efficacy of intermittent theta burst stimulation (iTBS) in ameliorating chronic non-fluent aphasia and compared it with that of LF-rTMS.

METHODS

We randomly assigned patients with poststroke non-fluent aphasia to an ipsilesional iTBS (n = 29), contralesional 1-Hz rTMS (n = 27), or sham (n = 29) group. Each group received the rTMS protocol executed in 10 daily sessions over 2 weeks. We evaluated language function before and after the intervention by using the Concise Chinese Aphasia Test (CCAT).

RESULTS

Compared with the sham group, the iTBS group exhibited significant improvements in conversation, description, and expression scores (P = 0.0004-0.031), which characterize verbal production, as well as in auditory comprehension, reading comprehension, and matching scores (P < 0.01), which characterize language perception. The 1-Hz group exhibited superior improvements in expression, reading comprehension, and imitation writing scores compared with the sham group (P < 0.05). The iTBS group had significantly superior results in CCAT total score, matching and auditory comprehension (P < 0.05) relative to the 1-Hz group.

CONCLUSION

Our study findings contribute to a growing body of evidence that ipsilesional iTBS enhances the language recovery of patients with non-fluent aphasia after a chronic stroke. Auditory comprehension was more preferentially enhanced by iTBS compared with the 1-Hz protocol. Our findings highlight the importance of ipsilesional modulation through excitatory rTMS for the recovery of non-fluent aphasia in patients with chronic stroke.

CLINICAL TRIAL REGISTRATION

[www.ClinicalTrials.gov], identifier [NCT03059225].

Multilevel fMRI adaptation for spoken word processing in the awake dog brain

Human brains process lexical meaning separately from emotional prosody of speech at higher levels of the processing hierarchy. Recently we demonstrated that dog brains can also dissociate lexical and emotional prosodic information in human spoken words. To better understand the neural dynamics of lexical processing in the dog brain, here we used an event-related design, optimized for fMRI adaptation analyses on multiple time scales. We investigated repetition effects in dogs’ neural (BOLD) responses to lexically marked (praise) words and to lexically unmarked (neutral) words, in praising and neutral prosody. We identified temporally and anatomically distinct adaptation patterns. In a subcortical auditory region, we found both short- and long-term fMRI adaptation for emotional prosody, but not for lexical markedness. In multiple cortical auditory regions, we found long-term fMRI adaptation for lexically marked compared to unmarked words. This lexical adaptation showed right-hemisphere bias and was age-modulated in a near-primary auditory region and was independent of prosody in a secondary auditory region. Word representations in dogs’ auditory cortex thus contain more than just the emotional prosody they are typically associated with. These findings demonstrate multilevel fMRI adaptation effects in the dog brain and are consistent with a hierarchical account of spoken word processing.

Understanding rostral-caudal auditory cortex contributions to auditory perception

There are functional and anatomical distinctions between the neural systems involved in the recognition of sounds in the environment and those involved in the sensorimotor guidance of sound production and the spatial processing of sound. Evidence for the separation of these processes has historically come from disparate literatures on the perception and production of speech, music and other sounds. More recent evidence indicates that there are computational distinctions between the rostral and caudal primate auditory cortex that may underlie functional differences in auditory processing. These functional differences may originate from differences in the response times and temporal profiles of neurons in the rostral and caudal auditory cortex, suggesting that computational accounts of primate auditory pathways should focus on the implications of these temporal response differences.

Cortical mapping of receptive language processing in children using navigated transcranial magnetic stimulation

We used a stepwise process to develop a new paradigm for preoperative cortical mapping of receptive language in children, using temporary functional blocking with transcranial magnetic stimulation (TMS). The method combines short sentences with a lexical decision task in which children are asked to point at a picture that fits a short sentence delivered aurally. This was first tested with 24 healthy children aged 4-16 years. Next, 75 sentences and 25 slides were presented to five healthy children in a clinical setting without TMS. Responses were registered on a separate computer, and facial expressions and hand movements were filmed for later offline review. Technical adjustments were made to combine these elements with the existing TMS equipment. The audio-recorded sentences were presented before the visual stimuli. Sentence lists were constructed to avoid similar stimuli in a row. Two different baseline lists were used before the TMS registration; the second baseline resulted in faster responses and was chosen as the reference for possible response delays induced by TMS. Protocols for offline reviews were constructed. No response, incorrect response, self-correction, delayed response, and perseveration were considered clear stimulation effects, while poor attention, discomfort, and other events were regarded as unclear. Finally, three children (6:2, 14:0, 14:10 years) with epilepsy and expected to undergo neurosurgery were assessed using TMS (left hemisphere in one; both hemispheres in the other two). In the two assessed bilaterally, TMS effects indicated bilateral language processing. Delayed response was the most common error. This is a first attempt to develop a new TMS paradigm for receptive language mapping, and further evaluation is suggested.

The relationship between behavioral language laterality, face laterality and language performance in left-handers

Left-handers provide unique information about the relationship between cognitive functions because of their larger variability in hemispheric dominance. This study presents the laterality distribution of, correlations between and test-retest reliability of behavioral lateralized language tasks (speech production, reading and speech perception), face recognition tasks, handedness measures and language performance tests based on data from 98 left-handers. The results show that a behavioral test battery leads to percentages of (a)typical dominance that are similar to those found in neuropsychological studies even though the incidence of clear atypical lateralization (about 20%) may be overestimated at the group level. Significant correlations were found between the language tasks for both reaction time and accuracy lateralization indices. The degree of language laterality could however not be linked to face laterality, handedness or language performance. Finally, individuals were classified less consistently than expected as being typical, bilateral or atypical across all tasks. This may be due to the often good (speech production and perception tasks) but sometimes weak (reading and face tasks) test-retest reliabilities. The lack of highly reliable and valid test protocols for functions unrelated to speech remains one of the largest impediments for individual analysis and cross-task investigations in laterality research.

Hierarchy of speech-driven spectrotemporal receptive fields in human auditory cortex

Existing data indicate that cortical speech processing is hierarchically organized. Numerous studies have shown that early auditory areas encode fine acoustic details while later areas encode abstracted speech patterns. However, it remains unclear precisely what speech information is encoded across these hierarchical levels. Estimation of speech-driven spectrotemporal receptive fields (STRFs) provides a means to explore cortical speech processing in terms of acoustic or linguistic information associated with characteristic spectrotemporal patterns. Here, we estimate STRFs from cortical responses to continuous speech in fMRI. Using a novel approach based on filtering randomly-selected spectrotemporal modulations (STMs) from aurally-presented sentences, STRFs were estimated for a group of listeners and categorized using a data-driven clustering algorithm. 'Behavioral STRFs' highlighting STMs crucial for speech recognition were derived from intelligibility judgments. Clustering revealed that STRFs in the supratemporal plane represented a broad range of STMs, while STRFs in the lateral temporal lobe represented circumscribed STM patterns important to intelligibility. Detailed analysis recovered a bilateral organization with posterior-lateral regions preferentially processing STMs associated with phonological information and anterior-lateral regions preferentially processing STMs associated with word- and phrase-level information. Regions in lateral Heschl's gyrus preferentially processed STMs associated with vocalic information (pitch).

The functional and structural asymmetries of the superior temporal sulcus

The superior temporal sulcus (STS) is an anatomical structure that increasingly interests researchers. This structure appears to receive multisensory input and is involved in several perceptual and cognitive core functions, such as speech perception, audiovisual integration, (biological) motion processing and theory of mind capacities. In addition, the superior temporal sulcus is not only one of the longest sulci of the brain, but it also shows marked functional and structural asymmetries, some of which have only been found in humans. To explore the functional-structural relationships of these asymmetries in more detail, this study combines functional and structural magnetic resonance imaging. Using a speech perception task, an audiovisual integration task, and a theory of mind task, this study again demonstrated an involvement of the STS in these processes, with an expected strong leftward asymmetry for the speech perception task. Furthermore, this study confirmed the earlier described, human-specific asymmetries, namely that the left STS is longer than the right STS and that the right STS is deeper than the left STS. However, this study did not find any relationship between these structural asymmetries and the detected brain activations or their functional asymmetries. This can, on the other hand, give further support to the notion that the structural asymmetry of the STS is not directly related to the functional asymmetry of the speech perception and the language system as a whole, but that it may have other causes and functions.

Auditory, Visual and Audiovisual Speech Processing Streams in Superior Temporal Sulcus

The human superior temporal sulcus (STS) is responsive to visual and auditory information, including sounds and facial cues during speech recognition. We investigated the functional organization of STS with respect to modality-specific and multimodal speech representations. Twenty younger adult participants were instructed to perform an oddball detection task and were presented with auditory, visual, and audiovisual speech stimuli, as well as auditory and visual nonspeech control stimuli in a block fMRI design. Consistent with a hypothesized anterior-posterior processing gradient in STS, auditory, visual and audiovisual stimuli produced the largest BOLD effects in anterior, posterior and middle STS (mSTS), respectively, based on whole-brain, linear mixed effects and principal component analyses. Notably, the mSTS exhibited preferential responses to multisensory stimulation, as well as speech compared to nonspeech. Within the mid-posterior and mSTS regions, response preferences changed gradually from visual, to multisensory, to auditory moving posterior to anterior. Post hoc analysis of visual regions in the posterior STS revealed that a single subregion bordering the mSTS was insensitive to differences in low-level motion kinematics yet distinguished between visual speech and nonspeech based on multi-voxel activation patterns. These results suggest that auditory and visual speech representations are elaborated gradually within anterior and posterior processing streams, respectively, and may be integrated within the mSTS, which is sensitive to more abstract speech information within and across presentation modalities. The spatial organization of STS is consistent with processing streams that are hypothesized to synthesize perceptual speech representations from sensory signals that provide convergent information from visual and auditory modalities.

Vowels and Consonants in the Brain: Evidence from Magnetoencephalographic Studies on the N1m in Normal-Hearing Listeners

Speech sound perception is one of the most fascinating tasks performed by the human brain. It involves a mapping from continuous acoustic waveforms onto the discrete phonological units computed to store words in the mental lexicon. In this article, we review the magnetoencephalographic studies that have explored the timing and morphology of the N1m component to investigate how vowels and consonants are computed and represented within the auditory cortex. The neurons that are involved in the N1m act to construct a sensory memory of the stimulus due to spatially and temporally distributed activation patterns within the auditory cortex. Indeed, localization of auditory fields maps in animals and humans suggested two levels of sound coding, a tonotopy dimension for spectral properties and a tonochrony dimension for temporal properties of sounds. When the stimulus is a complex speech sound, tonotopy and tonochrony data may give important information to assess whether the speech sound parsing and decoding are generated by pure bottom-up reflection of acoustic differences or whether they are additionally affected by top-down processes related to phonological categories. Hints supporting pure bottom-up processing coexist with hints supporting top-down abstract phoneme representation. Actually, N1m data (amplitude, latency, source generators, and hemispheric distribution) are limited and do not help to disentangle the issue. The nature of these limitations is discussed. Moreover, neurophysiological studies on animals and neuroimaging studies on humans have been taken into consideration. We compare also the N1m findings with the investigation of the magnetic mismatch negativity (MMNm) component and with the analogous electrical components, the N1 and the MMN. We conclude that N1 seems more sensitive to capture lateralization and hierarchical processes than N1m, although the data are very preliminary. Finally, we suggest that MEG data should be integrated with EEG data in the light of the neural oscillations framework and we propose some concerns that should be addressed by future investigations if we want to closely line up language research with issues at the core of the functional brain mechanisms.

Structural alterations of the language connectome in children with specific language impairment

We evaluated brain white matter pathways associated with language processing in 37 children with specific language impairment aged 6-12 years and 34 controls, matched for age, sex and handedness. Arcuate fascicle (AF), inferior fronto-occipital fascicle (IFOF), inferior longitudinal fascicle (ILF) and uncinate fascicle (UF) were identified using magnetic resonance diffusion tensor imaging (DTI). Diffusivity parameters and volume of the tracts were compared between the SLI and control group. Children with SLI showed decreased fractional anisotropy in all investigated tracts, increased mean diffusivity and radial diffusivity component in arcuate fascicle bilaterally, left IFOF and left ILF. Further, bilaterally increased volume of the ILF in children with SLI was found. We confirmed previous findings indicating deficient connectivity of the arcuate fascicle and as a novel finding, demonstrate abnormal development of the ventral language stream in patients with SLI.

Cerebral asymmetry for language: Comparing production with comprehension

Although left-hemispheric damage can impair both the production and comprehension of language, it has been claimed that comprehension is more bilaterally represented than is production. A variant of this theme is based on the theory that different aspects of language are processed by a dorsal stream, responsible for mapping words to articulation, and a ventral stream for processing input for meaning. Some have claimed that the dorsal stream is left-hemispheric, while the ventral stream is bilaterally organized. We used fMRI to record activation while left- and right-handed participants performed covert word-generation task and judged whether word pairs were synonyms. Regions of interest were Broca's area as part of the dorsal stream and the superior and middle temporal gyri as part of the ventral stream. Laterality indices showed equal left-hemispheric lateralization in Broca's area for word generation and both Broca's area and temporal lobe for the synonym judgments. Handedness influenced laterality equally in each area and task, with right-handers showing stronger left-hemispheric dominance than left-handers. Although our findings provide no evidence that asymmetry is more pronounced for production than for comprehension, correlations between the tasks and regions of interest support the view that lateralization in the temporal lobe depends on feedback influences from frontal regions.

Laterality and unilateral deafness: Patients with congenital right ear deafness do not develop atypical language dominance

Auditory speech perception, speech production and reading lateralize to the left hemisphere in the majority of healthy right-handers. In this study, we investigated to what extent sensory input underlies the side of language dominance. We measured the lateralization of the three core subprocesses of language in patients who had profound hearing loss in the right ear from birth and in matched control subjects. They took part in a semantic decision listening task involving speech and sound stimuli (auditory perception), a word generation task (speech production) and a passive reading task (reading). The results show that a lack of sensory auditory input on the right side, which is strongly connected to the contralateral left hemisphere, does not lead to atypical lateralization of speech perception. Speech production and reading were also typically left lateralized in all but one patient, contradicting previous small scale studies. Other factors such as genetic constraints presumably overrule the role of sensory input in the development of (a)typical language lateralization.

Temporal dynamics of sensorimotor integration in speech perception and production: independent component analysis of EEG data

Activity in anterior sensorimotor regions is found in speech production and some perception tasks. Yet, how sensorimotor integration supports these functions is unclear due to a lack of data examining the timing of activity from these regions. Beta (~20 Hz) and alpha (~10 Hz) spectral power within the EEG μ rhythm are considered indices of motor and somatosensory activity, respectively. In the current study, perception conditions required discrimination (same/different) of syllables pairs (/ba/ and /da/) in quiet and noisy conditions. Production conditions required covert and overt syllable productions and overt word production. Independent component analysis was performed on EEG data obtained during these conditions to (1) identify clusters of μ components common to all conditions and (2) examine real-time event-related spectral perturbations (ERSP) within alpha and beta bands. 17 and 15 out of 20 participants produced left and right μ-components, respectively, localized to precentral gyri. Discrimination conditions were characterized by significant (pFDR < 0.05) early alpha event-related synchronization (ERS) prior to and during stimulus presentation and later alpha event-related desynchronization (ERD) following stimulus offset. Beta ERD began early and gained strength across time. Differences were found between quiet and noisy discrimination conditions. Both overt syllable and word productions yielded similar alpha/beta ERD that began prior to production and was strongest during muscle activity. Findings during covert production were weaker than during overt production. One explanation for these findings is that μ-beta ERD indexes early predictive coding (e.g., internal modeling) and/or overt and covert attentional/motor processes. μ-alpha ERS may index inhibitory input to the premotor cortex from sensory regions prior to and during discrimination, while μ-alpha ERD may index sensory feedback during speech rehearsal and production.

Functional asymmetry and effective connectivity of the auditory system during speech perception is modulated by the place of articulation of the consonant- A 7T fMRI study

To differentiate between stop-consonants, the auditory system has to detect subtle place of articulation (PoA) and voice-onset time (VOT) differences between stop-consonants. How this differential processing is represented on the cortical level remains unclear. The present functional magnetic resonance (fMRI) study takes advantage of the superior spatial resolution and high sensitivity of ultra-high-field 7 T MRI. Subjects were attentively listening to consonant–vowel (CV) syllables with an alveolar or bilabial stop-consonant and either a short or long VOT. The results showed an overall bilateral activation pattern in the posterior temporal lobe during the processing of the CV syllables. This was however modulated strongest by PoA such that syllables with an alveolar stop-consonant showed stronger left lateralized activation. In addition, analysis of underlying functional and effective connectivity revealed an inhibitory effect of the left planum temporale (PT) onto the right auditory cortex (AC) during the processing of alveolar CV syllables. Furthermore, the connectivity result indicated also a directed information flow from the right to the left AC, and further to the left PT for all syllables. These results indicate that auditory speech perception relies on an interplay between the left and right ACs, with the left PT as modulator. Furthermore, the degree of functional asymmetry is determined by the acoustic properties of the CV syllables.

Neuronal basis of speech comprehension

Verbal communication does not rely only on the simple perception of auditory signals. It is rather a parallel and integrative processing of linguistic and non-linguistic information, involving temporal and frontal areas in particular. This review describes the inherent complexity of auditory speech comprehension from a functional-neuroanatomical perspective. The review is divided into two parts. In the first part, structural and functional asymmetry of language relevant structures will be discus. The second part of the review will discuss recent neuroimaging studies, which coherently demonstrate that speech comprehension processes rely on a hierarchical network involving the temporal, parietal, and frontal lobes. Further, the results support the dual-stream model for speech comprehension, with a dorsal stream for auditory-motor integration, and a ventral stream for extracting meaning but also the processing of sentences and narratives. Specific patterns of functional asymmetry between the left and right hemisphere can also be demonstrated. The review article concludes with a discussion on interactions between the dorsal and ventral streams, particularly the involvement of motor related areas in speech perception processes, and outlines some remaining unresolved issues. This article is part of a Special Issue entitled Human Auditory Neuroimaging.