Thalamic connections of the core auditory cortex and rostral supratemporal plane in the macaque monkey

The lateral thalamus: a bridge between multisensory processing and naturalistic behaviors

The lateral thalamus (LT) receives input from primary sensory nuclei and responds to multimodal stimuli. The LT is also involved in regulating innate and social behaviors through its projections to cortical and limbic networks. However, the importance of multisensory processing within the LT in modulating behavioral output has not been explicitly addressed. Here, we discuss recent findings primarily from rodent studies that extend the classical view of the LT as a passive relay, by underscoring its involvement in associating multimodal features and encoding the salience, valence, and social relevance of sensory signals. We propose that the primary function of the LT is to integrate sensory and non-sensory aspects of multisensory input to gate naturalistic behaviors.

Large-scale single-neuron speech sound encoding across the depth of human cortex

Understanding the neural basis of speech perception requires that we study the human brain both at the scale of the fundamental computational unit of neurons and in their organization across the depth of cortex. Here we used high-density Neuropixels arrays1-3 to record from 685 neurons across cortical layers at nine sites in a high-level auditory region that is critical for speech, the superior temporal gyrus4,5, while participants listened to spoken sentences. Single neurons encoded a wide range of speech sound cues, including features of consonants and vowels, relative vocal pitch, onsets, amplitude envelope and sequence statistics. Neurons at each cross-laminar recording exhibited dominant tuning to a primary speech feature while also containing a substantial proportion of neurons that encoded other features contributing to heterogeneous selectivity. Spatially, neurons at similar cortical depths tended to encode similar speech features. Activity across all cortical layers was predictive of high-frequency field potentials (electrocorticography), providing a neuronal origin for macroelectrode recordings from the cortical surface. Together, these results establish single-neuron tuning across the cortical laminae as an important dimension of speech encoding in human superior temporal gyrus.

Dissecting neural computations in the human auditory pathway using deep neural networks for speech

The human auditory system extracts rich linguistic abstractions from speech signals. Traditional approaches to understanding this complex process have used linear feature-encoding models, with limited success. Artificial neural networks excel in speech recognition tasks and offer promising computational models of speech processing. We used speech representations in state-of-the-art deep neural network (DNN) models to investigate neural coding from the auditory nerve to the speech cortex. Representations in hierarchical layers of the DNN correlated well with the neural activity throughout the ascending auditory system. Unsupervised speech models performed at least as well as other purely supervised or fine-tuned models. Deeper DNN layers were better correlated with the neural activity in the higher-order auditory cortex, with computations aligned with phonemic and syllabic structures in speech. Accordingly, DNN models trained on either English or Mandarin predicted cortical responses in native speakers of each language. These results reveal convergence between DNN model representations and the biological auditory pathway, offering new approaches for modeling neural coding in the auditory cortex.

Rostro-caudal networks for sound processing in the primate brain

Sound is processed in primate brains along anatomically and functionally distinct streams: this pattern can be seen in both human and non-human primates. We have previously proposed a general auditory processing framework in which these different perceptual profiles are associated with different computational characteristics. In this paper we consider how recent work supports our framework.

Alterations in the volume of thalamic nuclei in patients with schizophrenia and persistent auditory hallucinations

•

Analysis of structural MRI images using a probabilistic atlas for segmentation of several nuclei of the thalamus.

•

Comparison of chronic patients with schizophrenia, with and without auditory hallucinations and matched healthy controls.

•

Volumetric reductions in patients with AH vs controls: Medial geniculate nucleus, anterior pulvinar nucleus and lateral and medial mediodorsal nuclei.

•

In patients without AH we found reductions in the volume of the pulvinar and mediodorsal nuclei, but not in the medial geniculate nucleus.

•

Found also some significant correlations between the volume of these nuclei and the total score of the PSYRATS scale.

The thalamus is a subcortical structure formed by different nuclei that relay information to the neocortex. Several reports have already described alterations of this structure in patients of schizophrenia that experience auditory hallucinations. However, to date no study has addressed whether the volumes of specific thalamic nuclei are altered in chronic patients experiencing persistent auditory hallucinations. We have processed structural MRI images using Freesurfer, and have segmented them into 25 nuclei using the probabilistic atlas developed by Iglesias and collaborators (Iglesias et al., 2018). To homogenize the sample, we have matched patients of schizophrenia, with and without persistent auditory hallucinations, with control subjects, considering sex, age and their estimated intracranial volume. This rendered a group number of 41 patients experiencing persistent auditory hallucinations, 35 patients without auditory hallucinations, and 55 healthy controls. In addition, we have also correlated the volume of the altered thalamic nuclei with the total score of the PSYRATS, a clinical scale used to evaluate the positive symptoms of this disorder. We have found alterations in the volume of 8 thalamic nuclei in both cohorts of patients with schizophrenia: The medial and lateral geniculate nuclei, the anterior, inferior, and lateral pulvinar nuclei, the lateral complex and the lateral and medial mediodorsal nuclei. We have also found some significant correlations between the volume of these nuclei in patients experiencing auditory hallucinations, and the total score of the PSYRATS scale. Altogether our results indicate that volumetric alterations of thalamic nuclei involved in audition may be related to persistent auditory hallucinations in chronic schizophrenia patients, whereas alterations in nuclei related to association cortices are evident in all patients. Future studies should explore whether the structural alterations are cause or consequence of these positive symptoms and whether they are already present in first episodes of psychosis.

Controversy over the temporal cortical terminations of the left arcuate fasciculus: a reappraisal

The arcuate fasciculus has been considered a major dorsal fronto-temporal white matter pathway linking frontal language production regions with auditory perception in the superior temporal gyrus, the so-called Wernicke's area. In line with this tradition, both historical and contemporary models of language function have assigned primacy to superior temporal projections of the arcuate fasciculus. However, classical anatomical descriptions and emerging behavioural data are at odds with this assumption. On one hand, fronto-temporal projections to Wernicke's area may not be unique to the arcuate fasciculus. On the other hand, dorsal stream language deficits have been reported also for damage to middle, inferior and basal temporal gyri which may be linked to arcuate disconnection. These findings point to a reappraisal of arcuate projections in the temporal lobe. Here, we review anatomical and functional evidence regarding the temporal cortical terminations of the left arcuate fasciculus by incorporating dissection and tractography findings with stimulation data using cortico-cortical evoked potentials and direct electrical stimulation mapping in awake patients. Firstly, we discuss the fibers of the arcuate fasciculus projecting to the superior temporal gyrus and the functional rostro-caudal gradient in this region where both phonological encoding and auditory-motor transformation may be performed. Caudal regions within the temporoparietal junction may be involved in articulation and associated with temporoparietal projections of the third branch of the superior longitudinal fasciculus, while more rostral regions may support encoding of acoustic phonetic features, supported by arcuate fibres. We then move to examine clinical data showing that multimodal phonological encoding is facilitated by projections of the arcuate fasciculus to superior, but also middle, inferior and basal temporal regions. Hence, we discuss how projections of the arcuate fasciculus may contribute to acoustic (middle-posterior superior and middle temporal gyri), visual (posterior inferior temporal/fusiform gyri comprising the visual word form area) and lexical (anterior-middle inferior temporal/fusiform gyri in the basal temporal language area) information in the temporal lobe to be processed, encoded and translated into a dorsal phonological route to the frontal lobe. Finally, we point out surgical implications for this model in terms of the prediction and avoidance of neurological deficit.

Dynamic reconfiguration of macaque brain networks during natural vision

Natural vision engages a wide range of higher-level regions that integrate visual information over the large-scale brain network. How interareal connectivity reconfigures during the processing of ongoing natural visual scenes and how these dynamic functional changes relate to the underlaying anatomical links between regions is not well understood. Here, we hypothesized that macaque visual brain regions are poly-functional sharing the capacity to change their configuration state depending on the nature of visual input. To address this hypothesis, we reconstructed networks from in-vivo diffusion-weighted imaging (DWI) and functional magnetic resonance imaging (fMRI) data obtained in four alert macaque monkeys viewing naturalistic movie scenes. At first, we characterized network properties and found greater interhemispheric density and greater inter-subject variability in free-viewing networks as compared to structural networks. From the structural connectivity, we then captured modules on which we identified hubs during free-viewing that formed a widespread visuo-saccadic network across frontal (FEF, 46v), parietal (LIP, Tpt), and occipitotemporal modules (MT, V4, TEm), and that excluded primary visual cortex. Inter-subject variability of well-connected hubs reflected subject-specific configurations that largely recruited occipito-parietal and frontal modules. Across the cerebral hemispheres, free-viewing networks showed higher correlations among long-distance brain regions as compared to structural networks. From these findings, we hypothesized that long-distance interareal connectivity could reconfigure depending on the ongoing changes in visual scenes. Testing this hypothesis by applying temporally resolved functional connectivity we observed that many structurally defined areas (such as areas V4, MT/MST and LIP) were poly-functional as they were recruited as hub members of multiple network states that changed during the presentation of scenes containing objects, motion, faces, and actions. We suggest that functional flexibility in macaque macroscale brain networks is required for the efficient interareal communication during active natural vision. To further promote the use of naturalistic free-viewing paradigms and increase the development of macaque neuroimaging resources, we share our datasets in the PRIME-DE consortium.

Parallel and distributed encoding of speech across human auditory cortex

Speech perception is thought to rely on a cortical feedforward serial transformation of acoustic into linguistic representations. Using intracranial recordings across the entire human auditory cortex, electrocortical stimulation, and surgical ablation, we show that cortical processing across areas is not consistent with a serial hierarchical organization. Instead, response latency and receptive field analyses demonstrate parallel and distinct information processing in the primary and nonprimary auditory cortices. This functional dissociation was also observed where stimulation of the primary auditory cortex evokes auditory hallucination but does not distort or interfere with speech perception. Opposite effects were observed during stimulation of nonprimary cortex in superior temporal gyrus. Ablation of the primary auditory cortex does not affect speech perception. These results establish a distributed functional organization of parallel information processing throughout the human auditory cortex and demonstrate an essential independent role for nonprimary auditory cortex in speech processing.

Neuronal figure-ground responses in primate primary auditory cortex

Figure-ground segregation, the brain’s ability to group related features into stable perceptual entities, is crucial for auditory perception in noisy environments. The neuronal mechanisms for this process are poorly understood in the auditory system. Here, we report figure-ground modulation of multi-unit activity (MUA) in the primary and non-primary auditory cortex of rhesus macaques. Across both regions, MUA increases upon presentation of auditory figures, which consist of coherent chord sequences. We show increased activity even in the absence of any perceptual decision, suggesting that neural mechanisms for perceptual grouping are, to some extent, independent of behavioral demands. Furthermore, we demonstrate differences in figure encoding between more anterior and more posterior regions; perceptual saliency is represented in anterior cortical fields only. Our results suggest an encoding of auditory figures from the earliest cortical stages by a rate code.

•

Neuronal figure-ground modulation in primary auditory cortex

•

A rate code is used to signal the presence of auditory figures

•

Anteriorly located recording sites encode perceptual saliency

•

Figure-ground modulation is present without perceptual detection

Understanding rostral-caudal auditory cortex contributions to auditory perception

There are functional and anatomical distinctions between the neural systems involved in the recognition of sounds in the environment and those involved in the sensorimotor guidance of sound production and the spatial processing of sound. Evidence for the separation of these processes has historically come from disparate literatures on the perception and production of speech, music and other sounds. More recent evidence indicates that there are computational distinctions between the rostral and caudal primate auditory cortex that may underlie functional differences in auditory processing. These functional differences may originate from differences in the response times and temporal profiles of neurons in the rostral and caudal auditory cortex, suggesting that computational accounts of primate auditory pathways should focus on the implications of these temporal response differences.

Quantitative ultrasound and apoptotic death in the neonatal primate brain

Apoptosis is triggered in the developing mammalian brain by sedative, anesthetic or antiepileptic drugs during late gestation and early life. Whether human children are vulnerable to this toxicity mechanism remains unknown, as there are no imaging techniques to capture it. Apoptosis is characterized by distinct structural features, which affect the way damaged tissue scatters ultrasound compared to healthy tissue. We evaluated whether apoptosis, triggered by the anesthetic sevoflurane in the brains of neonatal rhesus macaques, can be detected using quantitative ultrasound (QUS). Neonatal (n = 15) rhesus macaques underwent 5 h of sevoflurane anesthesia. QUS images were obtained through the sagittal suture at 0.5 and 6 h. Brains were collected at 8 h and examined immunohistochemically to analyze apoptotic neuronal and oligodendroglial death. Significant apoptosis was detected in white and gray matter throughout the brain, including the thalamus. We measured a change in the effective scatterer size (ESS), a QUS biomarker derived from ultrasound echo signals obtained with clinical scanners, after sevoflurane-anesthesia in the thalamus. Although initial inclusion of all measurements did not reveal a significant correlation, when outliers were excluded, the change in the ESS between the pre- and post-anesthesia measurements correlated strongly and proportionally with the severity of apoptotic death. We report for the first time in vivo changes in QUS parameters, which may reflect severity of apoptosis in the brains of infant nonhuman primates. These findings suggest that QUS may enable in vivo studies of apoptosis in the brains of human infants following exposure to anesthetics, antiepileptics and other brain injury mechanisms.

Top-down, contextual entrainment of neuronal oscillations in the auditory thalamocortical circuit

Our results indicate that nonhuman primates detect complex repeating acoustic sequences in a continuous auditory stream, which is an important precursor for human speech learning and perception. We demonstrate that oscillatory entrainment, known to support the attentive perception of rhythmic stimulus sequences, can occur for rhythms defined solely by stimulus context rather than physical boundaries. As opposed to acoustically driven entrainment by rhythmic tone sequences demonstrated previously, this form of entrainment relies on the brain’s ability to group auditory inputs based on their statistical regularities. The internally initiated, context-driven modulation of excitability in the medial pulvinar prior to A1 supports the notion of top-down entrainment.

Prior studies have shown that repetitive presentation of acoustic stimuli results in an alignment of ongoing neuronal oscillations to the sequence rhythm via oscillatory entrainment by external cues. Our study aimed to explore the neural correlates of the perceptual parsing and grouping of complex repeating auditory patterns that occur based solely on statistical regularities, or context. Human psychophysical studies suggest that the recognition of novel auditory patterns amid a continuous auditory stimulus sequence occurs automatically halfway through the first repetition. We hypothesized that once repeating patterns were detected by the brain, internal rhythms would become entrained, demarcating the temporal structure of these repetitions despite lacking external cues defining pattern on- or offsets. To examine the neural correlates of pattern perception, neuroelectric activity of primary auditory cortex (A1) and thalamic nuclei was recorded while nonhuman primates passively listened to streams of rapidly presented pure tones and bandpass noise bursts. At arbitrary intervals, random acoustic patterns composed of 11 stimuli were repeated five times without any perturbance of the constant stimulus flow. We found significant delta entrainment by these patterns in the A1, medial geniculate body, and medial pulvinar. In A1 and pulvinar, we observed a statistically significant, pattern structure-aligned modulation of neuronal firing that occurred earliest in the pulvinar, supporting the idea that grouping and detecting complex auditory patterns is a top-down, context-driven process. Besides electrophysiological measures, a pattern-related modulation of pupil diameter verified that, like humans, nonhuman primates consciously detect complex repetitive patterns that lack physical boundaries.