Where, When, and How: Are they all sensorimotor? Towards a unified view of the dorsal pathway in vision and audition

Hubs and interaction: the brain's meta-loop

We must reconcile the needs of the internal world and the demands of the external world to make decisions relevant to homeostasis, well-being, and flexible behavior. Engagement with the internal (eg interoceptive) world is linked to medial brain systems, whereas the extrapersonal space (eg exteroceptive) is associated with lateral brain systems. Using Human Connectome Project data, we found three association tracts connecting the action-related frontal lobe with perception-related posterior lobes. A lateral dorsal tract and a medial dorsal tract interact independently with a ventral tract at frontal and posterior hubs. The two frontal and the two posterior hubs are interconnected, forming a meta-loop that integrates lateral and medial brain systems. The four anatomical hubs correspond to the common nodes of the intrinsic cognitive brain networks such as the default mode network. These functional networks depend on the integration of both realms. Thus, the positioning of functional cognitive networks can be understood as the intersection of long anatomical association tracts. The strength of structural connectivity within lateral and medial brain systems correlates with performance on behavioral tests assessing theory of mind. The meta-loop provides an anatomical framework to associate neurological and psychiatric symptoms with functional and structural changes.

Toward cognitive models of misophonia

Misophonia is a disorder in which specific common sounds such as another person breathing or chewing, or the ticking of a clock, cause an atypical negative emotional response. Affected individuals may experience anger, irritability, annoyance, disgust, and anxiety, as well as physiological autonomic responses, and may find everyday environments and contexts to be unbearable in which their 'misophonic stimuli' (often called 'trigger sounds') are present. Misophonia is gradually being recognized as a genuine problem that causes significant distress and has negative consequences for individuals and their families. It has only recently come under scientific scrutiny, as researchers and clinicians are establishing its prevalence, distinguishing it from other disorders of sensory sensitivity such as hyperacusis, establishing its neurobiological bases, and evaluating the effectiveness of potential treatments. While ideas abound as to the mechanisms involved in misophonia, few have coalesced into models. The aim of the present work is to summarize and extend recent thinking on the mechanistic basis of misophonia, with a focus on moving towards neurologically-informed cognitive models that can (a) account for extant findings, and (b) generate testable predictions. We hope this work will facilitate future refinements in our understanding of misophonia, and ultimately inform treatments.

Human Auditory-Motor Networks Show Frequency-Specific Phase-Based Coupling in Resting-State MEG

Perception and production of music and speech rely on auditory-motor coupling, a mechanism which has been linked to temporally precise oscillatory coupling between auditory and motor regions of the human brain, particularly in the beta frequency band. Recently, brain imaging studies using magnetoencephalography (MEG) have also shown that accurate auditory temporal predictions specifically depend on phase coherence between auditory and motor cortical regions. However, it is not yet clear whether this tight oscillatory phase coupling is an intrinsic feature of the auditory-motor loop, or whether it is only elicited by task demands. Further, we do not know if phase synchrony is uniquely enhanced in the auditory-motor system compared to other sensorimotor modalities, or to which degree it is amplified by musical training. In order to resolve these questions, we measured the degree of phase locking between motor regions and auditory or visual areas in musicians and non-musicians using resting-state MEG. We derived phase locking values (PLVs) and phase transfer entropy (PTE) values from 90 healthy young participants. We observed significantly higher PLVs across all auditory-motor pairings compared to all visuomotor pairings in all frequency bands. The pairing with the highest degree of phase synchrony was right primary auditory cortex with right ventral premotor cortex, a connection which has been highlighted in previous literature on auditory-motor coupling. Additionally, we observed that auditory-motor and visuomotor PLVs were significantly higher across all structures in the right hemisphere, and we found the highest differences between auditory and visual PLVs in the theta, alpha, and beta frequency bands. Last, we found that the theta and beta bands exhibited a preference for a motor-to-auditory PTE direction and that the alpha and gamma bands exhibited the opposite preference for an auditory-to-motor PTE direction. Taken together, these findings confirm our hypotheses that motor phase synchrony is significantly enhanced in auditory compared to visual cortical regions at rest, that these differences are highest across the theta-beta spectrum of frequencies, and that there exist alternating information flow loops across auditory-motor structures as a function of frequency. In our view, this supports the existence of an intrinsic, time-based coupling for low-latency integration of sounds and movements which involves synchronized phasic activity between primary auditory cortex with motor and premotor cortical areas.

Bilateral and symmetric glycinergic and glutamatergic projections from the LSO to the IC in the CBA/CaH mouse

Auditory space has been conceptualized as a matrix of systematically arranged combinations of binaural disparity cues that arise in the superior olivary complex (SOC). The computational code for interaural time and intensity differences utilizes excitatory and inhibitory projections that converge in the inferior colliculus (IC). The challenge is to determine the neural circuits underlying this convergence and to model how the binaural cues encode location. It has been shown that midbrain neurons are largely excited by sound from the contralateral ear and inhibited by sound leading at the ipsilateral ear. In this context, ascending projections from the lateral superior olive (LSO) to the IC have been reported to be ipsilaterally glycinergic and contralaterally glutamatergic. This study used CBA/CaH mice (3-6 months old) and applied unilateral retrograde tracing techniques into the IC in conjunction with immunocytochemical methods with glycine and glutamate transporters (GlyT2 and vGLUT2, respectively) to analyze the projection patterns from the LSO to the IC. Glycinergic and glutamatergic neurons were spatially intermixed within the LSO, and both types projected to the IC. For GlyT2 and vGLUT2 neurons, the average percentage of ipsilaterally and contralaterally projecting cells was similar (ANOVA, p = 0.48). A roughly equal number of GlyT2 and vGLUT2 neurons did not project to the IC. The somatic size and shape of these neurons match the descriptions of LSO principal cells. A minor but distinct population of small (< 40 μm2) neurons that labeled for GlyT2 did not project to the IC; these cells emerge as candidates for inhibitory local circuit neurons. Our findings indicate a symmetric and bilateral projection of glycine and glutamate neurons from the LSO to the IC. The differences between our results and those from previous studies suggest that species and habitat differences have a significant role in mechanisms of binaural processing and highlight the importance of research methods and comparative neuroscience. These data will be important for modeling how excitatory and inhibitory systems converge to create auditory space in the CBA/CaH mouse.

Information-based rhythmic transcranial magnetic stimulation to accelerate learning during auditory working memory training: a proof-of-concept study

Introduction

Rhythmic transcranial magnetic stimulation (rhTMS) has been shown to enhance auditory working memory manipulation, specifically by boosting theta oscillatory power in the dorsal auditory pathway during task performance. It remains unclear whether these enhancements (i) persist beyond the period of stimulation, (ii) if they can accelerate learning and (iii) if they would accumulate over several days of stimulation. In the present study, we investigated the lasting behavioral and electrophysiological effects of applying rhTMS over the left intraparietal sulcus (IPS) throughout the course of seven sessions of cognitive training on an auditory working memory task.

Methods

A limited sample of 14 neurologically healthy participants took part in the training protocol with an auditory working memory task while being stimulated with either theta (5 Hz) rhTMS or sham TMS. Electroencephalography (EEG) was recorded before, throughout five training sessions and after the end of training to assess to effects of rhTMS on behavioral performance and on oscillatory entrainment of the dorsal auditory network.

Results

We show that this combined approach enhances theta oscillatory activity within the fronto-parietal network and causes improvements in auditoryworking memory performance. We show that compared to individuals who received sham stimulation, cognitive training can be accelerated when combined with optimized rhTMS, and that task performance benefits can outlast the training period by ∼ 3 days. Furthermore, we show that there is increased theta oscillatory power within the recruited dorsal auditory network during training, and that sustained EEG changes can be observed ∼ 3 days following stimulation.

Discussion

The present study, while underpowered for definitive statistical analyses, serves to improve our understanding of the causal dynamic interactions supporting auditory working memory. Our results constitute an important proof of concept for the potential translational impact of non-invasive brain stimulation protocols and provide preliminary data for developing optimized rhTMS and training protocols that could be implemented in clinical populations.

Live music stimulates the affective brain and emotionally entrains listeners in real time

Music is powerful in conveying emotions and triggering affective brain mechanisms. Affective brain responses in previous studies were however rather inconsistent, potentially because of the non-adaptive nature of recorded music used so far. Live music instead can be dynamic and adaptive and is often modulated in response to audience feedback to maximize emotional responses in listeners. Here, we introduce a setup for studying emotional responses to live music in a closed-loop neurofeedback setup. This setup linked live performances by musicians to neural processing in listeners, with listeners' amygdala activity was displayed to musicians in real time. Brain activity was measured using functional MRI, and especially amygdala activity was quantified in real time for the neurofeedback signal. Live pleasant and unpleasant piano music performed in response to amygdala neurofeedback from listeners was acoustically very different from comparable recorded music and elicited significantly higher and more consistent amygdala activity. Higher activity was also found in a broader neural network for emotion processing during live compared to recorded music. This finding included observations of the predominance for aversive coding in the ventral striatum while listening to unpleasant music, and involvement of the thalamic pulvinar nucleus, presumably for regulating attentional and cortical flow mechanisms. Live music also stimulated a dense functional neural network with the amygdala as a central node influencing other brain systems. Finally, only live music showed a strong and positive coupling between features of the musical performance and brain activity in listeners pointing to real-time and dynamic entrainment processes.

Embodying Time in the Brain: A Multi-Dimensional Neuroimaging Meta-Analysis of 95 Duration Processing Studies

Time is an omnipresent aspect of almost everything we experience internally or in the external world. The experience of time occurs through such an extensive set of contextual factors that, after decades of research, a unified understanding of its neural substrates is still elusive. In this study, following the recent best-practice guidelines, we conducted a coordinate-based meta-analysis of 95 carefully-selected neuroimaging papers of duration processing. We categorized the included papers into 14 classes of temporal features according to six categorical dimensions. Then, using the activation likelihood estimation (ALE) technique we investigated the convergent activation patterns of each class with a cluster-level family-wise error correction at p < 0.05. The regions most consistently activated across the various timing contexts were the pre-SMA and bilateral insula, consistent with an embodied theory of timing in which abstract representations of duration are rooted in sensorimotor and interoceptive experience, respectively. Moreover, class-specific patterns of activation could be roughly divided according to whether participants were timing auditory sequential stimuli, which additionally activated the dorsal striatum and SMA-proper, or visual single interval stimuli, which additionally activated the right middle frontal and inferior parietal cortices. We conclude that temporal cognition is so entangled with our everyday experience that timing stereotypically common combinations of stimulus characteristics reactivates the sensorimotor systems with which they were first experienced.

Intracranial electrophysiology of spectrally degraded speech in the human cortex

Introduction

Cochlear implants (CIs) are the treatment of choice for severe to profound hearing loss. Variability in CI outcomes remains despite advances in technology and is attributed in part to differences in cortical processing. Studying these differences in CI users is technically challenging. Spectrally degraded stimuli presented to normal-hearing individuals approximate input to the central auditory system in CI users. This study used intracranial electroencephalography (iEEG) to investigate cortical processing of spectrally degraded speech.

Methods

Participants were adult neurosurgical epilepsy patients. Stimuli were utterances /aba/ and /ada/, spectrally degraded using a noise vocoder (1-4 bands) or presented without vocoding. The stimuli were presented in a two-alternative forced choice task. Cortical activity was recorded using depth and subdural iEEG electrodes. Electrode coverage included auditory core in posteromedial Heschl's gyrus (HGPM), superior temporal gyrus (STG), ventral and dorsal auditory-related areas, and prefrontal and sensorimotor cortex. Analysis focused on high gamma (70-150 Hz) power augmentation and alpha (8-14 Hz) suppression.

Results

Chance task performance occurred with 1-2 spectral bands and was near-ceiling for clear stimuli. Performance was variable with 3-4 bands, permitting identification of good and poor performers. There was no relationship between task performance and participants demographic, audiometric, neuropsychological, or clinical profiles. Several response patterns were identified based on magnitude and differences between stimulus conditions. HGPM responded strongly to all stimuli. A preference for clear speech emerged within non-core auditory cortex. Good performers typically had strong responses to all stimuli along the dorsal stream, including posterior STG, supramarginal, and precentral gyrus; a minority of sites in STG and supramarginal gyrus had a preference for vocoded stimuli. In poor performers, responses were typically restricted to clear speech. Alpha suppression was more pronounced in good performers. In contrast, poor performers exhibited a greater involvement of posterior middle temporal gyrus when listening to clear speech.

Discussion

Responses to noise-vocoded speech provide insights into potential factors underlying CI outcome variability. The results emphasize differences in the balance of neural processing along the dorsal and ventral stream between good and poor performers, identify specific cortical regions that may have diagnostic and prognostic utility, and suggest potential targets for neuromodulation-based CI rehabilitation strategies.

Anatomy of the auditory cortex then and now

Using neuroanatomical investigations in the macaque, Deepak Pandya and his colleagues have established the framework for auditory cortex organization, with subdivisions into core and belt areas. This has aided subsequent neurophysiological and imaging studies in monkeys and humans, and a nomenclature building on Pandya's work has also been adopted by the Human Connectome Project. The foundational work by Pandya and his colleagues is highlighted here in the context of subsequent and ongoing studies on the functional anatomy and physiology of auditory cortex in primates, including humans, and their relevance for understanding cognitive aspects of speech and language.

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

EEG-based auditory attention decoding with audiovisual speech for hearing-impaired listeners

Auditory attention decoding (AAD) was used to determine the attended speaker during an auditory selective attention task. However, the auditory factors modulating AAD remained unclear for hearing-impaired (HI) listeners. In this study, scalp electroencephalogram (EEG) was recorded with an auditory selective attention paradigm, in which HI listeners were instructed to attend one of the two simultaneous speech streams with or without congruent visual input (articulation movements), and at a high or low target-to-masker ratio (TMR). Meanwhile, behavioral hearing tests (i.e. audiogram, speech reception threshold, temporal modulation transfer function) were used to assess listeners' individual auditory abilities. The results showed that both visual input and increasing TMR could significantly enhance the cortical tracking of the attended speech and AAD accuracy. Further analysis revealed that the audiovisual (AV) gain in attended speech cortical tracking was significantly correlated with listeners' auditory amplitude modulation (AM) sensitivity, and the TMR gain in attended speech cortical tracking was significantly correlated with listeners' hearing thresholds. Temporal response function analysis revealed that subjects with higher AM sensitivity demonstrated more AV gain over the right occipitotemporal and bilateral frontocentral scalp electrodes.

Functional ultrasound reveals effects of MRI acoustic noise on brain function

Loud acoustic noise from the scanner during functional magnetic resonance imaging (fMRI) can affect functional connectivity (FC) observed in the resting state, but the exact effect of the MRI acoustic noise on resting state FC is not well understood. Functional ultrasound (fUS) is a neuroimaging method that visualizes brain activity based on relative cerebral blood volume (rCBV), a similar neurovascular coupling response to that measured by fMRI, but without the audible acoustic noise. In this study, we investigated the effects of different acoustic noise levels (silent, 80 dB, and 110 dB) on FC by measuring resting state fUS (rsfUS) in awake mice in an environment similar to fMRI measurement. Then, we compared the results to those of resting state fMRI (rsfMRI) conducted using an 11.7 Tesla scanner. RsfUS experiments revealed a significant reduction in FC between the retrosplenial dysgranular and auditory cortexes (0.56 ± 0.07 at silence vs 0.05 ± 0.05 at 110 dB, p=.01) and a significant increase in FC anticorrelation between the infralimbic and motor cortexes (-0.21 ± 0.08 at silence vs -0.47 ± 0.04 at 110 dB, p=.017) as acoustic noise increased from silence to 80 dB and 110 dB, with increased consistency of FC patterns between rsfUS and rsfMRI being found with the louder noise conditions. Event-related auditory stimulation experiments using fUS showed strong positive rCBV changes (16.5% ± 2.9% at 110 dB) in the auditory cortex, and negative rCBV changes (-6.7% ± 0.8% at 110 dB) in the motor cortex, both being constituents of the brain network that was altered by the presence of acoustic noise in the resting state experiments. Anticorrelation between constituent brain regions of the default mode network (such as the infralimbic cortex) and those of task-positive sensorimotor networks (such as the motor cortex) is known to be an important feature of brain network antagonism, and has been studied as a biological marker of brain disfunction and disease. This study suggests that attention should be paid to the acoustic noise level when using rsfMRI to evaluate the anticorrelation between the default mode network and task-positive sensorimotor network.

Amodal population clock in the primate medial premotor system for rhythmic tapping

The neural substrate for beat extraction and response entrainment to rhythms is not fully understood. Here we analyze the activity of medial premotor neurons in monkeys performing isochronous tapping guided by brief flashing stimuli or auditory tones. The population dynamics shared the following properties across modalities: the circular dynamics of the neural trajectories form a regenerating loop for every produced interval; the trajectories converge in similar state space at tapping times resetting the clock; and the tempo of the synchronized tapping is encoded in the trajectories by a combination of amplitude modulation and temporal scaling. Notably, the modality induces displacement in the neural trajectories in the auditory and visual subspaces without greatly altering the time-keeping mechanism. These results suggest that the interaction between the medial premotor cortex's amodal internal representation of pulse and a modality-specific external input generates a neural rhythmic clock whose dynamics govern rhythmic tapping execution across senses.

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Functional geometry of auditory cortical resting state networks derived from intracranial electrophysiology

Understanding central auditory processing critically depends on defining underlying auditory cortical networks and their relationship to the rest of the brain. We addressed these questions using resting state functional connectivity derived from human intracranial electroencephalography. Mapping recording sites into a low-dimensional space where proximity represents functional similarity revealed a hierarchical organization. At a fine scale, a group of auditory cortical regions excluded several higher-order auditory areas and segregated maximally from the prefrontal cortex. On mesoscale, the proximity of limbic structures to the auditory cortex suggested a limbic stream that parallels the classically described ventral and dorsal auditory processing streams. Identities of global hubs in anterior temporal and cingulate cortex depended on frequency band, consistent with diverse roles in semantic and cognitive processing. On a macroscale, observed hemispheric asymmetries were not specific for speech and language networks. This approach can be applied to multivariate brain data with respect to development, behavior, and disorders.

Evidence for a Spoken Word Lexicon in the Auditory Ventral Stream

The existence of a neural representation for whole words (i.e., a lexicon) is a common feature of many models of speech processing. Prior studies have provided evidence for a visual lexicon containing representations of whole written words in an area of the ventral visual stream known as the visual word form area. Similar experimental support for an auditory lexicon containing representations of spoken words has yet to be shown. Using functional magnetic resonance imaging rapid adaptation techniques, we provide evidence for an auditory lexicon in the auditory word form area in the human left anterior superior temporal gyrus that contains representations highly selective for individual spoken words. Furthermore, we show that familiarization with novel auditory words sharpens the selectivity of their representations in the auditory word form area. These findings reveal strong parallels in how the brain represents written and spoken words, showing convergent processing strategies across modalities in the visual and auditory ventral streams.

Expectation violations produce error signals in mouse V1

Repeated exposure to visual sequences changes the form of evoked activity in the primary visual cortex (V1). Predictive coding theory provides a potential explanation for this, namely that plasticity shapes cortical circuits to encode spatiotemporal predictions and that subsequent responses are modulated by the degree to which actual inputs match these expectations. Here we use a recently developed statistical modeling technique called Model-Based Targeted Dimensionality Reduction (MbTDR) to study visually evoked dynamics in mouse V1 in the context of an experimental paradigm called "sequence learning." We report that evoked spiking activity changed significantly with training, in a manner generally consistent with the predictive coding framework. Neural responses to expected stimuli were suppressed in a late window (100-150 ms) after stimulus onset following training, whereas responses to novel stimuli were not. Substituting a novel stimulus for a familiar one led to increases in firing that persisted for at least 300 ms. Omitting predictable stimuli in trained animals also led to increased firing at the expected time of stimulus onset. Finally, we show that spiking data can be used to accurately decode time within the sequence. Our findings are consistent with the idea that plasticity in early visual circuits is involved in coding spatiotemporal information.

Sensorimotor foundations of speech perception in infancy

The perceptual system for speech is highly organized from early infancy. This organization bootstraps young human learners' ability to acquire their native speech and language from speech input. Here, we review behavioral and neuroimaging evidence that perceptual systems beyond the auditory modality are also specialized for speech in infancy, and that motor and sensorimotor systems can influence speech perception even in infants too young to produce speech-like vocalizations. These investigations complement existing literature on infant vocal development and on the interplay between speech perception and production systems in adults. We conclude that a multimodal speech and language network is present before speech-like vocalizations emerge.

Dual-functional network regulation underlies the central executive system in working memory

The frontoparietal network (FPN) and cingulo-opercular network (CON) may exert top-down regulation corresponding to the central executive system (CES) in working memory (WM); however, contributions and regulatory mechanisms remain unclear. We examined network interaction mechanisms underpinning the CES by depicting CON- and FPN-mediated whole-brain information flow in WM. We used datasets from participants performing verbal and spatial working memory tasks, divided into encoding, maintenance, and probe stages. We used general linear models to obtain task-activated CON and FPN nodes to define regions of interest (ROI); an online meta-analysis defined alternative ROIs for validation. We calculated whole-brain functional connectivity (FC) maps seeded by CON and FPN nodes at each stage using beta sequence analysis. We used Granger causality analysis to obtain the connectivity maps and assess task-level information flow patterns. For verbal working memory, the CON functionally connected positively and negatively to task-dependent and task-independent networks, respectively, at all stages. FPN FC patterns were similar only in the encoding and maintenance stages. The CON elicited stronger task-level outputs. Main effects were: stable CON→FPN, CON→DMN, CON→visual areas, FPN→visual areas, and phonological areas→FPN. The CON and FPN both up-regulated task-dependent and down-regulated task-independent networks during encoding and probing. Task-level output was slightly stronger for the CON. CON→FPN, CON→DMN, visual areas→CON, and visual areas→FPN showed consistent effects. The CON and FPN might together underlie the CES's neural basis and achieve top-down regulation through information interaction with other large-scale functional networks, and the CON may be a higher-level regulatory core in WM.

Auditory cortical connectivity in humans

To understand auditory cortical processing, the effective connectivity between 15 auditory cortical regions and 360 cortical regions was measured in 171 Human Connectome Project participants, and complemented with functional connectivity and diffusion tractography. 1. A hierarchy of auditory cortical processing was identified from Core regions (including A1) to Belt regions LBelt, MBelt, and 52; then to PBelt; and then to HCP A4. 2. A4 has connectivity to anterior temporal lobe TA2, and to HCP A5, which connects to dorsal-bank superior temporal sulcus (STS) regions STGa, STSda, and STSdp. These STS regions also receive visual inputs about moving faces and objects, which are combined with auditory information to help implement multimodal object identification, such as who is speaking, and what is being said. Consistent with this being a "what" ventral auditory stream, these STS regions then have effective connectivity to TPOJ1, STV, PSL, TGv, TGd, and PGi, which are language-related semantic regions connecting to Broca's area, especially BA45. 3. A4 and A5 also have effective connectivity to MT and MST, which connect to superior parietal regions forming a dorsal auditory "where" stream involved in actions in space. Connections of PBelt, A4, and A5 with BA44 may form a language-related dorsal stream.

Hearing and Cognition in Childhood

The human brain shows extensive development of the cerebral cortex after birth. This is extensively altered by the absence of auditory input: the development of cortical synapses in the auditory system is delayed and their degradation is increased. Recent work shows that the synapses responsible for corticocortical processing of stimuli and their embedding into multisensory interactions and cognition are particularly affected. Since the brain is heavily reciprocally interconnected, inborn deafness manifests not only in deficits in auditory processing, but also in cognitive (non-auditory) functions that are affected differently between individuals. It requires individualized approaches in therapy of deafness in childhood.

Successful aging of musicians: Preservation of sensorimotor regions aids audiovisual speech-in-noise perception

Musicianship can mitigate age-related declines in audiovisual speech-in-noise perception. We tested whether this benefit originates from functional preservation or functional compensation by comparing fMRI responses of older musicians, older nonmusicians, and young nonmusicians identifying noise-masked audiovisual syllables. Older musicians outperformed older nonmusicians and showed comparable performance to young nonmusicians. Notably, older musicians retained similar neural specificity of speech representations in sensorimotor areas to young nonmusicians, while older nonmusicians showed degraded neural representations. In the same region, older musicians showed higher neural alignment to young nonmusicians than older nonmusicians, which was associated with their training intensity. In older nonmusicians, the degree of neural alignment predicted better performance. In addition, older musicians showed greater activation in frontal-parietal, speech motor, and visual motion regions and greater deactivation in the angular gyrus than older nonmusicians, which predicted higher neural alignment in sensorimotor areas. Together, these findings suggest that musicianship-related benefit in audiovisual speech-in-noise processing is rooted in preserving youth-like representations in sensorimotor regions.

Brain areas associated with visual spatial attention display topographic organization during auditory spatial attention

Spatially selective modulation of alpha power (8-14 Hz) is a robust finding in electrophysiological studies of visual attention, and has been recently generalized to auditory spatial attention. This modulation pattern is interpreted as reflecting a top-down mechanism for suppressing distracting input from unattended directions of sound origin. The present study on auditory spatial attention extends this interpretation by demonstrating that alpha power modulation is closely linked to oculomotor action. We designed an auditory paradigm in which participants were required to attend to upcoming sounds from one of 24 loudspeakers arranged in a circular array around the head. Maintaining the location of an auditory cue was associated with a topographically modulated distribution of posterior alpha power resembling the findings known from visual attention. Multivariate analyses allowed the prediction of the sound location in the horizontal plane. Importantly, this prediction was also possible, when derived from signals capturing saccadic activity. A control experiment on auditory spatial attention confirmed that, in absence of any visual/auditory input, lateralization of alpha power is linked to the lateralized direction of gaze. Attending to an auditory target engages oculomotor and visual cortical areas in a topographic manner akin to the retinotopic organization associated with visual attention.

Theories about Developmental Dyslexia

Despite proving its usefulness for over a century, the concept of developmental dyslexia (DD) is currently in severe disarray because of the recent introduction of the phonological theory of its causation. Since mastering the phonological principle is essential for all reading, failure to do so cannot be used to distinguish DD from the many other causes of such failure. To overcome this problem, many new psychological, signal detection, and neurological theories have been introduced recently. All these new theories converge on the idea that DD is fundamentally caused by impaired signalling of the timing of the visual and auditory cues that are essential for reading. These are provided by large 'magnocellular' neurones which respond rapidly to sensory transients. The evidence for this conclusion is overwhelming. Especially convincing are intervention studies that have shown that improving magnocellular function improves dyslexic children's reading, together with cohort studies that have demonstrated that the magnocellular timing deficit is present in infants who later become dyslexic, long before they begin learning to read. The converse of the magnocellular deficit in dyslexics may be that they gain parvocellular abundance. This may often impart the exceptional 'holistic' talents that have been ascribed to them and that society needs to nurture.

Preoperative Reading Efficiency as a Predictor of Adult Cochlear Implant Outcomes

HYPOTHESES

1) Scores of reading efficiency (the Test of Word Reading Efficiency, second edition) obtained in adults before cochlear implant surgery will be predictive of speech recognition outcomes 6 months after surgery; and 2) Cochlear implantation will lead to improvements in language processing as measured through reading efficiency from preimplantation to postimplantation.

BACKGROUND

Adult cochlear implant (CI) users display remarkable variability in speech recognition outcomes. "Top-down" processing-the use of cognitive resources to make sense of degraded speech-contributes to speech recognition abilities in CI users. One area that has received little attention is the efficiency of lexical and phonological processing. In this study, a visual measure of word and nonword reading efficiency-relying on lexical and phonological processing, respectively-was investigated for its ability to predict CI speech recognition outcomes, as well as to identify any improvements after implantation.

METHODS

Twenty-four postlingually deaf adult CI candidates were tested on the Test of Word Reading Efficiency, Second Edition preoperatively and again 6 months post-CI. Six-month post-CI speech recognition measures were also assessed across a battery of word and sentence recognition.

RESULTS

Preoperative nonword reading scores were moderately predictive of sentence recognition outcomes, but real word reading scores were not; word recognition scores were not predicted by either. No 6-month post-CI improvement was demonstrated in either word or nonword reading efficiency.

CONCLUSION

Phonological processing as measured by the Test of Word Reading Efficiency, Second Edition nonword reading predicts to a moderate degree 6-month sentence recognition outcomes in adult CI users. Reading efficiency did not improve after implantation, although this could be because of the relatively short duration of CI use.

The visual basis of reading and reading difficulties

Most of our knowledge about the neural networks mediating reading has derived from studies of developmental dyslexia (DD). For much of the 20th C. this was diagnosed on the basis of finding a discrepancy between children's unexpectedly low reading and spelling scores compared with their normal or high oral and non-verbal reasoning ability. This discrepancy criterion has now been replaced by the claim that the main feature of dyslexia is a phonological deficit, and it is now argued that we should test for this to identify dyslexia. However, grasping the phonological principle is essential for all learning to read; so every poor reader will show a phonological deficit. The phonological theory does not explain why dyslexic people, in particular, fail; so this phonological criterion makes it impossible to distinguish DD from any of the many other causes of reading failure. Currently therefore, there is no agreement about precisely how we should identify it. Yet, if we understood the specific neural pathways that underlie failure to acquire phonological skills specifically in people with dyslexia, we should be able to develop reliable means of identifying it. An important, though not the only, cause in people with dyslexia is impaired development of the brain's rapid visual temporal processing systems; these are required for sequencing the order of the letters in a word accurately. Such temporal, "transient," processing is carried out primarily by a distinct set of "magnocellular" (M-) neurones in the visual system; and the development of these has been found to be impaired in many people with dyslexia. Likewise, auditory sequencing of the sounds in a word is mediated by the auditory temporal processing system whose development is impaired in many dyslexics. Together these two deficits can therefore explain their problems with acquiring the phonological principle. Assessing poor readers' visual and auditory temporal processing skills should enable dyslexia to be reliably distinguished from other causes of reading failure and this will suggest principled ways of helping these children to learn to read, such as sensory training, yellow or blue filters or omega 3 fatty acid supplements. This will enable us to diagnose DD with confidence, and thus to develop educational plans targeted to exploit each individual child's strengths and compensate for his weaknesses.

Interaction of bottom-up and top-down neural mechanisms in spatial multi-talker speech perception

How the human auditory cortex represents spatially separated simultaneous talkers and how talkers' locations and voices modulate the neural representations of attended and unattended speech are unclear. Here, we measured the neural responses from electrodes implanted in neurosurgical patients as they performed single-talker and multi-talker speech perception tasks. We found that spatial separation between talkers caused a preferential encoding of the contralateral speech in Heschl's gyrus (HG), planum temporale (PT), and superior temporal gyrus (STG). Location and spectrotemporal features were encoded in different aspects of the neural response. Specifically, the talker's location changed the mean response level, whereas the talker's spectrotemporal features altered the variation of response around response's baseline. These components were differentially modulated by the attended talker's voice or location, which improved the population decoding of attended speech features. Attentional modulation due to the talker's voice only appeared in the auditory areas with longer latencies, but attentional modulation due to location was present throughout. Our results show that spatial multi-talker speech perception relies upon a separable pre-attentive neural representation, which could be further tuned by top-down attention to the location and voice of the talker.

The neural substrates of visual organization in children and adolescents: An fMRI study

Deficient visual organization ability not only indicates possible brain dysfunctions but further affects an individual's daily activities. This study aimed to use functional magnetic resonance imaging (fMRI) to investigate the neural network contributing to visual organization abilities in children and adolescents. A two-choice version of the Hooper Visual Organization Test (T-HVOT) was adapted as the fMRI task for the present study. The effects of age and gender on overall visual perceptual functions and related neural foundations were also analyzed. Seventy children and adolescents were administered with the Test of Visual Perceptual Skill-Third Edition and 41 completed the fMRI scans. The whole-brain fMRI mapping results showed the cortical activation of multiple brain areas relating to visual organization. The greatest cortical activities were seen in the middle occipital gyrus, middle temporal gyrus, middle frontal gyrus and inferior frontal gyrus, and two age groups showed significant differences in cortical activation patterns as well. Gender had no significant effects on visual perceptual functions nor related cortical activation patterns. The overall visual perception functions improve with age, and the different cortical activation patterns indicated that the two groups adopt different strategies while performing visual organization tasks. The sensitivity and spatial resolution of fMRI allowed us to make specific conclusions about cortical regions involved in visual organization function and to provide a reference for objectively judging rehabilitative outcomes.

Is Reduced Visual Processing the Price of Language?

We suggest a later timeline for full language capabilities in Homo sapiens, placing the emergence of language over 200,000 years after the emergence of our species. The late Paleolithic period saw several significant changes. Homo sapiens became more gracile and gradually lost significant brain volumes. Detailed realistic cave paintings disappeared completely, and iconic/symbolic ones appeared at other sites. This may indicate a shift in perceptual abilities, away from an accurate perception of the present. Language in modern humans interact with vision. One example is the McGurk effect. Studies show that artistic abilities may improve when language-related brain areas are damaged or temporarily knocked out. Language relies on many pre-existing non-linguistic functions. We suggest that an overwhelming flow of perceptual information, vision, in particular, was an obstacle to language, as is sometimes implied in autism with relative language impairment. We systematically review the recent research literature investigating the relationship between language and perception. We see homologues of language-relevant brain functions predating language. Recent findings show brain lateralization for communicative gestures in other primates without language, supporting the idea that a language-ready brain may be overwhelmed by raw perception, thus blocking overt language from evolving. We find support in converging evidence for a change in neural organization away from raw perception, thus pushing the emergence of language closer in time. A recent origin of language makes it possible to investigate the genetic origins of language.

The human language effective connectome

To advance understanding of brain networks involved in language, the effective connectivity between 26 cortical regions implicated in language by a community analysis and 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography, all using the HCP multimodal parcellation atlas. A (semantic) network (Group 1) involving inferior cortical regions of the superior temporal sulcus cortex (STS) with the adjacent inferior temporal visual cortex TE1a and temporal pole TG, and the connected parietal PGi region, has effective connectivity with inferior temporal visual cortex (TE) regions; with parietal PFm which also has visual connectivity; with posterior cingulate cortex memory-related regions; with the frontal pole, orbitofrontal cortex, and medial prefrontal cortex; with the dorsolateral prefrontal cortex; and with 44 and 45 for output regions. It is proposed that this system can build in its temporal lobe (STS and TG) and parietal parts (PGi and PGs) semantic representations of objects incorporating especially their visual and reward properties. Another (semantic) network (Group 3) involving superior regions of the superior temporal sulcus cortex and more superior temporal lobe regions including STGa, auditory A5, TPOJ1, the STV and the Peri-Sylvian Language area (PSL) has effective connectivity with auditory areas (A1, A4, A5, Pbelt); with relatively early visual areas involved in motion, e.g., MT and MST, and faces/words (FFC); with somatosensory regions (frontal opercular FOP, insula and parietal PF); with other TPOJ regions; and with the inferior frontal gyrus regions (IFJa and IFSp). It is proposed that this system builds semantic representations specialising in auditory and related facial motion information useful in theory of mind and somatosensory / body image information, with outputs directed not only to regions 44 and 45, but also to premotor 55b and midcingulate premotor cortex. Both semantic networks (Groups 1 and 3) have access to the hippocampal episodic memory system via parahippocampal TF. A third largely frontal network (Group 2) (44, 45, 47l; 55b; the Superior Frontal Language region SFL; and including temporal pole TGv) receives effective connectivity from the two semantic systems, and is implicated in syntax and speech output.

Topological Maps and Brain Computations From Low to High

We first briefly summarize data from microelectrode studies on visual maps in non-human primates and other mammals, and characterize differences among the features of the approximately topological maps in the three main sensory modalities. We then explore the almost 50% of human neocortex that contains straightforward topological visual, auditory, and somatomotor maps by presenting a new parcellation as well as a movie atlas of cortical area maps on the FreeSurfer average surface, fsaverage. Third, we review data on moveable map phenomena as well as a recent study showing that cortical activity during sensorimotor actions may involve spatially locally coherent traveling wave and bump activity. Finally, by analogy with remapping phenomena and sensorimotor activity, we speculate briefly on the testable possibility that coherent localized spatial activity patterns might be able to ‘escape’ from topologically mapped cortex during ‘serial assembly of content’ operations such as scene and language comprehension, to form composite ‘molecular’ patterns that can move across some cortical areas and possibly return to topologically mapped cortex to generate motor output there.

Lip movements enhance speech representations and effective connectivity in auditory dorsal stream

Viewing speaker's lip movements facilitates speech perception, especially under adverse listening conditions, but the neural mechanisms of this perceptual benefit at the phonemic and feature levels remain unclear. This fMRI study addressed this question by quantifying regional multivariate representation and network organization underlying audiovisual speech-in-noise perception. Behaviorally, valid lip movements improved recognition of place of articulation to aid phoneme identification. Meanwhile, lip movements enhanced neural representations of phonemes in left auditory dorsal stream regions, including frontal speech motor areas and supramarginal gyrus (SMG). Moreover, neural representations of place of articulation and voicing features were promoted differentially by lip movements in these regions, with voicing enhanced in Broca's area while place of articulation better encoded in left ventral premotor cortex and SMG. Next, dynamic causal modeling (DCM) analysis showed that such local changes were accompanied by strengthened effective connectivity along the dorsal stream. Moreover, the neurite orientation dispersion of the left arcuate fasciculus, the bearing skeleton of auditory dorsal stream, predicted the visual enhancements of neural representations and effective connectivity. Our findings provide novel insight to speech science that lip movements promote both local phonemic and feature encoding and network connectivity in the dorsal pathway and the functional enhancement is mediated by the microstructural architecture of the circuit.

Adapting to altered auditory cues: Generalization from manual reaching to head pointing

Localising sounds means having the ability to process auditory cues deriving from the interplay among sound waves, the head and the ears. When auditory cues change because of temporary or permanent hearing loss, sound localization becomes difficult and uncertain. The brain can adapt to altered auditory cues throughout life and multisensory training can promote the relearning of spatial hearing skills. Here, we study the training potentials of sound-oriented motor behaviour to test if a training based on manual actions toward sounds can learning effects that generalize to different auditory spatial tasks. We assessed spatial hearing relearning in normal hearing adults with a plugged ear by using visual virtual reality and body motion tracking. Participants performed two auditory tasks that entail explicit and implicit processing of sound position (head-pointing sound localization and audio-visual attention cueing, respectively), before and after having received a spatial training session in which they identified sound position by reaching to auditory sources nearby. Using a crossover design, the effects of the above-mentioned spatial training were compared to a control condition involving the same physical stimuli, but different task demands (i.e., a non-spatial discrimination of amplitude modulations in the sound). According to our findings, spatial hearing in one-ear plugged participants improved more after reaching to sound trainings rather than in the control condition. Training by reaching also modified head-movement behaviour during listening. Crucially, the improvements observed during training generalize also to a different sound localization task, possibly as a consequence of acquired and novel head-movement strategies.

Musicianship-Related Structural and Functional Cortical Features Are Preserved in Elderly Musicians

Background

Professional musicians are a model population for exploring basic auditory function, sensorimotor and multisensory integration, and training-induced neuroplasticity. The brain of musicians exhibits distinct structural and functional cortical features; however, little is known about how these features evolve during aging. This multiparametric study aimed to examine the functional and structural neural correlates of lifelong musical practice in elderly professional musicians.

Methods

Sixteen young musicians, 16 elderly musicians (age >70), and 15 elderly non-musicians participated in the study. We assessed gray matter metrics at the whole-brain and region of interest (ROI) levels using high-resolution magnetic resonance imaging (MRI) with the Freesurfer automatic segmentation and reconstruction pipeline. We used BrainVoyager semiautomated segmentation to explore individual auditory cortex morphotypes. Furthermore, we evaluated functional blood oxygenation level-dependent (BOLD) activations in auditory and non-auditory regions by functional MRI (fMRI) with an attentive tone-listening task. Finally, we performed discriminant function analyses based on structural and functional ROIs.

Results

A general reduction of gray matter metrics distinguished the elderly from the young subjects at the whole-brain level, corresponding to widespread natural brain atrophy. Age- and musicianship-dependent structural correlations revealed group-specific differences in several clusters including superior, middle, and inferior frontal as well as perirolandic areas. In addition, the elderly musicians exhibited increased gyrification of auditory cortex like the young musicians. During fMRI, the elderly non-musicians activated predominantly auditory regions, whereas the elderly musicians co-activated a much broader network of auditory association areas, primary and secondary motor areas, and prefrontal and parietal regions like, albeit weaker, the young musicians. Also, group-specific age- and musicianship-dependent functional correlations were observed in the frontal and parietal regions. Moreover, discriminant function analysis could separate groups with high accuracy based on a set of specific structural and functional, mainly temporal and occipital, ROIs.

Conclusion

In conclusion, despite naturally occurring senescence, the elderly musicians maintained musicianship-specific structural and functional cortical features. The identified structural and functional brain regions, discriminating elderly musicians from non-musicians, might be of relevance for the aging musicians’ brain. To what extent lifelong musical activity may have a neuroprotective impact needs to be addressed further in larger longitudinal studies.

Neural Correlates of Listening to Varying Synchrony Between Beats in Samba Percussion and Relations to Feeling the Groove

Listening to samba percussion often elicits feelings of pleasure and the desire to move with the beat-an experience sometimes referred to as "feeling the groove"- as well as social connectedness. Here we investigated the effects of performance timing in a Brazilian samba percussion ensemble on listeners' experienced pleasantness and the desire to move/dance in a behavioral experiment, as well as on neural processing as assessed via functional magnetic resonance imaging (fMRI). Participants listened to different excerpts of samba percussion produced by multiple instruments that either were "in sync", with no additional asynchrony between instrumental parts other than what is usual in naturalistic recordings, or were presented "out of sync" by delaying the snare drums (by 28, 55, or 83 ms). Results of the behavioral experiment showed increasing pleasantness and desire to move/dance with increasing synchrony between instruments. Analysis of hemodynamic responses revealed stronger bilateral brain activity in the supplementary motor area, the left premotor area, and the left middle frontal gyrus with increasing synchrony between instruments. Listening to "in sync" percussion thus strengthens audio-motor interactions by recruiting motor-related brain areas involved in rhythm processing and beat perception to a higher degree. Such motor related activity may form the basis for "feeling the groove" and the associated desire to move to music. Furthermore, in an exploratory analysis we found that participants who reported stronger emotional responses to samba percussion in everyday life showed higher activity in the subgenual cingulate cortex, an area involved in prosocial emotions, social group identification and social bonding.

Intra-individual Reliability of Voice- and Music-elicited Responses and their Modulation by Expertise

A growing number of functional neuroimaging studies have identified regions within the temporal lobe, particularly along the planum polare and planum temporale, that respond more strongly to music than other types of acoustic stimuli, including voice. This "music preferred" regions have been reported using a variety of stimulus sets, paradigms and analysis approaches and their consistency across studies confirmed through meta-analyses. However, the critical question of intra-subject reliability of these responses has received less attention. Here, we directly assessed this important issue by contrasting brain responses to musical vs. vocal stimuli in the same subjects across three consecutive fMRI runs, using different types of stimuli. Moreover, we investigated whether these music- and voice-preferred responses were reliably modulated by expertise. Results demonstrated that music-preferred activity previously reported in temporal regions, and its modulation by expertise, exhibits a high intra-subject reliability. However, we also found that activity in some extra-temporal regions, such as the precentral and middle frontal gyri, did depend on the particular stimuli employed, which may explain why these are less consistently reported in the literature. Taken together, our findings confirm and extend the notion that specific regions in the brain consistently respond more strongly to certain socially-relevant stimulus categories, such as faces, voices and music, but that some of these responses appear to depend, at least to some extent, on the specific features of the paradigm employed.

Controversy over the temporal cortical terminations of the left arcuate fasciculus: a reappraisal

The arcuate fasciculus has been considered a major dorsal fronto-temporal white matter pathway linking frontal language production regions with auditory perception in the superior temporal gyrus, the so-called Wernicke's area. In line with this tradition, both historical and contemporary models of language function have assigned primacy to superior temporal projections of the arcuate fasciculus. However, classical anatomical descriptions and emerging behavioural data are at odds with this assumption. On one hand, fronto-temporal projections to Wernicke's area may not be unique to the arcuate fasciculus. On the other hand, dorsal stream language deficits have been reported also for damage to middle, inferior and basal temporal gyri which may be linked to arcuate disconnection. These findings point to a reappraisal of arcuate projections in the temporal lobe. Here, we review anatomical and functional evidence regarding the temporal cortical terminations of the left arcuate fasciculus by incorporating dissection and tractography findings with stimulation data using cortico-cortical evoked potentials and direct electrical stimulation mapping in awake patients. Firstly, we discuss the fibers of the arcuate fasciculus projecting to the superior temporal gyrus and the functional rostro-caudal gradient in this region where both phonological encoding and auditory-motor transformation may be performed. Caudal regions within the temporoparietal junction may be involved in articulation and associated with temporoparietal projections of the third branch of the superior longitudinal fasciculus, while more rostral regions may support encoding of acoustic phonetic features, supported by arcuate fibres. We then move to examine clinical data showing that multimodal phonological encoding is facilitated by projections of the arcuate fasciculus to superior, but also middle, inferior and basal temporal regions. Hence, we discuss how projections of the arcuate fasciculus may contribute to acoustic (middle-posterior superior and middle temporal gyri), visual (posterior inferior temporal/fusiform gyri comprising the visual word form area) and lexical (anterior-middle inferior temporal/fusiform gyri in the basal temporal language area) information in the temporal lobe to be processed, encoded and translated into a dorsal phonological route to the frontal lobe. Finally, we point out surgical implications for this model in terms of the prediction and avoidance of neurological deficit.

A computational examination of the two-streams hypothesis: which pathway needs a longer memory?

The two visual streams hypothesis is a robust example of neural functional specialization that has inspired countless studies over the past four decades. According to one prominent version of the theory, the fundamental goal of the dorsal visual pathway is the transformation of retinal information for visually-guided motor behavior. To that end, the dorsal stream processes input using absolute (or veridical) metrics only when the movement is initiated, necessitating very little, or no, memory. Conversely, because the ventral visual pathway does not involve motor behavior (its output does not influence the real world), the ventral stream processes input using relative (or illusory) metrics and can accumulate or integrate sensory evidence over long time constants, which provides a substantial capacity for memory. In this study, we tested these relations between functional specialization, processing metrics, and memory by training identical recurrent neural networks to perform either a viewpoint-invariant object classification task or an orientation/size determination task. The former task relies on relative metrics, benefits from accumulating sensory evidence, and is usually attributed to the ventral stream. The latter task relies on absolute metrics, can be computed accurately in the moment, and is usually attributed to the dorsal stream. To quantify the amount of memory required for each task, we chose two types of neural network models. Using a long-short-term memory (LSTM) recurrent network, we found that viewpoint-invariant object categorization (object task) required a longer memory than orientation/size determination (orientation task). Additionally, to dissect this memory effect, we considered factors that contributed to longer memory in object tasks. First, we used two different sets of objects, one with self-occlusion of features and one without. Second, we defined object classes either strictly by visual feature similarity or (more liberally) by semantic label. The models required greater memory when features were self-occluded and when object classes were defined by visual feature similarity, showing that self-occlusion and visual similarity among object task samples are contributing to having a long memory. The same set of tasks modeled using modified leaky-integrator echo state recurrent networks (LiESN), however, did not replicate the results, except under some conditions. This may be because LiESNs cannot perform fine-grained memory adjustments due to their network-wide memory coefficient and fixed recurrent weights. In sum, the LSTM simulations suggest that longer memory is advantageous for performing viewpoint-invariant object classification (a putative ventral stream function) because it allows for interpolation of features across viewpoints. The results further suggest that orientation/size determination (a putative dorsal stream function) does not benefit from longer memory. These findings are consistent with the two visual streams theory of functional specialization.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11571-021-09703-z.

Cerebral Representation of Sound Localization Using Functional Near-Infrared Spectroscopy

Sound localization is an essential part of auditory processing. However, the cortical representation of identifying the direction of sound sources presented in the sound field using functional near-infrared spectroscopy (fNIRS) is currently unknown. Therefore, in this study, we used fNIRS to investigate the cerebral representation of different sound sources. Twenty-five normal-hearing subjects (aged 26 ± 2.7, male 11, female 14) were included and actively took part in a block design task. The test setup for sound localization was composed of a seven-speaker array spanning a horizontal arc of 180° in front of the participants. Pink noise bursts with two intensity levels (48 dB/58 dB) were randomly applied via five loudspeakers (–90°/–30°/–0°/+30°/+90°). Sound localization task performances were collected, and simultaneous signals from auditory processing cortical fields were recorded for analysis by using a support vector machine (SVM). The results showed a classification accuracy of 73.60, 75.60, and 77.40% on average at –90°/0°, 0°/+90°, and –90°/+90° with high intensity, and 70.60, 73.6, and 78.6% with low intensity. The increase of oxyhemoglobin was observed in the bilateral non-primary auditory cortex (AC) and dorsolateral prefrontal cortex (dlPFC). In conclusion, the oxyhemoglobin (oxy-Hb) response showed different neural activity patterns between the lateral and front sources in the AC and dlPFC. Our results may serve as a basic contribution for further research on the use of fNIRS in spatial auditory studies.

Global and Parallel Cortical Processing Based on Auditory Gamma Oscillatory Responses in Humans

Gamma oscillations are physiological phenomena that reflect perception and cognition, and involve parvalbumin-positive γ-aminobutyric acid-ergic interneuron function. The auditory steady-state response (ASSR) is the most robust index for gamma oscillations, and it is impaired in patients with neuropsychiatric disorders such as schizophrenia and autism. Although ASSR reduction is known to vary in terms of frequency and time, the neural mechanisms are poorly understood. We obtained high-density electrocorticography recordings from a wide area of the cortex in 8 patients with refractory epilepsy. In an ASSR paradigm, click sounds were presented at frequencies of 20, 30, 40, 60, 80, 120, and 160 Hz. We performed time-frequency analyses and analyzed intertrial coherence, event-related spectral perturbation, and high-gamma oscillations. We demonstrate that the ASSR is globally distributed among the temporal, parietal, and frontal cortices. The ASSR was composed of time-dependent neural subcircuits differing in frequency tuning. Importantly, the frequency tuning characteristics of the late-latency ASSR varied between the temporal/frontal and parietal cortex, suggestive of differentiation along parallel auditory pathways. This large-scale survey of the cortical ASSR could serve as a foundation for future studies of the ASSR in patients with neuropsychiatric disorders.

A reachable probability approach for the analysis of spatio-temporal dynamics in the human functional network

The dynamic architecture of the human brain has been consistently observed. However, there is still limited modeling work to elucidate how neuronal circuits are hierarchically and flexibly organized in functional systems. Here we proposed a reachable probability approach based on non-homogeneous Markov chains, to characterize all possible connectivity flows and the hierarchical structure of brain functional systems at the dynamic level. We proved at the theoretical level the convergence of the functional brain network system, and demonstrated that this approach is able to detect network steady states across connectivity structure, particularly in areas of the default mode network. We further explored the dynamically hierarchical functional organization centered at the primary sensory cortices. We observed smaller optimal reachable steps to their local functional regions, and differentiated patterns in larger optimal reachable steps for primary perceptual modalities. The reachable paths with the largest and second largest transition probabilities between primary sensory seeds via multisensory integration regions were also tracked to explore the flexibility and plasticity of the multisensory integration. The present work provides a novel approach to depict both the stable and flexible hierarchical connectivity organization of the human brain.

Mapping Specific Mental Content during Musical Imagery

Humans can mentally represent auditory information without an external stimulus, but the specificity of these internal representations remains unclear. Here, we asked how similar the temporally unfolding neural representations of imagined music are compared to those during the original perceived experience. We also tested whether rhythmic motion can influence the neural representation of music during imagery as during perception. Participants first memorized six 1-min-long instrumental musical pieces with high accuracy. Functional MRI data were collected during: 1) silent imagery of melodies to the beat of a visual metronome; 2) same but while tapping to the beat; and 3) passive listening. During imagery, inter-subject correlation analysis showed that melody-specific temporal response patterns were reinstated in right associative auditory cortices. When tapping accompanied imagery, the melody-specific neural patterns were reinstated in more extensive temporal-lobe regions bilaterally. These results indicate that the specific contents of conscious experience are encoded similarly during imagery and perception in the dynamic activity of auditory cortices. Furthermore, rhythmic motion can enhance the reinstatement of neural patterns associated with the experience of complex sounds, in keeping with models of motor to sensory influences in auditory processing.

Expectancy-based rhythmic entrainment as continuous Bayesian inference

When presented with complex rhythmic auditory stimuli, humans are able to track underlying temporal structure (e.g., a "beat"), both covertly and with their movements. This capacity goes far beyond that of a simple entrained oscillator, drawing on contextual and enculturated timing expectations and adjusting rapidly to perturbations in event timing, phase, and tempo. Previous modeling work has described how entrainment to rhythms may be shaped by event timing expectations, but sheds little light on any underlying computational principles that could unify the phenomenon of expectation-based entrainment with other brain processes. Inspired by the predictive processing framework, we propose that the problem of rhythm tracking is naturally characterized as a problem of continuously estimating an underlying phase and tempo based on precise event times and their correspondence to timing expectations. We present two inference problems formalizing this insight: PIPPET (Phase Inference from Point Process Event Timing) and PATIPPET (Phase and Tempo Inference). Variational solutions to these inference problems resemble previous "Dynamic Attending" models of perceptual entrainment, but introduce new terms representing the dynamics of uncertainty and the influence of expectations in the absence of sensory events. These terms allow us to model multiple characteristics of covert and motor human rhythm tracking not addressed by other models, including sensitivity of error corrections to inter-event interval and perceived tempo changes induced by event omissions. We show that positing these novel influences in human entrainment yields a range of testable behavioral predictions. Guided by recent neurophysiological observations, we attempt to align the phase inference framework with a specific brain implementation. We also explore the potential of this normative framework to guide the interpretation of experimental data and serve as building blocks for even richer predictive processing and active inference models of timing.

The left dorsal stream causally mediates the tone labeling in absolute pitch

Absolute pitch (AP) refers to the ability to effortlessly identify given pitches without any reference. Correlative evidence suggests that the left posterior dorsolateral prefrontal cortex (DLPFC) is responsible for the process underlying pitch labeling in AP. Here, we measured the sight‐reading performance of right‐handed AP possessors and matched controls under cathodal and sham transcranial direct current stimulation of the left DLPFC. The participants were instructed to report notations as accurately and as fast as possible by playing with their right hand on a piano. The notations were simultaneously presented with distracting auditory stimuli that either matched or mismatched them in different semitone degrees. Unlike the controls, AP possessors revealed an interference effect in that they responded slower in mismatching conditions than in the matching one. Under cathodal stimulation, this interference effect disappeared. These findings confirm that the pitch‐labeling process underlying AP occurs automatically and is largely nonsuppressible when triggered by tone exposure. The improvement of the AP possessors’ sight‐reading performances in response to the suppression of the left DLPFC using cathodal stimulation confirms a causal relationship between this brain structure and pitch labeling.

Hand preference for the visual and auditory modalities in humans

The sensory dominance effect refers to the phenomenon that one sensory modality more frequently receives preferential processing (and eventually dominates consciousness and behavior) over and above other modalities. On the other hand, hand dominance is an innate aspect of the human motor system. To investigate how the sensory dominance effect interacts with hand dominance, we applied the adapted Colavita paradigm and recruited a large cohort of healthy right-handed participants (n = 119). While the visual dominance effect in bimodal trials was observed for the whole group (n = 119), about half of the right-handers (48%) showed a visual preference, i.e., their dominant hand effect manifested in responding to the visual stimuli. By contrast, 39% of the right-handers exhibited an auditory preference, i.e., the dominant hand effect occurred for the auditory responses. The remaining participants (13%) did not show any dominant hand preference for either visual or auditory responses. For the first time, the current behavioral data revealed that human beings possess a characteristic and persistent preferential link between different sensory modalities and the dominant vs. non-dominant hand. Whenever this preferential link between the sensory and the motor system was adopted, one dominance effect peaks upon the other dominance effect's best performance.

New Insights Into the Anatomy, Connectivity and Clinical Implications of the Middle Longitudinal Fasciculus

The middle longitudinal fascicle (MdLF) is a long, associative white matter tract connecting the superior temporal gyrus (STG) with the parietal and occipital lobe. Previous studies show different cortical terminations, and a possible segmentation pattern of the tract. In this study, we performed a post-mortem white matter dissection of 12 human hemispheres and an in vivo deterministic fiber tracking of 24 subjects acquired from the Human Connectome Project to establish whether a constant organization of fibers exists among the MdLF subcomponents and to acquire anatomical information on each subcomponent. Moreover, two clinical cases of brain tumors impinged on MdLF territories are reported to further discuss the anatomical results in light of previously published data on the functional involvement of this bundle. The main finding is that the MdLF is consistently organized into two layers: an antero-ventral segment (aMdLF) connecting the anterior STG (including temporal pole and planum polare) and the extrastriate lateral occipital cortex, and a posterior-dorsal segment (pMdLF) connecting the posterior STG, anterior transverse temporal gyrus and planum temporale with the superior parietal lobule and lateral occipital cortex. The anatomical connectivity pattern and quantitative differences between the MdLF subcomponents along with the clinical cases reported in this paper support the role of MdLF in high-order functions related to acoustic information. We suggest that pMdLF may contribute to the learning process associated with verbal-auditory stimuli, especially on left side, while aMdLF may play a role in processing/retrieving auditory information already consolidated within the temporal lobe.

Motor engagement relates to accurate perception of phonemes and audiovisual words, but not auditory words

A longstanding debate has surrounded the role of the motor system in speech perception, but progress in this area has been limited by tasks that only examine isolated syllables and conflate decision-making with perception. Using an adaptive task that temporally isolates perception from decision-making, we examined an EEG signature of motor activity (sensorimotor μ/beta suppression) during the perception of auditory phonemes, auditory words, audiovisual words, and environmental sounds while holding difficulty constant at two levels (Easy/Hard). Results revealed left-lateralized sensorimotor μ/beta suppression that was related to perception of speech but not environmental sounds. Audiovisual word and phoneme stimuli showed enhanced left sensorimotor μ/beta suppression for correct relative to incorrect trials, while auditory word stimuli showed enhanced suppression for incorrect trials. Our results demonstrate that motor involvement in perception is left-lateralized, is specific to speech stimuli, and it not simply the result of domain-general processes. These results provide evidence for an interactive network for speech perception in which dorsal stream motor areas are dynamically engaged during the perception of speech depending on the characteristics of the speech signal. Crucially, this motor engagement has different effects on the perceptual outcome depending on the lexicality and modality of the speech stimulus.

Michaelis et al. used extra-cranial EEG during a forced-choice identification task to investigate the role of the motor system in speech perception. Their findings suggest that left hemisphere dorsal stream motor areas are dynamically engaged during speech perception based on the properties of the stimulus.

How Beat Perception Co-opts Motor Neurophysiology

Beat perception offers cognitive scientists an exciting opportunity to explore how cognition and action are intertwined in the brain even in the absence of movement. Many believe the motor system predicts the timing of beats, yet current models of beat perception do not specify how this is neurally implemented. Drawing on recent insights into the neurocomputational properties of the motor system, we propose that beat anticipation relies on action-like processes consisting of precisely patterned neural time-keeping activity in the supplementary motor area (SMA), orchestrated and sequenced by activity in the dorsal striatum. In addition to synthesizing recent advances in cognitive science and motor neuroscience, our framework provides testable predictions to guide future work.

Motor and Predictive Processes in Auditory Beat and Rhythm Perception

In this article, we review recent advances in research on rhythm and musical beat perception, focusing on the role of predictive processes in auditory motor interactions. We suggest that experimental evidence of the motor system's role in beat perception, including in passive listening, may be explained by the generation and maintenance of internal predictive models, concordant with the Active Inference framework of sensory processing. We highlight two complementary hypotheses for the neural underpinnings of rhythm perception: The Action Simulation for Auditory Prediction hypothesis (Patel and Iversen, 2014) and the Gradual Audiomotor Evolution hypothesis (Merchant and Honing, 2014) and review recent experimental progress supporting each of these hypotheses. While initial formulations of ASAP and GAE explain different aspects of beat-based timing-the involvement of motor structures in the absence of movement, and physical entrainment to an auditory beat respectively-we suggest that work under both hypotheses provide converging evidence toward understanding the predictive role of the motor system in the perception of rhythm, and the specific neural mechanisms involved. We discuss future experimental work necessary to further evaluate the causal neural mechanisms underlying beat and rhythm perception.