Neural circuits underlying auditory contrast gain control and their perceptual implications

Click train elicited local gamma synchrony: Differing performance and pharmacological responsivity of primary auditory and prefrontal cortices

Auditory neural networks in the brain naturally entrain to rhythmic stimuli. Such synchronization is an accessible index of local network performance as captured by EEG. Across species, click trains delivered ∼ 40 Hz show strong entrainment with primary auditory cortex (Actx) being a principal source. Imaging studies have revealed additional cortical sources, but it is unclear if they are functionally distinct. Since auditory processing evolves hierarchically, we hypothesized that local synchrony would differ between between primary and association cortices. In female SD rats (N = 12), we recorded 40 Hz click train-elicited gamma oscillations using epidural electrodes situated at two distinct sites; one above the prefrontal cortex (PFC) and another above the Actx, after dosing with saline (1 ml/kg, sc) or the NMDA antagonist, MK801 (0.025, 0.05 or 0.1 mpk), in a blocked crossover design. Post-saline, both regions showed a strong 40 Hz auditory steady state response (ASSR). The latencies for the N1 response were ∼ 16 ms (Actx) and ∼ 34 ms (PFC). Narrow band (38-42 Hz) gamma oscillations appeared rapidly (<40 ms from stim onset at Actx but in a more delayed fashion (∼200 ms) at PFC. MK801 augmented gamma synchrony at Actx while dose-dependently disrupting at the PFC. Event-related gamma (but not beta) coherence, an index of long-distance connectivity, was disrupted by MK801. In conclusion, local network gamma synchrony in a higher order association cortex performs differently from that of the primary auditory cortex. We discuss these findings in the context of evolving sound processing across the cortical hierarchy.

Sodium salicylate improves detection of amplitude-modulated sound in mice

Salicylate is commonly used to induce tinnitus in animals, but its underlying mechanism of action is still debated. We therefore tested its effects on the firing properties of neurons in the mouse inferior colliculus (IC). Salicylate induced a large decrease in the spontaneous activity and an increase of ∼20 dB SPL in the minimum threshold of single units. In response to sinusoidally modulated noise (SAM noise) single units showed both an increase in phase locking and improved rate coding. Mice also became better at detecting amplitude modulations, and a simple threshold model based on the IC population response could reproduce this improvement. The responses to dynamic random chords (DRCs) suggested that the improved AM encoding was due to a linearization of the cochlear output, resulting in larger contrasts during SAM noise. These effects of salicylate are not consistent with the presence of tinnitus, but should be taken into account when studying hyperacusis.

The Mouse Inferior Colliculus Responds Preferentially to Non-Ultrasonic Vocalizations

The inferior colliculus (IC), the midbrain auditory integration center, analyzes information about social vocalizations and provides substrates for higher level processing of vocal signals. We used multichannel recordings to characterize and localize responses to social vocalizations and synthetic stimuli within the IC of female and male mice, both urethane anesthetized and unanesthetized. We compared responses to ultrasonic vocalizations (USVs) with other vocalizations in the mouse repertoire and related vocal responses to frequency tuning, IC subdivisions, and sex. Responses to lower frequency, broadband social vocalizations were widespread in IC, well represented throughout the tonotopic axis, across subdivisions, and in both sexes. Responses to USVs were much more limited. Although we observed some differences in tonal and vocal responses by sex and subdivision, representations of vocal responses by sex and subdivision were largely the same. For most units, responses to vocal signals occurred only when frequency response areas overlapped with spectra of the vocal signals. Since tuning to frequencies contained within the highest frequency USVs is limited (<15% of IC units), responses to these vocalizations are correspondingly limited (<5% of sound-responsive units). These results highlight a paradox of USV processing in some rodents: although USVs are the most abundant social vocalization, their representation and the representation of corresponding frequencies are less than lower frequency social vocalizations. We interpret this paradox in light of observations suggesting that USVs with lower frequency elements (<50 kHz) are associated with increased emotional intensity and engage a larger population of neurons in the mouse auditory system.

Dissociable Roles of the Auditory Midbrain and Cortex in Processing the Statistical Features of Natural Sound Textures

Sound texture perception takes advantage of a hierarchy of time-averaged statistical features of acoustic stimuli, but much remains unclear about how these statistical features are processed along the auditory pathway. Here, we compared the neural representation of sound textures in the inferior colliculus (IC) and auditory cortex (AC) of anesthetized female rats. We recorded responses to texture morph stimuli that gradually add statistical features of increasingly higher complexity. For each texture, several different exemplars were synthesized using different random seeds. An analysis of transient and ongoing multiunit responses showed that the IC units were sensitive to every type of statistical feature, albeit to a varying extent. In contrast, only a small proportion of AC units were overtly sensitive to any statistical features. Differences in texture types explained more of the variance of IC neural responses than did differences in exemplars, indicating a degree of "texture type tuning" in the IC, but the same was, perhaps surprisingly, not the case for AC responses. We also evaluated the accuracy of texture type classification from single-trial population activity and found that IC responses became more informative as more summary statistics were included in the texture morphs, while for AC population responses, classification performance remained consistently very low. These results argue against the idea that AC neurons encode sound type via an overt sensitivity in neural firing rate to fine-grain spectral and temporal statistical features.

Parvalbumin and Somatostatin: Biomarkers for Two Parallel Tectothalamic Pathways in the Auditory Midbrain

The inferior colliculus (IC) represents a crucial relay station in the auditory pathway, located in the midbrain's tectum and primarily projecting to the thalamus. Despite the identification of distinct cell classes based on various biomarkers in the IC, their specific contributions to the organization of auditory tectothalamic pathways have remained poorly understood. In this study, we demonstrate that IC neurons expressing parvalbumin (ICPV+) or somatostatin (ICSOM+) represent two minimally overlapping cell classes throughout the three IC subdivisions in mice of both sexes. Strikingly, regardless of their location within the IC, these neurons predominantly project to the primary and secondary auditory thalamic nuclei, respectively. Cell class-specific input tracing suggested that ICPV+ neurons primarily receive auditory inputs, whereas ICSOM+ neurons receive significantly more inputs from the periaqueductal gray and the superior colliculus (SC), which are sensorimotor regions critically involved in innate behaviors. Furthermore, ICPV+ neurons exhibit significant heterogeneity in both intrinsic electrophysiological properties and presynaptic terminal size compared with ICSOM+ neurons. Notably, approximately one-quarter of ICPV+ neurons are inhibitory neurons, whereas all ICSOM+ neurons are excitatory neurons. Collectively, our findings suggest that parvalbumin and somatostatin expression in the IC can serve as biomarkers for two functionally distinct, parallel tectothalamic pathways. This discovery suggests an alternative way to define tectothalamic pathways and highlights the potential usefulness of Cre mice in understanding the multifaceted roles of the IC at the circuit level.

Dynamics of cortical contrast adaptation predict perception of signals in noise

Neurons throughout the sensory pathway adapt their responses depending on the statistical structure of the sensory environment. Contrast gain control is a form of adaptation in the auditory cortex, but it is unclear whether the dynamics of gain control reflect efficient adaptation, and whether they shape behavioral perception. Here, we trained mice to detect a target presented in background noise shortly after a change in the contrast of the background. The observed changes in cortical gain and behavioral detection followed the dynamics of a normative model of efficient contrast gain control; specifically, target detection and sensitivity improved slowly in low contrast, but degraded rapidly in high contrast. Auditory cortex was required for this task, and cortical responses were not only similarly affected by contrast but predicted variability in behavioral performance. Combined, our results demonstrate that dynamic gain adaptation supports efficient coding in auditory cortex and predicts the perception of sounds in noise.

Adaptive mechanisms facilitate robust performance in noise and in reverberation in an auditory categorization model

For robust vocalization perception, the auditory system must generalize over variability in vocalization production as well as variability arising from the listening environment (e.g., noise and reverberation). We previously demonstrated using guinea pig and marmoset vocalizations that a hierarchical model generalized over production variability by detecting sparse intermediate-complexity features that are maximally informative about vocalization category from a dense spectrotemporal input representation. Here, we explore three biologically feasible model extensions to generalize over environmental variability: (1) training in degraded conditions, (2) adaptation to sound statistics in the spectrotemporal stage and (3) sensitivity adjustment at the feature detection stage. All mechanisms improved vocalization categorization performance, but improvement trends varied across degradation type and vocalization type. One or more adaptive mechanisms were required for model performance to approach the behavioral performance of guinea pigs on a vocalization categorization task. These results highlight the contributions of adaptive mechanisms at multiple auditory processing stages to achieve robust auditory categorization.

Adaptation in auditory processing

Adaptation is an essential feature of auditory neurons, which reduces their responses to unchanging and recurring sounds and allows their response properties to be matched to the constantly changing statistics of sounds that reach the ears. As a consequence, processing in the auditory system highlights novel or unpredictable sounds and produces an efficient representation of the vast range of sounds that animals can perceive by continually adjusting the sensitivity and, to a lesser extent, the tuning properties of neurons to the most commonly encountered stimulus values. Together with attentional modulation, adaptation to sound statistics also helps to generate neural representations of sound that are tolerant to background noise and therefore plays a vital role in auditory scene analysis. In this review, we consider the diverse forms of adaptation that are found in the auditory system in terms of the processing levels at which they arise, the underlying neural mechanisms, and their impact on neural coding and perception. We also ask what the dynamics of adaptation, which can occur over multiple timescales, reveal about the statistical properties of the environment. Finally, we examine how adaptation to sound statistics is influenced by learning and experience and changes as a result of aging and hearing loss.

Deep neural networks effectively model neural adaptation to changing background noise and suggest nonlinear noise filtering methods in auditory cortex

The human auditory system displays a robust capacity to adapt to sudden changes in background noise, allowing for continuous speech comprehension despite changes in background environments. However, despite comprehensive studies characterizing this ability, the computations that underly this process are not well understood. The first step towards understanding a complex system is to propose a suitable model, but the classical and easily interpreted model for the auditory system, the spectro-temporal receptive field (STRF), cannot match the nonlinear neural dynamics involved in noise adaptation. Here, we utilize a deep neural network (DNN) to model neural adaptation to noise, illustrating its effectiveness at reproducing the complex dynamics at the levels of both individual electrodes and the cortical population. By closely inspecting the model's STRF-like computations over time, we find that the model alters both the gain and shape of its receptive field when adapting to a sudden noise change. We show that the DNN model's gain changes allow it to perform adaptive gain control, while the spectro-temporal change creates noise filtering by altering the inhibitory region of the model's receptive field. Further, we find that models of electrodes in nonprimary auditory cortex also exhibit noise filtering changes in their excitatory regions, suggesting differences in noise filtering mechanisms along the cortical hierarchy. These findings demonstrate the capability of deep neural networks to model complex neural adaptation and offer new hypotheses about the computations the auditory cortex performs to enable noise-robust speech perception in real-world, dynamic environments.

Brain-wide inputs to the non-lemniscal inferior colliculus in mice

The inferior colliculus (IC) is the hub along the auditory pathway. Although it is fundamentally an auditory structure, the neurons in the IC, especially its non-lemniscal part also respond to multimodal stimuli. However, the sources of these non-auditory inputs are unclear. In this study, we injected the rAAV2-retro virus, a virus with efficient retrograde function, into the non-lemniscal IC of the Ai14 reporter line. The majority of cortical and subcortical brain areas, including cognitive, motor, somatosensory, auditory, and visual-related regions were revealed. The quantified whole brain input data have showed that the non-lemniscal IC received a higher proportion of inputs from ipsilateral cortical brain regions. The non-lemniscal IC integrates different multimodal patterns, for the dorsal cortex (ICD) receives primarily auditory inputs, and the external cortex (ICE) receives primarily auditory and somatosensory inputs. These findings demonstrate that auditory integration is shaped by a network of multi-sensory connections in the non-lemniscal IC subregions.

Neural substrates of perception in the vestibular thalamus during natural self-motion: A review

Accumulating evidence across multiple sensory modalities suggests that the thalamus does not simply relay information from the periphery to the cortex. Here we review recent findings showing that vestibular neurons within the ventral posteriolateral area of the thalamus perform nonlinear transformations on their afferent input that determine our subjective awareness of motion. Specifically, these neurons provide a substrate for previous psychophysical observations that perceptual discrimination thresholds are much better than predictions from Weber's law. This is because neural discrimination thresholds, which are determined from both variability and sensitivity, initially increase but then saturate with increasing stimulus amplitude, thereby matching the previously observed dependency of perceptual self-motion discrimination thresholds. Moreover, neural response dynamics give rise to unambiguous and optimized encoding of natural but not artificial stimuli. Finally, vestibular thalamic neurons selectively encode passively applied motion when occurring concurrently with voluntary (i.e., active) movements. Taken together, these results show that the vestibular thalamus plays an essential role towards generating motion perception as well as shaping our vestibular sense of agency that is not simply inherited from afferent input.

Relative changes in the cochlear summating potentials to paired-clicks predict speech-in-noise perception and subjective hearing acuity

Objective assays of human cochlear synaptopathy (CS) have been challenging to develop. It is suspected that relative summating potential (SP) changes are different in listeners with CS. In this proof-of-concept study, young, normal-hearing adults were recruited and assigned to a low/high-risk group for having CS based on their extended audiograms (9-16 kHz). SPs to paired-clicks with varying inter-click intervals isolated non-refractory receptor components of cochlear activity. Abrupt increases in SPs to paired- vs single-clicks were observed in high-risk listeners. Critically, exaggerated SPs predicted speech-in-noise and subjective hearing abilities, suggesting relative SP changes to rapid clicks might help identify putative synaptopathic listeners.

Selective corticofugal modulation on sound processing in auditory thalamus of awake marmosets

Cortical feedback has long been considered crucial for the modulation of sensory perception and recognition. However, previous studies have shown varying modulatory effects of the primary auditory cortex (A1) on the auditory response of subcortical neurons, which complicate interpretations regarding the function of A1 in sound perception and recognition. This has been further complicated by studies conducted under different brain states. In the current study, we used cryo-inactivation in A1 to examine the role of corticothalamic feedback on medial geniculate body (MGB) neurons in awake marmosets. The primary effects of A1 inactivation were a frequency-specific decrease in the auditory response of most MGB neurons coupled with an increased spontaneous firing rate, which together resulted in a decrease in the signal-to-noise ratio. In addition, we report for the first time that A1 robustly modulated the long-lasting sustained response of MGB neurons, which changed the frequency tuning after A1 inactivation, e.g. some neurons are sharper with corticofugal feedback and some get broader. Taken together, our results demonstrate that corticothalamic modulation in awake marmosets serves to enhance sensory processing in a manner similar to center-surround models proposed in visual and somatosensory systems, a finding which supports common principles of corticothalamic processing across sensory systems.

Neuromodulatory Mechanisms Underlying Contrast Gain Control in Mouse Auditory Cortex

Neural adaptation enables the brain to efficiently process sensory signals despite large changes in background noise. Previous studies have established that recent background spectro- or spatio-temporal statistics scale neural responses to sensory stimuli via a canonical normalization computation, which is conserved among species and sensory domains. In the auditory pathway, one major form of normalization, termed contrast gain control, presents as decreasing instantaneous firing-rate gain, the slope of the neural input-output relationship, with increasing variability of background sound levels (contrast) across time and frequency. Despite this gain rescaling, mean firing-rates in auditory cortex become invariant to sound level contrast, termed contrast invariance. The underlying neuromodulatory mechanisms of these two phenomena remain unknown. To study these mechanisms in male and female mice, we used a 2-photon calcium imaging preparation in layer 2/3 neurons of primary auditory cortex (A1), along with pharmacological and genetic KO approaches. We found that neuromodulatory cortical synaptic zinc signaling is necessary for contrast gain control but not contrast invariance in mouse A1.SIGNIFICANCE STATEMENT When sound levels in the acoustic environment become more variable across time and frequency, the brain decreases response gain to maintain dynamic range and thus stimulus discriminability. This gain adaptation accounts for changes in perceptual judgments in humans and mice; however, the underlying neuromodulatory mechanisms remain poorly understood. Here, we report context-dependent neuromodulatory effects of synaptic zinc that are necessary for contrast gain control in A1. Understanding context-specific neuromodulatory mechanisms, such as contrast gain control, provides insight into A1 cortical mechanisms of adaptation and also into fundamental aspects of perceptual changes that rely on gain modulation, such as attention.

Advancements in the Quest to Map, Monitor, and Manipulate Neural Circuitry

Neural circuits and the cells that comprise them represent the functional units of the brain. Circuits relay and process sensory information, maintain homeostasis, drive behaviors, and facilitate cognitive functions such as learning and memory. Creating a functionally-precise map of the mammalian brain requires anatomically tracing neural circuits, monitoring their activity patterns, and manipulating their activity to infer function. Advancements in cell-type-specific genetic tools allow interrogation of neural circuits with increased precision. This review provides a broad overview of recombination-based and activity-driven genetic targeting approaches, contemporary viral tracing strategies, electrophysiological recording methods, newly developed calcium, and voltage indicators, and neurotransmitter/neuropeptide biosensors currently being used to investigate circuit architecture and function. Finally, it discusses methods for acute or chronic manipulation of neural activity, including genetically-targeted cellular ablation, optogenetics, chemogenetics, and over-expression of ion channels. With this ever-evolving genetic toolbox, scientists are continuing to probe neural circuits with increasing resolution, elucidating the structure and function of the incredibly complex mammalian brain.

Cortical adaptation to sound reverberation

In almost every natural environment, sounds are reflected by nearby objects, producing many delayed and distorted copies of the original sound, known as reverberation. Our brains usually cope well with reverberation, allowing us to recognize sound sources regardless of their environments. In contrast, reverberation can cause severe difficulties for speech recognition algorithms and hearing-impaired people. The present study examines how the auditory system copes with reverberation. We trained a linear model to recover a rich set of natural, anechoic sounds from their simulated reverberant counterparts. The model neurons achieved this by extending the inhibitory component of their receptive filters for more reverberant spaces, and did so in a frequency-dependent manner. These predicted effects were observed in the responses of auditory cortical neurons of ferrets in the same simulated reverberant environments. Together, these results suggest that auditory cortical neurons adapt to reverberation by adjusting their filtering properties in a manner consistent with dereverberation.

Sensory adaptation mediates efficient and unambiguous encoding of natural stimuli by vestibular thalamocortical pathways

Sensory systems must continuously adapt to optimally encode stimuli encountered within the natural environment. The prevailing view is that such optimal coding comes at the cost of increased ambiguity, yet to date, prior studies have focused on artificial stimuli. Accordingly, here we investigated whether such a trade-off between optimality and ambiguity exists in the encoding of natural stimuli in the vestibular system. We recorded vestibular nuclei and their target vestibular thalamocortical neurons during naturalistic and artificial self-motion stimulation. Surprisingly, we found no trade-off between optimality and ambiguity. Using computational methods, we demonstrate that thalamocortical neural adaptation in the form of contrast gain control actually reduces coding ambiguity without compromising the optimality of coding under naturalistic but not artificial stimulation. Thus, taken together, our results challenge the common wisdom that adaptation leads to ambiguity and instead suggest an essential role in underlying unambiguous optimized encoding of natural stimuli.

Flexible auditory training, psychophysics, and enrichment of common marmosets with an automated, touchscreen-based system

Devising new and more efficient protocols to analyze the phenotypes of non-human primates, as well as their complex nervous systems, is rapidly becoming of paramount importance. This is because with genome-editing techniques, recently adopted to non-human primates, new animal models for fundamental and translational research have been established. One aspect in particular, namely cognitive hearing, has been difficult to assess compared to visual cognition. To address this, we devised autonomous, standardized, and unsupervised training and testing of auditory capabilities of common marmosets with a cage-based standalone, wireless system. All marmosets tested voluntarily operated the device on a daily basis and went from naïve to experienced at their own pace and with ease. Through a series of experiments, here we show, that animals autonomously learn to associate sounds with images; to flexibly discriminate sounds, and to detect sounds of varying loudness. The developed platform and training principles combine in-cage training of common marmosets for cognitive and psychoacoustic assessment with an enriched environment that does not rely on dietary restriction or social separation, in compliance with the 3Rs principle.

The authors present a cage-based stand-alone platform for autonomous, standardized, and unsupervised training and testing of visuo-auditory-cued behaviours of common marmosets. The experiments do not require dietary restriction or social separation.

Hearing in Complex Environments: Auditory Gain Control, Attention, and Hearing Loss

Listening in noisy or complex sound environments is difficult for individuals with normal hearing and can be a debilitating impairment for those with hearing loss. Extracting meaningful information from a complex acoustic environment requires the ability to accurately encode specific sound features under highly variable listening conditions and segregate distinct sound streams from multiple overlapping sources. The auditory system employs a variety of mechanisms to achieve this auditory scene analysis. First, neurons across levels of the auditory system exhibit compensatory adaptations to their gain and dynamic range in response to prevailing sound stimulus statistics in the environment. These adaptations allow for robust representations of sound features that are to a large degree invariant to the level of background noise. Second, listeners can selectively attend to a desired sound target in an environment with multiple sound sources. This selective auditory attention is another form of sensory gain control, enhancing the representation of an attended sound source while suppressing responses to unattended sounds. This review will examine both “bottom-up” gain alterations in response to changes in environmental sound statistics as well as “top-down” mechanisms that allow for selective extraction of specific sound features in a complex auditory scene. Finally, we will discuss how hearing loss interacts with these gain control mechanisms, and the adaptive and/or maladaptive perceptual consequences of this plasticity.

Disturbed Balance of Inhibitory Signaling Links Hearing Loss and Cognition

Neuronal hyperexcitability in the central auditory pathway linked to reduced inhibitory activity is associated with numerous forms of hearing loss, including noise damage, age-dependent hearing loss, and deafness, as well as tinnitus or auditory processing deficits in autism spectrum disorder (ASD). In most cases, the reduced central inhibitory activity and the accompanying hyperexcitability are interpreted as an active compensatory response to the absence of synaptic activity, linked to increased central neural gain control (increased output activity relative to reduced input). We here suggest that hyperexcitability also could be related to an immaturity or impairment of tonic inhibitory strength that typically develops in an activity-dependent process in the ascending auditory pathway with auditory experience. In these cases, high-SR auditory nerve fibers, which are critical for the shortest latencies and lowest sound thresholds, may have either not matured (possibly in congenital deafness or autism) or are dysfunctional (possibly after sudden, stressful auditory trauma or age-dependent hearing loss linked with cognitive decline). Fast auditory processing deficits can occur despite maintained basal hearing. In that case, tonic inhibitory strength is reduced in ascending auditory nuclei, and fast inhibitory parvalbumin positive interneuron (PV-IN) dendrites are diminished in auditory and frontal brain regions. This leads to deficits in central neural gain control linked to hippocampal LTP/LTD deficiencies, cognitive deficits, and unbalanced extra-hypothalamic stress control. Under these conditions, a diminished inhibitory strength may weaken local neuronal coupling to homeostatic vascular responses required for the metabolic support of auditory adjustment processes. We emphasize the need to distinguish these two states of excitatory/inhibitory imbalance in hearing disorders: (i) Under conditions of preserved fast auditory processing and sustained tonic inhibitory strength, an excitatory/inhibitory imbalance following auditory deprivation can maintain precise hearing through a memory linked, transient disinhibition that leads to enhanced spiking fidelity (central neural gain⇑) (ii) Under conditions of critically diminished fast auditory processing and reduced tonic inhibitory strength, hyperexcitability can be part of an increased synchronization over a broader frequency range, linked to reduced spiking reliability (central neural gain⇓). This latter stage mutually reinforces diminished metabolic support for auditory adjustment processes, increasing the risks for canonical dementia syndromes.

Effects of Cortical Cooling on Sound Processing in Auditory Cortex and Thalamus of Awake Marmosets

The auditory thalamus is the central nexus of bottom-up connections from the inferior colliculus and top-down connections from auditory cortical areas. While considerable efforts have been made to investigate feedforward processing of sounds in the auditory thalamus (medial geniculate body, MGB) of non-human primates, little is known about the role of corticofugal feedback in the MGB of awake non-human primates. Therefore, we developed a small, repositionable cooling probe to manipulate corticofugal feedback and studied neural responses in both auditory cortex and thalamus to sounds under conditions of normal and reduced cortical temperature. Cooling-induced increases in the width of extracellularly recorded spikes in auditory cortex were observed over the distance of several hundred micrometers away from the cooling probe. Cortical neurons displayed reduction in both spontaneous and stimulus driven firing rates with decreased cortical temperatures. In thalamus, cortical cooling led to increased spontaneous firing and either increased or decreased stimulus driven activity. Furthermore, response tuning to modulation frequencies of temporally modulated sounds and spatial tuning to sound source location could be altered (increased or decreased) by cortical cooling. Specifically, best modulation frequencies of individual MGB neurons could shift either toward higher or lower frequencies based on the vector strength or the firing rate. The tuning of MGB neurons for spatial location could both sharpen or widen. Elevation preference could shift toward higher or lower elevations and azimuth tuning could move toward ipsilateral or contralateral locations. Such bidirectional changes were observed in many parameters which suggests that the auditory thalamus acts as a filter that could be adjusted according to behaviorally driven signals from auditory cortex. Future work will have to delineate the circuit elements responsible for the observed effects.

Sound level context modulates neural activity in the human brainstem

Optimal perception requires adaptation to sounds in the environment. Adaptation involves representing the acoustic stimulation history in neural response patterns, for example, by altering response magnitude or latency as sound-level context changes. Neurons in the auditory brainstem of rodents are sensitive to acoustic stimulation history and sound-level context (often referred to as sensitivity to stimulus statistics), but the degree to which the human brainstem exhibits such neural adaptation is unclear. In six electroencephalography experiments with over 125 participants, we demonstrate that the response latency of the human brainstem is sensitive to the history of acoustic stimulation over a few tens of milliseconds. We further show that human brainstem responses adapt to sound-level context in, at least, the last 44 ms, but that neural sensitivity to sound-level context decreases when the time window over which acoustic stimuli need to be integrated becomes wider. Our study thus provides evidence of adaptation to sound-level context in the human brainstem and of the timescale over which sound-level information affects neural responses to sound. The research delivers an important link to studies on neural adaptation in non-human animals.

Sensitivity of neural responses in the inferior colliculus to statistical features of sound textures

Previous psychophysical studies have identified a hierarchy of time-averaged statistics which determine the identity of natural sound textures. However, it is unclear whether the neurons in the inferior colliculus (IC) are sensitive to each of these statistical features in the natural sound textures. We used 13 representative sound textures spanning the space of 3 statistics extracted from over 200 natural textures. The synthetic textures were generated by incorporating the statistical features in a step-by-step manner, in which a particular statistical feature was changed while the other statistical features remain unchanged. The extracellular activity in response to the synthetic texture stimuli was recorded in the IC of anesthetized rats. Analysis of the transient and sustained multiunit activity after each transition of statistical feature showed that the IC units were sensitive to the changes of all types of statistics, although to a varying extent. For example, we found that more neurons were sensitive to the changes in variance than that in the modulation correlations. Our results suggest that the sensitivity of the statistical features in the subcortical levels contributes to the identification and discrimination of natural sound textures.

Roving oddball paradigm elicits sensory gating, frequency sensitivity, and long-latency response in common marmosets

Mismatch negativity (MMN) is a candidate biomarker for neuropsychiatric disease. Understanding the extent to which it reflects cognitive deviance-detection or purely sensory processes will assist practitioners in making informed clinical interpretations. This study compares the utility of deviance-detection and sensory-processing theories for describing MMN-like auditory responses of a common marmoset monkey during roving oddball stimulation. The following exploratory analyses were performed on an existing dataset: responses during the transition and repetition sequence of the roving oddball paradigm (standard -> deviant/S1 -> S2 -> S3) were compared; long-latency potentials evoked by deviant stimuli were examined using a double-epoch waveform subtraction; effects of increasing stimulus repetitions on standard and deviant responses were analyzed; and transitions between standard and deviant stimuli were divided into ascending and descending frequency changes to explore contributions of frequency-sensitivity. An enlarged auditory response to deviant stimuli was observed. This decreased exponentially with stimulus repetition, characteristic of sensory gating. A slow positive deflection was viewed over approximately 300–800 ms after the deviant stimulus, which is more difficult to ascribe to afferent sensory mechanisms. When split into ascending and descending frequency transitions, the resulting difference waveforms were disproportionally influenced by descending frequency deviant stimuli. This asymmetry is inconsistent with the general deviance-detection theory of MMN. These findings tentatively suggest that MMN-like responses from common marmosets are predominantly influenced by rapid sensory adaptation and frequency preference of the auditory cortex, while deviance-detection may play a role in long-latency activity.

When and How Does the Auditory Cortex Influence Subcortical Auditory Structures? New Insights About the Roles of Descending Cortical Projections

For decades, the corticofugal descending projections have been anatomically well described but their functional role remains a puzzling question. In this review, we will first describe the contributions of neuronal networks in representing communication sounds in various types of degraded acoustic conditions from the cochlear nucleus to the primary and secondary auditory cortex. In such situations, the discrimination abilities of collicular and thalamic neurons are clearly better than those of cortical neurons although the latter remain very little affected by degraded acoustic conditions. Second, we will report the functional effects resulting from activating or inactivating corticofugal projections on functional properties of subcortical neurons. In general, modest effects have been observed in anesthetized and in awake, passively listening, animals. In contrast, in behavioral tasks including challenging conditions, behavioral performance was severely reduced by removing or transiently silencing the corticofugal descending projections. This suggests that the discriminative abilities of subcortical neurons may be sufficient in many acoustic situations. It is only in particularly challenging situations, either due to the task difficulties and/or to the degraded acoustic conditions that the corticofugal descending connections bring additional abilities. Here, we propose that it is both the top-down influences from the prefrontal cortex, and those from the neuromodulatory systems, which allow the cortical descending projections to impact behavioral performance in reshaping the functional circuitry of subcortical structures. We aim at proposing potential scenarios to explain how, and under which circumstances, these projections impact on subcortical processing and on behavioral responses.

Corticothalamic Pathways in Auditory Processing: Recent Advances and Insights From Other Sensory Systems

The corticothalamic (CT) pathways emanate from either Layer 5 (L5) or 6 (L6) of the neocortex and largely outnumber the ascending, thalamocortical pathways. The CT pathways provide the anatomical foundations for an intricate, bidirectional communication between thalamus and cortex. They act as dynamic circuits of information transfer with the ability to modulate or even drive the response properties of target neurons at each synaptic node of the circuit. L6 CT feedback pathways enable the cortex to shape the nature of its driving inputs, by directly modulating the sensory message arriving at the thalamus. L5 CT pathways can drive the postsynaptic neurons and initiate a transthalamic corticocortical circuit by which cortical areas communicate with each other. For this reason, L5 CT pathways place the thalamus at the heart of information transfer through the cortical hierarchy. Recent evidence goes even further to suggest that the thalamus via CT pathways regulates functional connectivity within and across cortical regions, and might be engaged in cognition, behavior, and perceptual inference. As descending pathways that enable reciprocal and context-dependent communication between thalamus and cortex, we venture that CT projections are particularly interesting in the context of hierarchical perceptual inference formulations such as those contemplated in predictive processing schemes, which so far heavily rely on cortical implementations. We discuss recent proposals suggesting that the thalamus, and particularly higher order thalamus via transthalamic pathways, could coordinate and contextualize hierarchical inference in cortical hierarchies. We will explore these ideas with a focus on the auditory system.

Lemniscal Corticothalamic Feedback in Auditory Scene Analysis

Sound information is transmitted from the ear to central auditory stations of the brain via several nuclei. In addition to these ascending pathways there exist descending projections that can influence the information processing at each of these nuclei. A major descending pathway in the auditory system is the feedback projection from layer VI of the primary auditory cortex (A1) to the ventral division of medial geniculate body (MGBv) in the thalamus. The corticothalamic axons have small glutamatergic terminals that can modulate thalamic processing and thalamocortical information transmission. Corticothalamic neurons also provide input to GABAergic neurons of the thalamic reticular nucleus (TRN) that receives collaterals from the ascending thalamic axons. The balance of corticothalamic and TRN inputs has been shown to refine frequency tuning, firing patterns, and gating of MGBv neurons. Therefore, the thalamus is not merely a relay stage in the chain of auditory nuclei but does participate in complex aspects of sound processing that include top-down modulations. In this review, we aim (i) to examine how lemniscal corticothalamic feedback modulates responses in MGBv neurons, and (ii) to explore how the feedback contributes to auditory scene analysis, particularly on frequency and harmonic perception. Finally, we will discuss potential implications of the role of corticothalamic feedback in music and speech perception, where precise spectral and temporal processing is essential.

Natural Statistics as Inference Principles of Auditory Tuning in Biological and Artificial Midbrain Networks

Bats provide a powerful mammalian model to explore the neural representation of complex sounds, as they rely on hearing to survive in their environment. The inferior colliculus (IC) is a central hub of the auditory system that receives converging projections from the ascending pathway and descending inputs from auditory cortex. In this work, we build an artificial neural network to replicate auditory characteristics in IC neurons of the big brown bat. We first test the hypothesis that spectro-temporal tuning of IC neurons is optimized to represent the natural statistics of conspecific vocalizations. We estimate spectro-temporal receptive fields (STRFs) of IC neurons and compare tuning characteristics to statistics of bat calls. The results indicate that the FM tuning of IC neurons is matched with the statistics. Then, we investigate this hypothesis on the network optimized to represent natural sound statistics and to compare its output with biological responses. We also estimate biomimetic STRFs from the artificial network and correlate their characteristics to those of biological neurons. Tuning properties of both biological and artificial neurons reveal strong agreement along both spectral and temporal dimensions, and suggest the presence of nonlinearity, sparsity, and complexity constraints that underlie the neural representation in the auditory midbrain. Additionally, the artificial neurons replicate IC neural activities in discrimination of social calls, and provide simulated results for a noise robust discrimination. In this way, the biomimetic network allows us to infer the neural mechanisms by which the bat’s IC processes natural sounds used to construct the auditory scene.

Robustness to Noise in the Auditory System: A Distributed and Predictable Property

Background noise strongly penalizes auditory perception of speech in humans or vocalizations in animals. Despite this, auditory neurons are still able to detect communications sounds against considerable levels of background noise. We collected neuronal recordings in cochlear nucleus (CN), inferior colliculus (IC), auditory thalamus, and primary and secondary auditory cortex in response to vocalizations presented either against a stationary or a chorus noise in anesthetized guinea pigs at three signal-to-noise ratios (SNRs; −10, 0, and 10 dB). We provide evidence that, at each level of the auditory system, five behaviors in noise exist within a continuum, from neurons with high-fidelity representations of the signal, mostly found in IC and thalamus, to neurons with high-fidelity representations of the noise, mostly found in CN for the stationary noise and in similar proportions in each structure for the chorus noise. The two cortical areas displayed fewer robust responses than the IC and thalamus. Furthermore, between 21% and 72% of the neurons (depending on the structure) switch categories from one background noise to another, even if the initial assignment of these neurons to a category was confirmed by a severe bootstrap procedure. Importantly, supervised learning pointed out that assigning a recording to one of the five categories can be predicted up to a maximum of 70% based on both the response to signal alone and noise alone.

Inverted central auditory hierarchies for encoding local intervals and global temporal patterns

In sensory systems, representational features of increasing complexity emerge at successive stages of processing. In the mammalian auditory pathway, the clearest change from brainstem to cortex is defined by what is lost, not by what is gained, in that high-fidelity temporal coding becomes increasingly restricted to slower acoustic modulation rates.^1,2 Here, we explore the idea that sluggish temporal processing is more than just an inability for fast processing, but instead reflects an emergent specialization for encoding sound features that unfold on very slow timescales.^3,4 We performed simultaneous single unit ensemble recordings from three hierarchical stages of auditory processing in awake mice - the inferior colliculus (IC), medial geniculate body of the thalamus (MGB) and primary auditory cortex (A1). As expected, temporal coding of brief local intervals (0.001 - 0.1 s) separating consecutive noise bursts was robust in the IC and declined across MGB and A1. By contrast, slowly developing (∼1 s period) global rhythmic patterns of inter-burst interval sequences strongly modulated A1 spiking, were weakly captured by MGB neurons, and not at all by IC neurons. Shifts in stimulus regularity were not represented by changes in A1 spike rates, but rather in how the spikes were arranged in time. These findings show that low-level auditory neurons with fast timescales encode isolated sound features but not the longer gestalt, while the extended timescales in higher-level areas can facilitate sensitivity to slower contextual changes in the sensory environment.

A Survey on Probabilistic Models in Human Perception and Machines

Extracting information from noisy signals is of fundamental importance for both biological and artificial perceptual systems. To provide tractable solutions to this challenge, the fields of human perception and machine signal processing (SP) have developed powerful computational models, including Bayesian probabilistic models. However, little true integration between these fields exists in their applications of the probabilistic models for solving analogous problems, such as noise reduction, signal enhancement, and source separation. In this mini review, we briefly introduce and compare selective applications of probabilistic models in machine SP and human psychophysics. We focus on audio and audio-visual processing, using examples of speech enhancement, automatic speech recognition, audio-visual cue integration, source separation, and causal inference to illustrate the basic principles of the probabilistic approach. Our goal is to identify commonalities between probabilistic models addressing brain processes and those aiming at building intelligent machines. These commonalities could constitute the closest points for interdisciplinary convergence.

Complementary Effects of Adaptation and Gain Control on Sound Encoding in Primary Auditory Cortex

An important step toward understanding how the brain represents complex natural sounds is to develop accurate models of auditory coding by single neurons. A commonly used model is the linear-nonlinear spectro-temporal receptive field (STRF; LN model). The LN model accounts for many features of auditory tuning, but it cannot account for long-lasting effects of sensory context on sound-evoked activity. Two mechanisms that may support these contextual effects are short-term plasticity (STP) and contrast-dependent gain control (GC), which have inspired expanded versions of the LN model. Both models improve performance over the LN model, but they have never been compared directly. Thus, it is unclear whether they account for distinct processes or describe one phenomenon in different ways. To address this question, we recorded activity of neurons in primary auditory cortex (A1) of awake ferrets during presentation of natural sounds. We then fit models incorporating one nonlinear mechanism (GC or STP) or both (GC+STP) using this single dataset, and measured the correlation between the models' predictions and the recorded neural activity. Both the STP and GC models performed significantly better than the LN model, but the GC+STP model outperformed both individual models. We also quantified the equivalence of STP and GC model predictions and found only modest similarity. Consistent results were observed for a dataset collected in clean and noisy acoustic contexts. These results establish general methods for evaluating the equivalence of arbitrarily complex encoding models and suggest that the STP and GC models describe complementary processes in the auditory system.

Listening in complex acoustic scenes

Being able to pick out particular sounds, such as speech, against a background of other sounds represents one of the key tasks performed by the auditory system. Understanding how this happens is important because speech recognition in noise is particularly challenging for older listeners and for people with hearing impairments. Central to this ability is the capacity of neurons to adapt to the statistics of sounds reaching the ears, which helps to generate noise-tolerant representations of sounds in the brain. In more complex auditory scenes, such as a cocktail party — where the background noise comprises other voices, sound features associated with each source have to be grouped together and segregated from those belonging to other sources. This depends on precise temporal coding and modulation of cortical response properties when attending to a particular speaker in a multi-talker environment. Furthermore, the neural processing underlying auditory scene analysis is shaped by experience over multiple timescales.

Contrast gain control occurs independently of both parvalbumin-positive interneuron activity and shunting inhibition in auditory cortex

Contrast gain control is the systematic adjustment of neuronal gain in response to the contrast of sensory input. It is widely observed in sensory cortical areas and has been proposed to be a canonical neuronal computation. Here, we investigated whether shunting inhibition from parvalbumin-positive interneurons-a mechanism involved in gain control in visual cortex-also underlies contrast gain control in auditory cortex. First, we performed extracellular recordings in the auditory cortex of anesthetized male mice and optogenetically manipulated the activity of parvalbumin-positive interneurons while varying the contrast of the sensory input. We found that both activation and suppression of parvalbumin interneuron activity altered the overall gain of cortical neurons. However, despite these changes in overall gain, we found that manipulating parvalbumin interneuron activity did not alter the strength of contrast gain control in auditory cortex. Furthermore, parvalbumin-positive interneurons did not show increases in activity in response to high-contrast stimulation, which would be expected if they drive contrast gain control. Finally, we performed in vivo whole-cell recordings in auditory cortical neurons during high- and low-contrast stimulation and found that no increase in membrane conductance was observed during high-contrast stimulation. Taken together, these findings indicate that while parvalbumin-positive interneuron activity modulates the overall gain of auditory cortical responses, other mechanisms are primarily responsible for contrast gain control in this cortical area.NEW & NOTEWORTHY We investigated whether contrast gain control is mediated by shunting inhibition from parvalbumin-positive interneurons in auditory cortex. We performed extracellular and intracellular recordings in mouse auditory cortex while presenting sensory stimuli with varying contrasts and manipulated parvalbumin-positive interneuron activity using optogenetics. We show that while parvalbumin-positive interneuron activity modulates the gain of cortical responses, this activity is not the primary mechanism for contrast gain control in auditory cortex.