Context-dependent signaling of coincident auditory and visual events in primary visual cortex

Auditory cortex learns to discriminate audiovisual cues through selective multisensory enhancement

Multisensory object discrimination is essential in everyday life, yet the neural mechanisms underlying this process remain unclear. In this study, we trained rats to perform a two-alternative forced-choice task using both auditory and visual cues. Our findings reveal that multisensory perceptual learning actively engages auditory cortex (AC) neurons in both visual and audiovisual processing. Importantly, many audiovisual neurons in the AC exhibited experience-dependent associations between their visual and auditory preferences, displaying a unique integration model. This model employed selective multisensory enhancement for the auditory-visual pairing guiding the contralateral choice, which correlated with improved multisensory discrimination. Furthermore, AC neurons effectively distinguished whether a preferred auditory stimulus was paired with its associated visual stimulus using this distinct integrative mechanism. Our results highlight the capability of sensory cortices to develop sophisticated integrative strategies, adapting to task demands to enhance multisensory discrimination abilities.

Stability of cross-sensory input to primary somatosensory cortex across experience

Merging information across sensory modalities is key to forming robust percepts, yet how the brain achieves this feat remains unclear. Recent studies report cross-modal influences in the primary sensory cortex, suggesting possible multisensory integration in the early stages of cortical processing. We test several hypotheses about the function of auditory influences on mouse primary somatosensory cortex (S1) using in vivo two-photon calcium imaging. We found sound-evoked spiking activity in an extremely small fraction of cells, and this sparse activity did not encode auditory stimulus identity. Moreover, S1 did not encode information about specific audio-tactile feature conjunctions. Auditory and audio-tactile stimulus encoding remained unchanged after both passive experience and reinforcement. These results suggest that while primary sensory cortex is plastic within its own modality, the influence of other modalities is remarkably stable and stimulus nonspecific.

Parallel mechanisms signal a hierarchy of sequence structure violations in the auditory cortex

The brain predicts regularities in sensory inputs at multiple complexity levels, with neuronal mechanisms that remain elusive. Here, we monitored auditory cortex activity during the local-global paradigm, a protocol nesting different regularity levels in sound sequences. We observed that mice encode local predictions based on stimulus occurrence and stimulus transition probabilities, because auditory responses are boosted upon prediction violation. This boosting was due to both short-term adaptation and an adaptation-independent surprise mechanism resisting anesthesia. In parallel, and only in wakefulness, VIP interneurons responded to the omission of the locally expected sound repeat at the sequence ending, thus providing a chunking signal potentially useful for establishing global sequence structure. When this global structure was violated, by either shortening the sequence or ending it with a locally expected but globally unexpected sound transition, activity slightly increased in VIP and PV neurons, respectively. Hence, distinct cellular mechanisms predict different regularity levels in sound sequences.

Enhanced auditory responses in visual cortex of blind rats using intrinsic optical signal imaging

Functional maturation of the visual cortex is induced by visual experiences during critical periods. Blind animals and humans exhibit improved auditory abilities after losing their vision. Here we investigated the response of the visual cortex to white noise stimuli during the progression of photoreceptor degeneration in a rat model of blindness (Royal College of Surgeons [RCS] (rdy/rdy) rats). Optical coherence tomography of RCS (+/+) rats with normal visual function revealed normal photoreceptor cells, whereas 3-month-old RCS (rdy/rdy) rats demonstrated photoreceptor cell degeneration. Visual cortex responses (VCRs) to a single flash stimulus were negligible in 3-month-old photoreceptor-degenerated rats. However, VCRs with white noise stimuli were significantly increased in blind versus RCS rats (+/+). Slight changes in the intrinsic optical signals of the control rats were observed on the ventral side of the visual cortex. In contrast, responses were markedly increased throughout the visual cortex of RCS (rdy/rdy) rats. These results indicate that the visual cortex rapidly acquires auditory system function over the first 3 months of life and that the entire visual cortex, rather than just the portion close to the auditory cortex, responds to white noise.

Local wakefulness-like activity of layer 5 cortex under general anaesthesia

Consciousness, defined as being aware of and responsive to one's surroundings, is characteristic of normal waking life and typically is lost during sleep and general anaesthesia. The traditional view of consciousness as a global brain state has evolved toward a more sophisticated interplay between global and local states, with the presence of local sleep in the awake brain and local wakefulness in the sleeping brain. However, this interplay is not clear for general anaesthesia, where loss of consciousness was recently suggested to be associated with a global state of brain-wide synchrony that selectively involves layer 5 cortical pyramidal neurons across sensory, motor and associative areas. According to this global view, local wakefulness of layer 5 cortex should be incompatible with deep anaesthesia, a hypothesis that deserves to be scrutinised with causal manipulations. Here, we show that unilateral chemogenetic activation of layer 5 pyramidal neurons in the sensorimotor cortex of isoflurane-anaesthetised mice induces a local state transition from slow-wave activity to tonic firing in the transfected hemisphere. This wakefulness-like activity dramatically disrupts layer 5 interhemispheric synchrony with mirror-image locations in the contralateral hemisphere, but does not reduce the level of unconsciousness under deep anaesthesia, nor in the transitions to/from anaesthesia. Global layer 5 synchrony may thus be a sufficient condition for anaesthesia-induced unconsciousness, but is not a necessary one, at least under isoflurane anaesthesia. Local wakefulness-like activity of layer 5 cortex can be induced and maintained under deep anaesthesia, encouraging further investigation into the local vs. global aspects of anaesthesia-induced unconsciousness. KEY POINTS: The neural correlates of consciousness have evolved from global brain states to a nuanced interplay between global and local states, evident in terms of local sleep in awake brains and local wakefulness in sleeping brains. The concept of local wakefulness remains unclear for general anaesthesia, where the loss of consciousness has been recently suggested to involve brain-wide synchrony of layer 5 cortical neurons. We found that local wakefulness-like activity of layer 5 cortical can be chemogenetically induced in anaesthetised mice without affecting the depth of anaesthesia or the transitions to and from unconsciousness. Global layer 5 synchrony may thus be a sufficient but not necessary feature for the unconsciousness induced by general anaesthesia. Local wakefulness-like activity of layer 5 neurons is compatible with general anaesthesia, thus promoting further investigation into the local vs. global aspects of anaesthesia-induced unconsciousness.

Stability of cross-sensory input to primary somatosensory cortex across experience

Merging information from across sensory modalities is key to forming robust, disambiguated percepts of the world, yet how the brain achieves this feat remains unclear. Recent observations of cross-modal influences in primary sensory cortical areas have suggested that multisensory integration may occur in the earliest stages of cortical processing, but the role of these responses is still poorly understood. We address these questions by testing several hypotheses about the possible functions served by auditory influences on the barrel field of mouse primary somatosensory cortex (S1) using in vivo 2-photon calcium imaging. We observed sound-evoked spiking activity in a small fraction of cells overall, and moreover that this sparse activity was insufficient to encode auditory stimulus identity; few cells responded preferentially to one sound or another, and a linear classifier trained to decode auditory stimuli from population activity performed barely above chance. Moreover S1 did not encode information about specific audio-tactile feature conjunctions that we tested. Our ability to decode auditory audio-tactile stimuli from neural activity remained unchanged after both passive experience and reinforcement. Collectively, these results suggest that while a primary sensory cortex is highly plastic with regard to its own modality, the influence of other modalities are remarkably stable and play a largely stimulus-non-specific role.

Dynamic modulation of mouse thalamocortical visual activity by salient sounds

Visual responses of the primary visual cortex (V1) are altered by sound. Sound-driven behavioral arousal suggests that, in addition to direct inputs from the primary auditory cortex (A1), multiple other sources may shape V1 responses to sound. Here, we show in anesthetized mice that sound (white noise, ≥70dB) drives a biphasic modulation of V1 visually driven gamma-band activity, comprising fast-transient inhibitory and slow, prolonged excitatory (A1-independent) arousal-driven components. An analogous yet quicker modulation of the visual response also occurred earlier in the visual pathway, at the level of the dorsolateral geniculate nucleus (dLGN), where sound transiently inhibited the early phasic visual response and subsequently induced a prolonged increase in tonic spiking activity and gamma rhythmicity. Our results demonstrate that sound-driven modulations of visual activity are not exclusive to V1 and suggest that thalamocortical inputs from the dLGN to V1 contribute to shaping V1 visual response to sound.

A primary sensory cortical interareal feedforward inhibitory circuit for tacto-visual integration

Tactile sensation and vision are often both utilized for the exploration of objects that are within reach though it is not known whether or how these two distinct sensory systems combine such information. Here in mice, we used a combination of stereo photogrammetry for 3D reconstruction of the whisker array, brain-wide anatomical tracing and functional connectivity analysis to explore the possibility of tacto-visual convergence in sensory space and within the circuitry of the primary visual cortex (VISp). Strikingly, we find that stimulation of the contralateral whisker array suppresses visually evoked activity in a tacto-visual sub-region of VISp whose visual space representation closely overlaps with the whisker search space. This suppression is mediated by local fast-spiking interneurons that receive a direct cortico-cortical input predominantly from layer 6 neurons located in the posterior primary somatosensory barrel cortex (SSp-bfd). These data demonstrate functional convergence within and between two primary sensory cortical areas for multisensory object detection and recognition.

Auditory cortex conveys non-topographic sound localization signals to visual cortex

Spatiotemporally congruent sensory stimuli are fused into a unified percept. The auditory cortex (AC) sends projections to the primary visual cortex (V1), which could provide signals for binding spatially corresponding audio-visual stimuli. However, whether AC inputs in V1 encode sound location remains unknown. Using two-photon axonal calcium imaging and a speaker array, we measured the auditory spatial information transmitted from AC to layer 1 of V1. AC conveys information about the location of ipsilateral and contralateral sound sources to V1. Sound location could be accurately decoded by sampling AC axons in V1, providing a substrate for making location-specific audiovisual associations. However, AC inputs were not retinotopically arranged in V1, and audio-visual modulations of V1 neurons did not depend on the spatial congruency of the sound and light stimuli. The non-topographic sound localization signals provided by AC might allow the association of specific audiovisual spatial patterns in V1 neurons.

Rodents' visual gamma as a biomarker of pathological neural conditions

Neural gamma oscillations (indicatively 30-100 Hz) are ubiquitous: they are associated with a broad range of functions in multiple cortical areas and across many animal species. Experimental and computational works established gamma rhythms as a global emergent property of neuronal networks generated by the balanced and coordinated interaction of excitation and inhibition. Coherently, gamma activity is strongly influenced by the alterations of synaptic dynamics which are often associated with pathological neural dysfunctions. We argue therefore that these oscillations are an optimal biomarker for probing the mechanism of cortical dysfunctions. Gamma oscillations are also highly sensitive to external stimuli in sensory cortices, especially the primary visual cortex (V1), where the stimulus dependence of gamma oscillations has been thoroughly investigated. Gamma manipulation by visual stimuli tuning is particularly easy in rodents, which have become a standard animal model for investigating the effects of network alterations on gamma oscillations. Overall, gamma in the rodents' visual cortex offers an accessible probe on dysfunctional information processing in pathological conditions. Beyond vision-related dysfunctions, alterations of gamma oscillations in rodents were indeed also reported in neural deficits such as migraine, epilepsy and neurodegenerative or neuropsychiatric conditions such as Alzheimer's, schizophrenia and autism spectrum disorders. Altogether, the connections between visual cortical gamma activity and physio-pathological conditions in rodent models underscore the potential of gamma oscillations as markers of neuronal (dys)functioning.

Behavior-relevant top-down cross-modal predictions in mouse neocortex

Animals adapt to a constantly changing world by predicting their environment and the consequences of their actions. The predictive coding hypothesis proposes that the brain generates predictions and continuously compares them with sensory inputs to guide behavior. However, how the brain reconciles conflicting top-down predictions and bottom-up sensory information remains unclear. To address this question, we simultaneously imaged neuronal populations in the mouse somatosensory barrel cortex and posterior parietal cortex during an auditory-cued texture discrimination task. In mice that had learned the task with fixed tone-texture matching, the presentation of mismatched pairing induced conflicts between tone-based texture predictions and actual texture inputs. When decisions were based on the predicted rather than the actual texture, top-down information flow was dominant and texture representations in both areas were modified, whereas dominant bottom-up information flow led to correct representations and behavioral choice. Our findings provide evidence for hierarchical predictive coding in the mouse neocortex.

Layer 1 neocortex: Gating and integrating multidimensional signals

Layer 1 (L1) of the neocortex acts as a nexus for the collection and processing of widespread information. By integrating ascending inputs with extensive top-down activity, this layer likely provides critical information regulating how the perception of sensory inputs is reconciled with expectation. This is accomplished by sorting, directing, and integrating the complex network of excitatory inputs that converge onto L1. These signals are combined with neuromodulatory afferents and gated by the wealth of inhibitory interneurons that either are embedded within L1 or send axons from other cortical layers. Together, these interactions dynamically calibrate information flow throughout the neocortex. This review will primarily focus on L1 within the primary sensory cortex and will use these insights to understand L1 in other cortical areas.

Sequential maturation of stimulus-specific adaptation in the mouse lemniscal auditory system

Stimulus-specific adaptation (SSA), the reduction of neural activity to a common stimulus that does not generalize to other, rare stimuli, is an essential property of our brain. Although well characterized in adults, it is still unknown how it develops during adolescence and what neuronal circuits are involved. Using in vivo electrophysiology and optogenetics in the lemniscal pathway of the mouse auditory system, we observed SSA to be stable from postnatal day 20 (P20) in the inferior colliculus, to develop until P30 in the auditory thalamus and even later in the primary auditory cortex (A1). We found this maturation process to be experience-dependent in A1 but not in thalamus and to be related to alterations in deep but not input layers of A1. We also identified corticothalamic projections to be implicated in thalamic SSA development. Together, our results reveal different circuits underlying the sequential SSA maturation and provide a unique perspective to understand predictive coding and surprise across sensory systems.

Hypersensitivity to Distractors in Fragile X Syndrome from Loss of Modulation of Cortical VIP Interneurons

Attention deficit is one of the most prominent and disabling symptoms in Fragile X syndrome (FXS). Hypersensitivity to sensory stimuli contributes to attention difficulties by overwhelming and/or distracting affected individuals, which disrupts activities of daily living at home and learning at school. We find that auditory or visual distractors selectively impair visual discrimination performance in humans and mice with FXS but not in typically developing controls. In both species, males and females were examined. Vasoactive intestinal polypeptide (VIP) neurons were significantly modulated by incorrect responses in the poststimulus period during early distractor trials in WT mice, consistent with their known role as error signals. Strikingly, however, VIP cells from Fmr1 -/- mice showed little modulation in error trials, and this correlated with their poor performance on the distractor task. Thus, VIP interneurons and their reduced modulatory influence on pyramidal cells could be a potential therapeutic target for attentional difficulties in FXS.SIGNIFICANCE STATEMENT Sensory hypersensitivity, impulsivity, and persistent inattention are among the most consistent clinical features of FXS, all of which impede daily functioning and create barriers to learning. However, the neural mechanisms underlying sensory over-reactivity remain elusive. To overcome a significant challenge in translational FXS research we demonstrate a compelling alignment of sensory over-reactivity in both humans with FXS and Fmr1 -/- mice (the principal animal model of FXS) using a novel analogous distractor task. Two-photon microscopy in mice revealed that lack of modulation by VIP cells contributes to susceptibility to distractors. Implementing research efforts we describe here can help identify dysfunctional neural mechanisms associated not only with sensory issues but broader impairments, including those in learning and cognition.

Continuous multiplexed population representations of task context in the mouse primary visual cortex

Effective task execution requires the representation of multiple task-related variables that determine how stimuli lead to correct responses. Even the primary visual cortex (V1) represents other task-related variables such as expectations, choice, and context. However, it is unclear how V1 can flexibly accommodate these variables without interfering with visual representations. We trained mice on a context-switching cross-modal decision task, where performance depends on inferring task context. We found that the context signal that emerged in V1 was behaviorally relevant as it strongly covaried with performance, independent from movement. Importantly, this signal was integrated into V1 representation by multiplexing visual and context signals into orthogonal subspaces. In addition, auditory and choice signals were also multiplexed as these signals were orthogonal to the context representation. Thus, multiplexing allows V1 to integrate visual inputs with other sensory modalities and cognitive variables to avoid interference with the visual representation while ensuring the maintenance of task-relevant variables.

How 'visual' is the visual cortex? The interactions between the visual cortex and other sensory, motivational and motor systems as enabling factors for visual perception

The definition of the visual cortex is primarily based on the evidence that lesions of this area impair visual perception. However, this does not exclude that the visual cortex may process more information than of retinal origin alone, or that other brain structures contribute to vision. Indeed, research across the past decades has shown that non-visual information, such as neural activity related to reward expectation and value, locomotion, working memory and other sensory modalities, can modulate primary visual cortical responses to retinal inputs. Nevertheless, the function of this non-visual information is poorly understood. Here we review recent evidence, coming primarily from studies in rodents, arguing that non-visual and motor effects in visual cortex play a role in visual processing itself, for instance disentangling direct auditory effects on visual cortex from effects of sound-evoked orofacial movement. These findings are placed in a broader framework casting vision in terms of predictive processing under control of frontal, reward- and motor-related systems. In contrast to the prevalent notion that vision is exclusively constructed by the visual cortical system, we propose that visual percepts are generated by a larger network-the extended visual system-spanning other sensory cortices, supramodal areas and frontal systems. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Multimodal Temporal Pattern Discrimination Is Encoded in Visual Cortical Dynamics

Discriminating between temporal features in sensory stimuli is critical to complex behavior and decision-making. However, how sensory cortical circuit mechanisms contribute to discrimination between subsecond temporal components in sensory events is unclear. To elucidate the mechanistic underpinnings of timing in primary visual cortex (V1), we recorded from V1 using two-photon calcium imaging in awake-behaving mice performing a go/no-go discrimination timing task, which was composed of patterns of subsecond audiovisual stimuli. In both conditions, activity during the early stimulus period was temporally coordinated with the preferred stimulus. However, while network activity increased in the preferred condition, network activity was increasingly suppressed in the nonpreferred condition over the stimulus period. Multiple levels of analyses suggest that discrimination between subsecond intervals that are contained in rhythmic patterns can be accomplished by local neural dynamics in V1.

Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex

In everyday life, we integrate visual and auditory information in routine tasks such as navigation and communication. While concurrent sound can improve visual perception, the neuronal correlates of audiovisual integration are not fully understood. Specifically, it remains unclear whether neuronal firing patters in the primary visual cortex (V1) of awake animals demonstrate similar sound-induced improvement in visual discriminability. Furthermore, presentation of sound is associated with movement in the subjects, but little is understood about whether and how sound-associated movement affects audiovisual integration in V1. Here, we investigated how sound and movement interact to modulate V1 visual responses in awake, head-fixed mice and whether this interaction improves neuronal encoding of the visual stimulus. We presented visual drifting gratings with and without simultaneous auditory white noise to awake mice while recording mouse movement and V1 neuronal activity. Sound modulated activity of 80% of light-responsive neurons, with 95% of neurons increasing activity when the auditory stimulus was present. A generalized linear model (GLM) revealed that sound and movement had distinct and complementary effects of the neuronal visual responses. Furthermore, decoding of the visual stimulus from the neuronal activity was improved with sound, an effect that persisted even when controlling for movement. These results demonstrate that sound and movement modulate visual responses in complementary ways, improving neuronal representation of the visual stimulus. This study clarifies the role of movement as a potential confound in neuronal audiovisual responses and expands our knowledge of how multimodal processing is mediated at a neuronal level in the awake brain.SIGNIFICANCE STATEMENT Sound and movement are both known to modulate visual responses in the primary visual cortex; however, sound-induced movement has largely remained unaccounted for as a potential confound in audiovisual studies in awake animals. Here, authors found that sound and movement both modulate visual responses in an important visual brain area, the primary visual cortex, in distinct, yet complementary ways. Furthermore, sound improved encoding of the visual stimulus even when accounting for movement. This study reconciles contrasting theories on the mechanism underlying audiovisual integration and asserts the primary visual cortex as a key brain region participating in tripartite sensory interactions.

Behavioral origin of sound-evoked activity in mouse visual cortex

Sensory cortices can be affected by stimuli of multiple modalities and are thus increasingly thought to be multisensory. For instance, primary visual cortex (V1) is influenced not only by images but also by sounds. Here we show that the activity evoked by sounds in V1, measured with Neuropixels probes, is stereotyped across neurons and even across mice. It is independent of projections from auditory cortex and resembles activity evoked in the hippocampal formation, which receives little direct auditory input. Its low-dimensional nature starkly contrasts the high-dimensional code that V1 uses to represent images. Furthermore, this sound-evoked activity can be precisely predicted by small body movements that are elicited by each sound and are stereotyped across trials and mice. Thus, neural activity that is apparently multisensory may simply arise from low-dimensional signals associated with internal state and behavior.

Magnetoencephalography recordings reveal the neural mechanisms of auditory contributions to improved visual detection

Sounds enhance the detection of visual stimuli while concurrently biasing an observer's decisions. To investigate the neural mechanisms that underlie such multisensory interactions, we decoded time-resolved Signal Detection Theory sensitivity and criterion parameters from magneto-encephalographic recordings of participants that performed a visual detection task. We found that sounds improved visual detection sensitivity by enhancing the accumulation and maintenance of perceptual evidence over time. Meanwhile, criterion decoding analyses revealed that sounds induced brain activity patterns that resembled the patterns evoked by an actual visual stimulus. These two complementary mechanisms of audiovisual interplay differed in terms of their automaticity: Whereas the sound-induced enhancement in visual sensitivity depended on participants being actively engaged in a detection task, we found that sounds activated the visual cortex irrespective of task demands, potentially inducing visual illusory percepts. These results challenge the classical assumption that sound-induced increases in false alarms exclusively correspond to decision-level biases.

Metaplasticity framework for cross-modal synaptic plasticity in adults

Sensory loss leads to widespread adaptation of neural circuits to mediate cross-modal plasticity, which allows the organism to better utilize the remaining senses to guide behavior. While cross-modal interactions are often thought to engage multisensory areas, cross-modal plasticity is often prominently observed at the level of the primary sensory cortices. One dramatic example is from functional imaging studies in humans where cross-modal recruitment of the deprived primary sensory cortex has been observed during the processing of the spared senses. In addition, loss of a sensory modality can lead to enhancement and refinement of the spared senses, some of which have been attributed to compensatory plasticity of the spared sensory cortices. Cross-modal plasticity is not restricted to early sensory loss but is also observed in adults, which suggests that it engages or enables plasticity mechanisms available in the adult cortical circuit. Because adult cross-modal plasticity is observed without gross anatomical connectivity changes, it is thought to occur mainly through functional plasticity of pre-existing circuits. The underlying cellular and molecular mechanisms involve activity-dependent homeostatic and Hebbian mechanisms. A particularly attractive mechanism is the sliding threshold metaplasticity model because it innately allows neurons to dynamically optimize their feature selectivity. In this mini review, I will summarize the cellular and molecular mechanisms that mediate cross-modal plasticity in the adult primary sensory cortices and evaluate the metaplasticity model as an effective framework to understand the underlying mechanisms.

Hypersensitivity to distractors in Fragile X syndrome from loss of modulation of cortical VIP interneurons

Attention deficit is one of the most prominent and disabling symptoms in Fragile X Syndrome (FXS). Hypersensitivity to sensory stimuli contributes to attention difficulties by overwhelming and/or distracting affected individuals, which disrupts activities of daily living at home and learning at school. We find that auditory or visual distractors selectively impair visual discrimination performance in both humans and mice with FXS, but not their typically developing controls. Vasoactive intestinal polypeptide (VIP) neurons were significantly modulated by incorrect responses in the post-stimulus period during early distractor trials in WT mice, consistent with their known role as 'error' signals. Strikingly, however, VIP cells from Fmr1-/- mice showed little modulation in error trials, and this correlated with their poor performance on the distractor task. Thus, VIP interneurons and their reduced modulatory influence on pyramidal cells, could be a potential therapeutic target for attentional difficulties in FXS.

Probing top-down information in neocortical layer 1

Accurate perception of the environment is a constructive process that requires integration of external bottom-up sensory signals with internally generated top-down information. Decades of work have elucidated how sensory neocortex processes physical stimulus features. By contrast, examining how top-down information is encoded and integrated with bottom-up signals has been challenging using traditional neuroscience methods. Recent technological advances in functional imaging of brain-wide afferents in behaving mice have enabled the direct measurement of top-down information. Here, we review the emerging literature on encoding of these internally generated signals by different projection systems enriched in neocortical layer 1 during defined brain functions, including memory, attention, and predictive coding. Moreover, we identify gaps in current knowledge and highlight future directions for this rapidly advancing field.

Hierarchical unimodal processing within the primary somatosensory cortex during a bimodal detection task

Do sensory cortices process more than one sensory modality? To answer these questions, scientists have generated a wide variety of studies at distinct space-time scales in different animal models, and often shown contradictory conclusions. Some conclude that this process occurs in early sensory cortices, but others that this occurs in areas central to sensory cortices. Here, we sought to determine whether sensory neurons process and encode physical stimulus properties of different modalities (tactile and acoustic). For this, we designed a bimodal detection task where the senses of touch and hearing compete from trial to trial. Two Rhesus monkeys performed this novel task, while neural activity was recorded in areas 3b and 1 of the primary somatosensory cortex (S1). We analyzed neurons' coding properties and variability, organizing them by their receptive field's position relative to the stimulation zone. Our results indicate that neurons of areas 3b and 1 are unimodal, encoding only the tactile modality in both the firing rate and variability. Moreover, we found that neurons in area 3b carried more information about the periodic stimulus structure than those in area 1, possessed lower response and coding latencies, and had a lower intrinsic time scale. In sum, these differences reveal a hidden processing-based hierarchy. Finally, using a powerful nonlinear dimensionality reduction algorithm, we show that the activity from areas 3b and 1 can be separated, establishing a clear division in the functionality of these two subareas of S1.

Repetitive nociceptive stimulation increases spontaneous neural activation similar to nociception-induced activity in mouse insular cortex

Recent noninvasive neuroimaging technology has revealed that spatiotemporal patterns of cortical spontaneous activity observed in chronic pain patients are different from those in healthy subjects, suggesting that the spontaneous cortical activity plays a key role in the induction and/or maintenance of chronic pain. However, the mechanisms of the spontaneously emerging activities supposed to be induced by nociceptive inputs remain to be established. In the present study, we investigated spontaneous cortical activities in sessions before and after electrical stimulation of the periodontal ligament (PDL) by applying wide-field and two-photon calcium imaging to anesthetized GCaMP6s transgenic mice. First, we identified the sequential cortical activation patterns from the primary somatosensory and secondary somatosensory cortices to the insular cortex (IC) by PDL stimulation. We, then found that spontaneous IC activities that exhibited a similar spatiotemporal cortical pattern to evoked activities by PDL stimulation increased in the session after repetitive PDL stimulation. At the single-cell level, repetitive PDL stimulation augmented the synchronous neuronal activity. These results suggest that cortical plasticity induced by the repetitive stimulation leads to the frequent PDL stimulation-evoked-like spontaneous IC activation. This nociception-induced spontaneous activity in IC may be a part of mechanisms that induces chronic pain.

Olfactory modulation of barrel cortex activity during active whisking and passive whisker stimulation

Rodents depend on olfaction and touch to meet many of their fundamental needs. However, the impact of simultaneous olfactory and tactile inputs on sensory representations in the cortex remains elusive. To study these interactions, we recorded large populations of barrel cortex neurons using 2-photon calcium imaging in head-fixed mice during olfactory and tactile stimulation. Here we show that odors bidirectionally alter activity in a small but significant population of barrel cortex neurons through at least two mechanisms, first by enhancing whisking, and second by a central mechanism that persists after whisking is abolished by facial nerve sectioning. Odor responses have little impact on tactile information, and they are sufficient for decoding odor identity, while behavioral parameters like whisking, sniffing, and facial movements are not odor identity-specific. Thus, barrel cortex activity encodes specific olfactory information that is not linked with odor-induced changes in behavior.

Rodents use both touch and smell to get around. This work describes how olfactory information is combined with touch perception in the cortex to guide behavior.

Existing function in primary visual cortex is not perturbed by new skill acquisition of a non-matched sensory task

Acquisition of new skills has the potential to disturb existing network function. To directly assess whether previously acquired cortical function is altered during learning, mice were trained in an abstract task in which selected activity patterns were rewarded using an optical brain-computer interface device coupled to primary visual cortex (V1) neurons. Excitatory neurons were longitudinally recorded using 2-photon calcium imaging. Despite significant changes in local neural activity during task performance, tuning properties and stimulus encoding assessed outside of the trained context were not perturbed. Similarly, stimulus tuning was stable in neurons that remained responsive following a different, visual discrimination training task. However, visual discrimination training increased the rate of representational drift. Our results indicate that while some forms of perceptual learning may modify the contribution of individual neurons to stimulus encoding, new skill learning is not inherently disruptive to the quality of stimulus representation in adult V1.

Estimating How Sounds Modulate Orientation Representation in the Primary Visual Cortex Using Shallow Neural Networks

Audiovisual perception results from the interaction between visual and auditory processing. Hence, presenting auditory and visual inputs simultaneously usually improves the accuracy of the unimodal percepts, but can also lead to audiovisual illusions. Cross-talks between visual and auditory inputs during sensory processing were recently shown to occur as early as in the primary visual cortex (V1). In a previous study, we demonstrated that sounds improve the representation of the orientation of visual stimuli in the naïve mouse V1 by promoting the recruitment of neurons better tuned to the orientation and direction of the visual stimulus. However, we did not test if this type of modulation was still present when the auditory and visual stimuli were both behaviorally relevant. To determine the effect of sounds on active visual processing, we performed calcium imaging in V1 while mice were performing an audiovisual task. We then compared the representations of the task stimuli orientations in the unimodal visual and audiovisual context using shallow neural networks (SNNs). SNNs were chosen because of the biological plausibility of their computational structure and the possibility of identifying post hoc the biological neurons having the strongest influence on the classification decision. We first showed that SNNs can categorize the activity of V1 neurons evoked by drifting gratings of 12 different orientations. Then, we demonstrated using the connection weight approach that SNN training assigns the largest computational weight to the V1 neurons having the best orientation and direction selectivity. Finally, we showed that it is possible to use SNNs to determine how V1 neurons represent the orientations of stimuli that do not belong to the set of orientations used for SNN training. Once the SNN approach was established, we replicated the previous finding that sounds improve orientation representation in the V1 of naïve mice. Then, we showed that, in mice performing an audiovisual detection task, task tones improve the representation of the visual cues associated with the reward while deteriorating the representation of non-rewarded cues. Altogether, our results suggest that the direction of sound modulation in V1 depends on the behavioral relevance of the visual cue.

Visual cortex responds to sound onset and offset during passive listening

Sounds enhance our ability to detect, localize, and respond to co-occurring visual targets. Research suggests that sounds improve visual processing by resetting the phase of ongoing oscillations in visual cortex. However, it remains unclear what information is relayed from the auditory system to visual areas and if sounds modulate visual activity even in the absence of visual stimuli (e.g., during passive listening). Using intracranial electroencephalography (iEEG) in humans, we examined the sensitivity of visual cortex to three forms of auditory information during a passive listening task: auditory onset responses, auditory offset responses, and rhythmic entrainment to sounds. Because some auditory neurons respond to both sound onsets and offsets, visual timing and duration processing may benefit from each. Additionally, if auditory entrainment information is relayed to visual cortex, it could support the processing of complex stimulus dynamics that are aligned between auditory and visual stimuli. Results demonstrate that in visual cortex, amplitude-modulated sounds elicited transient onset and offset responses in multiple areas, but no entrainment to sound modulation frequencies. These findings suggest that activity in visual cortex (as measured with iEEG in response to auditory stimuli) may not be affected by temporally fine-grained auditory stimulus dynamics during passive listening (though it remains possible that this signal may be observable with simultaneous auditory-visual stimuli). Moreover, auditory responses were maximal in low-level visual cortex, potentially implicating a direct pathway for rapid interactions between auditory and visual cortices. This mechanism may facilitate perception by time-locking visual computations to environmental events marked by auditory discontinuities.

A silent two-photon imaging system for studying in vivo auditory neuronal functions

Two-photon laser-scanning microscopy has become an essential tool for imaging neuronal functions in vivo and has been applied to different parts of the neural system, including the auditory system. However, many components of a two-photon microscope, such as galvanometer-based laser scanners, generate mechanical vibrations and thus acoustic artifacts, making it difficult to interpret auditory responses from recorded neurons. Here, we report the development of a silent two-photon imaging system and its applications in the common marmoset (Callithrix Jacchus), a non-human primate species sharing a similar hearing range with humans. By utilizing an orthogonal pair of acousto-optical deflectors (AODs), full-frame raster scanning at video rate was achieved without introducing mechanical vibrations. Imaging depth can be optically controlled by adjusting the chirping speed on the AODs without any mechanical motion along the Z-axis. Furthermore, all other sound-generating components of the system were acoustically isolated, leaving the noise floor of the working system below the marmoset's hearing threshold. Imaging with the system in awake marmosets revealed many auditory cortex neurons that exhibited maximal responses at low sound levels, which were not possible to study using traditional two-photon imaging systems. This is the first demonstration of a silent two-photon imaging system that is capable of imaging auditory neuronal functions in vivo without acoustic artifacts. This capacity opens new opportunities for a better understanding of auditory functions in the brain and helps isolate animal behavior from microscope-generated acoustic interference.

A cortical circuit for audio-visual predictions

Learned associations between stimuli in different sensory modalities can shape the way we perceive these stimuli. However, it is not well understood how these interactions are mediated or at what level of the processing hierarchy they occur. Here we describe a neural mechanism by which an auditory input can shape visual representations of behaviorally relevant stimuli through direct interactions between auditory and visual cortices in mice. We show that the association of an auditory stimulus with a visual stimulus in a behaviorally relevant context leads to experience-dependent suppression of visual responses in primary visual cortex (V1). Auditory cortex axons carry a mixture of auditory and retinotopically matched visual input to V1, and optogenetic stimulation of these axons selectively suppresses V1 neurons that are responsive to the associated visual stimulus after, but not before, learning. Our results suggest that cross-modal associations can be communicated by long-range cortical connections and that, with learning, these cross-modal connections function to suppress responses to predictable input.

Task-induced modulations of neuronal activity along the auditory pathway

Sensory processing varies depending on behavioral context. Here, we ask how task engagement modulates neurons in the auditory system. We train mice in a simple tone-detection task and compare their neuronal activity during passive hearing and active listening. Electrophysiological extracellular recordings in the inferior colliculus, medial geniculate body, primary auditory cortex, and anterior auditory field reveal widespread modulations across all regions and cortical layers and in both putative regular- and fast-spiking cortical neurons. Clustering analysis unveils ten distinct modulation patterns that can either enhance or suppress neuronal activity. Task engagement changes the tone-onset response in most neurons. Such modulations first emerge in subcortical areas, ruling out cortical feedback as the only mechanism underlying subcortical modulations. Half the neurons additionally display late modulations associated with licking, arousal, or reward. Our results reveal the presence of functionally distinct subclasses of neurons, differentially sensitive to specific task-related variables but anatomically distributed along the auditory pathway.

Apical amplification-a cellular mechanism of conscious perception?

We present a theoretical view of the cellular foundations for network-level processes involved in producing our conscious experience. Inputs to apical synapses in layer 1 of a large subset of neocortical cells are summed at an integration zone near the top of their apical trunk. These inputs come from diverse sources and provide a context within which the transmission of information abstracted from sensory input to their basal and perisomatic synapses can be amplified when relevant. We argue that apical amplification enables conscious perceptual experience and makes it more flexible, and thus more adaptive, by being sensitive to context. Apical amplification provides a possible mechanism for recurrent processing theory that avoids strong loops. It makes the broadcasting hypothesized by global neuronal workspace theories feasible while preserving the distinct contributions of the individual cells receiving the broadcast. It also provides mechanisms that contribute to the holistic aspects of integrated information theory. As apical amplification is highly dependent on cholinergic, aminergic, and other neuromodulators, it relates the specific contents of conscious experience to global mental states and to fluctuations in arousal when awake. We conclude that apical dendrites provide a cellular mechanism for the context-sensitive selective amplification that is a cardinal prerequisite of conscious perception.

Visual and auditory brain areas share a representational structure that supports emotion perception

Emotionally expressive music and dance occur together across the world. This may be because features shared across the senses are represented the same way even in different sensory brain areas, putting music and movement in directly comparable terms. These shared representations may arise from a general need to identify environmentally relevant combinations of sensory features, particularly those that communicate emotion. To test the hypothesis that visual and auditory brain areas share a representational structure, we created music and animation stimuli with crossmodally matched features expressing a range of emotions. Participants confirmed that each emotion corresponded to a set of features shared across music and movement. A subset of participants viewed both music and animation during brain scanning, revealing that representations in auditory and visual brain areas were similar to one another. This shared representation captured not only simple stimulus features but also combinations of features associated with emotion judgments. The posterior superior temporal cortex represented both music and movement using this same structure, suggesting supramodal abstraction of sensory content. Further exploratory analysis revealed that early visual cortex used this shared representational structure even when stimuli were presented auditorily. We propose that crossmodally shared representations support mutually reinforcing dynamics across auditory and visual brain areas, facilitating crossmodal comparison. These shared representations may help explain why emotions are so readily perceived and why some dynamic emotional expressions can generalize across cultural contexts.

Neuroplasticity and Crossmodal Connectivity in the Normal, Healthy Brain

Objective

Neuroplasticity enables the brain to establish new crossmodal connections or reorganize old connections which are essential to perceiving a multisensorial world. The intent of this review is to identify and summarize the current developments in neuroplasticity and crossmodal connectivity, and deepen understanding of how crossmodal connectivity develops in the normal, healthy brain, highlighting novel perspectives about the principles that guide this connectivity.

Methods

To the above end, a narrative review is carried out. The data documented in prior relevant studies in neuroscience, psychology and other related fields available in a wide range of prominent electronic databases are critically assessed, synthesized, interpreted with qualitative rather than quantitative elements, and linked together to form new propositions and hypotheses about neuroplasticity and crossmodal connectivity.

Results

Three major themes are identified. First, it appears that neuroplasticity operates by following eight fundamental principles and crossmodal integration operates by following three principles. Second, two different forms of crossmodal connectivity, namely direct crossmodal connectivity and indirect crossmodal connectivity, are suggested to operate in both unisensory and multisensory perception. Third, three principles possibly guide the development of crossmodal connectivity into adulthood. These are labeled as the principle of innate crossmodality, the principle of evolution-driven 'neuromodular' reorganization and the principle of multimodal experience. These principles are combined to develop a three-factor interaction model of crossmodal connectivity.

Conclusions

The hypothesized principles and the proposed model together advance understanding of neuroplasticity, the nature of crossmodal connectivity, and how such connectivity develops in the normal, healthy brain.

Multisensory-Guided Associative Learning Enhances Multisensory Representation in Primary Auditory Cortex

Sensory cortices, classically considered to represent modality-specific sensory information, are also found to engage in multisensory processing. However, how sensory processing in sensory cortices is cross-modally modulated remains an open question. Specifically, we understand little of cross-modal representation in sensory cortices in perceptual tasks and how perceptual learning modifies this process. Here, we recorded neural responses in primary auditory cortex (A1) both while freely moving rats discriminated stimuli in Go/No-Go tasks and when anesthetized. Our data show that cross-modal representation in auditory cortices varies with task contexts. In the task of an audiovisual cue being the target associating with water reward, a significantly higher proportion of auditory neurons showed a visually evoked response. The vast majority of auditory neurons, if processing auditory-visual interactions, exhibit significant multisensory enhancement. However, when the rats performed tasks with unisensory cues being the target, cross-modal inhibition, rather than enhancement, predominated. In addition, multisensory associational learning appeared to leave a trace of plastic change in A1, as a larger proportion of A1 neurons showed multisensory enhancement in anesthesia. These findings indicate that multisensory processing in principle sensory cortices is not static, and having cross-modal interaction in the task requirement can substantially enhance multisensory processing in sensory cortices.

Cortical and Subcortical Circuits for Cross-Modal Plasticity Induced by Loss of Vision

Cortical areas are highly interconnected both via cortical and subcortical pathways, and primary sensory cortices are not isolated from this general structure. In primary sensory cortical areas, these pre-existing functional connections serve to provide contextual information for sensory processing and can mediate adaptation when a sensory modality is lost. Cross-modal plasticity in broad terms refers to widespread plasticity across the brain in response to losing a sensory modality, and largely involves two distinct changes: cross-modal recruitment and compensatory plasticity. The former involves recruitment of the deprived sensory area, which includes the deprived primary sensory cortex, for processing the remaining senses. Compensatory plasticity refers to plasticity in the remaining sensory areas, including the spared primary sensory cortices, to enhance the processing of its own sensory inputs. Here, we will summarize potential cellular plasticity mechanisms involved in cross-modal recruitment and compensatory plasticity, and review cortical and subcortical circuits to the primary sensory cortices which can mediate cross-modal plasticity upon loss of vision.

Neural Correlates of Multisensory Detection Behavior: Comparison of Primary and Higher-Order Visual Cortex

We act upon stimuli in our surrounding environment by gathering the multisensory information they convey and by integrating this information to decide on a behavioral action. We hypothesized that the anterolateral secondary visual cortex (area AL) of the mouse brain may serve as a hub for sensorimotor transformation of audiovisual information. We imaged neuronal activity in primary visual cortex (V1) and AL of the mouse during a detection task using visual, auditory, and audiovisual stimuli. We found that AL neurons were more sensitive to weak uni- and multisensory stimuli compared to V1. Depending on contrast, different subsets of AL and V1 neurons showed cross-modal modulation of visual responses. During audiovisual stimulation, AL neurons showed stronger differentiation of behaviorally reported versus unreported stimuli compared to V1, whereas V1 showed this distinction during unisensory visual stimulation. Thus, neural population activity in area AL correlates more closely with multisensory detection behavior than V1.

Robustness to Noise in the Auditory System: A Distributed and Predictable Property

Background noise strongly penalizes auditory perception of speech in humans or vocalizations in animals. Despite this, auditory neurons are still able to detect communications sounds against considerable levels of background noise. We collected neuronal recordings in cochlear nucleus (CN), inferior colliculus (IC), auditory thalamus, and primary and secondary auditory cortex in response to vocalizations presented either against a stationary or a chorus noise in anesthetized guinea pigs at three signal-to-noise ratios (SNRs; −10, 0, and 10 dB). We provide evidence that, at each level of the auditory system, five behaviors in noise exist within a continuum, from neurons with high-fidelity representations of the signal, mostly found in IC and thalamus, to neurons with high-fidelity representations of the noise, mostly found in CN for the stationary noise and in similar proportions in each structure for the chorus noise. The two cortical areas displayed fewer robust responses than the IC and thalamus. Furthermore, between 21% and 72% of the neurons (depending on the structure) switch categories from one background noise to another, even if the initial assignment of these neurons to a category was confirmed by a severe bootstrap procedure. Importantly, supervised learning pointed out that assigning a recording to one of the five categories can be predicted up to a maximum of 70% based on both the response to signal alone and noise alone.

Head Movements Control the Activity of Primary Visual Cortex in a Luminance-Dependent Manner

The vestibular system broadcasts head-movement-related signals to sensory areas throughout the brain, including visual cortex. These signals are crucial for the brain's ability to assess whether motion of the visual scene results from the animal's head movements. However, how head movements affect visual cortical circuits remains poorly understood. Here, we discover that ambient luminance profoundly transforms how mouse primary visual cortex (V1) processes head movements. While in darkness, head movements result in overall suppression of neuronal activity; in ambient light, the same head movements trigger excitation across all cortical layers. This light-dependent switch in how V1 processes head movements is controlled by somatostatin-expressing (SOM) inhibitory neurons, which are excited by head movements in dark, but not in light. This study thus reveals a light-dependent switch in the response of V1 to head movements and identifies a circuit in which SOM cells are key integrators of vestibular and luminance signals.

Synaptic inhibition in the neocortex: Orchestration and computation through canonical circuits and variations on the theme

The neocortex plays a crucial role in all basic and abstract cognitive functions. Conscious mental processes are achieved through a correct flow of information within and across neocortical networks, whose particular activity state results from a tight balance between excitation and inhibition. The proper equilibrium between these indissoluble forces is operated with multiscale organization: along the dendro-somatic axis of single neurons and at the network level. Fast synaptic inhibition is assured by a multitude of inhibitory interneurons. During cortical activities, these cells operate a finely tuned division of labor that is epitomized by their detailed connectivity scheme. Recent results combining the use of mouse genetics, cutting-edge optical and neurophysiological approaches have highlighted the role of fast synaptic inhibition in driving cognition-related activity through a canonical cortical circuit, involving several major interneuron subtypes and principal neurons. Here we detail the organization of this cortical blueprint and we highlight the crucial role played by different neuron types in fundamental cortical computations. In addition, we argue that this canonical circuit is prone to many variations on the theme, depending on the resolution of the classification of neuronal types, and the cortical area investigated. Finally, we discuss how specific alterations of distinct inhibitory circuits can underlie several devastating brain diseases.

Sensory Island Task (SIT): A New Behavioral Paradigm to Study Sensory Perception and Neural Processing in Freely Moving Animals

A central function of sensory systems is the gathering of information about dynamic interactions with the environment during self-motion. To determine whether modulation of a sensory cue was externally caused or a result of self-motion is fundamental to perceptual invariance and requires the continuous update of sensory processing about recent movements. This process is highly context-dependent and crucial for perceptual performances such as decision-making and sensory object formation. Yet despite its fundamental ecological role, voluntary self-motion is rarely incorporated in perceptual or neurophysiological investigations of sensory processing in animals. Here, we present the Sensory Island Task (SIT), a new freely moving search paradigm to study sensory processing and perception. In SIT, animals explore an open-field arena to find a sensory target relying solely on changes in the presented stimulus, which is controlled by closed-loop position tracking in real-time. Within a few sessions, animals are trained via positive reinforcement to search for a particular area in the arena (“target island”), which triggers the presentation of the target stimulus. The location of the target island is randomized across trials, making the modulated stimulus feature the only informative cue for task completion. Animals report detection of the target stimulus by remaining within the island for a defined time (“sit-time”). Multiple “non-target” islands can be incorporated to test psychometric discrimination and identification performance. We exemplify the suitability of SIT for rodents (Mongolian gerbil, Meriones unguiculatus) and small primates (mouse lemur, Microcebus murinus) and for studying various sensory perceptual performances (auditory frequency discrimination, sound source localization, visual orientation discrimination). Furthermore, we show that pairing SIT with chronic electrophysiological recordings allows revealing neuronal signatures of sensory processing under ecologically relevant conditions during goal-oriented behavior. In conclusion, SIT represents a flexible and easily implementable behavioral paradigm for mammals that combines self-motion and natural exploratory behavior to study sensory sensitivity and decision-making and their underlying neuronal processing.

Approaches to Understanding Multisensory Dysfunction in Autism Spectrum Disorder

Abnormal sensory responses are a DSM-5 symptom of autism spectrum disorder (ASD), and research findings demonstrate altered sensory processing in ASD. Beyond difficulties with processing information within single sensory domains, including both hypersensitivity and hyposensitivity, difficulties in multisensory processing are becoming a core issue of focus in ASD. These difficulties may be targeted by treatment approaches such as "sensory integration," which is frequently applied in autism treatment but not yet based on clear evidence. Recently, psychophysical data have emerged to demonstrate multisensory deficits in some children with ASD. Unlike deficits in social communication, which are best understood in humans, sensory and multisensory changes offer a tractable marker of circuit dysfunction that is more easily translated into animal model systems to probe the underlying neurobiological mechanisms. Paralleling experimental paradigms that were previously applied in humans and larger mammals, we and others have demonstrated that multisensory function can also be examined behaviorally in rodents. Here, we review the sensory and multisensory difficulties commonly found in ASD, examining laboratory findings that relate these findings across species. Next, we discuss the known neurobiology of multisensory integration, drawing largely on experimental work in larger mammals, and extensions of these paradigms into rodents. Finally, we describe emerging investigations into multisensory processing in genetic mouse models related to autism risk. By detailing findings from humans to mice, we highlight the advantage of multisensory paradigms that can be easily translated across species, as well as the potential for rodent experimental systems to reveal opportunities for novel treatments. LAY SUMMARY: Sensory and multisensory deficits are commonly found in ASD and may result in cascading effects that impact social communication. By using similar experiments to those in humans, we discuss how studies in animal models may allow an understanding of the brain mechanisms that underlie difficulties in multisensory integration, with the ultimate goal of developing new treatments. Autism Res 2020, 13: 1430-1449. © 2020 International Society for Autism Research, Wiley Periodicals, Inc.

Inhibitory plasticity in layer 1 - dynamic gatekeeper of neocortical associations

Neocortical layer 1 is a major site of convergence for a variety of brain wide afferents carrying experience-dependent top-down information, which are integrated and processed in the apical tuft dendrites of pyramidal cells. Two types of local inhibitory interneurons, Martinotti cells and layer 1 interneurons, dominantly shape dendritic integration, and work from recent years has significantly advanced our understanding of the role of these interneurons in circuit plasticity and learning. Both cell types instruct plasticity in local pyramidal cells, and are themselves subject to robust plastic changes. Despite these similarities, the emerging hypothesis is that they fulfill different, and potentially opposite roles, as they receive different inputs, employ distinct inhibitory dynamics and are implicated in different behavioral contexts.

Resolving multisensory and attentional influences across cortical depth in sensory cortices

In our environment, our senses are bombarded with a myriad of signals, only a subset of which is relevant for our goals. Using sub-millimeter-resolution fMRI at 7T, we resolved BOLD-response and activation patterns across cortical depth in early sensory cortices to auditory, visual and audiovisual stimuli under auditory or visual attention. In visual cortices, auditory stimulation induced widespread inhibition irrespective of attention, whereas auditory relative to visual attention suppressed mainly central visual field representations. In auditory cortices, visual stimulation suppressed activations, but amplified responses to concurrent auditory stimuli, in a patchy topography. Critically, multisensory interactions in auditory cortices were stronger in deeper laminae, while attentional influences were greatest at the surface. These distinct depth-dependent profiles suggest that multisensory and attentional mechanisms regulate sensory processing via partly distinct circuitries. Our findings are crucial for understanding how the brain regulates information flow across senses to interact with our complex multisensory world.

The Visual Cortex in Context

In this article, we review the anatomical inputs and outputs to the mouse primary visual cortex, area V1. Our survey of data from the Allen Institute Mouse Connectivity project indicates that mouse V1 is highly interconnected with both cortical and subcortical brain areas. This pattern of innervation allows for computations that depend on the state of the animal and on behavioral goals, which contrasts with simple feedforward, hierarchical models of visual processing. Thus, to have an accurate description of the function of V1 during mouse behavior, its involvement with the rest of the brain circuitry has to be considered. Finally, it remains an open question whether the primary visual cortex of higher mammals displays the same degree of sensorimotor integration in the early visual system.