The sifting of visual information in the superior colliculus

Tangential high-density electrode insertions allow to simultaneously measure neuronal activity across an extended region of the visual field in mouse superior colliculus

BACKGROUND

The superior colliculus (SC) is a midbrain structure that plays a central role in visual processing. Although we have learned a considerable amount about the function of single SC neurons, the way in which sensory information is represented and processed on the population level in awake behaving animals and across a large region of the retinotopic map is still largely unknown. Partially because the SC is anatomically located below the cortical sheet and the transverse sinus, which render the measure of neuronal activity from a large population of neurons in the SC technically difficult to perform.

NEW METHOD

To address this, we propose a tangential recording configuration using high-density electrode probes (Neuropixels) in mouse SC in vivo. This method permits a large number of recording sites (~200) inside the SC circuitry allowing to record from a large population of SC neurons along a vast area of retinotopic space.

RESULTS

This approach provides a unique opportunity to measure the activity of SC neuronal populations over up to ~2mm of SC tissue reporting for the first time the continuous receptive fields coverage of almost the entire SC retinotopy. Here we describe how to perform targeted tangential recordings along the anterior-posterior and the medio-lateral axis of the mouse SC in vivo in the upper visual layers. Furthermore, we describe how to combine this approach with optogenetic tools for cell-type identification on the population level.

COMPARISON WITH EXISTING METHODS

Vertical insertion has been a standard way to record visual responses in the SC. Inserting multi-shank probes vertically allows to cover a larger region of the SC but misses both the complete extent of the available retinotopy and the continuous measure allowed by the high density of recording sites on Neuropixels probes.

CONCLUSION

Altogether tangential insertions in the upper visual layers of the mouse SC using Neuropixels permit for the first time to access a majority of the retinotopically organized visual representation of the world at an unprecedented precision.

Functional Organisation of the Mouse Superior Colliculus

The superior colliculus (SC) is a highly conserved area of the mammalian midbrain that is widely implicated in the organisation and control of behaviour. SC receives input from a large number of brain areas, and provides outputs to a large number of areas. The convergence and divergence of anatomical connections with different areas and systems provides challenges for understanding how SC contributes to behaviour. Recent work in mouse has provided large anatomical datasets, and a wealth of new data from experiments that identify and manipulate different cells within SC, and their inputs and outputs, during simple behaviours. These data offer an opportunity to better understand the roles that SC plays in these behaviours. However, some of the observations appear, at first sight, to be contradictory. Here we review this recent work and hypothesise a simple framework which can capture the observations, that requires only a small change to previous models. Specifically, the functional organisation of SC can be explained by supposing that three largely distinct circuits support three largely distinct classes of simple behaviours-arrest, turning towards, and the triggering of escape or capture. These behaviours are hypothesised to be supported by the optic, intermediate and deep layers, respectively.

The Superior Colliculus: Cell Types, Connectivity, and Behavior

The superior colliculus (SC), one of the most well-characterized midbrain sensorimotor structures where visual, auditory, and somatosensory information are integrated to initiate motor commands, is highly conserved across vertebrate evolution. Moreover, cell-type-specific SC neurons integrate afferent signals within local networks to generate defined output related to innate and cognitive behaviors. This review focuses on the recent progress in understanding of phenotypic diversity amongst SC neurons and their intrinsic circuits and long-projection targets. We further describe relevant neural circuits and specific cell types in relation to behavioral outputs and cognitive functions. The systematic delineation of SC organization, cell types, and neural connections is further put into context across species as these depend upon laminar architecture. Moreover, we focus on SC neural circuitry involving saccadic eye movement, and cognitive and innate behaviors. Overall, the review provides insight into SC functioning and represents a basis for further understanding of the pathology associated with SC dysfunction.

A unified model of the task-evoked pupil response

The pupil dilates and reconstricts following task events. It is popular to model this task-evoked pupil response as a linear transformation of event-locked impulses, whose amplitudes are used as estimates of arousal. We show that this model is incorrect and propose an alternative model based on the physiological finding that a common neural input drives saccades and pupil size. The estimates of arousal from our model agreed with key predictions: Arousal scaled with task difficulty and behavioral performance but was invariant to small differences in trial duration. Moreover, the model offers a unified explanation for a wide range of phenomena: entrainment of pupil size and saccades to task timing, modulation of pupil response amplitude and noise with task difficulty, reaction time-dependent modulation of pupil response timing and amplitude, a constrictory pupil response time-locked to saccades, and task-dependent distortion of this saccade-locked pupil response.

Feature Detection by Retinal Ganglion Cells

Retinal circuits transform the pixel representation of photoreceptors into the feature representations of ganglion cells, whose axons transmit these representations to the brain. Functional, morphological, and transcriptomic surveys have identified more than 40 retinal ganglion cell (RGC) types in mice. RGCs extract features of varying complexity; some simply signal local differences in brightness (i.e., luminance contrast), whereas others detect specific motion trajectories. To understand the retina, we need to know how retinal circuits give rise to the diverse RGC feature representations. A catalog of the RGC feature set, in turn, is fundamental to understanding visual processing in the brain. Anterograde tracing indicates that RGCs innervate more than 50 areas in the mouse brain. Current maps connecting RGC types to brain areas are rudimentary, as is our understanding of how retinal signals are transformed downstream to guide behavior. In this article, I review the feature selectivities of mouse RGCs, how they arise, and how they are utilized downstream. Not only is knowledge of the behavioral purpose of RGC signals critical for understanding the retinal contributions to vision; it can also guide us to the most relevant areas of visual feature space. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Brain-wide mapping of inputs to the mouse lateral posterior (LP/Pulvinar) thalamus-anterior cingulate cortex network

The rodent homolog of the primate pulvinar, the lateral posterior (LP) thalamus, is extensively interconnected with multiple cortical areas. While these cortical interactions can span the entire LP, subdivisions of the LP are characterized by differential connections with specific cortical regions. In particular, the medial LP has reciprocal connections with frontoparietal cortical areas, including the anterior cingulate cortex (ACC). The ACC plays an integral role in top‐down sensory processing and attentional regulation, likely exerting some of these functions via the LP. However, little is known about how ACC and LP interact, and about the information potentially integrated in this reciprocal network. Here, we address this gap by employing a projection‐specific monosynaptic rabies tracing strategy to delineate brain‐wide inputs to bottom‐up LP→ACC and top‐down ACC→LP neurons. We find that LP→ACC neurons receive inputs from widespread cortical regions, including primary and higher order sensory and motor cortical areas. LP→ACC neurons also receive extensive subcortical inputs, particularly from the intermediate and deep layers of the superior colliculus (SC). Sensory inputs to ACC→LP neurons largely arise from visual cortical areas. In addition, ACC→LP neurons integrate cross‐hemispheric prefrontal cortex inputs as well as inputs from higher order medial cortex. Our brain‐wide anatomical mapping of inputs to the reciprocal LP‐ACC pathways provides a roadmap for understanding how LP and ACC communicate different sources of information to mediate attentional control and visuomotor functions.

Neuronal modulation in the mouse superior colliculus during covert visual selective attention

Covert visual attention is accomplished by a cascade of mechanisms distributed across multiple brain regions. Visual cortex is associated with enhanced representations of relevant stimulus features, whereas the contributions of subcortical circuits are less well understood but have been associated with selection of relevant spatial locations and suppression of distracting stimuli. As a step toward understanding these subcortical circuits, here we identified how neuronal activity in the intermediate layers of the superior colliculus (SC) of head-fixed mice is modulated during covert visual attention. We found that spatial cues modulated both firing rate and spike-count correlations. Crucially, the cue-related modulation in firing rate was due to enhancement of activity at the cued spatial location rather than suppression at the uncued location, indicating that SC neurons in our task were modulated by an excitatory or disinhibitory circuit mechanism focused on the relevant location, rather than broad inhibition of irrelevant locations. This modulation improved the neuronal discriminability of visual-change-evoked activity, but only when assessed for neuronal activity between the contralateral and ipsilateral SC. Together, our findings indicate that neurons in the mouse SC can contribute to covert visual selective attention by biasing processing in favor of locations expected to contain task-relevant information.

Stimulus-driven visual attention in mice

In primates, stimulus-driven changes in visual attention can facilitate or hinder perceptual performance, depending on the location and timing of the stimulus event. Mice have emerged as a powerful model for studying visual circuits and behavior; however, it is unclear whether mice show similar interactions between stimulus events and visual attention during perceptual decisions. To investigate this, we trained head-fixed mice to detect a near-threshold change in visual orientation and tested how performance was altered by task-irrelevant stimuli that occurred at different times and locations with respect to the orientation change. We found that task-irrelevant stimuli strongly affected mouse performance. Specifically, stimulus-driven attention in mice followed a similar time course as that in other species: The decreases in reaction times fully emerged between 250 and 400 ms after the stimulus event, and detection accuracy was not affected. However, the effects of stimulus-driven attention on behavior in mice were insensitive to stimulus-event location, an aspect different from what is known in primates. In contrast, reaction times in mice were reduced at longer delays after the task-irrelevant stimulus event regardless of its spatial congruence to the target. These results highlight the strengths and limitations of using mice as a model for studying higher-order visual functions.

Should I stay or should I go? A thalamic circuit for modulating behavioral responses to visual threat

In this issue of Neuron and in Cell Reports, Fratzl et al. (2021) and Salay and Huberman (2021) identify the ventral lateral geniculate nucleus (vLGN) of the thalamus as a key regulator for adjusting defensive behaviors according to the level of perceived visual threat.

Divergent outputs of the ventral lateral geniculate nucleus mediate visually evoked defensive behaviors

Rapid alternations between exploration and defensive reactions require ongoing risk assessment. How visual cues and internal states flexibly modulate the selection of behaviors remains incompletely understood. Here, we show that the ventral lateral geniculate nucleus (vLGN)-a major retinorecipient structure-is a critical node in the network controlling defensive behaviors to visual threats. We find that vLGNGABA neuron activity scales with the intensity of environmental illumination and is modulated by behavioral state. Chemogenetic activation of vLGNGABA neurons reduces freezing, whereas inactivation dramatically extends the duration of freezing to visual threats. Perturbations of vLGN activity disrupt exploration in brightly illuminated environments. We describe both a vLGN→nucleus reuniens (Re) circuit and a vLGN→superior colliculus (SC) circuit, which exert opposite influences on defensive responses. These findings reveal roles for genetic- and projection-defined vLGN subpopulations in modulating the expression of behavioral threat responses according to internal state.

Association Cortex Is Essential to Reverse Hemianopia by Multisensory Training

Hemianopia induced by unilateral visual cortex lesions can be resolved by repeatedly exposing the blinded hemifield to auditory-visual stimuli. This rehabilitative "training" paradigm depends on mechanisms of multisensory plasticity that restore the lost visual responsiveness of multisensory neurons in the ipsilesional superior colliculus (SC) so that they can once again support vision in the blinded hemifield. These changes are thought to operate via the convergent visual and auditory signals relayed to the SC from association cortex (the anterior ectosylvian sulcus [AES], in cat). The present study tested this assumption by cryogenically deactivating ipsilesional AES in hemianopic, anesthetized cats during weekly multisensory training sessions. No signs of visual recovery were evident in this condition, even after providing animals with up to twice the number of training sessions required for effective rehabilitation. Subsequent training under the same conditions, but with AES active, reversed the hemianopia within the normal timeframe. These results indicate that the corticotectal circuit that is normally engaged in SC multisensory plasticity has to be operational for the brain to use visual-auditory experience to resolve hemianopia.

Electrode pooling can boost the yield of extracellular recordings with switchable silicon probes

State-of-the-art silicon probes for electrical recording from neurons have thousands of recording sites. However, due to volume limitations there are typically many fewer wires carrying signals off the probe, which restricts the number of channels that can be recorded simultaneously. To overcome this fundamental constraint, we propose a method called electrode pooling that uses a single wire to serve many recording sites through a set of controllable switches. Here we present the framework behind this method and an experimental strategy to support it. We then demonstrate its feasibility by implementing electrode pooling on the Neuropixels 1.0 electrode array and characterizing its effect on signal and noise. Finally we use simulations to explore the conditions under which electrode pooling saves wires without compromising the content of the recordings. We make recommendations on the design of future devices to take advantage of this strategy.

Retinal waves prime visual motion detection by simulating future optic flow

The ability to perceive and respond to environmental stimuli emerges in the absence of sensory experience. Spontaneous retinal activity prior to eye opening guides the refinement of retinotopy and eye-specific segregation in mammals, but its role in the development of higher-order visual response properties remains unclear. Here, we describe a transient window in neonatal mouse development during which the spatial propagation of spontaneous retinal waves resembles the optic flow pattern generated by forward self-motion. We show that wave directionality requires the same circuit components that form the adult direction-selective retinal circuit and that chronic disruption of wave directionality alters the development of direction-selective responses of superior colliculus neurons. These data demonstrate how the developing visual system patterns spontaneous activity to simulate ethologically relevant features of the external world and thereby instruct self-organization.

Unraveling circuits of visual perception and cognition through the superior colliculus

The superior colliculus is a conserved sensorimotor structure that integrates visual and other sensory information to drive reflexive behaviors. Although the evidence for this is strong and compelling, a number of experiments reveal a role for the superior colliculus in behaviors usually associated with the cerebral cortex, such as attention and decision-making. Indeed, in addition to collicular outputs targeting brainstem regions controlling movements, the superior colliculus also has ascending projections linking it to forebrain structures including the basal ganglia and amygdala, highlighting the fact that the superior colliculus, with its vast inputs and outputs, can influence processing throughout the neuraxis. Today, modern molecular and genetic methods combined with sophisticated behavioral assessments have the potential to make significant breakthroughs in our understanding of the evolution and conservation of neuronal cell types and circuits in the superior colliculus that give rise to simple and complex behaviors.

Visual stimulus-specific habituation of innate defensive behaviour in mice

Innate defensive responses such as freezing or escape are essential for animal survival. Mice show defensive behaviour to stimuli sweeping overhead, like a bird cruising the sky. Here, we tested this in young male mice and found that mice reduced their defensive freezing after sessions with a stimulus passing overhead repeatedly. This habituation is stimulus specific, as mice freeze again to a novel shape. Habituation occurs regardless of the visual field location of the repeated stimulus. The mice generalized over a range of sizes and shapes, but distinguished objects when they differed in both size and shape. Innate visual defensive responses are thus strongly influenced by previous experience as mice learn to ignore specific stimuli.

Multiple decisions about one object involve parallel sensory acquisition but time-multiplexed evidence incorporation

The brain is capable of processing several streams of information that bear on different aspects of the same problem. Here, we address the problem of making two decisions about one object, by studying difficult perceptual decisions about the color and motion of a dynamic random dot display. We find that the accuracy of one decision is unaffected by the difficulty of the other decision. However, the response times reveal that the two decisions do not form simultaneously. We show that both stimulus dimensions are acquired in parallel for the initial ∼0.1 s but are then incorporated serially in time-multiplexed bouts. Thus, there is a bottleneck that precludes updating more than one decision at a time, and a buffer that stores samples of evidence while access to the decision is blocked. We suggest that this bottleneck is responsible for the long timescales of many cognitive operations framed as decisions.

Task-Irrelevant Visual Forms Facilitate Covert and Overt Spatial Selection

Covert and overt spatial selection behaviors are guided by both visual saliency maps derived from early visual features as well as priority maps reflecting high-level cognitive factors. However, whether mid-level perceptual processes associated with visual form recognition contribute to covert and overt spatial selection behaviors remains unclear. We hypothesized that if peripheral visual forms contribute to spatial selection behaviors, then they should do so even when the visual forms are task-irrelevant. We tested this hypothesis in male and female human subjects as well as in male macaque monkeys performing a visual detection task. In this task, subjects reported the detection of a suprathreshold target spot presented on top of one of two peripheral images, and they did so with either a speeded manual button press (humans) or a speeded saccadic eye movement response (humans and monkeys). Crucially, the two images, one with a visual form and the other with a partially phase-scrambled visual form, were completely irrelevant to the task. In both manual (covert) and oculomotor (overt) response modalities, and in both humans and monkeys, response times were faster when the target was congruent with a visual form than when it was incongruent. Importantly, incongruent targets were associated with almost all errors, suggesting that forms automatically captured selection behaviors. These findings demonstrate that mid-level perceptual processes associated with visual form recognition contribute to covert and overt spatial selection. This indicates that neural circuits associated with target selection, such as the superior colliculus, may have privileged access to visual form information.SIGNIFICANCE STATEMENT Spatial selection of visual information either with (overt) or without (covert) foveating eye movements is critical to primate behavior. However, it is still not clear whether spatial maps in sensorimotor regions known to guide overt and covert spatial selection are influenced by peripheral visual forms. We probed the ability of humans and monkeys to perform overt and covert target selection in the presence of spatially congruent or incongruent visual forms. Even when completely task-irrelevant, images of visual objects had a dramatic effect on target selection, acting much like spatial cues used in spatial attention tasks. Our results demonstrate that traditional brain circuits for orienting behaviors, such as the superior colliculus, likely have privileged access to visual object representations.

Population coding in the cerebellum: a machine learning perspective

The cere resembles a feedforward, three-layer network of neurons in which the "hidden layer" consists of Purkinje cells (P-cells) and the output layer consists of deep cerebellar nucleus (DCN) neurons. In this analogy, the output of each DCN neuron is a prediction that is compared with the actual observation, resulting in an error signal that originates in the inferior olive. Efficient learning requires that the error signal reach the DCN neurons, as well as the P-cells that project onto them. However, this basic rule of learning is violated in the cerebellum: the olivary projections to the DCN are weak, particularly in adulthood. Instead, an extraordinarily strong signal is sent from the olive to the P-cells, producing complex spikes. Curiously, P-cells are grouped into small populations that converge onto single DCN neurons. Why are the P-cells organized in this way, and what is the membership criterion of each population? Here, I apply elementary mathematics from machine learning and consider the fact that P-cells that form a population exhibit a special property: they can synchronize their complex spikes, which in turn suppress activity of DCN neuron they project to. Thus complex spikes cannot only act as a teaching signal for a P-cell, but through complex spike synchrony, a P-cell population may act as a surrogate teacher for the DCN neuron that produced the erroneous output. It appears that grouping of P-cells into small populations that share a preference for error satisfies a critical requirement of efficient learning: providing error information to the output layer neuron (DCN) that was responsible for the error, as well as the hidden layer neurons (P-cells) that contributed to it. This population coding may account for several remarkable features of behavior during learning, including multiple timescales, protection from erasure, and spontaneous recovery of memory.

Brain-wide, scale-wide physiology underlying behavioral flexibility in zebrafish

The brain is tasked with choosing actions that maximize an animal's chances of survival and reproduction. These choices must be flexible and informed by the current state of the environment, the needs of the body, and the outcomes of past actions. This information is physiologically encoded and processed across different brain regions on a wide range of spatial scales, from molecules in single synapses to networks of brain areas. Uncovering these spatially distributed neural interactions underlying behavior requires investigations that span a similar range of spatial scales. Larval zebrafish, given their small size, transparency, and ease of genetic access, are a good model organism for such investigations, allowing the use of modern microscopy, molecular biology, and computational techniques. These approaches are yielding new insights into the mechanistic basis of behavioral states, which we review here and compare to related studies in mammalian species.

Functional Architecture of Motion Direction in the Mouse Superior Colliculus

Motion vision is important in guiding animal behavior. Both the retina and the visual cortex process object motion in largely unbiased fashion: all directions are represented at all locations in the visual field. We investigate motion processing in the superior colliculus of the awake mouse by optically recording neural responses across both hemispheres. Within the retinotopic map, one finds large regions of ∼500 μm size where neurons prefer the same direction of motion. This preference is maintained in depth to ∼350 μm. The scale of these patches, ∼30 degrees of visual angle, is much coarser than the animal's visual resolution (∼2 degrees). A global map of motion direction shows approximate symmetry between the left and right hemispheres and a net bias for upward-nasal motion in the upper visual field.

Magnitude, time course, and specificity of rapid adaptation across mouse visual areas

Adaptation is a ubiquitous feature of sensory processing whereby recent experience shapes future responses. The mouse primary visual cortex (V1) is particularly sensitive to recent experience, where a brief stimulus can suppress subsequent responses for seconds. This rapid adaptation profoundly impacts perception, suggesting that its effects are propagated along the visual hierarchy. To understand how rapid adaptation influences sensory processing, we measured its effects at key nodes in the visual system: in V1, three higher visual areas (HVAs: lateromedial, anterolateral, and posteromedial), and the superior colliculus (SC) in awake mice of both sexes using single-unit recordings. Consistent with the feed-forward propagation of adaptation along the visual hierarchy, we find that neurons in layer 4 adapt less strongly than those in other layers of V1. Furthermore, neurons in the HVAs adapt more strongly, and recover more slowly, than those in V1. The magnitude and time course of adaptation was comparable in each of the HVAs and in the SC, suggesting that adaptation may not linearly accumulate along the feed-forward visual processing hierarchy. Despite the increase in adaptation in the HVAs compared with V1, the effects were similarly orientation specific across all areas. These data reveal that adaptation profoundly shapes cortical processing, with increasing impact at higher levels in the cortical hierarchy, and also strongly influencing computations in the SC. Thus, we find robust, brain-wide effects of rapid adaptation on sensory processing.NEW & NOTEWORTHY Rapid adaptation dynamically alters sensory signals to account for recent experience. To understand how adaptation affects sensory processing and perception, we must determine how it impacts the diverse set of cortical and subcortical areas along the hierarchy of the mouse visual system. We find that rapid adaptation strongly impacts neurons in primary visual cortex, the higher visual areas, and the colliculus, consistent with its profound effects on behavior.