Neuronal activity is not required for the initial formation and maturation of visual selectivity

Visual experience orthogonalizes visual cortical stimulus responses via population code transformation

Sensory and behavioral experience can alter visual cortical stimulus coding, but the precise form of this plasticity is unclear. We measured orientation tuning in 4,000-neuron populations of mouse V1 before and after training on a visuomotor task. Changes to single-cell tuning curves appeared complex, including development of asymmetries and of multiple peaks. Nevertheless, these complex tuning curve transformations can be explained by a simple equation: a convex transformation suppressing responses to task stimuli specifically in cells responding at intermediate levels. The strength of the transformation varies across trials, suggesting a dynamic circuit mechanism rather than static synaptic plasticity. The transformation results in sparsening and orthogonalization of population codes for task stimuli. It cannot improve the performance of an optimal stimulus decoder, which is already perfect even for naive codes, but it improves the performance of a suboptimal decoder model with inductive bias as might be found in downstream readout circuits.

Development of ocular dominance columns across rodents and other species: revisiting the concept of critical period plasticity

The existence of cortical columns, regarded as computational units underlying both lower and higher-order information processing, has long been associated with highly evolved brains, and previous studies suggested their absence in rodents. However, recent discoveries have unveiled the presence of ocular dominance columns (ODCs) in the primary visual cortex (V1) of Long-Evans rats. These domains exhibit continuity from layer 2 through layer 6, confirming their identity as genuine ODCs. Notably, ODCs are also observed in Brown Norway rats, a strain closely related to wild rats, suggesting the physiological relevance of ODCs in natural survival contexts, although they are lacking in albino rats. This discovery has enabled researchers to explore the development and plasticity of cortical columns using a multidisciplinary approach, leveraging studies involving hundreds of individuals-an endeavor challenging in carnivore and primate species. Notably, developmental trajectories differ depending on the aspect under examination: while the distribution of geniculo-cortical afferent terminals indicates matured ODCs even before eye-opening, consistent with prevailing theories in carnivore/primate studies, examination of cortical neuron spiking activities reveals immature ODCs until postnatal day 35, suggesting delayed maturation of functional synapses which is dependent on visual experience. This developmental gap might be recognized as 'critical period' for ocular dominance plasticity in previous studies. In this article, I summarize cross-species differences in ODCs and geniculo-cortical network, followed by a discussion on the development, plasticity, and evolutionary significance of rat ODCs. I discuss classical and recent studies on critical period plasticity in the venue where critical period plasticity might be a component of experience-dependent development. Consequently, this series of studies prompts a paradigm shift in our understanding of species conservation of cortical columns and the nature of plasticity during the classical critical period.

Development and organization of the retinal orientation selectivity map

Orientation or axial selectivity, the property of neurons in the visual system to respond preferentially to certain angles of visual stimuli, plays a pivotal role in our understanding of visual perception and information processing. This computation is performed as early as the retina, and although much work has established the cellular mechanisms of retinal orientation selectivity, how this computation is organized across the retina is unknown. Using a large dataset collected across the mouse retina, we demonstrate functional organization rules of retinal orientation selectivity. First, we identify three major functional classes of retinal cells that are orientation selective and match previous descriptions. Second, we show that one orientation is predominantly represented in the retina and that this predominant orientation changes as a function of retinal location. Third, we demonstrate that neural activity plays little role on the organization of retinal orientation selectivity. Lastly, we use in silico modeling followed by validation experiments to demonstrate that the overrepresented orientation aligns along concentric axes. These results demonstrate that, similar to direction selectivity, orientation selectivity is organized in a functional map as early as the retina.

Development and Organization of the Retinal Orientation Selectivity Map

Orientation or axial selectivity, the property of neurons in the visual system to respond preferentially to certain angles of a visual stimuli, plays a pivotal role in our understanding of visual perception and information processing. This computation is performed as early as the retina, and although much work has established the cellular mechanisms of retinal orientation selectivity, how this computation is organized across the retina is unknown. Using a large dataset collected across the mouse retina, we demonstrate functional organization rules of retinal orientation selectivity. First, we identify three major functional classes of retinal cells that are orientation selective and match previous descriptions. Second, we show that one orientation is predominantly represented in the retina and that this predominant orientation changes as a function of retinal location. Third, we demonstrate that neural activity plays little role on the organization of retinal orientation selectivity. Lastly, we use in silico modeling followed by validation experiments to demonstrate that the overrepresented orientation aligns along concentric axes. These results demonstrate that, similar to direction selectivity, orientation selectivity is organized in a functional map as early as the retina.

One Sentence Summary

Development and organization of retinal orientation selectivity.

Visual experience-dependent development of ocular dominance columns in pigmented rats

Despite previous agreement of the absence of cortical column structure in the rodent visual cortex, we have recently revealed a presence of ocular dominance columns (ODCs) in the primary visual cortex (V1) of adult Long-Evans rats. In this study, we deepened understanding of characteristics of rat ODCs. We found that this structure was conserved in Brown Norway rats, but not in albino rats; therefore, it could be a structure generally present in pigmented wild rats. Activity-dependent gene expression indicated that maturation of eye-dominant patches takes more than 2 weeks after eye-opening, and this process is visual experience dependent. Monocular deprivation during classical critical period strongly influenced size of ODCs, shifting ocular dominance from the deprived eye to the opened eye. On the other hand, transneuronal anterograde tracer showed a presence of eye-dominant patchy innervation from the ipsilateral V1 even before eye-opening, suggesting the presence of visual activity-independent genetic components of developing ODCs. Pigmented C57BL/6J mice also showed minor clusters of ocular dominance neurons. These results provide insights into how visual experience-dependent and experience-independent components both contribute to develop cortical columns during early postnatal stages, and indicate that rats and mice can be excellent models to study them.

Spontaneous Thalamic Activity Modulates the Cortical Innervation of the Primary Visual Nucleus of the Thalamus

Sensory processing relies on the correct development of thalamocortical loops. Visual corticothalamic axons (CTAs) invade the dorsolateral geniculate nucleus (dLGN) of the thalamus in early postnatal mice according to a regulated program that includes activity-dependent mechanisms. Spontaneous retinal activity influences the thalamic incursion of CTAs, yet the perinatal thalamus also generates intrinsic patterns of spontaneous activity whose role in modulating afferent connectivity remains unknown. Here, we found that patterned spontaneous activity in the dLGN contributes to proper spatial and temporal innervation of CTAs. Disrupting patterned spontaneous activity in the dLGN delays corticogeniculate innervation under normal conditions and upon eye enucleation. The delayed innervation was evident throughout the first two postnatal weeks but resumes after eye-opening, suggesting that visual experience is necessary for the homeostatic recovery of corticogeniculate innervation.

Rapid development of motion-streak coding in the mouse visual cortex

Despite its importance, the development of higher visual areas (HVAs) at the cellular resolution remains largely unknown. Here, we conducted 2-photon calcium imaging of mouse HVAs lateromedial (LM) and anterolateral (AL) and V1 to observe developmental changes in visual response properties. HVA neurons showed selectivity for orientations and directions similar to V1 neurons at eye opening, which became sharper in the following weeks. Neurons in all areas over all developmental stages tended to respond selectively to dots moving along an axis perpendicular to their preferred orientation at slow speeds, suggesting a certain level of conventional motion coding already at eye opening. In contrast, at high speeds, many neurons responded to dots moving along the axis parallel to the preferred orientation in older animals but rarely after eye opening, indicating a lack of motion-streak coding in the earlier stage. Together, our results uncover the development of visual properties in HVAs.

Developmental stage-specific spontaneous activity contributes to callosal axon projections

The developing neocortex exhibits spontaneous network activity with various synchrony levels, which has been implicated in the formation of cortical circuits. We previously reported that the development of callosal axon projections, one of the major long-range axonal projections in the brain, is activity dependent. However, what sort of activity and when activity is indispensable are not known. Here, using a genetic method to manipulate network activity in a stage-specific manner, we demonstrated that network activity contributes to callosal axon projections in the mouse visual cortex during a ‘critical period’: restoring neuronal activity during that period resumed the projections, whereas restoration after the period failed. Furthermore, in vivo Ca²⁺ imaging revealed that the projections could be established even without fully restoring highly synchronous activity. Overall, our findings suggest that spontaneous network activity is selectively required during a critical developmental time window for the formation of long-range axonal projections in the cortex.

Emergence of probabilistic representation in the neural network of primary visual cortex

During the early development of the mammalian visual system, the distribution of neuronal preferred orientations in the primary visual cortex (V1) gradually shifts to match major orientation features of the environment, achieving its optimal representation. By combining computational modeling and electrophysiological recording, we provide a circuit plasticity mechanism that underlies the developmental emergence of such matched representation in the visual cortical network. Specifically, in a canonical circuit of densely-interconnected pyramidal cells and inhibitory parvalbumin-expressing (PV+) fast-spiking interneurons in V1 layer 2/3, our model successfully simulates the experimental observations and further reveals that the nonuniform inhibition plays a key role in shaping the network representation through spike timing-dependent plasticity. The experimental results suggest that PV + interneurons in V1 are capable of providing nonuniform inhibition shortly after vision onset. Our study elucidates a circuit mechanism for acquisition of prior knowledge of environment for optimal inference in sensory neural systems

•

Computational and experimental methods are combined to representation in mice V1

•

Nonuniform inhibition plays a key role in shaping the network representation

•

PV + interneurons provide nonuniform inhibition shortly after vision onset

Reconstruction of neocortex: Organelles, compartments, cells, circuits, and activity

We assembled a semi-automated reconstruction of L2/3 mouse primary visual cortex from ∼250 × 140 × 90 μm3 of electron microscopic images, including pyramidal and non-pyramidal neurons, astrocytes, microglia, oligodendrocytes and precursors, pericytes, vasculature, nuclei, mitochondria, and synapses. Visual responses of a subset of pyramidal cells are included. The data are publicly available, along with tools for programmatic and three-dimensional interactive access. Brief vignettes illustrate the breadth of potential applications relating structure to function in cortical circuits and neuronal cell biology. Mitochondria and synapse organization are characterized as a function of path length from the soma. Pyramidal connectivity motif frequencies are predicted accurately using a configuration model of random graphs. Pyramidal cells receiving more connections from nearby cells exhibit stronger and more reliable visual responses. Sample code shows data access and analysis.

The development of active binocular vision under normal and alternate rearing conditions

The development of binocular vision is an active learning process comprising the development of disparity tuned neurons in visual cortex and the establishment of precise vergence control of the eyes. We present a computational model for the learning and self-calibration of active binocular vision based on the Active Efficient Coding framework, an extension of classic efficient coding ideas to active perception. Under normal rearing conditions with naturalistic input, the model develops disparity tuned neurons and precise vergence control, allowing it to correctly interpret random dot stereograms. Under altered rearing conditions modeled after neurophysiological experiments, the model qualitatively reproduces key experimental findings on changes in binocularity and disparity tuning. Furthermore, the model makes testable predictions regarding how altered rearing conditions impede the learning of precise vergence control. Finally, the model predicts a surprising new effect that impaired vergence control affects the statistics of orientation tuning in visual cortical neurons.

Stable behavioral state-specific large scale activity patterns in the developing cortex of neonates

Intrinsic neuronal activity is a hallmark of the developing brain. In rodents, a handful of such activities were described in different cortical areas but the unifying macroscopic perspective is still lacking. Here we combined large-scale in vivo Ca²⁺ imaging of the dorsal cortex in non-anesthetized neonatal mice with mathematical analyses to reveal unique behavioral state-specific maps of intrinsic activity. These maps were remarkably stable over time within and across experiments and used patches of correlated activity with little hemispheric symmetry as well as stationary and propagating waves as building blocks. Importantly, the maps recorded during motion and rest were almost inverse, with frontoparietal areas active during motion and posterior-lateral areas active at rest. The retrosplenial cortex engaged in both resting- and motion-related activities via functional long-range connections with respective cortical areas. The data obtained bind different region-specific activity patterns described so far into a single consistent picture and set the stage for future inactivation studies, probing the exact function of this complex activity pattern for cortical wiring in neonates.

Spontaneous activity in developing thalamic and cortical sensory networks

Developing sensory circuits exhibit different patterns of spontaneous activity, patterns that are related to the construction and refinement of functional networks. During the development of different sensory modalities, spontaneous activity originates in the immature peripheral sensory structures and in the higher-order central structures, such as the thalamus and cortex. Certainly, the perinatal thalamus exhibits spontaneous calcium waves, a pattern of activity that is fundamental for the formation of sensory maps and for circuit plasticity. Here, we review our current understanding of the maturation of early (including embryonic) patterns of spontaneous activity and their influence on the assembly of thalamic and cortical sensory networks. Overall, the data currently available suggest similarities between the developmental trajectory of brain activity in experimental models and humans, which in the future may help to improve the early diagnosis of developmental disorders.

The role of early visual experience in the development of spatial-frequency preference in the primary visual cortex

KEY POINTS

The mature functioning of the primary visual cortex depends on postnatal visual experience, while the orientation/direction preference is established just after eye-opening, independently of visual experience. In this study, we find that visual experience is required for the normal development of spatial-frequency (SF) preference in mouse primary visual cortex. We show that age- and experience-dependent shifts in optimal SFs towards higher frequencies occurred similarly in excitatory neurons and parvalbumin-positive interneurons. We also show that some excitatory and parvalbumin-positive neurons preferentially responded to visual stimuli consisting of very high SFs and posterior directions, and that the preference was established at earlier developmental stages than the SF preference in the standard frequency range. These results suggest that early visual experience is required for the development of SF representation and shed light on the experience-dependent developmental mechanisms underlying visual cortical functions.

ABSTRACT

Early visual experience is crucial for the maturation of visual cortical functions. It has been demonstrated that the orientation and direction preferences in individual neurons of the primary visual cortex are well established immediately after eye-opening. The postnatal development of spatial frequency (SF) tuning and its dependence on visual experience, however, has not been thoroughly quantified. In this study, macroscopic imaging with flavoprotein autofluorescence revealed that the optimal SFs shift towards higher frequency values during normal development in mouse primary visual cortex. This developmental shift was impaired by binocular deprivation during the sensitive period, postnatal 3 weeks (PW3) to PW6. Furthermore, two-photon Ca²⁺ imaging revealed that the developmental shift of the optimal SFs, depending on visual experience, concurrently occurs in excitatory neurons and parvalbumin-positive inhibitory interneurons (PV neurons). In addition, some excitatory and PV neurons exhibited a preference for visual stimuli consisting of particularly high SFs and posterior directions at relatively early developmental stages; this preference was not affected by binocular deprivation. Thus, there may be two distinct developmental mechanisms for the establishment of SF preference depending on the frequency values. After PW3, SF tuning for neurons tuned to standard frequency ranges was sharper in excitatory neurons and slightly broader in PV neurons, leading to considerably attenuated SF tuning in PV neurons compared to excitatory neurons by PW5. Our findings suggest that early visual experience is far more important than orientation/direction selectivity for the development of the neural representation of the diverse SFs.

Modeling the role of gap junctions between excitatory neurons in the developing visual cortex

Recent experiments in the developing mammalian visual cortex have revealed that gap junctions couple excitatory cells and potentially influence the formation of chemical synapses. In particular, cells that were coupled by a gap junction during development tend to share an orientation preference and are preferentially coupled by a chemical synapse in the adult cortex, a property that is diminished when gap junctions are blocked. In this work, we construct a simplified model of the developing mouse visual cortex including spike-timing-dependent plasticity of both the feedforward synaptic inputs and recurrent cortical synapses. We use this model to show that synchrony among gap-junction-coupled cells underlies their preference to form strong recurrent synapses and develop similar orientation preference; this effect decreases with an increase in coupling density. Additionally, we demonstrate that gap-junction coupling works, together with the relative timing of synaptic development of the feedforward and recurrent synapses, to determine the resulting cortical map of orientation preference.

Gap junctions, or sites of direct electrical connections between neurons, have a significant presence in the cortex, both during development and in adulthood. Their primary function during either of these periods, however, is still poorly understood. In the adult cortex, gap junctions between local, inhibitory neurons have been shown to promote synchronous firing, a network characteristic thought to be important for learning, attention, and memory. During development, gap junctions between excitatory, pyramidal cells, have been conjectured to play a role in synaptic plasticity and the formation of cortical circuits. In the visual cortex, where neurons exhibit tuned responses to properties of visual input such as orientation and direction, recent experiments show that excitatory cells are coupled by gap junctions during the first postnatal week and are replaced by chemical synapses during the second week. In this work, we explore the possible contribution of gap-junction coupling during development to the formation of chemical synapses between the visual cortex from the thalamus and between cortical cells within the visual cortex. Specifically, using a mathematical model of the visual cortex during development, we identify the response properties of gap-junction-coupled cells and their influence on the formation of the cortical map of orientation preference.

Spatial organization and transitions of spontaneous neuronal activities in the developing sensory cortex

The sensory cortex underlies our ability to perceive and interact with the external world. Sensory perceptions are controlled by specialized neuronal circuits established through fine-tuning, which relies largely on neuronal activity during the development. Spontaneous neuronal activity is an essential driving force of neuronal circuit refinement. At early developmental stages, sensory cortices display spontaneous activities originating from the periphery and characterized by correlated firing arranged spatially according to the modality. The firing patterns are reorganized over time and become sparse, which is typical for the mature brain. This review focuses mainly on rodent sensory cortices. First, the features of the spontaneous activities during early postnatal stages are described. Then, the developmental changes in the spatial organization of the spontaneous activities and the transition mechanisms involved are discussed. The identification of the principles controlling the spatial organization of spontaneous activities in the developing sensory cortex is essential to understand the self-organization process of neuronal circuits.

Intercalated amygdala clusters orchestrate a switch in fear state

Adaptive behaviour necessitates the formation of memories for fearful events, but also that these memories can be extinguished. Effective extinction prevents excessive and persistent reactions to perceived threat, as can occur in anxiety and 'trauma- and stressor-related' disorders¹. However, although there is evidence that fear learning and extinction are mediated by distinct neural circuits, the nature of the interaction between these circuits remains poorly understood^2-6. Here, through a combination of in vivo calcium imaging, functional manipulations, and slice physiology, we show that distinct inhibitory clusters of intercalated neurons (ITCs) in the mouse amygdala exert diametrically opposed roles during the acquisition and retrieval of fear extinction memory. Furthermore, we find that the ITC clusters antagonize one another through mutual synaptic inhibition and differentially access functionally distinct cortical- and midbrain-projecting amygdala output pathways. Our findings show that the balance of activity between ITC clusters represents a unique regulatory motif that orchestrates a distributed neural circuitry, which in turn regulates the switch between high- and low-fear states. These findings suggest that the ITCs have a broader role in a range of amygdala functions and associated brain states that underpins the capacity to adapt to salient environmental demands.

Experience-Dependent Development and Maintenance of Binocular Neurons in the Mouse Visual Cortex

The development of neuronal circuits requires both hard-wired gene expression and experience-dependent plasticity. Sensory processing, such as binocular vision, is especially sensitive to perturbations of experience. We investigated the experience-dependent development of the binocular visual cortex at single-cell resolution by using two-photon calcium imaging in awake mice. At eye-opening, the majority of visually responsive neurons are monocular. Binocular neurons emerge later with visual experience and acquire distinct visual response properties. Surprisingly, rather than mirroring the effects of visual deprivation, mice that lack the plasticity gene Arc show increased numbers of binocular neurons and a shift in ocular dominance during development. Strikingly, acutely removing Arc in the adult binocular visual cortex also increases the number of binocular neurons, suggesting that the maintenance of binocular circuits requires ongoing plasticity. Thus, experience-dependent plasticity is critical for the development and maintenance of circuits required to process binocular vision.

Jenks and Shepherd show that neurons responding to both eyes in the mouse visual cortex develop with experience. These binocular neurons acquire unique visual response properties, such as a preference for horizonal orientations. The neuronal gene Arc limits and maintains the number of binocular neurons, even in the adult cortex.

Development of Natural Scene Representation in Primary Visual Cortex Requires Early Postnatal Experience

The development of the visual system is known to be shaped by early-life experience. To identify response properties that contribute to enhanced natural scene representation, we performed calcium imaging of excitatory neurons in the primary visual cortex (V1) of awake mice raised in three different conditions (standard-reared, dark-reared, and delayed-visual experience) and compared neuronal responses to natural scene features in relation to simpler grating stimuli that varied in orientation and spatial frequency. We assessed population selectivity in the V1 by using decoding methods and found that natural scene discriminability increased by 75% between the ages of 4 and 6 weeks. Both natural scene and grating discriminability were higher in standard-reared animals than in those raised in the dark. This increase in discriminability was accompanied by a reduction in the number of neurons that responded to low-spatial-frequency gratings. At the same time, there was an increase in neuronal preference for natural scenes. Light exposure restricted to a 2- to 4-week window during adulthood did not induce improvements in natural scene or in grating stimulus discriminability. Our results demonstrate that experience reduces the number of neurons needed to effectively encode grating stimuli and that early visual experience enhances natural scene discriminability by directly increasing responsiveness to natural scene features.

Single-Cell Visualization Deep in Brain Structures by Gene Transfer

A projection neuron targets multiple regions beyond the functional brain area. In order to map neuronal connectivity in a massive neural network, a means for visualizing the entire morphology of a single neuron is needed. Progress has facilitated single-neuron analysis in the cerebral cortex, but individual neurons in deep brain structures remain difficult to visualize. To this end, we developed an in vivo single-cell electroporation method for juvenile and adult brains that can be performed under a standard stereomicroscope. This technique involves rapid gene transfection and allows the visualization of dendritic and axonal morphologies of individual neurons located deep in brain structures. The transfection efficiency was enhanced by directly injecting the expression vector encoding green fluorescent protein instead of monitoring cell attachment to the electrode tip. We obtained similar transfection efficiencies in both young adult (≥P40) and juvenile mice (P21-30). By tracing the axons of thalamocortical neurons, we identified a specific subtype of neuron distinguished by its projection pattern. Additionally, transfected mOrange-tagged vesicle-associated membrane protein 2-a presynaptic protein-was strongly localized in terminal boutons of thalamocortical neurons. Thus, our in vivo single-cell gene transfer system offers rapid single-neuron analysis deep in brain. Our approach combines observation of neuronal morphology with functional analysis of genes of interest, which can be useful for monitoring changes in neuronal activity corresponding to specific behaviors in living animals.

Long-Range Interhemispheric Projection Neurons Show Biased Response Properties and Fine-Scale Local Subnetworks in Mouse Visual Cortex

Integration of information processed separately in distributed brain regions is essential for brain functions. This integration is enabled by long-range projection neurons, and further, concerted interactions between long-range projections and local microcircuits are crucial. It is not well known, however, how this interaction is implemented in cortical circuits. Here, to decipher this logic, using callosal projection neurons (CPNs) in layer 2/3 of the mouse visual cortex as a model of long-range projections, we found that CPNs exhibited distinct response properties and fine-scale local connectivity patterns. In vivo 2-photon calcium imaging revealed that CPNs showed a higher ipsilateral (to their somata) eye preference, and that CPN pairs showed stronger signal/noise correlation than random pairs. Slice recordings showed CPNs were preferentially connected to CPNs, demonstrating the existence of projection target-dependent fine-scale subnetworks. Collectively, our results suggest that long-range projection target predicts response properties and local connectivity of cortical projection neurons.

Combinatorial Developmental Controls on Striatonigral Circuits

Cortical pyramidal cells are generated locally, from pre-programmed progenitors, to form functionally distinct areas. By contrast, striatal projection neurons (SPNs) are generated remotely from a common source, undergo migration to form mosaics of striosomes and matrix, and become incorporated into functionally distinct sectors. Striatal circuits might thus have a unique logic of developmental organization, distinct from those of the neocortex. We explore this possibility in mice by mapping one set of SPNs, those in striosomes, with striatonigral projections to the dopamine-containing substantia nigra pars compacta (SNpc). Same-age SPNs exhibit topographic striatonigral projections, according to their resident sector. However, the different birth dates of resident SPNs within a given sector specify the destination of their axons within the SNpc. These findings highlight a logic intercalating birth date-dependent and birth date-independent factors in determining the trajectories of SPN axons and organizing specialized units of striatonigral circuitry that could influence behavioral expression and vulnerabilities to disease.

Unsupervised experience with temporal continuity of the visual environment is causally involved in the development of V1 complex cells

Unsupervised adaptation to the spatiotemporal statistics of visual experience is a key computational principle that has long been assumed to govern postnatal development of visual cortical tuning, including orientation selectivity of simple cells and position tolerance of complex cells in primary visual cortex (V1). Yet, causal empirical evidence supporting this hypothesis is scant. Here, we show that degrading the temporal continuity of visual experience during early postnatal life leads to a sizable reduction of the number of complex cells and to an impairment of their functional properties while fully sparing the development of simple cells. This causally implicates adaptation to the temporal structure of the visual input in the development of transformation tolerance but not of shape tuning, thus tightly constraining computational models of unsupervised cortical learning.

Natural images are reliably represented by sparse and variable populations of neurons in visual cortex

Natural scenes sparsely activate neurons in the primary visual cortex (V1). However, how sparsely active neurons reliably represent complex natural images and how the information is optimally decoded from these representations have not been revealed. Using two-photon calcium imaging, we recorded visual responses to natural images from several hundred V1 neurons and reconstructed the images from neural activity in anesthetized and awake mice. A single natural image is linearly decodable from a surprisingly small number of highly responsive neurons, and the remaining neurons even degrade the decoding. Furthermore, these neurons reliably represent the image across trials, regardless of trial-to-trial response variability. Based on our results, diverse, partially overlapping receptive fields ensure sparse and reliable representation. We suggest that information is reliably represented while the corresponding neuronal patterns change across trials and collecting only the activity of highly responsive neurons is an optimal decoding strategy for the downstream neurons.

Development and binocular matching of orientation selectivity in visual cortex: a computational model

In mouse visual cortex, right after eye opening binocular cells have different preferred orientations for input from the two eyes. With normal visual experience during a critical period, these preferred orientations evolve and eventually become well matched. To gain insight into the matching process, we developed a computational model of a cortical cell receiving orientation selective inputs via plastic synapses. The model captures the experimentally observed matching of the preferred orientations, the dependence of matching on ocular dominance of the cell, and the relationship between the degree of matching and the resulting monocular orientation selectivity. Moreover, our model puts forward testable predictions: 1) The matching speed increases with initial ocular dominance. 2) While the matching improves more slowly for cells that are more orientation selective, the selectivity increases faster for better matched cells during the matching process. This suggests that matching drives orientation selectivity but not vice versa. 3) There are two main routes to matching: the preferred orientations either drift toward each other or one of the orientations switches suddenly. The latter occurs for cells with large initial mismatch and can render the cells monocular. We expect that these results provide insight more generally into the development of neuronal systems that integrate inputs from multiple sources, including different sensory modalities.NEW & NOTEWORTHY Animals gather information through multiple modalities (vision, audition, touch, etc.). These information streams have to be merged coherently to provide a meaningful representation of the world. Thus, for neurons in visual cortex V1, the orientation selectivities for inputs from the two eyes have to match to enable binocular vision. We analyze the postnatal process underlying this matching using computational modeling. It captures recent experimental results and reveals interdependence between matching, ocular dominance, and orientation selectivity.

Autonomous Development of Active Binocular and Motion Vision Through Active Efficient Coding

We present a model for the autonomous and simultaneous learning of active binocular and motion vision. The model is based on the Active Efficient Coding (AEC) framework, a recent generalization of classic efficient coding theories to active perception. The model learns how to efficiently encode the incoming visual signals generated by an object moving in 3-D through sparse coding. Simultaneously, it learns how to produce eye movements that further improve the efficiency of the sensory coding. This learning is driven by an intrinsic motivation to maximize the system's coding efficiency. We test our approach on the humanoid robot iCub using simulations. The model demonstrates self-calibration of accurate object fixation and tracking of moving objects. Our results show that the model keeps improving until it hits physical constraints such as camera or motor resolution, or limits on its internal coding capacity. Furthermore, we show that the emerging sensory tuning properties are in line with results on disparity, motion, and motion-in-depth tuning in the visual cortex of mammals. The model suggests that vergence and tracking eye movements can be viewed as fundamentally having the same objective of maximizing the coding efficiency of the visual system and that they can be learned and calibrated jointly through AEC.

Characterisation of nonlinear receptive fields of visual neurons by convolutional neural network

A comprehensive understanding of the stimulus-response properties of individual neurons is necessary to crack the neural code of sensory cortices. However, a barrier to achieving this goal is the difficulty of analysing the nonlinearity of neuronal responses. Here, by incorporating convolutional neural network (CNN) for encoding models of neurons in the visual cortex, we developed a new method of nonlinear response characterisation, especially nonlinear estimation of receptive fields (RFs), without assumptions regarding the type of nonlinearity. Briefly, after training CNN to predict the visual responses to natural images, we synthesised the RF image such that the image would predictively evoke a maximum response. We first demonstrated the proof-of-principle using a dataset of simulated cells with various types of nonlinearity. We could visualise RFs with various types of nonlinearity, such as shift-invariant RFs or rotation-invariant RFs, suggesting that the method may be applicable to neurons with complex nonlinearities in higher visual areas. Next, we applied the method to a dataset of neurons in mouse V1. We could visualise simple-cell-like or complex-cell-like (shift-invariant) RFs and quantify the degree of shift-invariance. These results suggest that CNN encoding model is useful in nonlinear response analyses of visual neurons and potentially of any sensory neurons.

Experience-Dependent Development of Feature-Selective Synchronization in the Primary Visual Cortex

Early visual experience is essential for the maturation of visual functions in which the primary visual cortex plays crucial roles. The extraction of visual features based on response selectivity of individual neurons, a fundamental process in the cortex, is basically established by eye opening in rodents, suggesting that visual experience is required for the development of neural functions other than feature extraction. Here, we show that synchronized firing, which is important for visual information processing, occurs selectively in adjacent neurons sharing similar orientation or spatial frequency preferences in layers 2-4 (upper layer) of rat visual cortex. This feature-selective spike synchrony was rudimentary when the eyes opened and became prominent during the first few weeks after eye opening only in the presence of pattern vision. In contrast, synchronization in layers 5-6 (lower layer) was almost independent of orientation similarity and more weakly dependent on spatial frequency similarity compared with upper layer synchrony. Lower layer synchronization was strengthened during development after eye opening independently of visual experience as a whole. However, the feature selectivity of synchronization was regulated by visual inputs, whereas the inputs without contours were sufficient for this regulation. Therefore, we speculate that feature-selective synchronization in the upper layer may convey detailed information on visual objects to the higher-order cortex, whereas weakly feature-selective synchronization in the lower layer may covey rather rough visual information to the subcortical areas or higher-order cortex. A major role of visual experience may be to establish the specific neural circuits underlying highly feature-selective synchronization.SIGNIFICANCE STATEMENT The neuronal mechanisms underlying experience-dependent improvement of visual functions still remain unresolved. In this study, we investigated whether early visual experience contributes to the development of synchronized neural firing in the primary visual cortex, which plays important roles in visual information processing. We found that synchronized firing depends more remarkably on the similarity of preferred visual stimuli in the upper than lower layer neurons. Pattern vision during development was required for the establishment of spike synchrony in the upper but not the lower layer. These findings provide a new view regarding the role of sensory experience in the functional development of the cortex and the differences in the modes of information processing in the upper and lower cortical layers.

The development of local circuits in the neocortex: recent lessons from the mouse visual cortex

Precise synaptic connections among neurons in the neocortex generate the circuits that underlie a broad repertoire of cortical functions including perception, learning and memory, and complex problem solving. The specific patterns and properties of these synaptic connections are fundamental to the computations cortical neurons perform. How such specificity arises in cortical circuits has remained elusive. Here, we first consider the cell-type, subcellular and synaptic specificity required for generating mature patterns of cortical connectivity and responses. Next, we focus on recent progress in understanding how the synaptic connections among excitatory cortical projection neurons are established during development using the primary visual cortex of the mouse as a model.

Retained Plasticity and Substantial Recovery of Rod-Mediated Visual Acuity at the Visual Cortex in Blind Adult Mice with Retinal Dystrophy

In patients born blind with retinal dystrophies, understanding the critical periods of cortical plasticity is important for successful visual restoration. In this study, we sought to model childhood blindness and investigate the plasticity of visual pathways. To this end, we generated double-mutant (Pde6c^cpfl1/cpfl1Gnat1^IRD2/IRD2) mice with absent rod and cone photoreceptor function, and we evaluated their response for restoring rod (GNAT1) function through gene therapy. Despite the limited effectiveness of gene therapy in restoring visual acuity in patients with retinal dystrophy, visual acuity was, unexpectedly, successfully restored in the mice at the level of the primary visual cortex in this study. This success in visual restoration, defined by changes in the quantified optokinetic response and pattern visually evoked potential, was achieved regardless of the age at treatment (up to 16 months). In the contralateral visual cortex, cortical plasticity, tagged with light-triggered transcription of Arc, was also restored after the treatment in blind mice carrying an Arc promoter-driven reporter gene, dVenus. Our results demonstrate the remarkable plasticity of visual circuits for one of the two photoreceptor mechanisms in older as well as younger mice with congenital blindness due to retinal dystrophies.

Layer-Specific Refinement of Sensory Coding in Developing Mouse Barrel Cortex

Rodent rhythmic whisking behavior matures during a critical period around 2 weeks after birth. The functional adaptations of neocortical circuitry during this developmental period remain poorly understood. Here, we characterized stimulus-evoked neuronal activity across all layers of mouse barrel cortex before, during, and after the onset of whisking behavior. Employing multi-electrode recordings and 2-photon calcium imaging in anesthetized mice, we tested responses to rostro-caudal whisker deflections, axial "tapping" stimuli, and their combination from postnatal day 10 (P10) to P28. Within this period, whisker-evoked activity of neurons displayed a general decrease in layer 2/3 (L2/3) and L4, but increased in L5 and L6. Distinct alterations in neuronal response adaptation during the 2-s period of stimulation at ~5 Hz accompanied these changes. Moreover, single-unit analysis revealed that response selectivity in favor of either lateral deflection or axial tapping emerges in deeper layers within the critical period around P14. For superficial layers we confirmed this finding using calcium imaging of L2/3 neurons, which also exhibited emergence of response selectivity as well as progressive sparsification and decorrelation of evoked responses around P14. Our results demonstrate layer-specific development of sensory responsiveness and response selectivity in mouse somatosensory cortex coinciding with the onset of exploratory behavior.

Mice use robust and common strategies to discriminate natural scenes

Mice use vision to navigate and avoid predators in natural environments. However, their visual systems are compact compared to other mammals, and it is unclear how well mice can discriminate ethologically relevant scenes. Here, we examined natural scene discrimination in mice using an automated touch-screen system. We estimated the discrimination difficulty using the computational metric structural similarity (SSIM), and constructed psychometric curves. However, the performance of each mouse was better predicted by the mean performance of other mice than SSIM. This high inter-mouse agreement indicates that mice use common and robust strategies to discriminate natural scenes. We tested several other image metrics to find an alternative to SSIM for predicting discrimination performance. We found that a simple, primary visual cortex (V1)-inspired model predicted mouse performance with fidelity approaching the inter-mouse agreement. The model involved convolving the images with Gabor filters, and its performance varied with the orientation of the Gabor filter. This orientation dependence was driven by the stimuli, rather than an innate biological feature. Together, these results indicate that mice are adept at discriminating natural scenes, and their performance is well predicted by simple models of V1 processing.

Different Modes of Visual Integration in the Lateral Geniculate Nucleus Revealed by Single-Cell-Initiated Transsynaptic Tracing

The thalamus receives sensory input from different circuits in the periphery. How these sensory channels are integrated at the level of single thalamic cells is not well understood. We performed targeted single-cell-initiated transsynaptic tracing to label the retinal ganglion cells that provide input to individual principal cells in the mouse lateral geniculate nucleus (LGN). We identified three modes of sensory integration by single LGN cells. In the first, 1–5 ganglion cells of mostly the same type converged from one eye, indicating a relay mode. In the second, 6–36 ganglion cells of different types converged from one eye, revealing a combination mode. In the third, up to 91 ganglion cells converged from both eyes, revealing a binocular combination mode in which functionally specialized ipsilateral inputs joined broadly distributed contralateral inputs. Thus, the LGN employs at least three modes of visual input integration, each exhibiting different degrees of specialization.

•

Individual LGN cells integrate retinal inputs in one of three distinct modes

•

Relay-mode cells integrate inputs from few retinal ganglion cells of mostly one type

•

Combination- and binocular-mode cells combine inputs from many ganglion cell types

•

The three integration modes exhibit different degrees of cell-type specialization

Motion Vision: Cortical Preferences Influenced by Retinal Direction Selectivity

A recent study shows that retinal direction selectivity influences a subset of cells in primary visual cortex which respond to the optic flow associated with forward motion, while other cortical direction selective cells perform this computation independently.

Causal evidence for retina-dependent and -independent visual motion computations in mouse cortex

How neuronal computations in the sensory periphery contribute to computations in the cortex is not well understood. We examined this question in the context of visual-motion processing in the retina and primary visual cortex (V1) of mice. We disrupted retinal direction selectivity, either exclusively along the horizontal axis using FRMD7 mutants or along all directions by ablating starburst amacrine cells, and monitored neuronal activity in layer 2/3 of V1 during stimulation with visual motion. In control mice, we found an over-representation of cortical cells preferring posterior visual motion, the dominant motion direction an animal experiences when it moves forward. In mice with disrupted retinal direction selectivity, the over-representation of posterior-motion-preferring cortical cells disappeared, and their responses at higher stimulus speeds were reduced. This work reveals the existence of two functionally distinct, sensory-periphery-dependent and -independent computations of visual motion in the cortex.

Flashing Lights Induce Prolonged Distortions in Visual Cortical Responses and Visual Perception

The primary sensory neocortex generates an internal representation of the environment, and its circuit reorganization is thought to lead to a modification of sensory perception. This reorganization occurs primarily through activity-dependent plasticity and has been well documented in animals during early developmental stages. Here, we describe a new method for the noninvasive induction of long-term plasticity in the mature brain: simple transient visual stimuli (i.e., flashing lights) can be used to induce prolonged modifications in visual cortical processing and visually driven behaviors. Our previous studies have shown that, in the primary visual cortex (V1) of mice, a flashing light stimulus evokes a long-delayed response that persists for seconds. When the mice were repetitively presented with drifting grating stimuli (conditioned stimuli) during the flash stimulus-evoked delayed response period, the V1 neurons exhibited a long-lasting decrease in responsiveness to the conditioned stimuli. The flash stimulus-induced underrepresentation of the grating motion was specific to the direction of the conditioned stimuli and was associated with a decrease in the animal's ability to detect the motion of the drifting gratings. The neurophysiological and behavioral plasticity both persisted for at least several hours and required N-methyl-d-aspartate receptor activation in the visual cortex. We propose that flashing light stimuli can be used as an experimental tool to investigate the visual function and plasticity of neuronal representations and perception after a critical period of neocortical plasticity.

Activity-dependent development of visual receptive fields

It is widely appreciated that neuronal activity contributes to the development of brain representations of the external world. In the visual system, in particular, it is well known that activity cooperates with molecular cues to establish the topographic organization of visual maps on a macroscopic scale [1,2] (Huberman et al., 2008; Cang and Feldheim, 2013), mapping axons in a retinotopic and eye-specific manner. In recent years, significant progress has been made in elucidating the role of activity in driving the finer-scale circuit refinement that shapes the receptive fields of individual cells. In this review, we focus on these recent breakthroughs-primarily in mice, but also in other mammals where noted.

Mixed functional microarchitectures for orientation selectivity in the mouse primary visual cortex

A minicolumn is the smallest anatomical module in the cortical architecture, but it is still in debate whether it serves as functional units for cortical processing. In the rodent primary visual cortex (V1), neurons with different preferred orientations are mixed horizontally in a salt and pepper manner, but vertical functional organization was not examined. In this study, we found that neurons with similar orientation preference are weakly but significantly clustered vertically in a short length and horizontally in the scale of a minicolumn. Interestingly, the vertical clustering is found only in a part of minicolumns, and others are composed of neurons with a variety of orientation preferences. Thus, the mouse V1 is a mixture of vertical clusters of neurons with various degrees of orientation similarity, which may be the compromise between the brain size and keeping the vertical clusters of similarly tuned neurons at least in a subset of clusters.

Primary visual cortical neurons display mostly a salt and pepper arrangement of orientation preferences along the horizontal cortical axis. Here the authors show that a significant subset of minicolumns, one-cell wide arrays of cells arranged along the vertical axis, show similar orientation tuning preferences.

The Wiring of Developing Sensory Circuits-From Patterned Spontaneous Activity to Synaptic Plasticity Mechanisms

In order to accurately process incoming sensory stimuli, neurons must be organized into functional networks, with both genetic and environmental factors influencing the precise arrangement of connections between cells. Teasing apart the relative contributions of molecular guidance cues, spontaneous activity and visual experience during this maturation is on-going. During development of the sensory system, the first, rough organization of connections is created by molecular factors. These connections are then modulated by the intrinsically generated activity of neurons, even before the senses have become operational. Spontaneous waves of depolarizations sweep across the nervous system, placing them in a prime position to strengthen correct connections and weaken others, shaping synapses into a useful network. A large body of work now support the idea that, rather than being a mere side-effect of the system, spontaneous activity actually contains information which readies the nervous system so that, as soon as the senses become active, sensory information can be utilized by the animal. An example is the neonatal mouse. As soon as the eyelids first open, neurons in the cortex respond to visual information without the animal having previously encountered structured sensory input (Cang et al., 2005b; Rochefort et al., 2011; Zhang et al., 2012; Ko et al., 2013). In vivo imaging techniques have advanced considerably, allowing observation of the natural activity in the brain of living animals down to the level of the individual synapse. New (opto)genetic methods make it possible to subtly modulate the spatio-temporal properties of activity, aiding our understanding of how these characteristics relate to the function of spontaneous activity. Such experiments have had a huge impact on our knowledge by permitting direct testing of ideas about the plasticity mechanisms at play in the intact system, opening up a provocative range of fresh questions. Here, we intend to outline the most recent descriptions of spontaneous activity patterns in rodent developing sensory areas, as well as the inferences we can make about the information content of those activity patterns and ideas about the plasticity rules that allow this activity to shape the young brain.

Modulation of Neural Network Activity through Single Cell Ablation: An in Vitro Model of Minimally Invasive Neurosurgery

The technological advancement of optical approaches, and the growth of their applications in neuroscience, has allowed investigations of the physio-pathology of neural networks at a single cell level. Therefore, better understanding the role of single neurons in the onset and progression of neurodegenerative conditions has resulted in a strong demand for surgical tools operating with single cell resolution. Optical systems already provide subcellular resolution to monitor and manipulate living tissues, and thus allow understanding the potentiality of surgery actuated at single cell level. In the present work, we report an in vitro experimental model of minimally invasive surgery applied on neuronal cultures expressing a genetically encoded calcium sensor. The experimental protocol entails the continuous monitoring of the network activity before and after the ablation of a single neuron, to provide a robust evaluation of the induced changes in the network activity. We report that in subpopulations of about 1000 neurons, even the ablation of a single unit produces a reduction of the overall network activity. The reported protocol represents a simple and cost effective model to study the efficacy of single-cell surgery, and it could represent a test-bed to study surgical procedures circumventing the abrupt and complete tissue removal in pathological conditions.

Spatiotemporal Features of Retinal Waves Instruct the Wiring of the Visual Circuitry

Coordinated spontaneous activity is present in different sensory systems during early stages of development. This activity is thought to play a critical role in the development of sensory representations before the maturation of sensory experience. In the visual system, the mechanisms by which spatiotemporal properties of retinal spontaneous activity, called retinal waves, drive developmental events has been well studied. Recent advancements in pharmacological, genetic, and optogenetic manipulations have provided further understanding of the contribution of specific spatiotemporal properties of retinal waves to eye-specific segregation and retinotopic refinement of retinofugal projections. Here we review some of the recent progress in understanding the role of retinal waves in the early stages of visual system development, prior to the maturation of vision.

A framework for the first-person internal sensation of visual perception in mammals and a comparable circuitry for olfactory perception in Drosophila

Perception is a first-person internal sensation induced within the nervous system at the time of arrival of sensory stimuli from objects in the environment. Lack of access to the first-person properties has limited viewing perception as an emergent property and it is currently being studied using third-person observed findings from various levels. One feasible approach to understand its mechanism is to build a hypothesis for the specific conditions and required circuit features of the nodal points where the mechanistic operation of perception take place for one type of sensation in one species and to verify it for the presence of comparable circuit properties for perceiving a different sensation in a different species. The present work explains visual perception in mammalian nervous system from a first-person frame of reference and provides explanations for the homogeneity of perception of visual stimuli above flicker fusion frequency, the perception of objects at locations different from their actual position, the smooth pursuit and saccadic eye movements, the perception of object borders, and perception of pressure phosphenes. Using results from temporal resolution studies and the known details of visual cortical circuitry, explanations are provided for (a) the perception of rapidly changing visual stimuli, (b) how the perception of objects occurs in the correct orientation even though, according to the third-person view, activity from the visual stimulus reaches the cortices in an inverted manner and (c) the functional significance of well-conserved columnar organization of the visual cortex. A comparable circuitry detected in a different nervous system in a remote species-the olfactory circuitry of the fruit fly Drosophila melanogaster-provides an opportunity to explore circuit functions using genetic manipulations, which, along with high-resolution microscopic techniques and lipid membrane interaction studies, will be able to verify the structure-function details of the presented mechanism of perception.