Random Wiring, Ganglion Cell Mosaics, and the Functional Architecture of the Visual Cortex

Coherent cortical representations develop after experience via feedforward-recurrent circuit alignment

Sensory cortical areas guide behavior by transforming stimulus-driven inputs into selective responses representing relevant features. A classic example is the representation of edge orientations in the visual cortex 1-4 , where layer 4 (L4) neurons co-activated by an orientation provide feedforward inputs to specific functional modules in layer 2/3 (L2/3) that share strong recurrent connections 5-7 . The aligned state of feedforward-recurrent interactions is critical for amplifying selective cortical responses 8-12 , but how it develops remains unclear. Using simultaneous electrophysiology and calcium imaging in visually naïve animals we find that coactivity of L4 neurons and L2/3 modular responses elicited by oriented gratings lacks the tight relationship to orientation preference found in experienced animals. One factor that could contribute to the lack of functionally specific coactivity is high variability in naïve L4 neuron responses that decreases significantly following experience. But a computational model of feedforward-recurrent interaction suggests that high variability alone is insufficient to explain the naïve state and provides a biological signature of feedforward-recurrent misalignment that we confirm with whole-cell recordings: dynamic changes in orientation tuning of L2/3 subthreshold responses shortly after stimulus onset. In conclusion, we provide diverse evidence for a realignment of feedforward-recurrent interactions following experience that is critical for building reliable sensory representations with interlaminar temporal coherence.

Fast imaging of millimeter-scale areas with beam deflection transmission electron microscopy

Serial section transmission electron microscopy (TEM) has proven to be one of the leading methods for millimeter-scale 3D imaging of brain tissues at nanoscale resolution. It is important to further improve imaging efficiency to acquire larger and more brain volumes. We report here a threefold increase in the speed of TEM by using a beam deflecting mechanism to enable highly efficient acquisition of multiple image tiles (nine) for each motion of the mechanical stage. For millimeter-scale areas, the duty cycle of imaging doubles to more than 30%, yielding a net average imaging rate of 0.3 gigapixels per second. If fully utilized, an array of four beam deflection TEMs should be capable of imaging a dataset of cubic millimeter scale in five weeks.

Optimization-Based Pairwise Interaction Point Process (O-PIPP): A Precise and Universal Retinal Mosaic Modeling Approach

Purpose

A retinal mosaic, the spatial organization of a population of homotypic neurons, is thought to sample a specific visual feature into the feedforward visual pathway. The purpose of this study was to propose a universal modeling approach for precisely generating retinal mosaics and overcoming the limitations of previous models, especially in modeling abnormal mosaic patterns under disease conditions.

Methods

Here, we developed the optimization-based pairwise interaction point process (O-PIPP). It incorporates optimization techniques into previous simulation approaches, enabling directional control of the simulation process according to the user-designed optimization target. For the convenience of the community, we implemented the O-PIPP approach into a Python package and a website application.

Results

We showed that the O-PIPP can generate more precise neural spatial patterns of healthy and diseased mosaics compared to previous phenomenological approaches. Notably, through modeling the retinal neural circuitry with O-PIPP-simulated retinitis pigmentosa cone mosaics, we elucidated how the cone mosaic rearrangement impacted the information processing of ganglion cells.

Conclusions

The O-PIPP provides a precise and universal tool to simulate realistic mosaics, which could help to investigate the function of retinal mosaics in vision.

Orientation pinwheels in primary visual cortex of a highly visual marsupial

Primary visual cortices in many mammalian species exhibit modular and periodic orientation preference maps arranged in pinwheel-like layouts. The role of inherited traits as opposed to environmental influences in determining this organization remains unclear. Here, we characterize the cortical organization of an Australian marsupial, revealing pinwheel organization resembling that of eutherian carnivores and primates but distinctly different from the simpler salt-and-pepper arrangement of eutherian rodents and rabbits. The divergence of marsupials from eutherians 160 million years ago and the later emergence of rodents and rabbits suggest that the salt-and-pepper structure is not the primitive ancestral form. Rather, the genetic code that enables complex pinwheel formation is likely widespread, perhaps extending back to the common therian ancestors of modern mammals.

Punctuated evolution of visual cortical circuits? Evidence from the large rodent Dasyprocta leporina, and the tiny primate Microcebus murinus

Recent reports of the lack of periodic orientation columns in a very large rodent species, the red-rumped agouti, and the existence of incompressible hypercolumns in the lineage of primates, as demonstrated in one of the smallest primates, the mouse lemur, strengthen the interpretation that salt-and-pepper and columns-and-pinwheel mosaics are two distinct functional layouts. These layouts do neither depend on lifestyle nor scale with body size, brain size, absolute neuron numbers, binocular overlap, or visual acuity, but are primarily distinguishable by phylogenetic traits. The predictive value of other biological signatures such as V1 neuronal surface density and the central-peripheral density ratio of retinal ganglion cells are reconsidered, and experiments elucidating the intracortical connectivity in rodents are proposed.

Orientation Preference Maps in Microcebus murinus Reveal Size-Invariant Design Principles in Primate Visual Cortex

Orientation preference maps (OPMs) are a prominent feature of primary visual cortex (V1) organization in many primates and carnivores. In rodents, neurons are not organized in OPMs but are instead interspersed in a “salt and pepper” fashion, although clusters of orientation-selective neurons have been reported. Does this fundamental difference reflect the existence of a lower size limit for orientation columns (OCs) below which they cannot be scaled down with decreasing V1 size? To address this question, we examined V1 of one of the smallest living primates, the 60-g prosimian mouse lemur (Microcebus murinus). Using chronic intrinsic signal imaging, we found that mouse lemur V1 contains robust OCs, which are arranged in a pinwheel-like fashion. OC size in mouse lemurs was found to be only marginally smaller compared to the macaque, suggesting that these circuit elements are nearly incompressible. The spatial arrangement of pinwheels is well described by a common mathematical design of primate V1 circuit organization. In order to accommodate OPMs, we found that the mouse lemur V1 covers one-fifth of the cortical surface, which is one of the largest V1-to-cortex ratios found in primates. These results indicate that the primate-type visual cortical circuit organization is constrained by a size limitation and raises the possibility that its emergence might have evolved by disruptive innovation rather than gradual change.

Orientation preference maps are a hallmark of V1 organization in all primates studied thus far, yet they are absent in rodents. It is uncertain whether these structures scale with body or brain size. Using intrinsic signal imaging, Ho et al. reveal the presence of such maps in the V1 of the world’s smallest primate, the mouse lemur (Microcebus murinus).

Spontaneous Retinal Waves Can Generate Long-Range Horizontal Connectivity in Visual Cortex

In the primary visual cortex (V1) of higher mammals, long-range horizontal connections (LHCs) are observed to develop, linking iso-orientation domains of cortical tuning. It is unknown how this feature-specific wiring of circuitry develops before eye-opening. Here, we suggest that LHCs in V1 may originate from spatiotemporally structured feedforward activities generated from spontaneous retinal waves. Using model simulations based on the anatomy and observed activity patterns of the retina, we show that waves propagating in retinal mosaics can initialize the wiring of LHCs by coactivating neurons of similar tuning, whereas equivalent random activities cannot induce such organizations. Simulations showed that emerged LHCs can produce the patterned activities observed in V1, matching the topography of the underlying orientation map. The model can also reproduce feature-specific microcircuits in the salt-and-pepper organizations found in rodents. Our results imply that early peripheral activities contribute significantly to cortical development of functional circuits.SIGNIFICANCE STATEMENT Long-range horizontal connections (LHCs) in the primary visual cortex (V1) are observed to emerge before the onset of visual experience, thereby selectively connecting iso-domains of orientation map. However, it is unknown how such feature-specific wirings develop before eye-opening. Here, we show that LHCs in V1 may originate from the feature-specific activation of cortical neurons by spontaneous retinal waves during early developmental stages. Our simulations of a visual cortex model show that feedforward activities from the retina initialize the spatial organization of activity patterns in V1, which induces visual feature-specific wirings in the V1 neurons. Our model also explains the origin of cortical microcircuits observed in rodents, suggesting that the proposed developmental mechanism is universally applicable to circuits of various mammalian species.

A model for the origin and development of visual orientation selectivity

Orientation selectivity is a key property of primary visual cortex that contributes, downstream, to object recognition. The origin of orientation selectivity, however, has been debated for decades. It is known that on- and off-centre subcortical pathways converge onto single neurons in primary visual cortex, and that the spatial offset between these pathways gives rise to orientation selectivity. On- and off-centre pathways are intermingled, however, so it is unclear how their inputs to cortex come to be spatially segregated. We here describe a model in which the segregation occurs through Hebbian strengthening and weakening of geniculocortical synapses during the development of the visual system. Our findings include the following. 1. Neighbouring on- and off-inputs to cortex largely cancelled each other at the start of development. At each receptive field location, the Hebbian process increased the strength of one input sign at the expense of the other sign, producing a spatial segregation of on- and off-inputs. 2. The resulting orientation selectivity was precise in that the bandwidths of the orientation tuning functions fell within empirical estimates. 3. The model produced maps of preferred orientation–complete with iso-orientation domains and pinwheels–similar to those found in real cortex. 4. These maps did not originate in cortical processes, but from clustering of off-centre subcortical pathways and the relative location of neighbouring on-centre clusters. We conclude that a model with intermingled on- and off-pathways shaped by Hebbian synaptic plasticity can explain both the origin and development of orientation selectivity.

Many neurons in mammalian primary visual cortex are highly selective for the orientation of visual contours and can therefore contribute to object recognition. Orientation selectivity depends on on- and off-centre retinal neurons that respond, respectively, to light and dark. We describe a signal-processing model that includes both subcortical pathways and cortical neurons. The model predicts the preferred orientation of a cortical neuron from the empirically determined spatial layout of retinal cells. Further, the subcortical-to-cortical connections change in strength during visual development, meaning that cortical neurons in the model have orientation selectivity just as precise as real neurons. Our model can therefore explain the origin of orientation selectivity and the way it develops during visual system maturation.

The gist and details of sex differences in cognition and the brain: How parallels in sex differences across domains are shaped by the locus coeruleus and catecholamine systems

Across three different domains, there are similar sex differences in how men and women process information. There tends to be a male advantage in attending to and remembering the gist (essential central information of a scene or situation), but a female advantage in attending to and remembering the details (non-essential peripheral information of a scene or situation). This is seen in emotional memory, where emotion enhances gist memory more for males than for females, but enhances detail memory more for females than for males. It also occurs in spatial memory, where men tend to notice and remember the gist of where they or objects are in space, allowing them to more flexibly manipulate themselves or objects within that space, whereas women tend to recall the details of the space around them, allowing them to accurately remember the locations of objects. Finally, such sex differences have also been noted in perception of stimuli such that men attend to global aspects of stimuli (such as a large letter E) more than women, whereas women attend more to the local aspects (such as the many smaller letter Ts making up the E). We review the parallel sex differences seen across these domains in this paper and how they relate to the different brain systems involved in each of these task domains. In addition, we discuss how sex differences in evolutionary pressures and in the locus coeruleus and norepinephrine system may account for why parallel sex differences occur across these different task domains.

Distributed network interactions and their emergence in developing neocortex

The principles governing the functional organization and development of long-range network interactions in the neocortex remain poorly understood. Using in vivo wide-field and 2-photon calcium imaging of spontaneous activity patterns in mature ferret visual cortex, we find widespread modular correlation patterns that accurately predict the local structure of visually-evoked orientation columns several millimeters away. Longitudinal imaging demonstrates that long-range spontaneous correlations are present early in cortical development prior to the elaboration of horizontal connections, and predict mature network structure. Silencing feed-forward drive through retinal or thalamic blockade does not eliminate early long-range correlated activity, suggesting a cortical origin. Circuit models containing only local, but heterogeneous, connections are sufficient to generate long-range correlated activity by confining activity patterns to a low-dimensional subspace via multi-synaptic short-range interactions. These results suggest that local connections in early cortical circuits can generate structured long-range network correlations that guide the formation of visually-evoked distributed functional networks.

Dynamical complexity and computation in recurrent neural networks beyond their fixed point

Spontaneous activity found in neural networks usually results in a reduction of computational performance. As a consequence, artificial neural networks are often operated at the edge of chaos, where the network is stable yet highly susceptible to input information. Surprisingly, regular spontaneous dynamics in Neural Networks beyond their resting state possess a high degree of spatio-temporal synchronization, a situation that can also be found in biological neural networks. Characterizing information preservation via complexity indices, we show how spatial synchronization allows rRNNs to reduce the negative impact of regular spontaneous dynamics on their computational performance.

Neural field model to reconcile structure with function in primary visual cortex

Voltage-sensitive dye imaging experiments in primary visual cortex (V1) have shown that local, oriented visual stimuli elicit stable orientation-selective activation within the stimulus retinotopic footprint. The cortical activation dynamically extends far beyond the retinotopic footprint, but the peripheral spread stays non-selective-a surprising finding given a number of anatomo-functional studies showing the orientation specificity of long-range connections. Here we use a computational model to investigate this apparent discrepancy by studying the expected population response using known published anatomical constraints. The dynamics of input-driven localized states were simulated in a planar neural field model with multiple sub-populations encoding orientation. The realistic connectivity profile has parameters controlling the clustering of long-range connections and their orientation bias. We found substantial overlap between the anatomically relevant parameter range and a steep decay in orientation selective activation that is consistent with the imaging experiments. In this way our study reconciles the reported orientation bias of long-range connections with the functional expression of orientation selective neural activity. Our results demonstrate this sharp decay is contingent on three factors, that long-range connections are sufficiently diffuse, that the orientation bias of these connections is in an intermediate range (consistent with anatomy) and that excitation is sufficiently balanced by inhibition. Conversely, our modelling results predict that, for reduced inhibition strength, spurious orientation selective activation could be generated through long-range lateral connections. Furthermore, if the orientation bias of lateral connections is very strong, or if inhibition is particularly weak, the network operates close to an instability leading to unbounded cortical activation.