Neural Mechanisms Mediating Motion Sensitivity in Parasol Ganglion Cells of the Primate Retina

Modeling responses of macaque and human retinal ganglion cells to natural images using a convolutional neural network

Linear-nonlinear (LN) cascade models provide a simple way to capture retinal ganglion cell (RGC) responses to artificial stimuli such as white noise, but their ability to model responses to natural images is limited. Recently, convolutional neural network (CNN) models have been shown to produce light response predictions that were substantially more accurate than those of a LN model. However, this modeling approach has not yet been applied to responses of macaque or human RGCs to natural images. Here, we train and test a CNN model on responses to natural images of the four numerically dominant RGC types in the macaque and human retina - ON parasol, OFF parasol, ON midget and OFF midget cells. Compared with the LN model, the CNN model provided substantially more accurate response predictions. Linear reconstructions of the visual stimulus were more accurate for CNN compared to LN model-generated responses, relative to reconstructions obtained from the recorded data. These findings demonstrate the effectiveness of a CNN model in capturing light responses of major RGC types in the macaque and human retinas in natural conditions.

From water to land: Evolution of photoreceptor circuits for vision in air

When vertebrates first conquered the land, they encountered a visual world that was radically distinct from that of their aquatic ancestors. Fish exploit the strong wavelength-dependent interactions of light with water by differentially feeding the signals from up to 5 spectral photoreceptor types into distinct behavioural programmes. However, above the water the same spectral rules do not apply, and this called for an update to visual circuit strategies. Early tetrapods soon evolved the double cone, a still poorly understood pair of new photoreceptors that brought the "ancestral terrestrial" complement from 5 to 7. Subsequent nonmammalian lineages differentially adapted this highly parallelised retinal input strategy for their diverse visual ecologies. By contrast, mammals shed most ancestral photoreceptors and converged on an input strategy that is exceptionally general. In eutherian mammals including in humans, parallelisation emerges gradually as the visual signal traverses the layers of the retina and into the brain.

Synaptic Origins of the Complex Receptive Field Structure in Primate Smooth Monostratified Retinal Ganglion Cells

Considerable progress has been made in studying the receptive fields of the most common primate retinal ganglion cell (RGC) types, such as parasol RGCs. Much less is known about the rarer primate RGC types and the circuitry that gives rise to noncanonical receptive field structures. The goal of this study was to analyze synaptic inputs to smooth monostratified RGCs to determine the origins of their complex spatial receptive fields, which contain isolated regions of high sensitivity called "hotspots." Interestingly, smooth monostratified RGCs co-stratify with the well-studied parasol RGCs and are thus constrained to receiving input from bipolar and amacrine cells with processes sharing the same layer, raising the question of how their functional differences originate. Through 3D reconstructions of circuitry and synapses onto ON smooth monostratified and ON parasol RGCs from central macaque retina, we identified four distinct sampling strategies employed by smooth and parasol RGCs to extract diverse response properties from co-stratifying bipolar and amacrine cells. The two RGC types differed in the proportion of amacrine cell input, relative contributions of co-stratifying bipolar cell types, amount of synaptic input per bipolar cell, and spatial distribution of bipolar cell synapses. Our results indicate that the smooth RGC's complex receptive field structure arises through spatial asymmetries in excitatory bipolar cell input which formed several discrete clusters comparable with physiologically measured hotspots. Taken together, our results demonstrate how the striking differences between ON parasol and ON smooth monostratified RGCs arise from distinct strategies for sampling a common set of synaptic inputs.

The Role of Retinal Ganglion Cell Structure and Function in Glaucoma

Glaucoma, a leading cause of irreversible blindness globally, primarily affects retinal ganglion cells (RGCs). This review dives into the anatomy of RGC subtypes, covering the different underlying theoretical mechanisms that lead to RGC susceptibility in glaucoma, including mechanical, vascular, excitotoxicity, and neurotrophic factor deficiency, as well as oxidative stress and inflammation. Furthermore, we examined numerous imaging methods and functional assessments to gain insight into RGC health. Finally, we investigated the current possible neuroprotective targets for RGCs that could help with future glaucoma research and management.

Evolution of neuronal cell classes and types in the vertebrate retina

The basic plan of the retina is conserved across vertebrates, yet species differ profoundly in their visual needs1. Retinal cell types may have evolved to accommodate these varied needs, but this has not been systematically studied. Here we generated and integrated single-cell transcriptomic atlases of the retina from 17 species: humans, two non-human primates, four rodents, three ungulates, opossum, ferret, tree shrew, a bird, a reptile, a teleost fish and a lamprey. We found high molecular conservation of the six retinal cell classes (photoreceptors, horizontal cells, bipolar cells, amacrine cells, retinal ganglion cells (RGCs) and Müller glia), with transcriptomic variation across species related to evolutionary distance. Major subclasses were also conserved, whereas variation among cell types within classes or subclasses was more pronounced. However, an integrative analysis revealed that numerous cell types are shared across species, based on conserved gene expression programmes that are likely to trace back to an early ancestral vertebrate. The degree of variation among cell types increased from the outer retina (photoreceptors) to the inner retina (RGCs), suggesting that evolution acts preferentially to shape the retinal output. Finally, we identified rodent orthologues of midget RGCs, which comprise more than 80% of RGCs in the human retina, subserve high-acuity vision, and were previously believed to be restricted to primates2. By contrast, the mouse orthologues have large receptive fields and comprise around 2% of mouse RGCs. Projections of both primate and mouse orthologous types are overrepresented in the thalamus, which supplies the primary visual cortex. We suggest that midget RGCs are not primate innovations, but are descendants of evolutionarily ancient types that decreased in size and increased in number as primates evolved, thereby facilitating high visual acuity and increased cortical processing of visual information.

Detectability of Visual Field Defects in Glaucoma Using Moving Versus Static Stimuli for Perimetry

Purpose

We have previously shown that using moving, instead of static, stimuli extends the effective dynamic range of automated perimetry in glaucoma. In this study, we further investigate the effect of using moving stimuli on the detectability of functional loss.

Methods

We used two experimental perimetry paradigms to test 155 subjects with a diagnosis of glaucoma or glaucoma suspect, and 34 healthy control subjects. One test used stimuli moving parallel to the average nerve fiber bundle orientation at each location; the other used static stimuli. Algorithms were otherwise identical. Sensitivities to moving stimuli were transformed to the equivalent values for static stimuli based on a Bland-Altman plot. The proportions of locations outside age-corrected normative limits were compared, and test-retest variability was compared against defect depth for each stimulus type.

Results

More tested locations were below the fifth percentile of the normative range for that location using static stimuli. However, among locations abnormal according to standard clinical perimetry on the same day, 19.2% were abnormal using static stimuli, versus 20.5% using moving stimuli (P = 0.372). Test-retest variability was 44% lower for moving stimuli across the range of defect depths.

Conclusions

When compared with static automated perimetry and expressed on a common scale, moving stimuli extend the effective dynamic range and decrease variability, without decreasing the detectability of known functional defects.

Translational Relevance

Moving stimuli provide a method to improve known problems of current clinical perimetry.

Diversity of Ganglion Cell Responses to Saccade-Like Image Shifts in the Primate Retina

Saccades are a fundamental part of natural vision. They interrupt fixations of the visual gaze and rapidly shift the image that falls onto the retina. These stimulus dynamics can cause activation or suppression of different retinal ganglion cells, but how they affect the encoding of visual information in different types of ganglion cells is largely unknown. Here, we recorded spiking responses to saccade-like shifts of luminance gratings from ganglion cells in isolated marmoset retinas and investigated how the activity depended on the combination of presaccadic and postsaccadic images. All identified cell types, On and Off parasol and midget cells, as well as a type of Large Off cells, displayed distinct response patterns, including particular sensitivity to either the presaccadic or the postsaccadic image or combinations thereof. In addition, Off parasol and Large Off cells, but not On cells, showed pronounced sensitivity to whether the image changed across the transition. Stimulus sensitivity of On cells could be explained based on their responses to step changes in light intensity, whereas Off cells, in particular, parasol and the Large Off cells, seem to be affected by additional interactions that are not triggered during simple light-intensity flashes. Together, our data show that ganglion cells in the primate retina are sensitive to different combinations of presaccadic and postsaccadic visual stimuli. This contributes to the functional diversity of the output signals of the retina and to asymmetries between On and Off pathways and provides evidence of signal processing beyond what is triggered by isolated steps in light intensity.SIGNIFICANCE STATEMENT Sudden eye movements (saccades) shift our direction of gaze, bringing new images in focus on our retinas. To study how retinal neurons deal with these rapid image transitions, we recorded spiking activity from ganglion cells, the output neurons of the retina, in isolated retinas of marmoset monkeys while shifting a projected image in a saccade-like fashion across the retina. We found that the cells do not just respond to the newly fixated image, but that different types of ganglion cells display different sensitivities to the presaccadic and postsaccadic stimulus patterns. Certain Off cells, for example, are sensitive to changes in the image across transitions, which contributes to differences between On and Off information channels and extends the range of encoded stimulus features.

Evolution of neuronal cell classes and types in the vertebrate retina

The basic plan of the retina is conserved across vertebrates, yet species differ profoundly in their visual needs (Baden et al., 2020). One might expect that retinal cell types evolved to accommodate these varied needs, but this has not been systematically studied. Here, we generated and integrated single-cell transcriptomic atlases of the retina from 17 species: humans, two non-human primates, four rodents, three ungulates, opossum, ferret, tree shrew, a teleost fish, a bird, a reptile and a lamprey. Molecular conservation of the six retinal cell classes (photoreceptors, horizontal cells, bipolar cells, amacrine cells, retinal ganglion cells [RGCs] and Muller glia) is striking, with transcriptomic differences across species correlated with evolutionary distance. Major subclasses are also conserved, whereas variation among types within classes or subclasses is more pronounced. However, an integrative analysis revealed that numerous types are shared across species based on conserved gene expression programs that likely trace back to the common ancestor of jawed vertebrates. The degree of variation among types increases from the outer retina (photoreceptors) to the inner retina (RGCs), suggesting that evolution acts preferentially to shape the retinal output. Finally, we identified mammalian orthologs of midget RGCs, which comprise >80% of RGCs in the human retina, subserve high-acuity vision, and were believed to be primate-specific (Berson, 2008); in contrast, the mouse orthologs comprise <2% of mouse RGCs. Projections both primate and mouse orthologous types are overrepresented in the thalamus, which supplies the primary visual cortex. We suggest that midget RGCs are not primate innovations, but descendants of evolutionarily ancient types that decreased in size and increased in number as primates evolved, thereby facilitating high visual acuity and increased cortical processing of visual information.

Moving Stimulus Perimetry: A New Functional Test for Glaucoma

Purpose

Static pointwise perimetric sensitivities of less than approximately 19 dB are unreliable in glaucoma owing to excessive variability. We propose using moving stimuli to increase detectability, decrease variability, and hence increase this dynamic range.

Methods

A moving stimulus was designed to travel parallel to the average nerve fiber bundle orientation at each location, and compared against an otherwise identical static stimulus. To assess dynamic range, psychometric functions were measured at 4 locations of each of 10 subjects. To assess clinically realistic test-retest variability, 34 locations of 94 subjects with glaucoma and glaucoma suspects were tested twice, 6 months apart. Pointwise sensitivity estimates were compared using generalized estimating equation regression models. The test-retest limits of agreement for each stimulus were assessed, adjusted for within-eye clustering.

Results

Using static stimuli, 9 of the 40 psychometric functions had less than a 90% maximum response probability, suggesting being beyond the dynamic range. Eight of those locations had asymptotic maximum of more than 90% with moving stimuli. Sensitivities were higher for moving stimuli (P < 0.001); the difference increased as sensitivity decreased (P < 0.001). Test-retest limits of agreement were narrower for moving stimuli (-6.35 to +6.48 dB) than static stimuli (-12.7 to +7.81 dB). Sixty-two percent of subjects preferred using moving stimuli versus 19% who preferred static stimuli.

Conclusions

Using a moving stimulus increases perimetric sensitivities in regions of glaucomatous loss. This extends the effective dynamic range, allowing reliable testing later into the disease. Results are more repeatable, and the test is preferred by most subjects.

Translational Relevance

Moving stimuli allow reliable testing in patients with more severe glaucoma than currently possible.

Classical center-surround receptive fields facilitate novel object detection in retinal bipolar cells

Antagonistic interactions between center and surround receptive field (RF) components lie at the heart of the computations performed in the visual system. Circularly symmetric center-surround RFs are thought to enhance responses to spatial contrasts (i.e., edges), but how visual edges affect motion processing is unclear. Here, we addressed this question in retinal bipolar cells, the first visual neuron with classic center-surround interactions. We found that bipolar glutamate release emphasizes objects that emerge in the RF; their responses to continuous motion are smaller, slower, and cannot be predicted by signals elicited by stationary stimuli. In our hands, the alteration in signal dynamics induced by novel objects was more pronounced than edge enhancement and could be explained by priming of RF surround during continuous motion. These findings echo the salience of human visual perception and demonstrate an unappreciated capacity of the center-surround architecture to facilitate novel object detection and dynamic signal representation.

Center-surround receptive fields are typically considered to mediate edge detection. Here, by studying retinal bipolar cells responding to flashed and moving stimuli, the authors reveal an additional function: enhanced representation of newly appearing visual items.

Center-surround interactions underlie bipolar cell motion sensitivity in the mouse retina

Motion sensing is a critical aspect of vision. We studied the representation of motion in mouse retinal bipolar cells and found that some bipolar cells are radially direction selective, preferring the origin of small object motion trajectories. Using a glutamate sensor, we directly observed bipolar cells synaptic output and found that there are radial direction selective and non-selective bipolar cell types, the majority being selective, and that radial direction selectivity relies on properties of the center-surround receptive field. We used these bipolar cell receptive fields along with connectomics to design biophysical models of downstream cells. The models and additional experiments demonstrated that bipolar cells pass radial direction selective excitation to starburst amacrine cells, which contributes to their directional tuning. As bipolar cells provide excitation to most amacrine and ganglion cells, their radial direction selectivity may contribute to motion processing throughout the visual system.

How We See Black and White: The Role of Midget Ganglion Cells

According to classical opponent color theory, hue sensations are mediated by spectrally opponent neurons that are excited by some wavelengths of light and inhibited by others, while black-and-white sensations are mediated by spectrally non-opponent neurons that respond with the same sign to all wavelengths. However, careful consideration of the morphology and physiology of spectrally opponent L vs. M midget retinal ganglion cells (RGCs) in the primate retina indicates that they are ideally suited to mediate black-and-white sensations and poorly suited to mediate color. Here we present a computational model that demonstrates how the cortex could use unsupervised learning to efficiently separate the signals from L vs. M midget RGCs into distinct signals for black and white based only correlation of activity over time. The model also reveals why it is unlikely that these same ganglion cells could simultaneously mediate our perception of red and green, and shows how, in theory, a separate small population of midget RGCs with input from S, M, and L cones would be ideally suited to mediating hue perception.

Impact of Photoreceptor Loss on Retinal Circuitry

Our sense of sight relies on photoreceptors, which transduce photons into the nervous system's electrochemical interpretation of the visual world. These precious photoreceptors can be disrupted by disease, injury, and aging. Once photoreceptors start to die, but before blindness occurs, the remaining retinal circuitry can withstand, mask, or exacerbate the photoreceptor deficit and potentially be receptive to newfound therapies for vision restoration. To maximize the retina's receptivity to therapy, one must understand the conditions that influence the state of the remaining retina. In this review, we provide an overview of the retina's structure and function in health and disease. We analyze a collection of observations on photoreceptor disruption and generate a predictive model to identify parameters that influence the retina's response. Finally, we speculate on whether the retina, with its remarkable capacity to function over light levels spanning nine orders of magnitude, uses these same adaptational mechanisms to withstand and perhaps mask photoreceptor loss.

Morphology, Molecular Characterization, and Connections of Ganglion Cells in Primate Retina

The eye sends information about the visual world to the brain on over 20 parallel signal pathways, each specialized to signal features such as spectral reflection (color), edges, and motion of objects in the environment. Each pathway is formed by the axons of a separate type of retinal output neuron (retinal ganglion cell). In this review, we summarize what is known about the excitatory retinal inputs, brain targets, and gene expression patterns of ganglion cells in humans and nonhuman primates. We describe how most ganglion cell types receive their input from only one or two of the 11 types of cone bipolar cell and project selectively to only one or two target regions in the brain. We also highlight how genetic methods are providing tools to characterize ganglion cells and establish cross-species homologies.

Regional Variation of Gap Junctional Connections in the Mammalian Inner Retina

The retinas of many species show regional specialisations that are evident in the differences in the processing of visual input from different parts of the visual field. Regional specialisation is thought to reflect an adaptation to the natural visual environment, optical constraints, and lifestyle of the species. Yet, little is known about regional differences in synaptic circuitry. Here, we were interested in the topographical distribution of connexin-36 (Cx36), the major constituent of electrical synapses in the retina. We compared the retinas of mice, rats, and cats to include species with different patterns of regional specialisations in the analysis. First, we used the density of Prox1-immunoreactive amacrine cells as a marker of any regional specialisation, with higher cell density signifying more central regions. Double-labelling experiments showed that Prox1 is expressed in AII amacrine cells in all three species. Interestingly, large Cx36 plaques were attached to about 8-10% of Prox1-positive amacrine cell somata, suggesting the strong electrical coupling of pairs or small clusters of cell bodies. When analysing the regional changes in the volumetric density of Cx36-immunoreactive plaques, we found a tight correlation with the density of Prox1-expressing amacrine cells in the ON, but not in the OFF sublamina in all three species. The results suggest that the relative contribution of electrical synapses to the ON- and OFF-pathways of the retina changes with retinal location, which may contribute to functional ON/OFF asymmetries across the visual field.

Predictive encoding of motion begins in the primate retina

Predictive motion encoding is an important aspect of visually guided behavior that allows animals to estimate the trajectory of moving objects. Motion prediction is understood primarily in the context of translational motion, but the environment contains other types of behaviorally salient motion correlation such as those produced by approaching or receding objects. However, the neural mechanisms that detect and predictively encode these correlations remain unclear. We report here that four of the parallel output pathways in the primate retina encode predictive motion information, and this encoding occurs for several classes of spatiotemporal correlation that are found in natural vision. Such predictive coding can be explained by known nonlinear circuit mechanisms that produce a nearly optimal encoding, with transmitted information approaching the theoretical limit imposed by the stimulus itself. Thus, these neural circuit mechanisms efficiently separate predictive information from nonpredictive information during the encoding process.

Impaired motion perception is associated with functional and structural visual pathway damage in multiple sclerosis and neuromyelitis optica spectrum disorders

Background:

Decreased motion perception has been suggested as a marker for visual pathway demyelination in optic neuritis (ON) and/or multiple sclerosis (MS).

Objectives:

To examine the influence of neuro-axonal damage on motion perception in MS and neuromyelitis optica spectrum disorders (NMOSD).

Methods:

We analysed motion perception with numbers-from-motion (NFM), visual acuity, (multifocal (mf)) VEP, optical coherence tomography in patients with MS (n = 38, confirmatory cohort n = 43), NMOSD (n = 13) and healthy controls (n = 33).

Results:

NFM was lower compared with controls in MS (B = −12.37, p < 0.001) and NMOSD (B = −34.5, p < 0.001). NFM was lower in ON than in non-ON eyes (B = −30.95, p = 0.041) in NMOSD, but not MS. In MS and NMOSD, lower NFM was associated with worse visual acuity (B = −139.4, p < 0.001/B = −77.2, p < 0.001) and low contrast letter acuity (B = 0.99, p = 0.002/B = 1.6, p < 0.001), thinner peripapillary retinal nerve fibre layer (B = 1.0, p < 0.001/ B = 0.92, p = 0.016) and ganglion cell/inner plexiform layer (B = 64.8, p < 0.001/B = 79.5, p = 0.006), but not with VEP P100 latencies. In the confirmatory MS cohort, lower NFM was associated with thinner retinal nerve fibre layer (B = 1.351, p < 0.001) and increased mfVEP P100 latencies (B = −1.159, p < 0.001).

Conclusions:

Structural neuro-axonal visual pathway damage is an important driver of motion perception impairment in MS and NMOSD.

Predictive Visual Motion Extrapolation Emerges Spontaneously and without Supervision at Each Layer of a Hierarchical Neural Network with Spike-Timing-Dependent Plasticity

The fact that the transmission and processing of visual information in the brain takes time presents a problem for the accurate real-time localization of a moving object. One way this problem might be solved is extrapolation: using an object's past trajectory to predict its location in the present moment. Here, we investigate how a simulated in silico layered neural network might implement such extrapolation mechanisms, and how the necessary neural circuits might develop. We allowed an unsupervised hierarchical network of velocity-tuned neurons to learn its connectivity through spike-timing-dependent plasticity (STDP). We show that the temporal contingencies between the different neural populations that are activated by an object as it moves causes the receptive fields of higher-level neurons to shift in the direction opposite to their preferred direction of motion. The result is that neural populations spontaneously start to represent moving objects as being further along their trajectory than where they were physically detected. Because of the inherent delays of neural transmission, this effectively compensates for (part of) those delays by bringing the represented position of a moving object closer to its instantaneous position in the world. Finally, we show that this model accurately predicts the pattern of perceptual mislocalization that arises when human observers are required to localize a moving object relative to a flashed static object (the flash-lag effect; FLE).SIGNIFICANCE STATEMENT Our ability to track and respond to rapidly changing visual stimuli, such as a fast-moving tennis ball, indicates that the brain is capable of extrapolating the trajectory of a moving object to predict its current position, despite the delays that result from neural transmission. Here, we show how the neural circuits underlying this ability can be learned through spike-timing-dependent synaptic plasticity and that these circuits emerge spontaneously and without supervision. This demonstrates how the neural transmission delays can, in part, be compensated to implement the extrapolation mechanisms required to predict where a moving object is at the present moment.

Identification of retinal ganglion cell types expressing the transcription factor Satb2 in three primate species

In primates, the retinal ganglion cells contributing to high acuity spatial vision (midget cells and parasol cells), and blue-yellow color vision (small bistratified cells) are well understood. Many other ganglion cell types with large dendritic fields (named wide-field ganglion cells) have been identified, but their spatial density and distribution are largely unknown. Here we took advantage of the recently established molecular diversity of ganglion cells to study wide-field ganglion cell populations in three primate species. We used antibodies against the transcription factor Special AT-rich binding protein 2 (Satb2) to explore its expression in macaque (Macaca fascicularis, M. nemestrina), human and marmoset (Callithrix jacchus) retinas. In all three species, Satb2 cells make up a low proportion (1.5-4%) of the ganglion cell population, with a slight increase from central to peripheral retina. Intracellular dye injections revealed that in macaque and human retinas, the large majority (over 80%) of Satb2 cells are inner and outer stratifying large sparse cells. By contrast, in marmoset retina the majority (over 60%) of Satb2 expressing cells were broad thorny cells, with smaller proportions of recursive bistratified (putative direction-selective), large bistratified, and outer stratifying narrow thorny cells. Our findings imply that Satb2 expression has undergone rapid species specific adaptations during primate evolution, because expression is not conserved across Old World (macaque, human) and New World (marmoset) suborders.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Reconstruction of natural images from responses of primate retinal ganglion cells

The visual message conveyed by a retinal ganglion cell (RGC) is often summarized by its spatial receptive field, but in principle also depends on the responses of other RGCs and natural image statistics. This possibility was explored by linear reconstruction of natural images from responses of the four numerically-dominant macaque RGC types. Reconstructions were highly consistent across retinas. The optimal reconstruction filter for each RGC - its visual message - reflected natural image statistics, and resembled the receptive field only when nearby, same-type cells were included. ON and OFF cells conveyed largely independent, complementary representations, and parasol and midget cells conveyed distinct features. Correlated activity and nonlinearities had statistically significant but minor effects on reconstruction. Simulated reconstructions, using linear-nonlinear cascade models of RGC light responses that incorporated measured spatial properties and nonlinearities, produced similar results. Spatiotemporal reconstructions exhibited similar spatial properties, suggesting that the results are relevant for natural vision.

Closed loop motor-sensory dynamics in human vision

Vision is obtained with a continuous motion of the eyes. The kinematic analysis of eye motion, during any visual or ocular task, typically reveals two (kinematic) components: saccades, which quickly replace the visual content in the retinal fovea, and drifts, which slowly scan the image after each saccade. While the saccadic exchange of regions of interest (ROIs) is commonly considered to be included in motor-sensory closed-loops, it is commonly assumed that drifts function in an open-loop manner, that is, independent of the concurrent visual input. Accordingly, visual perception is assumed to be based on a sequence of open-loop processes, each initiated by a saccade-triggered retinal snapshot. Here we directly challenged this assumption by testing the dependency of drift kinematics on concurrent visual inputs using real-time gaze-contingent-display. Our results demonstrate a dependency of the trajectory on the concurrent visual input, convergence of speed to condition-specific values and maintenance of selected drift-related motor-sensory controlled variables, all strongly indicative of drifts being included in a closed-loop brain-world process, and thus suggesting that vision is inherently a closed-loop process.

Object-Displacement-Sensitive Visual Neurons Drive Freezing in Drosophila

Visual systems are often equipped with neurons that detect small moving objects, which may represent prey, predators, or conspecifics. Although the processing properties of those neurons have been studied in diverse organisms, links between the proposed algorithms and animal behaviors or circuit mechanisms remain elusive. Here, we have investigated behavioral function, computational algorithm, and neurochemical mechanisms of an object-selective neuron, LC11, in Drosophila. With genetic silencing and optogenetic activation, we show that LC11 is necessary for a visual object-induced stopping behavior in walking flies, a form of short-term freezing, and its activity can promote stopping. We propose a new quantitative model for small object selectivity based on the physiology and anatomy of LC11 and its inputs. The model accurately reproduces LC11 responses by pooling fast-adapting, tightly size-tuned inputs. Direct visualization of neurotransmitter inputs to LC11 confirmed the model conjectures about upstream processing. Our results demonstrate how adaptation can enhance selectivity for behaviorally relevant, dynamic visual features.

Wide-field amacrine cell inputs to ON parasol ganglion cells in macaque retina

Parasol cells are one of the major types of primate retinal ganglion cells. The goal of this study was to describe the synaptic inputs that shape the light responses of the ON type of parasol cells, which are excited by increments in light intensity. A connectome from central macaque retina was generated by serial blockface scanning electron microscopy. Six neighboring ON parasol cells were reconstructed, and their synaptic inputs were analyzed. On average, they received 21% of their input from bipolar cells, excitatory local circuit neurons receiving input from cones. The majority of their input was from amacrine cells, local circuit neurons of the inner retina that are typically inhibitory. Their contributions to the neural circuit providing input to parasol cells are not well-understood, and the focus of this study was on the presynaptic wide-field amacrine cells, which provided 17% of the input to ON parasol cells. These are GABAergic amacrine cells with long, relatively straight dendrites, and sometimes also axons, that run in a single, narrow stratum of the inner plexiform layer. The presynaptic wide-field amacrine cells were reconstructed, and two types were identified based on their characteristic morphology. One presynaptic amacrine cell was identified as semilunar type 2, a polyaxonal cell that is electrically coupled to ON parasol cells. A second amacrine was identified as wiry type 2, a type known to be sensitive to motion. These inputs likely make ON parasol cells more sensitive to stimuli that are rapidly changing outside their classical receptive fields.

Efficient Coding by Midget and Parasol Ganglion Cells in the Human Retina

In humans, midget and parasol ganglion cells account for most of the input from the eyes to the brain. Yet, how they encode visual information is unknown. Here, we perform large-scale multi-electrode array recordings from retinas of treatment-naive patients who underwent enucleation surgery for choroidal malignant melanomas. We identify robust differences in the function of midget and parasol ganglion cells, consistent asymmetries between their ON and OFF types (that signal light increments and decrements, respectively) and divergence in the function of human versus non-human primate retinas. Our computational analyses reveal that the receptive fields of human midget and parasol ganglion cells divide naturalistic movies into adjacent spatiotemporal frequency domains with equal stimulus power, while the asymmetric response functions of their ON and OFF types simultaneously maximize stimulus coverage and information transmission and minimize metabolic cost. Thus, midget and parasol ganglion cells in the human retina efficiently encode our visual environment.

Dynamic properties of VDP-CPG model in rhythmic movement with delay

In this paper, Van Der Pol (VDP) oscillators are used as the output signal of central pattern generator (CPG), and a VDP-CPG network system of quadruped with four primary gaits (walk, trot, pace and bound) is established. The existence conditions of Hopf bifurcations for VDP-CPG systems corresponding to four primary gaits are given, and the coupling strength ranges between oscillators for four gaits are obtained. Numerical simulations are used to support theoretical analysis.

Inference of nonlinear receptive field subunits with spike-triggered clustering

Responses of sensory neurons are often modeled using a weighted combination of rectified linear subunits. Since these subunits often cannot be measured directly, a flexible method is needed to infer their properties from the responses of downstream neurons. We present a method for maximum likelihood estimation of subunits by soft-clustering spike-triggered stimuli, and demonstrate its effectiveness in visual neurons. For parasol retinal ganglion cells in macaque retina, estimated subunits partitioned the receptive field into compact regions, likely representing aggregated bipolar cell inputs. Joint clustering revealed shared subunits between neighboring cells, producing a parsimonious population model. Closed-loop validation, using stimuli lying in the null space of the linear receptive field, revealed stronger nonlinearities in OFF cells than ON cells. Responses to natural images, jittered to emulate fixational eye movements, were accurately predicted by the subunit model. Finally, the generality of the approach was demonstrated in macaque V1 neurons.

Selectivity to approaching motion in retinal inputs to the dorsal visual pathway

To efficiently navigate through the environment and avoid potential threats, an animal must quickly detect the motion of approaching objects. Current models of primate vision place the origins of this complex computation in the visual cortex. Here, we report that detection of approaching motion begins in the retina. Several ganglion cell types, the retinal output neurons, show selectivity to approaching motion. Synaptic current recordings from these cells further reveal that this preference for approaching motion arises in the interplay between presynaptic excitatory and inhibitory circuit elements. These findings demonstrate how excitatory and inhibitory circuits interact to mediate an ethologically relevant neural function. Moreover, the elementary computations that detect approaching motion begin early in the visual stream of primates.

Cell types and cell circuits in human and non-human primate retina

This review summarizes our current knowledge of primate including human retina focusing on bipolar, amacrine and ganglion cells and their connectivity. We have two main motivations in writing. Firstly, recent progress in non-invasive imaging methods to study retinal diseases mean that better understanding of the primate retina is becoming an important goal both for basic and for clinical sciences. Secondly, genetically modified mice are increasingly used as animal models for human retinal diseases. Thus, it is important to understand to which extent the retinas of primates and rodents are comparable. We first compare cell populations in primate and rodent retinas, with emphasis on how the fovea (despite its small size) dominates the neural landscape of primate retina. We next summarise what is known, and what is not known, about the postreceptoral neurone populations in primate retina. The inventories of bipolar and ganglion cells in primates are now nearing completion, comprising ~12 types of bipolar cell and at least 17 types of ganglion cell. Primate ganglion cells show clear differences in dendritic field size across the retina, and their morphology differs clearly from that of mouse retinal ganglion cells. Compared to bipolar and ganglion cells, amacrine cells show even higher morphological diversity: they could comprise over 40 types. Many amacrine types appear conserved between primates and mice, but functions of only a few types are understood in any primate or non-primate retina. Amacrine cells appear as the final frontier for retinal research in monkeys and mice alike.

Understanding the retinal basis of vision across species

The vertebrate retina first evolved some 500 million years ago in ancestral marine chordates. Since then, the eyes of different species have been tuned to best support their unique visuoecological lifestyles. Visual specializations in eye designs, large-scale inhomogeneities across the retinal surface and local circuit motifs mean that all species' retinas are unique. Computational theories, such as the efficient coding hypothesis, have come a long way towards an explanation of the basic features of retinal organization and function; however, they cannot explain the full extent of retinal diversity within and across species. To build a truly general understanding of vertebrate vision and the retina's computational purpose, it is therefore important to more quantitatively relate different species' retinal functions to their specific natural environments and behavioural requirements. Ultimately, the goal of such efforts should be to build up to a more general theory of vision.

Response Latency Tuning by Retinal Circuits Modulates Signal Efficiency

In the visual system, retinal ganglion cells (RGCs) of various subtypes encode preprocessed photoreceptor signals into a spike output which is then transmitted towards the brain through parallel feature pathways. Spike timing determines how each feature signal contributes to the output of downstream neurons in visual brain centers, thereby influencing efficiency in visual perception. In this study, we demonstrate a marked population-wide variability in RGC response latency that is independent of trial-to-trial variability and recording approach. RGC response latencies to simple visual stimuli vary considerably in a heterogenous cell population but remain reliable when RGCs of a single subtype are compared. This subtype specificity, however, vanishes when the retinal circuitry is bypassed via direct RGC electrical stimulation. This suggests that latency is primarily determined by the signaling speed through retinal pathways that provide subtype specific inputs to RGCs. In addition, response latency is significantly altered when GABA inhibition or gap junction signaling is disturbed, which further supports the key role of retinal microcircuits in latency tuning. Finally, modulation of stimulus parameters affects individual RGC response delays considerably. Based on these findings, we hypothesize that retinal microcircuits fine-tune RGC response latency, which in turn determines the context-dependent weighing of each signal and its contribution to visual perception.

Ganglion Cells in Primate Retina Use Fuzzy Logic to Encode Complex Visual Receptive Fields

In most neurons, all spikes look alike. However, in this issue of Neuron, Rhoades et al. (2019) describe a ganglion cell in primate retina that reports visual input to different regions of its receptive field with distinct action potential waveforms.

Neural sensitization improves encoding fidelity in the primate retina

An animal’s motion through the environment can induce large and frequent fluctuations in light intensity on the retina. These fluctuations pose a major challenge to neural circuits tasked with encoding visual information, as they can cause cells to adapt and lose sensitivity. Here, we report that sensitization, a short-term plasticity mechanism, solves this difficult computational problem by maintaining neuronal sensitivity in the face of these fluctuations. The numerically dominant output pathway in the macaque monkey retina, the midget (parvocellular-projecting) pathway, undergoes sensitization under specific conditions, including simulated eye movements. Sensitization is present in the excitatory synaptic inputs from midget bipolar cells and is mediated by presynaptic disinhibition from a wide-field mechanism extending >0.5 mm along the retinal surface. Direct physiological recordings and a computational model indicate that sensitization in the midget pathway supports accurate sensory encoding and prevents a loss of responsiveness during dynamic visual processing.

Light intensity on the retina can fluctuate rapidly during natural vision, posing a challenge for encoding visual information. Here, the authors report that mechanisms of sensitization/facilitation maintain the sensitivity of the numerically dominant neural pathway in the primate retina during dynamic vision.

Unusual Physiological Properties of Smooth Monostratified Ganglion Cell Types in Primate Retina

The functions of the diverse retinal ganglion cell types in primates and the parallel visual pathways they initiate remain poorly understood. Here, unusual physiological and computational properties of the ON and OFF smooth monostratified ganglion cells are explored. Large-scale multi-electrode recordings from 48 macaque retinas revealed that these cells exhibit irregular receptive field structure composed of spatially segregated hotspots, quite different from the classic center-surround model of retinal receptive fields. Surprisingly, visual stimulation of different hotspots in the same cell produced spikes with subtly different spatiotemporal voltage signatures, consistent with a dendritic contribution to hotspot structure. Targeted visual stimulation and computational inference demonstrated strong nonlinear subunit properties associated with each hotspot, supporting a model in which the hotspots apply nonlinearities at a larger spatial scale than bipolar cells. These findings reveal a previously unreported nonlinear mechanism in the output of the primate retina that contributes to signaling spatial information.

An S-cone circuit for edge detection in the primate retina

Midget retinal ganglion cells (RGCs) are the most common RGC type in the primate retina. Their responses have been proposed to mediate both color and spatial vision, yet the specific links between midget RGC responses and visual perception are unclear. Previous research on the dual roles of midget RGCs has focused on those comparing long (L) vs. middle (M) wavelength sensitive cones. However, there is evidence for several other rare midget RGC subtypes receiving S-cone input, but their role in color and spatial vision is uncertain. Here, we confirm the existence of the single S-cone center OFF midget RGC circuit in the central retina of macaque monkey both structurally and functionally. We investigated the receptive field properties of the S-OFF midget circuit with single cell electrophysiology and 3D electron microscopy reconstructions of the upstream circuitry. Like the well-studied L vs. M midget RGCs, the S-OFF midget RGCs have a center-surround receptive field consistent with a role in spatial vision. While spectral opponency in a primate RGC is classically assumed to contribute to hue perception, a role supporting edge detection is more consistent with the S-OFF midget RGC receptive field structure and studies of hue perception.

An Old Neuron Learns New Tricks: Redefining Motion Processing in the Primate Retina

Motion sensitivity requires the comparison of neural responses activated by nearby points in visual space. In this issue of Neuron, Manookin et al. (2018) find that in the primate retina, such comparisons are already manifest in second-order retinal bipolar cells, relying on lateral excitation mediated by gap junctions.

The spectral identity of foveal cones is preserved in hue perception

Organisms are faced with the challenge of making inferences about the physical world from incomplete incoming sensory information. One strategy to combat ambiguity in this process is to combine new information with prior experiences. We investigated the strategy of combining these information sources in color vision. Single cones in human subjects were stimulated and the associated percepts were recorded. Subjects rated each flash for brightness, hue, and saturation. Brightness ratings were proportional to stimulus intensity. Saturation was independent of intensity, but varied between cones. Hue, in contrast, was assigned in a stereotyped manner that was predicted by cone type. These experiments revealed that, near the fovea, long and middle wavelength sensitive cones produce sensations that can be reliably distinguished on the basis of hue, but not saturation or brightness. Taken together, these observations implicate the high-resolution, color-opponent parvocellular pathway in this low-level visual task.

Speed-Selectivity in Retinal Ganglion Cells is Sharpened by Broad Spatial Frequency, Naturalistic Stimuli

Motion detection represents one of the critical tasks of the visual system and has motivated a large body of research. However, it remains unclear precisely why the response of retinal ganglion cells (RGCs) to simple artificial stimuli does not predict their response to complex, naturalistic stimuli. To explore this topic, we use Motion Clouds (MC), which are synthetic textures that preserve properties of natural images and are merely parameterized, in particular by modulating the spatiotemporal spectrum complexity of the stimulus by adjusting the frequency bandwidths. By stimulating the retina of the diurnal rodent, Octodon degus with MC we show that the RGCs respond to increasingly complex stimuli by narrowing their adjustment curves in response to movement. At the level of the population, complex stimuli produce a sparser code while preserving movement information; therefore, the stimuli are encoded more efficiently. Interestingly, these properties were observed throughout different populations of RGCs. Thus, our results reveal that the response at the level of RGCs is modulated by the naturalness of the stimulus - in particular for motion - which suggests that the tuning to the statistics of natural images already emerges at the level of the retina.

Characterization of Retinal Functionality at Different Eccentricities in a Diurnal Rodent

Although the properties of the neurons of the visual system that process central and peripheral regions of the visual field have been widely researched in the visual cortex and the LGN, they have scarcely been documented for the retina. The retina is the first step in integrating optical signals, and despite considerable efforts to functionally characterize the different types of retinal ganglion cells (RGCs), a clear account of the particular functionality of cells with central vs. peripheral fields is still wanting. Here, we use electrophysiological recordings, gathered from retinas of the diurnal rodent Octodon degus, to show that RGCs with peripheral receptive fields (RF) are larger, faster, and have shorter transient responses. This translates into higher sensitivity at high temporal frequencies and a full frequency bandwidth when compared to RGCs with more central RF. We also observed that imbalances between ON and OFF cell populations are preserved with eccentricity. Finally, the high diversity of functional types of RGCs highlights the complexity of the computational strategies implemented in the early stages of visual processing, which could inspire the development of bio-inspired artificial systems.

The dynamic receptive fields of retinal ganglion cells

Retinal ganglion cells (RGCs) were one of the first classes of sensory neurons to be described in terms of a receptive field (RF). Over the last six decades, our understanding of the diversity of RGC types and the nuances of their response properties has grown exponentially. We will review the current understanding of RGC RFs mostly from studies in mammals, but including work from other vertebrates as well. We will argue for a new paradigm that embraces the fluidity of RGC RFs with an eye toward the neuroethology of vision. Specifically, we will focus on (1) different methods for measuring RGC RFs, (2) RF models, (3) feature selectivity and the distinction between fluid and stable RF properties, and (4) ideas about the future of understanding RGC RFs.

Molecular Fingerprinting of On-Off Direction-Selective Retinal Ganglion Cells Across Species and Relevance to Primate Visual Circuits

The ability to detect moving objects is an ethologically salient function. Direction-selective neurons have been identified in the retina, thalamus, and cortex of many species, but their homology has remained unclear. For instance, it is unknown whether direction-selective retinal ganglion cells (DSGCs) exist in primates and, if so, whether they are the equivalent to mouse and rabbit DSGCs. Here, we used a molecular/circuit approach in both sexes to address these issues. In mice, we identify the transcription factor Satb2 (special AT-rich sequence-binding protein 2) as a selective marker for three RGC types: On-Off DSGCs encoding motion in either the anterior or posterior direction, a newly identified type of Off-DSGC, and an Off-sustained RGC type. In rabbits, we find that expression of Satb2 is conserved in On-Off DSGCs; however, it has evolved to include On-Off DSGCs encoding upward and downward motion in addition to anterior and posterior motion. Next, we show that macaque RGCs express Satb2 most likely in a single type. We used rabies virus-based circuit-mapping tools to reveal the identity of macaque Satb2-RGCs and discovered that their dendritic arbors are relatively large and monostratified. Together, these data indicate Satb2-expressing On-Off DSGCs are likely not present in the primate retina. Moreover, if DSGCs are present in the primate retina, it is unlikely that they express Satb2.SIGNIFICANCE STATEMENT The ability to detect object motion is a fundamental feature of almost all visual systems. Here, we identify a novel marker for retinal ganglion cells encoding directional motion that is evolutionarily conserved in mice and rabbits, but not in primates. We show in macaque monkeys that retinal ganglion cells (RGCs) that express this marker comprise a single type and are morphologically distinct from mouse and rabbit direction-selective RGCs. Our findings indicate that On-Off direction-selective retinal neurons may have evolutionarily diverged in primates and more generally provide novel insight into the identity and organization of primate parallel visual pathways.

Neural Mechanisms of Motion Processing in the Mammalian Retina

Visual motion on the retina activates a cohort of retinal ganglion cells (RGCs). This population activity encodes multiple streams of information extracted by parallel retinal circuits. Motion processing in the retina is best studied in the direction-selective circuit. The main focus of this review is the neural basis of direction selectivity, which has been investigated in unprecedented detail using state-of-the-art functional, connectomic, and modeling methods. Mechanisms underlying the encoding of other motion features by broader RGC populations are also discussed. Recent discoveries at both single-cell and population levels highlight the dynamic and stimulus-dependent engagement of multiple mechanisms that collectively implement robust motion detection under diverse visual conditions.

A Role for Mouse Primary Visual Cortex in Motion Perception

Visual motion is an ethologically important stimulus throughout the animal kingdom. In primates, motion perception relies on specific higher-order cortical regions. Although mouse primary visual cortex (V1) and higher-order visual areas show direction-selective (DS) responses, their role in motion perception remains unknown. Here, we tested whether V1 is involved in motion perception in mice. We developed a head-fixed discrimination task in which mice must report their perceived direction of motion from random dot kinematograms (RDKs). After training, mice made around 90% correct choices for stimuli with high coherence and performed significantly above chance for 16% coherent RDKs. Accuracy increased with both stimulus duration and visual field coverage of the stimulus, suggesting that mice in this task integrate motion information in time and space. Retinal recordings showed that thalamically projecting On-Off DS ganglion cells display DS responses when stimulated with RDKs. Two-photon calcium imaging revealed that neurons in layer (L) 2/3 of V1 display strong DS tuning in response to this stimulus. Thus, RDKs engage motion-sensitive retinal circuits as well as downstream visual cortical areas. Contralateral V1 activity played a key role in this motion direction discrimination task because its reversible inactivation with muscimol led to a significant reduction in performance. Neurometric-psychometric comparisons showed that an ideal observer could solve the task with the information encoded in DS L2/3 neurons. Motion discrimination of RDKs presents a powerful behavioral tool for dissecting the role of retino-forebrain circuits in motion processing.

Sensations from a single M-cone depend on the activity of surrounding S-cones

Color vision requires the activity of cone photoreceptors to be compared in post-receptoral circuitry. Decades of psychophysical measurements have quantified the nature of these comparative interactions on a coarse scale. How such findings generalize to a cellular scale remains unclear. To answer that question, we quantified the influence of surrounding light on the appearance of spots targeted to individual cones. The eye's aberrations were corrected with adaptive optics and retinal position was precisely tracked in real-time to compensate for natural movement. Subjects reported the color appearance of each spot. A majority of L-and M-cones consistently gave rise to the sensation of white, while a smaller group repeatedly elicited hue sensations. When blue sensations were reported they were more likely mediated by M- than L-cones. Blue sensations were elicited from M-cones against a short-wavelength light that preferentially elevated the quantal catch in surrounding S-cones, while stimulation of the same cones against a white background elicited green sensations. In one of two subjects, proximity to S-cones increased the probability of blue reports when M-cones were probed. We propose that M-cone increments excited both green and blue opponent pathways, but the relative activity of neighboring cones favored one pathway over the other.