Specificity of M and L cone inputs to receptive fields in the parvocellular pathway: random wiring with functional bias

Cone-Opponent Ganglion Cells in the Primate Fovea Tuned to Non-Cardinal Color Directions

A long-standing question in vision science is how the three cone photoreceptor types - long (L), medium (M) and short (S) wavelength sensitive - combine to generate our perception of color. Hue perception can be described along two opponent axes: red-green and blue-yellow. Psychophysical measurements of color appearance indicate that the cone inputs to the red-green and blue-yellow opponent axes are M vs. L+S and L vs. M+S, respectively. However, the "cardinal directions of color space" revealed by psychophysical measurements of color detection thresholds are L vs. M and S vs. L+M. The cardinal directions match the most common cone-opponent retinal ganglion cells (RGCs) in the primate retina. Accordingly, the cone opponency necessary for color appearance is thought to be established in cortex. However, small populations with the appropriate M vs. L+S and L vs. M+S cone-opponency have been reported in large surveys of cone inputs to primate RGCs and their projections to the lateral geniculate nucleus (LGN) yet their existence continues to be debated. Resolving this long-standing open question is needed as a complete account of the cone-opponency in the retinal output is critical for efforts to understand how downstream neural circuits process color. Here, we performed adaptive optics calcium imaging to longitudinally and noninvasively measurements of the foveal RGC light responses in the living macaque eye. We confirm the presence of L vs. M+S and M vs. L+S neurons with non-cardinal cone-opponency and demonstrate that cone-opponent signals in the retinal output are substantially more diverse than classically thought.

Retinal ganglion cells and the magnocellular, parvocellular, and koniocellular subcortical visual pathways from the eye to the brain

In primates including humans, most retinal ganglion cells send signals to the lateral geniculate nucleus (LGN) of the thalamus. The anatomical and functional properties of the two major pathways through the LGN, the parvocellular (P) and magnocellular (M) pathways, are now well understood. Neurones in these pathways appear to convey a filtered version of the retinal image to primary visual cortex for further analysis. The properties of the P-pathway suggest it is important for high spatial acuity and red-green color vision, while those of the M-pathway suggest it is important for achromatic visual sensitivity and motion vision. Recent work has sharpened our understanding of how these properties are built in the retina, and described subtle but important nonlinearities that shape the signals that cortex receives. In addition to the P- and M-pathways, other retinal ganglion cells also project to the LGN. These ganglion cells are larger than those in the P- and M-pathways, have different retinal connectivity, and project to distinct regions of the LGN, together forming heterogenous koniocellular (K) pathways. Recent work has started to reveal the properties of these K-pathways, in the retina and in the LGN. The functional properties of K-pathways are more complex than those in the P- and M-pathways, and the K-pathways are likely to have a distinct contribution to vision. They provide a complementary pathway to the primary visual cortex, but can also send signals directly to extrastriate visual cortex. At the level of the LGN, many neurones in the K-pathways seem to integrate retinal with non-retinal inputs, and some may provide an early site of binocular convergence.

Analysis of Parvocellular and Magnocellular Visual Pathways in Human Retina

Two main subcortical pathways serving conscious visual perception are the midget-parvocellular (P), and the parasol-magnocellular (M) pathways. It is generally accepted that the P pathway serves red-green color vision, but the relative contribution of P and M pathways to spatial vision is a long-standing and unresolved issue. Here, we mapped the spatial sampling properties of P and M pathways across the human retina. Data were obtained from immunolabeled vertical sections of six postmortem male and female human donor retinas and imaged using high-resolution microscopy. Cone photoreceptors, OFF-midget bipolar cells (P pathway), OFF-diffuse bipolar (DB) types DB3a and DB3b (M pathway), and ganglion cells were counted along the temporal horizontal meridian, taking foveal spatial distortions (postreceptoral displacements) into account. We found that the density of OFF-midget bipolar and OFF-midget ganglion cells can support one-to-one connections to 1.05-mm (3.6°) eccentricity. One-to-one connections of cones to OFF-midget bipolar cells are present to at least 10-mm (35°) eccentricity. The OFF-midget ganglion cell array acuity is well-matched to photopic spatial acuity measures throughout the central 35°, but the OFF-parasol array acuity is well below photopic spatial acuity, supporting the view that the P pathway underlies high-acuity spatial vision. Outside the fovea, array acuity of both OFF-midget and OFF-DB cells exceeds psychophysical measures of photopic spatial acuity. We conclude that parasol and midget pathway bipolar cells deliver high-acuity spatial signals to the inner plexiform layer, but outside the fovea, this spatial resolution is lost at the level of ganglion cells.SIGNIFICANCE STATEMENT We make accurate maps of the spatial density and distribution of neurons in the human retina to aid in understanding human spatial vision, interpretation of diagnostic tests, and the implementation of therapies for retinal diseases. Here, we map neurons involved with the midget-parvocellular (P pathway) and parasol-magnocellular (M pathway) through human retina. We find that P-type bipolar cells outnumber M-type bipolar cells at all eccentricities. We show that cone photoreceptors and P-type pathway bipolar cells are tightly connected throughout the retina, but that spatial resolution is lost at the level of the ganglion cells. Overall, the results support the view that the P pathway is specialized to serve both high acuity vision and red-green color vision.

Connectomic Identification and Three-Dimensional Color Tuning of S-OFF Midget Ganglion Cells in the Primate Retina

In the trichromatic primate retina, the "midget" retinal ganglion cell is the classical substrate for red-green color signaling, with a circuitry that enables antagonistic responses between long (L)- and medium (M)-wavelength-sensitive cone inputs. Previous physiological studies showed that some OFF midget ganglion cells may receive sparse input from short (S)-wavelength-sensitive cones, but the effect of S-cone inputs on the chromatic tuning properties of such cells has not been explored. Moreover, anatomical evidence for a synaptic pathway from S cones to OFF midget ganglion cells through OFF midget bipolar cells remains ambiguous. In this study, we address both questions for the macaque monkey retina. First, we used serial block-face electron microscopy to show that every S cone in the parafoveal retina synapses principally with a single OFF midget bipolar cell, which in turn forms a private-line connection with an OFF midget ganglion cell. Second, we used patch electrophysiology to characterize the chromatic tuning of OFF midget ganglion cells in the near peripheral retina that receive combined input from L, M, and S cones. These "S-OFF" midget cells have a characteristic S-cone spatial signature, but demonstrate heterogeneous color properties due to the variable strength of L, M, and S cone input across the receptive field. Together, these findings strongly support the hypothesis that the OFF midget pathway is the major conduit for S-OFF signals in primate retina and redefines the pathway as a chromatically complex substrate that encodes color signals beyond the classically recognized L versus M and S versus L+M cardinal mechanisms.SIGNIFICANCE STATEMENT The first step of color processing in the visual pathway of primates occurs when signals from short (S)-, middle (M)-, and long (L)-wavelength-sensitive cone types interact antagonistically within the retinal circuitry to create color-opponent pathways. The midget (L versus M or "red-green") and small bistratified (S vs L+M, or "blue-yellow") ganglion cell pathways appear to provide the physiological origin of the cardinal axes of human color vision. Here we confirm the presence of an additional S-OFF midget circuit in the macaque monkey fovea with scanning block-face electron microscopy and show physiologically that a subpopulation of S-OFF midget cells combine S, L, and M cone inputs along noncardinal directions of color space, expanding the retinal role in color coding.

Reconciling Color Vision Models With Midget Ganglion Cell Receptive Fields

Midget retinal ganglion cells (RGCs) make up the majority of foveal RGCs in the primate retina. The receptive fields of midget RGCs exhibit both spectral and spatial opponency and are implicated in both color and achromatic form vision, yet the exact mechanisms linking their responses to visual perception remain unclear. Efforts to develop color vision models that accurately predict all the features of human color and form vision based on midget RGCs provide a case study connecting experimental and theoretical neuroscience, drawing on diverse research areas such as anatomy, physiology, psychophysics, and computer vision. Recent technological advances have allowed researchers to test some predictions of color vision models in new and precise ways, producing results that challenge traditional views. Here, we review the progress in developing models of color-coding receptive fields that are consistent with human psychophysics, the biology of the primate visual system and the response properties of midget RGCs.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

Randomly weighted receptor inputs can explain the large diversity of colour-coding neurons in the bee visual system

True colour vision requires comparing the responses of different spectral classes of photoreceptors. In insects, there is a wealth of data available on the physiology of photoreceptors and on colour-dependent behaviour, but less is known about the neural mechanisms that link the two. The available information in bees indicates a diversity of colour opponent neurons in the visual optic ganglia that significantly exceeds that known in humans and other primates. Here, we present a simple mathematical model for colour processing in the optic lobes of bees to explore how this diversity might arise. We found that the model can reproduce the physiological spectral tuning curves of the 22 neurons that have been described so far. Moreover, the distribution of the presynaptic weights in the model suggests that colour-coding neurons are likely to be wired up to the receptor inputs randomly. The perceptual distances in our random synaptic weight model are in agreement with behavioural observations. Our results support the idea that the insect nervous system might adopt partially random wiring of neurons for colour processing.

Nonselective Wiring Accounts for Red-Green Opponency in Midget Ganglion Cells of the Primate Retina

In primate retina, "red-green" color coding is initiated when signals originating in long (L) and middle (M) wavelength-sensitive cone photoreceptors interact antagonistically. The center-surround receptive field of "midget" ganglion cells provides the neural substrate for L versus M cone-opponent interaction, but the underlying circuitry remains unsettled, centering around the longstanding question of whether specialized cone wiring is present. To address this question, we measured the strength, sign, and spatial tuning of L- and M-cone input to midget receptive fields in the peripheral retina of macaque primates of either sex. Consistent with previous work, cone opponency arose when one of the cone types showed a stronger connection to the receptive field center than to the surround. We implemented a difference-of-Gaussians spatial receptive field model, incorporating known biology of the midget circuit, to test whether physiological responses we observed in real cells could be captured entirely by anatomical nonselectivity. When this model sampled nonselectively from a realistic cone mosaic, it accurately reproduced key features of a cone-opponent receptive field structure, and predicted both the variability and strength of cone opponency across the retina. The model introduced here is consistent with abundant anatomical evidence for nonselective wiring, explains both local and global properties of the midget population, and supports a role in their multiplexing of spatial and color information. It provides a neural basis for human chromatic sensitivity across the visual field, as well as the maintenance of normal color vision despite significant variability in the relative number of L and M cones across individuals.SIGNIFICANCE STATEMENT Red-green color vision is a hallmark of the human and nonhuman primate that starts in the retina with the presence of long (L)- and middle (M)-wavelength sensitive cone photoreceptor types. Understanding the underlying retinal mechanism for color opponency has focused on the broad question of whether this characteristic can emerge from nonselective wiring, or whether complex cone-type-specific wiring must be invoked. We provide experimental and modeling support for the hypothesis that nonselective connectivity is sufficient to produce the range of red-green color opponency observed in midget ganglion cells across the retina. Our nonselective model reproduces the diversity of physiological responses of midget cells while also accounting for systematic changes in color sensitivity across the visual field.

Spatiochromatic Interactions between Individual Cone Photoreceptors in the Human Retina

A remarkable feature of human vision is that the retina and brain have evolved circuitry to extract useful spatial and spectral information from signals originating in a photoreceptor mosaic with trichromatic constituents that vary widely in their relative numbers and local spatial configurations. A critical early transformation applied to cone signals is horizontal-cell-mediated lateral inhibition, which imparts a spatially antagonistic surround to individual cone receptive fields, a signature inherited by downstream neurons and implicated in color signaling. In the peripheral retina, the functional connectivity of cone inputs to the circuitry that mediates lateral inhibition is not cone-type specific, but whether these wiring schemes are maintained closer to the fovea remains unsettled, in part because central retinal anatomy is not easily amenable to direct physiological assessment. Here, we demonstrate how the precise topography of the long (L)-, middle (M)-, and short (S)-wavelength-sensitive cones in the human parafovea (1.5° eccentricity) shapes perceptual sensitivity. We used adaptive optics microstimulation to measure psychophysical detection thresholds from individual cones with spectral types that had been classified independently by absorptance imaging. Measured against chromatic adapting backgrounds, the sensitivities of L and M cones were, on average, receptor-type specific, but individual cone thresholds varied systematically with the number of preferentially activated cones in the immediate neighborhood. The spatial and spectral patterns of these interactions suggest that interneurons mediating lateral inhibition in the central retina, likely horizontal cells, establish functional connections with L and M cones indiscriminately, implying that the cone-selective circuitry supporting red-green color vision emerges after the first retinal synapse.SIGNIFICANCE STATEMENT We present evidence for spatially antagonistic interactions between individual, spectrally typed cones in the central retina of human observers using adaptive optics. Using chromatic adapting fields to modulate the relative steady-state activity of long (L)- and middle (M)-wavelength-sensitive cones, we found that single-cone detection thresholds varied predictably with the spectral demographics of the surrounding cones. The spatial scale and spectral pattern of these photoreceptor interactions were consistent with lateral inhibition mediated by retinal horizontal cells that receive nonselective input from L and M cones. These results demonstrate a clear link between the neural architecture of the visual system inputs-cone photoreceptors-and visual perception and have implications for the neural locus of the cone-specific circuitry supporting color vision.

Relationship between cortical state and spiking activity in the lateral geniculate nucleus of marmosets

KEY POINTS

How parallel are the primate visual pathways? In the present study, we demonstrate that parallel visual pathways in the dorsal lateral geniculate nucleus (LGN) show distinct patterns of interaction with rhythmic activity in the primary visual cortex (V1). In the V1 of anaesthetized marmosets, the EEG frequency spectrum undergoes transient changes that are characterized by fluctuations in delta-band EEG power. We show that, on multisecond timescales, spiking activity in an evolutionary primitive (koniocellular) LGN pathway is specifically linked to these slow EEG spectrum changes. By contrast, on subsecond (delta frequency) timescales, cortical oscillations can entrain spiking activity throughout the entire LGN. Our results are consistent with the hypothesis that, in waking animals, the koniocellular pathway selectively participates in brain circuits controlling vigilance and attention.

ABSTRACT

The major afferent cortical pathway in the visual system passes through the dorsal lateral geniculate nucleus (LGN), where nerve signals originating in the eye can first interact with brain circuits regulating visual processing, vigilance and attention. In the present study, we investigated how ongoing and visually driven activity in magnocellular (M), parvocellular (P) and koniocellular (K) layers of the LGN are related to cortical state. We recorded extracellular spiking activity in the LGN simultaneously with local field potentials (LFP) in primary visual cortex, in sufentanil-anaesthetized marmoset monkeys. We found that asynchronous cortical states (marked by low power in delta-band LFPs) are linked to high spike rates in K cells (but not P cells or M cells), on multisecond timescales. Cortical asynchrony precedes the increases in K cell spike rates by 1-3 s, implying causality. At subsecond timescales, the spiking activity in many cells of all (M, P and K) classes is phase-locked to delta waves in the cortical LFP, and more cells are phase-locked during synchronous cortical states than during asynchronous cortical states. The switch from low-to-high spike rates in K cells does not degrade their visual signalling capacity. By contrast, during asynchronous cortical states, the fidelity of visual signals transmitted by K cells is improved, probably because K cell responses become less rectified. Overall, the data show that slow fluctuations in cortical state are selectively linked to K pathway spiking activity, whereas delta-frequency cortical oscillations entrain spiking activity throughout the entire LGN, in anaesthetized marmosets.

Photosensitivity in generalized epilepsies

Photosensitivity, which is the hallmark of photosensitive epilepsy (PSE), is described as an abnormal EEG response to visual stimuli known as a photoparoxysmal response (PPR). The PPR is a well-recognized phenomenon, occurring in 2-14% of patients with epilepsy but its pathophysiology is not clearly understood. PPR is electrographically described as 2-5Hz spike, spike-wave, or slow wave complexes with frontal and paracentral prevalence. Diagnosis of PPR is confirmed using intermittent photic stimulation (IPS) as well as video monitoring. The PPR can be elicited by certain types of visual stimuli including flicker, high contrast gratings, moving patterns, and rapidly modulating luminance patterns which may be encountered during e.g., watching television, playing video games, or attending discotheques. Photosensitivity may present in different idiopathic (genetic) epilepsy syndromes e.g. juvenile myoclonic epilepsy (JME) as well as non-IGE syndromes e.g. severe myoclonic epilepsy of infancy. Consequently, PPR is present in patients with diverse seizure types including absence, myoclonic, and generalized tonic-clonic (GTC) seizures. Across syndromes, abnormalities in structural connectivity, functional connectivity, cortical excitability, cortical morphology, and behavioral and neuropsychological function have been reported. Treatment of photosensitivity includes antiepileptic drug administration, and the use of non-pharmacological agents, e.g. tinted or polarizing glasses, as well as occupational measures, e.g. avoidance of certain stimuli.

A Retina Inspired Model for Enhancing Visibility of Hazy Images

The mammalian retina seems far smarter than scientists have believed so far. Inspired by the visual processing mechanisms in the retina, from the layer of photoreceptors to the layer of retinal ganglion cells (RGCs), we propose a computational model for haze removal from a single input image, which is an important issue in the field of image enhancement. In particular, the bipolar cells serve to roughly remove the low-frequency of haze, and the amacrine cells modulate the output of cone bipolar cells to compensate the loss of details by increasing the image contrast. Then the RGCs with disinhibitory receptive field surround refine the local haze removal as well as the image detail enhancement. Results on a variety of real-world and synthetic hazy images show that the proposed model yields results comparative to or even better than the state-of-the-art methods, having the advantage of simultaneous dehazing and enhancing of single hazy image with simple and straightforward implementation.

Color and the Cone Mosaic

Vision is limited by the measurements taken by the cone photoreceptors. To provide useful perceptual representations, the brain must go beyond the measurements and make inferences about the scene being viewed. This article considers the first stages of spatiochromatic vision. We show how spatial and chromatic information become intertwined by the optics of the eye and because of the structure of the retinal cone mosaic, and we consider the consequent implications for perception. Because there is at most one cone at each retinal location, the standard treatment of human trichromacy does not apply at fine spatial scales. Rather, trichromacy results from a perceptual inference based on measurements from cones of different classes at different locations. Our treatment emphasizes linking physics, biology, and computation with the goal of providing a framework for a larger understanding of how the brain interprets photoreceptor excitations to see objects and their properties.

A simpler primate brain: the visual system of the marmoset monkey

Humans are diurnal primates with high visual acuity at the center of gaze. Although primates share many similarities in the organization of their visual centers with other mammals, and even other species of vertebrates, their visual pathways also show unique features, particularly with respect to the organization of the cerebral cortex. Therefore, in order to understand some aspects of human visual function, we need to study non-human primate brains. Which species is the most appropriate model? Macaque monkeys, the most widely used non-human primates, are not an optimal choice in many practical respects. For example, much of the macaque cerebral cortex is buried within sulci, and is therefore inaccessible to many imaging techniques, and the postnatal development and lifespan of macaques are prohibitively long for many studies of brain maturation, plasticity, and aging. In these and several other respects the marmoset, a small New World monkey, represents a more appropriate choice. Here we review the visual pathways of the marmoset, highlighting recent work that brings these advantages into focus, and identify where additional work needs to be done to link marmoset brain organization to that of macaques and humans. We will argue that the marmoset monkey provides a good subject for studies of a complex visual system, which will likely allow an important bridge linking experiments in animal models to humans.

Color coding in the primate visual pathway: a historical view

The physiology and anatomy of the primate visual pathway are reviewed from a historical perspective, especially in relation to color vision. From the work of the last decades, certain issues have been selected which remain unresolved and still pose a challenge for neurobiologists and psychophysicists. It is suggested that the structure of the primate visual pathway has been colored by the evolution of trichromacy and that many features of the parvocellular pathway represent adaptations to this end.

Mixing of Chromatic and Luminance Retinal Signals in Primate Area V1

Vision emerges from activation of chromatic and achromatic retinal channels whose interaction in visual cortex is still poorly understood. To investigate this interaction, we recorded neuronal activity from retinal ganglion cells and V1 cortical cells in macaques and measured their visual responses to grating stimuli that had either luminance contrast (luminance grating), chromatic contrast (chromatic grating), or a combination of the two (compound grating). As with parvocellular or koniocellular retinal ganglion cells, some V1 cells responded mostly to the chromatic contrast of the compound grating. As with magnocellular retinal ganglion cells, other V1 cells responded mostly to the luminance contrast and generated a frequency-doubled response to equiluminant chromatic gratings. Unlike magnocellular and parvocellular retinal ganglion cells, V1 cells formed a unimodal distribution for luminance/color preference with a 2- to 4-fold bias toward luminance. V1 cells associated with positive local field potentials in deep layers showed the strongest combined responses to color and luminance and, as a population, V1 cells encoded a diverse combination of luminance/color edges that matched edge distributions of natural scenes. Taken together, these results suggest that the primary visual cortex combines magnocellular and parvocellular retinal inputs to increase cortical receptive field diversity and to optimize visual processing of our natural environment.

Cortical-like receptive fields in the lateral geniculate nucleus of marmoset monkeys

Most neurons in primary visual cortex (V1) exhibit high selectivity for the orientation of visual stimuli. In contrast, neurons in the main thalamic input to V1, the lateral geniculate nucleus (LGN), are considered to be only weakly orientation selective. Here we characterize a sparse population of cells in marmoset LGN that show orientation and spatial frequency selectivity as great as that of cells in V1. The recording position in LGN and histological reconstruction of these cells shows that they are part of the koniocellular (K) pathways. Accordingly we have named them K-o ("koniocellular-orientation") cells. Most K-o cells prefer vertically oriented gratings; their contrast sensitivity and TF tuning are similar to those of parvocellular cells, and they receive negligible functional input from short wavelength-sensitive ("blue") cone photoreceptors. Four K-o cells tested displayed binocular responses. Our results provide further evidence that in primates as in nonprimate mammals the cortical input streams include a diversity of visual representations. The presence of K-o cells increases functional homologies between K pathways in primates and "sluggish/W" pathways in nonprimate visual systems.

Spatial distributions of cone inputs to cells of the parvocellular pathway investigated with cone-isolating gratings

Receptive fields of midget ganglion cells and parvocellular lateral geniculate nucleus (LGN) neurons show color-opponent responses because they receive antagonistic input from the middle- and long-wavelength sensitive cones. It has been controversial as to whether this opponency can derive from random connectivity; if receptive field centers of cells near the fovea are cone-specific due to midget morphology, this would confer some degree of color opponency even with random cone input to the surround. A simple test of this mixed surround hypothesis is to compare spatial frequency tuning curves for luminance gratings and gratings isolating cone input to the receptive field center. If tuning curves for luminance gratings were bandpass, then with the mixed surround hypothesis tuning curves for gratings isolating the receptive field center cone class should also be bandpass, but to a lesser extent than for luminance. Tuning curves for luminance, chromatic, and cone-isolating gratings were measured in macaque retinal ganglion cells and LGN cells. We defined and measured a bandpass index to compare luminance and center cone-isolating tuning curves. Midget retinal ganglion cells and parvocellular LGN cells had bandpass indices between 0.1 and 1 with luminance gratings, but the index was usually near 1 (meaning low-pass tuning) when the receptive field center cone class alone was modulated. This is strong evidence for a considerable degree of cone-specific input to the surround. A fraction of midget and parvocellular cells showed evidence of incomplete specificity. Fitting the data with receptive field models revealed considerable intercell variability, with indications in some cells of a more complex receptive structure than a simple difference of Gaussians model.

Transmission of colour and acuity signals by parvocellular cells in marmoset monkeys

The red-green axis of colour vision evolved recently in primate evolutionary history. Signals serving red-green colour vision travel together with signals serving spatial vision, in the parvocellular (PC) division of the subcortical visual pathway. However, the question of whether receptive fields of PC pathway cells are specialized to transmit red-green colour signals remains unresolved. We addressed this question in single-cell recordings from the lateral geniculate nucleus of anaesthetized marmosets. Marmosets show a high proportion of dichromatic (red-green colour-blind) individuals, allowing spatial and colour tuning properties of PC cells to be directly compared in dichromatic and trichromatic visual systems. We measured spatial frequency tuning for sine gratings that provided selective stimulation of individual photoreceptor types. We found that in trichromatic marmosets, the foveal visual field representation is dominated by red-green colour-selective PC cells. Colour selectivity of PC cells is reduced at greater eccentricities, but cone inputs to centre and surround are biased to create more selectivity than predicted by a purely 'random wiring' model. Thus, one-to-one connections in the fovea are sufficient, but not necessary, to create colour-selective responses. The distribution of spatial tuning properties for achromatic stimuli shows almost complete overlap between PC cells recorded in dichromatic and trichromatic marmosets. These data indicate that transmission of red-green colour signals has been enabled by centre-surround receptive fields of PC cells, and has not altered the capacity of PC cells to serve high-acuity vision at high stimulus contrast.

Horizontal cell feedback without cone type-selective inhibition mediates "red-green" color opponency in midget ganglion cells of the primate retina

The distinctive red-green dimension of human and nonhuman primate color perception arose relatively recently in the primate lineage with the appearance of separate long (L) and middle (M) wavelength-sensitive cone photoreceptor types. "Midget" ganglion cells of the retina use center-surround receptive field structure to combine L and M cone signals antagonistically and thereby establish a "red-green, color-opponent" visual pathway. However, the synaptic origin of red-green opponency is unknown, and conflicting evidence for either random or L versus M cone-selective inhibitory circuits has divergent implications for the developmental and evolutionary origins of trichromatic color vision. Here we directly measure the synaptic conductances evoked by selective L or M cone stimulation in the midget ganglion cell dendritic tree and show that L versus M cone opponency arises presynaptic to the midget cell and is transmitted entirely by modulation of an excitatory conductance. L and M cone synaptic inhibition is feedforward and thus occurs in phase with excitation for both cone types. Block of GABAergic and glycinergic receptors does not attenuate or modify L versus M cone antagonism, discounting both presynaptic and postsynaptic inhibition as sources of cone opponency. In sharp contrast, enrichment of retinal pH-buffering capacity, to attenuate negative feedback from horizontal cells that sum L and M cone inputs linearly and without selectivity, completely abolished both the midget cell surround and all chromatic opponency. Thus, red-green opponency appears to arise via outer retinal horizontal cell feedback that is not cone type selective without recourse to any inner retinal L versus M cone inhibitory pathways.

Advances in color science: from retina to behavior

Color has become a premier model system for understanding how information is processed by neural circuits, and for investigating the relationships among genes, neural circuits, and perception. Both the physical stimulus for color and the perceptual output experienced as color are quite well characterized, but the neural mechanisms that underlie the transformation from stimulus to perception are incompletely understood. The past several years have seen important scientific and technical advances that are changing our understanding of these mechanisms. Here, and in the accompanying minisymposium, we review the latest findings and hypotheses regarding color computations in the retina, primary visual cortex, and higher-order visual areas, focusing on non-human primates, a model of human color vision.

Functional connectivity in the retina at the resolution of photoreceptors

To understand a neural circuit requires knowing its connectivity. This paper reports measurements of functional connectivity between the input and ouput layers of the retina at single cell resolution and its implications for color vision. Multi-electrode technology was employed to record simultaneously from complete populations of the retinal ganglion cell types (midget, parasol, small bistratified) that transmit high-resolution visual signals to the brain. Fine-grained visual stimulation was used to identify the location, type and strength of the functional input of each cone photoreceptor to each ganglion cell. The populations of ON and OFF midget and parasol cells each sampled the complete population of long and middle wavelength sensitive cones. However, only OFF midget cells frequently received strong input from short wavelength sensitive cones. ON and OFF midget cells exhibited a small non-random tendency to selectively sample from either long or middle wavelength sensitive cones, to a degree not explained by clumping in the cone mosaic. These measurements reveal computations in a neural circuit at the elementary resolution of individual neurons.

Retinal connectivity and primate vision

The general principles of retinal organization are now well known. It may seem surprising that retinal organization in the primate, which has a complex visual behavioral repertoire, appears relatively simple. In this review, we primarily consider retinal structure and function in primate species. Photoreceptor distribution and connectivity are considered as are connectivity in the outer and inner retina. One key issue is the specificity of retinal connections; we suggest that the retina shows connectional specificity but this is seldom complete, and we consider here the functional consequences of imprecise wiring. Finally, we consider how retinal systems can be linked to psychophysical descriptions of different channels, chromatic and luminance, which are proposed to exist in the primate visual system.

Synaptic inputs onto small bistratified (blue-ON/yellow-OFF) ganglion cells in marmoset retina

The inner plexiform layer of the retina contains functional subdivisions, which segregate ON and OFF type light responses. Here, we studied quantitatively the ON and OFF synaptic input to small bistratified (blue-ON/yellow-OFF) ganglion cells in marmosets (Callithrix jacchus). Small bistratified cells display an extensive inner dendritic tier that receives blue-ON input from short-wavelength-sensitive (S) cones via blue cone bipolar cells. The outer dendritic tier is sparse and is thought to receive yellow-OFF input from medium (M)- and long (L)-wavelength-sensitive cones via OFF diffuse bipolar cells. In total, 14 small bistratified cells from different eccentricities were analyzed. The cells were retrogradely labeled from the koniocellular layers of the lateral geniculate nucleus and subsequently photofilled. Retinal preparations were processed with antibodies against the C-terminal binding protein 2, the AMPA receptor subunit GluR4, and/or gephyrin to identify bipolar and/or amacrine input. The results show that the synaptic input is evenly distributed across the dendritic tree, with a density similar to that reported previously for other ganglion cell types. The population of cells showed a consistent pattern, where bipolar input to the inner tier is about fourfold greater than bipolar input to the outer tier. This structural asymmetry of bipolar input may help to balance the weight of cone signals from the sparse S cone array against inputs from the much denser M/L cone array.

Color vision, cones, and color-coding in the cortex

Color processing begins with the absorption of light by cone photoreceptors, and progresses through a series of hierarchical stages: Retinal signals carrying color information are transmitted through the lateral geniculate nucleus of the thalamus (LGN) up to the primary visual cortex (V1). From V1, the signals are processed by the second visual area (V2); then by cells located in subcompartments ("globs") within the posterior inferior temporal (PIT) cortex, a brain region that encompasses area V4 and brain regions immediately anterior to V4. Color signals are then processed by regions deep within the inferior temporal (IT) cortex including area TE. As a heuristic, one can consider each of these stages to be involved in constructing a distinct aspect of the color percept. The three cone types are the basis for trichromacy; retinal ganglion cells that respond in an opponent fashion to activation of different cone classes are the basis for color opponency (these "cone-opponent" cells increase their firing rate above baseline to activation of one cone class and decrease their firing rate below baseline to activation of a different cone class); double-opponent neurons in the V1 generate local color contrast and are the building blocks for color constancy; glob cells elaborate the perception of hue; and IT integrates color perception in the context of behavior. Finally, though nothing is known, these signals presumably interface with motor programs and emotional centers of the brain to mediate the widely acknowledged emotional salience of color.

Resolving single cone inputs to visual receptive fields

With current techniques for mapping receptive fields, it is impossible to resolve the contribution of single cone photoreceptors to the response of central visual neurons. Using adaptive optics to correct for ocular aberrations, we delivered micron-scale spots of light to the receptive field centers of neurons in the macaque lateral geniculate nucleus. Parvocellular LGN neurons mapped this way responded with high reliability to stimulation of single cones.

Neural models and physiological reality

Neural models of retinal processing provide an important tool for analyzing retinal signals and their functional significance. However, it is here argued that in biological reality, retinal connectivity is unlikely to be as specific as ideal neural models might suggest. The retina is thought to provide functionally specific signals, but this specificity is unlikely to be anatomically complete. This is illustrated by examples of cone connectivity to macaque ganglion cells. For example, cells of the magnocellular pathway appear to avoid short-wavelength cone input, so that such input is negligible under normal conditions. However, there is anatomical, physiological, and psychophysical evidence that under special conditions, weak input may be revealed. Second, ideal models of how retinal information is centrally utilized have to take into account the biological reality of retinal signals. The stochastic nature of impulse trains modifies signal-to-noise ratio in unexpected ways. Also, non-linearities in cell responses make, for example, multiplexing of luminance and chromatic signals in the parvocellular pathway impracticable. The purpose of this analysis is to show than ideal neural models must confront an often more complex and nuanced physiological reality.

Amacrine cell contributions to red-green color opponency in central primate retina: a model study

To investigate the contributions of amacrine cells to red-green opponency, a linear computational model of the central macaque retina was developed based on a published cone mosaic. In the model, amacrine cells of ON and OFF types received input from all neighboring midget bipolar cells of the same polarity, but OFF amacrine cells had a bias toward bipolar cells whose center responses were mediated by middle wavelength sensitive cones. This bias might arise due to activity dependent plasticity because there are midget bipolar cells driven by short wavelength sensitive cones in the OFF pathway. The model midget ganglion cells received inputs from neighboring amacrine cells of both types. As in physiological experiments, the model ganglion cells showed spatially opponent responses to achromatic stimuli, but they responded to cone isolating stimuli as though center and surround were each driven by a single cone type. Without amacrine cell input, long and middle wavelength sensitive cones contributed to both the centers and surrounds of model ganglion cell receptive fields. According to the model, the summed amacrine cell input was red-green opponent even though inputs to individual amacrine cells were unselective. A key prediction is that GABA and glycine depolarize two of the four types of central midget ganglion cells; this may reflect lower levels of the potassium chloride co-transporter in their dendrites.

Cone selectivity derived from the responses of the retinal cone mosaic to natural scenes

To achieve color vision, the brain has to process signals of the cones in the retinal photoreceptor mosaic in a cone-type-specific way. We investigated the possibility that cone-type-specific wiring is an adaptation to the statistics of the cone signals. We analyzed estimates of cone responses to natural scenes and found that there is sufficient information in the higher order statistics of L- and M-cone responses to distinguish between cones of different types, enabling unsupervised learning of cone-type specificity. This was not the case for a fourth cone type with spectral sensitivity between L and M cones, suggesting an explanation for the lack of strong tetrachromacy in heterozygous carriers of color deficiencies.

A numerical study of red-green colour opponent properties in the primate retina

It remains an important question whether neural function is mediated entirely by its tailored circuitry. A persistent debate in retinal colour vision is whether the centre and the surround of a ganglion cell receptive field receive dominant inputs either from L or M cones in an antagonistic manner (the selective wiring model) or mixed inputs (the mixed wiring model). Despite many anatomical, physiological and psychophysical experiments, a decisive conclusion has not been reached. An in-depth examination of what the pure mixed wiring mechanisms predicts is therefore important. These two models make different predictions both for the fovea and for the peripheral retina. Recently, a dynamic cellular model of the primate fovea was developed [Momiji et al. (2006) Vis. Res., 46, 365-381]. Unlike earlier models, it explicitly incorporates spatial non-uniformities, such as the random arrangement of L and M cones. Here, a related model is developed for the peripheral retina by incorporating anatomically reasonable degrees of convergence between cones, bipolar cells and ganglion cells. These two models, in which selective wiring mechanisms are absent, are applied to describe both foveal and peripheral colour vision. In numerical simulations, peripheral ganglion cells are less colour sensitive than foveal counterparts, but none-the-less display comparative sensitivities. Furthermore, peripheral colour sensitivity increases with temporal frequency, relative to foveal sensitivity. These results are congruent with recent physiological experiments.

The machinery of colour vision

Some fundamental principles of colour vision, deduced from perceptual studies, have been understood for a long time. Physiological studies have confirmed the existence of three classes of cone photoreceptors, and of colour-opponent neurons that compare the signals from cones, but modern work has drawn attention to unexpected complexities of early organization: the proportions of cones of different types vary widely among individuals, without great effect on colour vision; the arrangement of different types of cones in the mosaic seems to be random, making it hard to optimize the connections to colour-opponent mechanisms; and new forms of colour-opponent mechanisms have recently been discovered. At a higher level, in the primary visual cortex, recent studies have revealed a simpler organization than had earlier been supposed, and in some respects have made it easier to reconcile physiological and perceptual findings.

Response variability of marmoset parvocellular neurons

This study concerns the properties of neurons carrying signals for colour vision in primates. We investigated the variability of responses of individual parvocellular lateral geniculate neurons of dichromatic and trichromatic marmosets to drifting sinusoidal luminance and chromatic gratings. Response variability was quantified by the cycle-to-cycle variation in Fourier components of the response. Averaged across the population, the variability at low contrasts was greater than predicted by a Poisson process, and at high contrasts the responses were approximately 40% more variable than responses at low contrasts. The contrast-dependent increase in variability was nevertheless below that expected from the increase in firing rate. Variability falls below the Poisson prediction at high contrast, and intrinsic variability of the spike train decreases as contrast increases. Thus, while deeply modulated responses in parvocellular cells have a larger absolute variability than weakly modulated ones, they have a more favourable signal: noise ratio than predicted by a Poisson process. Similar results were obtained from a small sample of magnocellular and koniocellular ('blue-on') neurons. For parvocellular neurons with pronounced colour opponency, chromatic responses were, on average, less variable (10-15%, p<0.01) than luminance responses of equal magnitude. Conversely, non-opponent parvocellular neurons showed the opposite tendency. This is consistent with a supra-additive noise source prior to combination of cone signals. In summary, though variability of parvocellular neurons is largely independent of the way in which they combine cone signals, the noise characteristics of retinal circuitry may augment specialization of parvocellular neurons to signal luminance or chromatic contrast.