Spatial structure of cone inputs to receptive fields in primate lateral geniculate nucleus

Contrast sensitivity functions in autoencoders

Three decades ago, Atick et al. suggested that human frequency sensitivity may emerge from the enhancement required for a more efficient analysis of retinal images. Here we reassess the relevance of low-level vision tasks in the explanation of the contrast sensitivity functions (CSFs) in light of 1) the current trend of using artificial neural networks for studying vision, and 2) the current knowledge of retinal image representations. As a first contribution, we show that a very popular type of convolutional neural networks (CNNs), called autoencoders, may develop human-like CSFs in the spatiotemporal and chromatic dimensions when trained to perform some basic low-level vision tasks (like retinal noise and optical blur removal), but not others (like chromatic) adaptation or pure reconstruction after simple bottlenecks). As an illustrative example, the best CNN (in the considered set of simple architectures for enhancement of the retinal signal) reproduces the CSFs with a root mean square error of 11% of the maximum sensitivity. As a second contribution, we provide experimental evidence of the fact that, for some functional goals (at low abstraction level), deeper CNNs that are better in reaching the quantitative goal are actually worse in replicating human-like phenomena (such as the CSFs). This low-level result (for the explored networks) is not necessarily in contradiction with other works that report advantages of deeper nets in modeling higher level vision goals. However, in line with a growing body of literature, our results suggests another word of caution about CNNs in vision science because the use of simplified units or unrealistic architectures in goal optimization may be a limitation for the modeling and understanding of human vision.

A quadratic model captures the human V1 response to variations in chromatic direction and contrast

An important goal for vision science is to develop quantitative models of the representation of visual signals at post-receptoral sites. To this end, we develop the quadratic color model (QCM) and examine its ability to account for the BOLD fMRI response in human V1 to spatially-uniform, temporal chromatic modulations that systematically vary in chromatic direction and contrast. We find that the QCM explains the same, cross-validated variance as a conventional general linear model, with far fewer free parameters. The QCM generalizes to allow prediction of V1 responses to a large range of modulations. We replicate the results for each subject and find good agreement across both replications and subjects. We find that within the LM cone contrast plane, V1 is most sensitive to L-M contrast modulations and least sensitive to L+M contrast modulations. Within V1, we observe little to no change in chromatic sensitivity as a function of eccentricity.

A Distinct Population of L6 Neurons in Mouse V1 Mediate Cross-Callosal Communication

Through the corpus callosum, interhemispheric communication is mediated by callosal projection (CP) neurons. Using retrograde labeling, we identified a population of layer 6 (L6) excitatory neurons as the main conveyer of transcallosal information in the monocular zone of the mouse primary visual cortex (V1). Distinct from L6 corticothalamic (CT) population, V1 L6 CP neurons contribute to an extensive reciprocal network across multiple sensory cortices over two hemispheres. Receiving both local and long-range cortical inputs, they encode orientation, direction, and receptive field information, while are also highly spontaneous active. The spontaneous activity of L6 CP neurons exhibits complex relationships with brain states and stimulus presentation, distinct from the spontaneous activity patterns of the CT population. The anatomical and functional properties of these L6 CP neurons enable them to broadcast visual and nonvisual information across two hemispheres, and thus may play a role in regulating and coordinating brain-wide activity events.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

The Energy Homeostasis Principle: Neuronal Energy Regulation Drives Local Network Dynamics Generating Behavior

A major goal of neuroscience is understanding how neurons arrange themselves into neural networks that result in behavior. Most theoretical and experimental efforts have focused on a top-down approach which seeks to identify neuronal correlates of behaviors. This has been accomplished by effectively mapping specific behaviors to distinct neural patterns, or by creating computational models that produce a desired behavioral outcome. Nonetheless, these approaches have only implicitly considered the fact that neural tissue, like any other physical system, is subjected to several restrictions and boundaries of operations. Here, we proposed a new, bottom-up conceptual paradigm: The Energy Homeostasis Principle, where the balance between energy income, expenditure, and availability are the key parameters in determining the dynamics of neuronal phenomena found from molecular to behavioral levels. Neurons display high energy consumption relative to other cells, with metabolic consumption of the brain representing 20% of the whole-body oxygen uptake, contrasting with this organ representing only 2% of the body weight. Also, neurons have specialized surrounding tissue providing the necessary energy which, in the case of the brain, is provided by astrocytes. Moreover, and unlike other cell types with high energy demands such as muscle cells, neurons have strict aerobic metabolism. These facts indicate that neurons are highly sensitive to energy limitations, with Gibb's free energy dictating the direction of all cellular metabolic processes. From this activity, the largest energy, by far, is expended by action potentials and post-synaptic potentials; therefore, plasticity can be reinterpreted in terms of their energy context. Consequently, neurons, through their synapses, impose energy demands over post-synaptic neurons in a close loop-manner, modulating the dynamics of local circuits. Subsequently, the energy dynamics end up impacting the homeostatic mechanisms of neuronal networks. Furthermore, local energy management also emerges as a neural population property, where most of the energy expenses are triggered by sensory or other modulatory inputs. Local energy management in neurons may be sufficient to explain the emergence of behavior, enabling the assessment of which properties arise in neural circuits and how. Essentially, the proposal of the Energy Homeostasis Principle is also readily testable for simple neuronal networks.

The Augmentation of Retinogeniculate Communication during Thalamic Burst Mode

Retinal signals are transmitted to cortex via neurons in the lateral geniculate nucleus (LGN), where they are processed in burst or tonic response mode. Burst mode occurs when LGN neurons are sufficiently hyperpolarized for T-type Ca²⁺ channels to deinactivate, allowing them to open in response to depolarization, which can trigger a high-frequency sequence of Na⁺-based spikes (i.e., burst). In contrast, T-type channels are inactivated during tonic mode and do not contribute to spiking. Although burst mode is commonly associated with sleep and the disruption of retinogeniculate communication, bursts can also be triggered by visual stimulation, thereby transforming the retinal signals relayed to the cortex. To determine how burst mode affects retinogeniculate communication, we made recordings from monosynaptically connected retinal ganglion cells and LGN neurons in male/female cats during visual stimulation. Our results reveal a robust augmentation of retinal signals within the LGN during burst mode. Specifically, retinal spikes were more effective and often triggered multiple LGN spikes during periods likely to have increased T-type Ca²⁺ channel activity. Consistent with the biophysical properties of T-type Ca²⁺ channels, analysis revealed that effect magnitude was correlated with the duration of the preceding thalamic interspike interval and occurred even in the absence of classically defined bursts. Importantly, the augmentation of geniculate responses to retinal input was not associated with a degradation of visual signals. Together, these results indicate a graded nature of response mode and suggest that, under certain conditions, bursts facilitate the transmission of visual information to the cortex by amplifying retinal signals.SIGNIFICANCE STATEMENT The thalamus is the gateway for retinal information traveling to the cortex. The lateral geniculate nucleus, like all thalamic nuclei, has two classically defined categories of spikes-tonic and burst-that differ in their underlying cellular mechanisms. Here we compare retinogeniculate communication during burst and tonic response modes. Our results show that retinogeniculate communication is enhanced during burst mode and visually evoked thalamic bursts, thereby augmenting retinal signals transmitted to cortex. Further, our results demonstrate that the influence of burst mode on retinogeniculate communication is graded and can be measured even in the absence of classically defined thalamic bursts.

Extrafoveally applied flashing light affects contrast thresholds of achromatic and S-cone isolating, but not L-M cone modulated stimuli

Flashing light stimulation is often used to investigate the visual system. However, the magnitude of the effect of this stimulus on the various subcortical pathways is not well investigated. The signals of conscious vision are conveyed by the magnocellular, parvocellular and koniocellular pathways. Parvocellular and koniocellular pathways (or more precisely, the L-M opponent and S-cone isolating channels) can be accessed by isoluminant red-green (L-M) and S-cone isolating stimuli, respectively. The main goal of the present study was to explore how costimulation with strong white extrafoveal light flashes alters the perception of stimuli specific to these pathways. Eleven healthy volunteers with negative neurological and ophthalmological history were enrolled for the study. Isoluminance of L-M and S-cone isolating sine-wave gratings was set individually, using the minimum motion procedure. The contrast thresholds for these stimuli as well as for achromatic gratings were determined by an adaptive staircase procedure where subjects had to indicate the orientation (horizontal, oblique or vertical) of the gratings. Thresholds were then determined again while a strong white peripheral light flash was presented 50 ms before each trial. Peripheral light flashes significantly (p < 0.05) increased the contrast thresholds of the achromatic and S-cone isolating stimuli. The threshold elevation was especially marked in case of the achromatic stimuli. However, the contrast threshold for the L-M stimuli was not significantly influenced by the light flashes. We conclude that extrafoveally applied light flashes influence predominantly the perception of achromatic stimuli.

Nonselective Wiring Accounts for Red-Green Opponency in Midget Ganglion Cells of the Primate Retina

In primate retina, "red-green" color coding is initiated when signals originating in long (L) and middle (M) wavelength-sensitive cone photoreceptors interact antagonistically. The center-surround receptive field of "midget" ganglion cells provides the neural substrate for L versus M cone-opponent interaction, but the underlying circuitry remains unsettled, centering around the longstanding question of whether specialized cone wiring is present. To address this question, we measured the strength, sign, and spatial tuning of L- and M-cone input to midget receptive fields in the peripheral retina of macaque primates of either sex. Consistent with previous work, cone opponency arose when one of the cone types showed a stronger connection to the receptive field center than to the surround. We implemented a difference-of-Gaussians spatial receptive field model, incorporating known biology of the midget circuit, to test whether physiological responses we observed in real cells could be captured entirely by anatomical nonselectivity. When this model sampled nonselectively from a realistic cone mosaic, it accurately reproduced key features of a cone-opponent receptive field structure, and predicted both the variability and strength of cone opponency across the retina. The model introduced here is consistent with abundant anatomical evidence for nonselective wiring, explains both local and global properties of the midget population, and supports a role in their multiplexing of spatial and color information. It provides a neural basis for human chromatic sensitivity across the visual field, as well as the maintenance of normal color vision despite significant variability in the relative number of L and M cones across individuals.SIGNIFICANCE STATEMENT Red-green color vision is a hallmark of the human and nonhuman primate that starts in the retina with the presence of long (L)- and middle (M)-wavelength sensitive cone photoreceptor types. Understanding the underlying retinal mechanism for color opponency has focused on the broad question of whether this characteristic can emerge from nonselective wiring, or whether complex cone-type-specific wiring must be invoked. We provide experimental and modeling support for the hypothesis that nonselective connectivity is sufficient to produce the range of red-green color opponency observed in midget ganglion cells across the retina. Our nonselective model reproduces the diversity of physiological responses of midget cells while also accounting for systematic changes in color sensitivity across the visual field.

Spatiochromatic Interactions between Individual Cone Photoreceptors in the Human Retina

A remarkable feature of human vision is that the retina and brain have evolved circuitry to extract useful spatial and spectral information from signals originating in a photoreceptor mosaic with trichromatic constituents that vary widely in their relative numbers and local spatial configurations. A critical early transformation applied to cone signals is horizontal-cell-mediated lateral inhibition, which imparts a spatially antagonistic surround to individual cone receptive fields, a signature inherited by downstream neurons and implicated in color signaling. In the peripheral retina, the functional connectivity of cone inputs to the circuitry that mediates lateral inhibition is not cone-type specific, but whether these wiring schemes are maintained closer to the fovea remains unsettled, in part because central retinal anatomy is not easily amenable to direct physiological assessment. Here, we demonstrate how the precise topography of the long (L)-, middle (M)-, and short (S)-wavelength-sensitive cones in the human parafovea (1.5° eccentricity) shapes perceptual sensitivity. We used adaptive optics microstimulation to measure psychophysical detection thresholds from individual cones with spectral types that had been classified independently by absorptance imaging. Measured against chromatic adapting backgrounds, the sensitivities of L and M cones were, on average, receptor-type specific, but individual cone thresholds varied systematically with the number of preferentially activated cones in the immediate neighborhood. The spatial and spectral patterns of these interactions suggest that interneurons mediating lateral inhibition in the central retina, likely horizontal cells, establish functional connections with L and M cones indiscriminately, implying that the cone-selective circuitry supporting red-green color vision emerges after the first retinal synapse.SIGNIFICANCE STATEMENT We present evidence for spatially antagonistic interactions between individual, spectrally typed cones in the central retina of human observers using adaptive optics. Using chromatic adapting fields to modulate the relative steady-state activity of long (L)- and middle (M)-wavelength-sensitive cones, we found that single-cone detection thresholds varied predictably with the spectral demographics of the surrounding cones. The spatial scale and spectral pattern of these photoreceptor interactions were consistent with lateral inhibition mediated by retinal horizontal cells that receive nonselective input from L and M cones. These results demonstrate a clear link between the neural architecture of the visual system inputs-cone photoreceptors-and visual perception and have implications for the neural locus of the cone-specific circuitry supporting color vision.

Does L/M Cone Opponency Disappear in Human Periphery?

We have assessed the optimal cone contrast sensitivity across eccentricity in human vision of the two cone-opponent mechanisms [L/M or red-green, and S/(L + M) or blue-yellow] and the luminance mechanism. We have used a novel stimulus, termed a ‘sinring’, that is a radially modulated sine-wave arc, Gaussian enveloped in both angular and radial directions. This stimulus overcomes the problem inherent in Gabor stimuli of confounding stimulus spatial frequency, size, and eccentricity and so allows contrast sensitivity to be tracked accurately into the periphery. Our results show that L/M cone opponency declines steeply across the human periphery and becomes behaviourally absent by 25–30 deg (in the nasal field). This result suggests that any L/M cone-opponent neurons found in primate peripheral retina beyond this limit are unlikely to be significant for colour contrast detection measured behaviourally.

Dependence of chromatic responses in V1 on visual field eccentricity and spatial frequency: an fMRI study

Psychophysical sensitivity to red-green chromatic modulation decreases with visual eccentricity, compared to sensitivity to luminance modulation, even after appropriate stimulus scaling. This is likely to occur at a central, rather than a retinal, site. Blood-oxygenation-level-dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to stimuli designed to separately stimulate different afferent channels' [red-green, luminance, and short-wavelength (S)-cone] circular gratings were recorded as a function of visual eccentricity (±10  deg) and spatial frequency (SF) in human primary visual cortex (V1) and further visual areas (V2v, V3v). In V1, the SF tuning of BOLD fMRI responses became coarser with eccentricity. For red-green and luminance gratings, similar SF tuning curves were found at all eccentricities. The pattern for S-cone modulation differed, with SF tuning changing more slowly with eccentricity than for the other two modalities. This may be due to the different retinal distribution with eccentricity of this receptor type. A similar pattern held in V2v and V3v. This would suggest that transformation or spatial filtering of the chromatic (red-green) signal occurs beyond these areas.

Neuronal Representation of Ultraviolet Visual Stimuli in Mouse Primary Visual Cortex

The mouse has become an important model for understanding the neural basis of visual perception. Although it has long been known that mouse lens transmits ultraviolet (UV) light and mouse opsins have absorption in the UV band, little is known about how UV visual information is processed in the mouse brain. Using a custom UV stimulation system and in vivo calcium imaging, we characterized the feature selectivity of layer 2/3 neurons in mouse primary visual cortex (V1). In adult mice, a comparable percentage of the neuronal population responds to UV and visible stimuli, with similar pattern selectivity and receptive field properties. In young mice, the orientation selectivity for UV stimuli increased steadily during development, but not direction selectivity. Our results suggest that, by expanding the spectral window through which the mouse can acquire visual information, UV sensitivity provides an important component for mouse vision.

Effects of luminance contrast on the color selectivity of neurons in the macaque area v4 and inferior temporal cortex

Appearance of a color stimulus is significantly affected by the contrast between its luminance and the luminance of the background. In the present study, we used stimuli evenly distributed on the CIE-xy chromaticity diagram to examine how luminance contrast affects neural representation of color in V4 and the anterior inferior temporal (AITC) and posterior inferior temporal (PITC) color areas (Banno et al., 2011). The activities of single neurons were recorded from monkeys performing a visual fixation task, and the effects of luminance contrast on the color selectivity of individual neurons and their population responses were systematically examined by comparing responses to color stimuli that were brighter or darker than the background. We found that the effects of luminance contrast differed considerably across V4 and the PITC and AITC. In both V4 and the PITC, the effects of luminance contrast on the population responses of color-selective neurons depended on color. In V4, the size of the effect was largest for blue and cyan, whereas in the PITC, the effect gradually increased as the saturation of the color stimulus was reduced, and was especially large with neutral colors (white, gray, black). The pattern observed in the PITC resembles the effect of luminance contrast on color appearance, suggesting PITC neurons are closely involved in the formation of the perceived appearance of color. By contrast, the color selectivities of AITC neurons were little affected by luminance contrast, indicating that hue and saturation of color stimuli are represented independently of luminance contrast in the AITC.

S-cone psychophysics

We review the features of the S-cone system that appeal to the psychophysicist and summarize the celebrated characteristics of S-cone mediated vision. Two factors are emphasized: First, the fine stimulus control that is required to isolate putative visual mechanisms and second, the relationship between physiological data and psychophysical approaches. We review convergent findings from physiology and psychophysics with respect to asymmetries in the retinal wiring of S-ON and S-OFF visual pathways, and the associated treatment of increments and decrements in the S-cone system. Beyond the retina, we consider the lack of S-cone projections to superior colliculus and the use of S-cone stimuli in experimental psychology, for example to address questions about the mechanisms of visually driven attention. Careful selection of stimulus parameters enables psychophysicists to produce entirely reversible, temporary, "lesions," and to assess behavior in the absence of specific neural subsystems.

Chromatic and Achromatic Spatial Resolution of Local Field Potentials in Awake Cortex

Local field potentials (LFPs) have become an important measure of neuronal population activity in the brain and could provide robust signals to guide the implant of visual cortical prosthesis in the future. However, it remains unclear whether LFPs can detect weak cortical responses (e.g., cortical responses to equiluminant color) and whether they have enough visual spatial resolution to distinguish different chromatic and achromatic stimulus patterns. By recording from awake behaving macaques in primary visual cortex, here we demonstrate that LFPs respond robustly to pure chromatic stimuli and exhibit ∼2.5 times lower spatial resolution for chromatic than achromatic stimulus patterns, a value that resembles the ratio of achromatic/chromatic resolution measured with psychophysical experiments in humans. We also show that, although the spatial resolution of LFP decays with visual eccentricity as is also the case for single neurons, LFPs have higher spatial resolution and show weaker response suppression to low spatial frequencies than spiking multiunit activity. These results indicate that LFP recordings are an excellent approach to measure spatial resolution from local populations of neurons in visual cortex including those responsive to color.

Contextual modulation and stimulus selectivity in extrastriate cortex

Contextual modulation is observed throughout the visual system, using techniques ranging from single-neuron recordings to behavioral experiments. Its role in generating feature selectivity within the retina and primary visual cortex has been extensively described in the literature. Here, we describe how similar computations can also elaborate feature selectivity in the extrastriate areas of both the dorsal and ventral streams of the primate visual system. We discuss recent work that makes use of normalization models to test specific roles for contextual modulation in visual cortex function. We suggest that contextual modulation renders neuronal populations more selective for naturalistic stimuli. Specifically, we discuss contextual modulation's role in processing optic flow in areas MT and MST and for representing naturally occurring curvature and contours in areas V4 and IT. We also describe how the circuitry that supports contextual modulation is robust to variations in overall input levels. Finally, we describe how this theory relates to other hypothesized roles for contextual modulation.

Temporal response properties of koniocellular (blue-on and blue-off) cells in marmoset lateral geniculate nucleus

Visual perception requires integrating signals arriving at different times from parallel visual streams. For example, signals carried on the phasic-magnocellular (MC) pathway reach the cerebral cortex pathways some tens of milliseconds before signals traveling on the tonic-parvocellular (PC) pathway. Visual latencies of cells in the koniocellular (KC) pathway have not been specifically studied in simian primates. Here we compared MC and PC cells to “blue-on” (BON) and “blue-off” (BOF) KC cells; these cells carry visual signals originating in short-wavelength-sensitive (S) cones. We made extracellular recordings in the lateral geniculate nucleus (LGN) of anesthetized marmosets. We found that BON visual latencies are 10–20 ms longer than those of PC or MC cells. A small number of recorded BOF cells ( n = 7) had latencies 10–20 ms longer than those of BON cells. Within all cell groups, latencies of foveal receptive fields (<10° eccentricity) were longer (by 3–8 ms) than latencies of peripheral receptive fields (>10°). Latencies of yellow-off inputs to BON cells lagged the blue-on inputs by up to 30 ms, but no differences in visual latency were seen on comparing marmosets expressing dichromatic (“red-green color-blind”) or trichromatic color vision phenotype. We conclude that S-cone signals leaving the LGN on KC pathways are delayed with respect to signals traveling on PC and MC pathways. Cortical circuits serving color vision must therefore integrate across delays in (red-green) chromatic signals carried by PC cells and (blue-yellow) signals carried by KC cells.

Color coding in the primate visual pathway: a historical view

The physiology and anatomy of the primate visual pathway are reviewed from a historical perspective, especially in relation to color vision. From the work of the last decades, certain issues have been selected which remain unresolved and still pose a challenge for neurobiologists and psychophysicists. It is suggested that the structure of the primate visual pathway has been colored by the evolution of trichromacy and that many features of the parvocellular pathway represent adaptations to this end.

Mixing of Chromatic and Luminance Retinal Signals in Primate Area V1

Vision emerges from activation of chromatic and achromatic retinal channels whose interaction in visual cortex is still poorly understood. To investigate this interaction, we recorded neuronal activity from retinal ganglion cells and V1 cortical cells in macaques and measured their visual responses to grating stimuli that had either luminance contrast (luminance grating), chromatic contrast (chromatic grating), or a combination of the two (compound grating). As with parvocellular or koniocellular retinal ganglion cells, some V1 cells responded mostly to the chromatic contrast of the compound grating. As with magnocellular retinal ganglion cells, other V1 cells responded mostly to the luminance contrast and generated a frequency-doubled response to equiluminant chromatic gratings. Unlike magnocellular and parvocellular retinal ganglion cells, V1 cells formed a unimodal distribution for luminance/color preference with a 2- to 4-fold bias toward luminance. V1 cells associated with positive local field potentials in deep layers showed the strongest combined responses to color and luminance and, as a population, V1 cells encoded a diverse combination of luminance/color edges that matched edge distributions of natural scenes. Taken together, these results suggest that the primary visual cortex combines magnocellular and parvocellular retinal inputs to increase cortical receptive field diversity and to optimize visual processing of our natural environment.

Reproducibility of a New Colour Test

<b><i>Purpose:</i></b> To evaluate the reproducibility of a new colour test, using the Chromatometer CM3. <b><i>Methods:</i></b> Twenty healthy subjects were recruited at the Department of Ophthalmology, at the Medical University of Vienna. A total of 40 eyes were tested. Both eyes were tested separately with the Chromatometer CM3. The colour test was repeated after several days. Each time, best-corrected visual acuity was tested using Snellen charts, and colour perception was tested using the Chromatometer CM3. <b><i>Results:</i></b> The Chromatometer CM3 showed reproducible results between the two tests at almost every luminosity level. All 4 green-red measurements and 2 blue-yellow brightness measurements showed reproducible results between the first and second tests. <b><i>Conclusion:</i></b> The Chromatometer CM3 seems to be an appropriate method to detect changes in colour perception, although the red-green comparison appeared to be more precise than the blue-yellow comparison.

Heterogeneity in the spatial receptive field architecture of multisensory neurons of the superior colliculus and its effects on multisensory integration

Multisensory integration has been widely studied in neurons of the mammalian superior colliculus (SC). This has led to the description of various determinants of multisensory integration, including those based on stimulus- and neuron-specific factors. The most widely characterized of these illustrate the importance of the spatial and temporal relationships of the paired stimuli as well as their relative effectiveness in eliciting a response in determining the final integrated output. Although these stimulus-specific factors have generally been considered in isolation (i.e., manipulating stimulus location while holding all other factors constant), they have an intrinsic interdependency that has yet to be fully elucidated. For example, changes in stimulus location will likely also impact both the temporal profile of response and the effectiveness of the stimulus. The importance of better describing this interdependency is further reinforced by the fact that SC neurons have large receptive fields, and that responses at different locations within these receptive fields are far from equivalent. To address these issues, the current study was designed to examine the interdependency between the stimulus factors of space and effectiveness in dictating the multisensory responses of SC neurons. The results show that neuronal responsiveness changes dramatically with changes in stimulus location - highlighting a marked heterogeneity in the spatial receptive fields of SC neurons. More importantly, this receptive field heterogeneity played a major role in the integrative product exhibited by stimulus pairings, such that pairings at weakly responsive locations of the receptive fields resulted in the largest multisensory interactions. Together these results provide greater insight into the interrelationship of the factors underlying multisensory integration in SC neurons, and may have important mechanistic implications for multisensory integration and the role it plays in shaping SC-mediated behaviors.

Processing of S-cone signals in the inner plexiform layer of the mammalian retina

Color information is encoded by two parallel pathways in the mammalian retina. One pathway compares signals from long- and middle-wavelength sensitive cones and generates red-green opponency. The other compares signals from short- and middle-/long-wavelength sensitive cones and generates blue-green (yellow) opponency. Whereas both pathways operate in trichromatic primates (including humans), the fundamental, phylogenetically ancient color mechanism shared among most mammals is blue-green opponency. In this review, we summarize the current understanding of how signals from short-wavelength sensitive cones are processed in the primate and nonprimate mammalian retina, with a focus on the inner plexiform layer where bipolar, amacrine, and ganglion cell processes interact to facilitate the generation of blue-green opponency.

Sex and vision II: color appearance of monochromatic lights

BACKGROUND

Because cerebral cortex has a very large number of testosterone receptors, we examined the possible sex differences in color appearance of monochromatic lights across the visible spectrum. There is a history of men and women perceiving color differently. However, all of these studies deal with higher cognitive functions which may be culture-biased. We study basic visual functions, such as color appearance, without reference to any objects. We present here a detailed analysis of sex differences in primary chromatic sensations.

METHODS

We tested large groups of young adults with normal vision, including spatial and temporal resolution, and stereopsis. Based on standard color-screening and anomaloscope data, we excluded all color-deficient observers. Stimuli were equi-luminant monochromatic lights across the spectrum. They were foveally-viewed flashes presented against a dark background. The elicited sensations were measured using magnitude estimation of hue and saturation. When the only permitted hue terms are red (R) yellow (Y), green (G), blue (B), alone or in combination, such hue descriptions are language-independent and the hue and saturation values can be used to derive a wide range of color-discrimination functions.

RESULTS

There were relatively small but clear and significant, differences between males and females in the hue sensations elicited by almost the entire spectrum. Generally, males required a slightly longer wavelength to experience the same hue as did females. The spectral loci of the unique hues are not correlated with anomaloscope matches; these matches are directly determined by the spectral sensitivities of L- and M-cones (genes for these cones are on the X-chromosomes). Nor are there correlations between loci of pairs of unique hues (R, Y, G, B). Wavelength-discrimination functions derived from the scaling data show that males have a broader range of poorer discrimination in the middle of the spectrum. The precise values for all the data depend on whether Newtonian or Maxwellian optics were used, but the sex differences were the same for both optical systems.

CONCLUSION

As with our associated paper on spatio-temporal vision, there are marked sex differences in color vision. The color-appearances we measured are determined by inputs from thalamic neurons (LGN) to individual neurons in primary visual cortex. This convergence from LGN to cortex is guided by the cortex during embryogenesis. We hypothesize that testosterone plays a major role, somehow leading to different connectivities for males and females: color appearance requires a re-combination and re-weighting of neuronal inputs from the LGN to the cortex, which, as we show, depends on the sex of the participant.

Natural versus synthetic stimuli for estimating receptive field models: a comparison of predictive robustness

An ultimate goal of visual neuroscience is to understand the neural encoding of complex, everyday scenes. Yet most of our knowledge of neuronal receptive fields has come from studies using simple artificial stimuli (e.g., bars, gratings) that may fail to reveal the full nature of a neuron's actual response properties. Our goal was to compare the utility of artificial and natural stimuli for estimating receptive field (RF) models. Using extracellular recordings from simple type cells in cat A18, we acquired responses to three types of broadband stimulus ensembles: two widely used artificial patterns (white noise and short bars), and natural images. We used a primary dataset to estimate the spatiotemporal receptive field (STRF) with two hold-back datasets for regularization and validation. STRFs were estimated using an iterative regression algorithm with regularization and subsequently fit with a zero-memory nonlinearity. Each RF model (STRF and zero-memory nonlinearity) was then used in simulations to predict responses to the same stimulus type used to estimate it, as well as to other broadband stimuli and sinewave gratings. White noise stimuli often elicited poor responses leading to noisy RF estimates, while short bars and natural image stimuli were more successful in driving A18 neurons and producing clear RF estimates with strong predictive ability. Natural image-derived RF models were the most robust at predicting responses to other broadband stimulus ensembles that were not used in their estimation and also provided good predictions of tuning curves for sinewave gratings.

Local diversity and fine-scale organization of receptive fields in mouse visual cortex

Many thousands of cortical neurons are activated by any single sensory stimulus, but the organization of these populations is poorly understood. For example, are neurons in mouse visual cortex--whose preferred orientations are arranged randomly--organized with respect to other response properties? Using high-speed in vivo two-photon calcium imaging, we characterized the receptive fields of up to 100 excitatory and inhibitory neurons in a 200 μm imaged plane. Inhibitory neurons had nonlinearly summating, complex-like receptive fields and were weakly tuned for orientation. Excitatory neurons had linear, simple receptive fields that can be studied with noise stimuli and system identification methods. We developed a wavelet stimulus that evoked rich population responses and yielded the detailed spatial receptive fields of most excitatory neurons in a plane. Receptive fields and visual responses were locally highly diverse, with nearby neurons having largely dissimilar receptive fields and response time courses. Receptive-field diversity was consistent with a nearly random sampling of orientation, spatial phase, and retinotopic position. Retinotopic positions varied locally on average by approximately half the receptive-field size. Nonetheless, the retinotopic progression across the cortex could be demonstrated at the scale of 100 μm, with a magnification of ≈ 10 μm/°. Receptive-field and response similarity were in register, decreasing by 50% over a distance of 200 μm. Together, the results indicate considerable randomness in local populations of mouse visual cortical neurons, with retinotopy as the principal source of organization at the scale of hundreds of micrometers.

A tritan Waldo would be easier to detect in the periphery than a red/green one: evidence from visual search

In a color naming task from 0° to 55° eccentricity, we found that red/green performance (n=10 subjects) declines around 40° eccentricity, 5° earlier than does tritan performance (main effect of color, p=0.009; eccentricity, p<0.001; interaction, p=0.005). In a feature visual search task (e.g., red target dot among green distractor dots; twelve 2.5° diameter dots; 0, 20, and 45° eccentricity; 12 subjects), performance was significantly more impaired for red/green than for tritan stimuli, especially in the periphery (main effect of color, p=0.007; eccentricity, p<0.001; interaction, p=0.003). This effect occurred even following a rod bleach. Our results are consistent with influences from both the retina (especially random rather than selective peripheral cone input to midget ganglion cells for red/green perception, and selective cone input to small bistratified cells for tritan perception) and the cortex (differential cortical magnification across the two chromatic axes).

Spatial distributions of cone inputs to cells of the parvocellular pathway investigated with cone-isolating gratings

Receptive fields of midget ganglion cells and parvocellular lateral geniculate nucleus (LGN) neurons show color-opponent responses because they receive antagonistic input from the middle- and long-wavelength sensitive cones. It has been controversial as to whether this opponency can derive from random connectivity; if receptive field centers of cells near the fovea are cone-specific due to midget morphology, this would confer some degree of color opponency even with random cone input to the surround. A simple test of this mixed surround hypothesis is to compare spatial frequency tuning curves for luminance gratings and gratings isolating cone input to the receptive field center. If tuning curves for luminance gratings were bandpass, then with the mixed surround hypothesis tuning curves for gratings isolating the receptive field center cone class should also be bandpass, but to a lesser extent than for luminance. Tuning curves for luminance, chromatic, and cone-isolating gratings were measured in macaque retinal ganglion cells and LGN cells. We defined and measured a bandpass index to compare luminance and center cone-isolating tuning curves. Midget retinal ganglion cells and parvocellular LGN cells had bandpass indices between 0.1 and 1 with luminance gratings, but the index was usually near 1 (meaning low-pass tuning) when the receptive field center cone class alone was modulated. This is strong evidence for a considerable degree of cone-specific input to the surround. A fraction of midget and parvocellular cells showed evidence of incomplete specificity. Fitting the data with receptive field models revealed considerable intercell variability, with indications in some cells of a more complex receptive structure than a simple difference of Gaussians model.

Spikes, BOLD, attention, and awareness: a comparison of electrophysiological and fMRI signals in V1

Early fMRI studies comparing results from fMRI and electrophysiological experiments support the notion that the blood oxygen level-dependent (BOLD) signal reliably follows the spiking activity of an underlying neuronal population averaged across a small region in space and a brief period in time. However, more recent studies focusing on higher level cognitive factors such as attention and visual awareness report striking discrepancies between the fMRI response in humans and electrophysiological signals in macaque early visual areas. Four hypotheses are discussed that can explain the discrepancies between the two methods: (1) the BOLD signal follows local field potential (LFP) signals closer than spikes, and only the LFP is modulated by top-down factors, (2) the BOLD signal is reflecting electrophysiological signals that are occurring later in time due to feedback delay, (3) the BOLD signal is more sensitive than traditional electrophysiological methods due to massive pooling by the hemodynamic coupling process, and finally (4) there is no real discrepancy, and instead, weak but reliable effects on firing rates may be obscured by differences in experimental design and interpretation of results across methods.

A comparative analysis of neural taste processing in animals

Understanding taste processing in the nervous system is a fundamental challenge of modern neuroscience. Recent research on the neural bases of taste coding in invertebrates and vertebrates allows discussion of whether labelled-line or across-fibre pattern encoding applies to taste perception. While the former posits that each gustatory receptor responds to one stimulus or a very limited range of stimuli and sends a direct 'line' to the central nervous system to communicate taste information, the latter postulates that each gustatory receptor responds to a wider range of stimuli so that the entire population of taste-responsive neurons participates in the taste code. Tastes are represented in the brain of the fruitfly and of the rat by spatial patterns of neural activity containing both distinct and overlapping regions, which are in accord with both labelled-line and across-fibre pattern processing of taste, respectively. In both animal models, taste representations seem to relate to the hedonic value of the tastant (e.g. palatable versus non-palatable). Thus, although the labelled-line hypothesis can account for peripheral taste processing, central processing remains either unknown or differs from a pure labelled-line coding. The essential task for a neuroscience of taste is, therefore, to determine the connectivity of taste-processing circuits in central nervous systems. Such connectivity may determine coding strategies that differ significantly from both the labelled-line and the across-fibre pattern models.

Horizontal cell feedback without cone type-selective inhibition mediates "red-green" color opponency in midget ganglion cells of the primate retina

The distinctive red-green dimension of human and nonhuman primate color perception arose relatively recently in the primate lineage with the appearance of separate long (L) and middle (M) wavelength-sensitive cone photoreceptor types. "Midget" ganglion cells of the retina use center-surround receptive field structure to combine L and M cone signals antagonistically and thereby establish a "red-green, color-opponent" visual pathway. However, the synaptic origin of red-green opponency is unknown, and conflicting evidence for either random or L versus M cone-selective inhibitory circuits has divergent implications for the developmental and evolutionary origins of trichromatic color vision. Here we directly measure the synaptic conductances evoked by selective L or M cone stimulation in the midget ganglion cell dendritic tree and show that L versus M cone opponency arises presynaptic to the midget cell and is transmitted entirely by modulation of an excitatory conductance. L and M cone synaptic inhibition is feedforward and thus occurs in phase with excitation for both cone types. Block of GABAergic and glycinergic receptors does not attenuate or modify L versus M cone antagonism, discounting both presynaptic and postsynaptic inhibition as sources of cone opponency. In sharp contrast, enrichment of retinal pH-buffering capacity, to attenuate negative feedback from horizontal cells that sum L and M cone inputs linearly and without selectivity, completely abolished both the midget cell surround and all chromatic opponency. Thus, red-green opponency appears to arise via outer retinal horizontal cell feedback that is not cone type selective without recourse to any inner retinal L versus M cone inhibitory pathways.

Color in the cortex: single- and double-opponent cells

This is a review of the research during the past 25years on cortical processing of color signals. At the beginning of the period the modular view of cortical processing predominated. However, at present an alternative view, that color and form are linked inextricably in visual cortical processing, is more persuasive than it seemed in 1985. Also, the role of the primary visual cortex, V1, in color processing now seems much larger than it did in 1985. The re-evaluation of the important role of V1 in color vision was caused in part by investigations of human V1 responses to color, measured with functional magnetic resonance imaging, fMRI, and in part by the results of numerous studies of single-unit neurophysiology in non-human primates. The neurophysiological results have highlighted the importance of double-opponent cells in V1. Another new concept is population coding of hue, saturation, and brightness in cortical neuronal population activity.

Visual pathways and psychophysical channels in the primate

The main cell systems of the retina that provide input to the striate cortex are now well described, although certain aspects of their anatomy and physiology remain contentious. Under simple stimulus conditions and in a threshold context psychophysical performance can often be assigned to one or other of these systems, and an identification of psychophysical channels with afferent pathways is justifiable. However, results from psychophysical studies using more complex stimulus conditions are more difficult to relate to 'front end' channels, and it is more difficult to separate the physiological contributions of afferent pathways from those of cortical mechanisms, in particular the separation of dorsal and ventral streams.

Functional connectivity in the retina at the resolution of photoreceptors

To understand a neural circuit requires knowing its connectivity. This paper reports measurements of functional connectivity between the input and ouput layers of the retina at single cell resolution and its implications for color vision. Multi-electrode technology was employed to record simultaneously from complete populations of the retinal ganglion cell types (midget, parasol, small bistratified) that transmit high-resolution visual signals to the brain. Fine-grained visual stimulation was used to identify the location, type and strength of the functional input of each cone photoreceptor to each ganglion cell. The populations of ON and OFF midget and parasol cells each sampled the complete population of long and middle wavelength sensitive cones. However, only OFF midget cells frequently received strong input from short wavelength sensitive cones. ON and OFF midget cells exhibited a small non-random tendency to selectively sample from either long or middle wavelength sensitive cones, to a degree not explained by clumping in the cone mosaic. These measurements reveal computations in a neural circuit at the elementary resolution of individual neurons.

Retinal connectivity and primate vision

The general principles of retinal organization are now well known. It may seem surprising that retinal organization in the primate, which has a complex visual behavioral repertoire, appears relatively simple. In this review, we primarily consider retinal structure and function in primate species. Photoreceptor distribution and connectivity are considered as are connectivity in the outer and inner retina. One key issue is the specificity of retinal connections; we suggest that the retina shows connectional specificity but this is seldom complete, and we consider here the functional consequences of imprecise wiring. Finally, we consider how retinal systems can be linked to psychophysical descriptions of different channels, chromatic and luminance, which are proposed to exist in the primate visual system.

L- and M-cone input to 12Hz and 30Hz flicker ERGs across the human retina

We recorded L- and M-cone isolating ERGs from human subjects using a silent substitution technique at temporal rates of 12 and 30 Hz. These frequencies isolate the activity of cone-opponent and non-opponent post-receptoral mechanisms, respectively. ERGs were obtained using a sequence of stimuli with different spatial configurations comprising; (1) circular stimuli of different sizes which increased in 10° steps up to 70°diameter, or (2) annular stimuli with a 70° outer diameter but with different sized central ablations from 10° up to 60°. L- and M-cone isolating ERGs were obtained from five colour normal subjects using a DTL fibre electrode. Fourier analysis of the ERGs was performed and we measured the amplitude of the first harmonic of the response. For 12 Hz ERGs the L:M cone response amplitude ratio (L:M(ERG)) was close to unity and remained stable irrespective of the spatial configuration of the stimulus. The maintenance of this balanced ratio points to the existence of cone selective input across the human retina for the L-M cone opponent mechanism. For 30 Hz the L:M(ERG) ratio was greater than unity but varied depending upon which region of the retina was being stimulated. This variation we consider to be a consequence of the global response properties of M-cone ERGs rather than representing a real variation in L:M cone ratios across the retina.

Corticogeniculate feedback and visual processing in the primate

Corticogeniculate neurones make more synapses in the lateral geniculate nucleus (LGN) than retinal ganglion cells, yet we know relatively little about the functions of corticogeniculate feedback for visual processing. In primates, feedforward projections from the retina to the LGN and from the LGN to primary visual cortex are organized into anatomically and physiologically distinct parallel pathways. Recent work demonstrates a close relationship between these parallel streams of feedforward projections and the corticogeniculate feedback pathway. Here, we review the evidence for stream-specific feedback in the primate and consider the implications of parallel streams of feedback for vision.

Blue-yellow opponency in primate S cone photoreceptors

The neural coding of human color vision begins in the retina. The outputs of long (L)-, middle (M)-, and short (S)-wavelength-sensitive cone photoreceptors combine antagonistically to produce "red-green" and "blue-yellow" spectrally opponent signals (Hering, 1878; Hurvich and Jameson, 1957). Spectral opponency is well established in primate retinal ganglion cells (Reid and Shapley, 1992; Dacey and Lee, 1994; Dacey et al., 1996), but the retinal circuitry creating the opponency remains uncertain. Here we find, from whole-cell recordings of photoreceptors in macaque monkey, that "blue-yellow" opponency is already present in the center-surround receptive fields of S cones. The inward current evoked by blue light derives from phototransduction within the outer segment of the S cone. The outward current evoked by yellow light is caused by feedback from horizontal cells that are driven by surrounding L and M cones. Stimulation of the surround modulates calcium conductance in the center S cone.

Parallel ON and OFF cone bipolar inputs establish spatially coextensive receptive field structure of blue-yellow ganglion cells in primate retina

In the primate retina the small bistratified, "blue-yellow" color-opponent ganglion cell receives parallel ON-depolarizing and OFF-hyperpolarizing inputs from short (S)-wavelength sensitive and combined long (L)- and middle (M)-wavelength sensitive cone photoreceptors, respectively. However, the synaptic pathways that create S versus LM cone-opponent receptive field structure remain controversial. Here, we show in the macaque monkey retina in vitro that at photopic light levels, when an identified rod input is excluded, the small bistratified cell displays a spatially coextensive receptive field in which the S-ON-input is in spatial, temporal, and chromatic balance with the LM-OFF-input. ON pathway block with l-AP-4, the mGluR6 receptor agonist, abolished the S-ON response but spared the LM-OFF response. The isolated LM component showed a center-surround receptive field structure consistent with an input from OFF-center, ON-surround "diffuse" cone bipolar cells. Increasing retinal buffering capacity with HEPES attenuated the LM-ON surround component, consistent with a non-GABAergic outer retina feedback mechanism for the bipolar surround. The GABAa/c receptor antagonist picrotoxin and the glycine receptor antagonist strychnine did not affect chromatic balance or the basic coextensive receptive field structure, suggesting that the LM-OFF field is not generated by an inner retinal inhibitory pathway. We conclude that the opponent S-ON and LM-OFF responses originate from the excitatory receptive field centers of S-ON and LM-OFF cone bipolar cells, and that the LM-OFF- and ON-surrounds of these parallel bipolar inputs largely cancel, explaining the small, spatially coextensive but spectrally antagonistic receptive field structure of the blue-ON ganglion cell.

Preserving information in neural transmission

Along most neural pathways, the spike trains transmitted from one neuron to the next are altered. In the process, neurons can either achieve a more efficient stimulus representation, or extract some biologically important stimulus parameter, or succeed at both. We recorded the inputs from single retinal ganglion cells and the outputs from connected lateral geniculate neurons in the macaque to examine how visual signals are relayed from retina to cortex. We found that geniculate neurons re-encoded multiple temporal stimulus features to yield output spikes that carried more information about stimuli than was available in each input spike. The coding transformation of some relay neurons occurred with no decrement in information rate, despite output spike rates that averaged half the input spike rates. This preservation of transmitted information was achieved by the short-term summation of inputs that geniculate neurons require to spike. A reduced model of the retinal and geniculate visual responses, based on two stimulus features and their associated nonlinearities, could account for >85% of the total information available in the spike trains and the preserved information transmission. These results apply to neurons operating on a single time-varying input, suggesting that synaptic temporal integration can alter the temporal receptive field properties to create a more efficient representation of visual signals in the thalamus than the retina.

Color responses of the human lateral geniculate nucleus: [corrected] selective amplification of S-cone signals between the lateral geniculate nucleno and primary visual cortex measured with high-field fMRI

The lateral geniculate nucleus (LGN) is the primary thalamic nucleus that relays visual information from the retina to the primary visual cortex (V1) and has been extensively studied in non-human primates. A key feature of the LGN is the segregation of retinal inputs into different cellular layers characterized by their differential responses to red-green (RG) color (L/M opponent), blue-yellow (BY) color (S-cone opponent) and achromatic (Ach) contrast. In this study we use high-field functional magnetic resonance imaging (4 tesla, 3.6 × 3.6 × 3 mm³) to record simultaneously the responses of the human LGN and V1 to chromatic and Ach contrast to investigate the LGN responses to color, and how these are modified as information transfers between LGN and cortex. We find that the LGN has a robust response to RG color contrast, equal to or greater than the Ach response, but a significantly poorer sensitivity to BY contrast. In V1 at low temporal rates (2 Hz), however, the sensitivity of the BY color pathway is selectively enhanced, rising in relation to the RG and Ach responses. We find that this effect generalizes across different stimulus contrasts and spatial stimuli (1-d and 2-d patterns), but is selective for temporal frequency, as it is not found for stimuli at 8 Hz. While the mechanism of this cortical enhancement of BY color vision and its dynamic component is unknown, its role may be to compensate for a weak BY signal originating from the sparse distribution of neurons in the retina and LGN.

The orientation selectivity of color-responsive neurons in macaque V1

Form has a strong influence on color perception. We investigated the neural basis of the form-color link in macaque primary visual cortex (V1) by studying orientation selectivity of single V1 cells for pure color patterns. Neurons that responded to color were classified, based on cone inputs and spatial selectivity, into chromatically single-opponent and double-opponent groups. Single-opponent cells responded well to color but weakly to luminance contrast; they were not orientation selective for color patterns. Most double-opponent cells were orientation selective to pure color stimuli as well as to achromatic patterns. We also found non-opponent cells that responded weakly or not at all to pure color; most were orientation selective for luminance patterns. Double-opponent and non-opponent cells' orientation selectivities were not contrast invariant; selectivity usually increased with contrast. Double-opponent cells were approximately equally orientation selective for luminance and equiluminant color stimuli when stimuli were matched in average cone contrast. V1 double-opponent cells could be the neural basis of the influence of form on color perception. The combined activities of single- and double-opponent cells in V1 are needed for the full repertoire of color perception.

Spike-triggered averages for passive and resonant neurons receiving filtered excitatory and inhibitory synaptic drive

A path-integral approach is developed for the analysis of spike-triggered average quantities in neurons with voltage-gated subthreshold currents. Using a linearization procedure to reduce the models to the generalized integrate-and-fire form, analytical expressions are obtained in an experimentally relevant limit of fluctuation-driven firing. The influences of voltage-gated channels as well as excitatory and inhibitory synaptic filtering are shown to affect significantly the neuronal dynamics prior to the spike. Analytical forms are given for all relevant physiological quantities, such as the mean voltage triggered to the spike, mean current flowing through voltage-gated channels, and the mean excitatory and inhibitory conductance waveforms prior to a spike. The mathematical results are shown to be in good agreement with numerical simulations of the underlying nonlinear conductance-based models. The method promises to provide a useful analytical tool for the prediction and interpretation of the temporal structure of spike-triggered averages measured experimentally.

Theoretical analysis of reverse-time correlation for idealized orientation tuning dynamics

A theoretical analysis is presented of a reverse-time correlation method used in experimentally investigating orientation tuning dynamics of neurons in the primary visual cortex. An exact mathematical characterization of the method is developed, and its connection with the Volterra-Wiener nonlinear systems theory is described. Various mathematical consequences and possible physiological implications of this analysis are illustrated using exactly solvable idealized models of orientation tuning.

Neural models and physiological reality

Neural models of retinal processing provide an important tool for analyzing retinal signals and their functional significance. However, it is here argued that in biological reality, retinal connectivity is unlikely to be as specific as ideal neural models might suggest. The retina is thought to provide functionally specific signals, but this specificity is unlikely to be anatomically complete. This is illustrated by examples of cone connectivity to macaque ganglion cells. For example, cells of the magnocellular pathway appear to avoid short-wavelength cone input, so that such input is negligible under normal conditions. However, there is anatomical, physiological, and psychophysical evidence that under special conditions, weak input may be revealed. Second, ideal models of how retinal information is centrally utilized have to take into account the biological reality of retinal signals. The stochastic nature of impulse trains modifies signal-to-noise ratio in unexpected ways. Also, non-linearities in cell responses make, for example, multiplexing of luminance and chromatic signals in the parvocellular pathway impracticable. The purpose of this analysis is to show than ideal neural models must confront an often more complex and nuanced physiological reality.

Dependence of response properties on sparse connectivity in a spiking neuron model of the lateral geniculate nucleus

We present a large-scale anatomically constrained spiking neuron model of the lateral geniculate nucleus (LGN), which operates solely with retinal input, relay cells, and interneurons. We show that interneuron inhibition and sparse connectivity between LGN cells could be key factors for explaining a number of observed classical and extraclassical response properties in LGN of monkey and cat. Among them are 1) weak orientation tuning, 2) contrast invariance of spatial frequency tuning in the absence of cortical feedback, 3) extraclassical surround suppression, and 4) orientation tuning of extraclassical surround suppression. The model also makes two surprising predictions: 1) a possible pinwheel-like spatial organization of orientation preference in the parvo layers of monkey LGN, much like what is seen in V1, and 2) a stimulus-induced trend (bias) in the orientation and phase preference of surround suppression, originating from the stimulus discontinuity between center and surround gratings rather than from specific circuitry.

Amacrine cell contributions to red-green color opponency in central primate retina: a model study

To investigate the contributions of amacrine cells to red-green opponency, a linear computational model of the central macaque retina was developed based on a published cone mosaic. In the model, amacrine cells of ON and OFF types received input from all neighboring midget bipolar cells of the same polarity, but OFF amacrine cells had a bias toward bipolar cells whose center responses were mediated by middle wavelength sensitive cones. This bias might arise due to activity dependent plasticity because there are midget bipolar cells driven by short wavelength sensitive cones in the OFF pathway. The model midget ganglion cells received inputs from neighboring amacrine cells of both types. As in physiological experiments, the model ganglion cells showed spatially opponent responses to achromatic stimuli, but they responded to cone isolating stimuli as though center and surround were each driven by a single cone type. Without amacrine cell input, long and middle wavelength sensitive cones contributed to both the centers and surrounds of model ganglion cell receptive fields. According to the model, the summed amacrine cell input was red-green opponent even though inputs to individual amacrine cells were unselective. A key prediction is that GABA and glycine depolarize two of the four types of central midget ganglion cells; this may reflect lower levels of the potassium chloride co-transporter in their dendrites.

Physiology, morphology and spatial densities of identified ganglion cell types in primate retina

The use of in vitro preparations of primate retina provides new perspectives on the mosaic organization and physiological properties of three ganglion cell types that project to the lateral geniculate nucleus: the parasol, midget and small bistratified cells. Dendritic field sizes and coverage for the three types suggest that their relative densities vary with eccentricity. Of the total ganglion cells in the human fovea, midget cells constitute about 90%, parasol cells about 5%, and small bistratified cells about 1%. In the periphery, midget cells make up about 40-45%, parasol cells about 20% and small bistratified cells about 10% of the total. Thus from peripheral to central retina the number of midget ganglion cells progressively increases relative to the parasol and small bistratified types. Physiological properties of these cells have recently been studied in macaque (Macaca nemestrina) retina by combining intracellular recording and dye injection. As expected, parasol cells, projecting to geniculate magnocellular layers, give phasic, non-opponent light responses. Midget cells, which project to geniculate parvocellular layers, show opponent responses sensitive to only mid and long wavelengths; no evidence of short-wavelength-sensitive cone (S-cone) input to any midget ganglion cell has been found. However, the small bistratified cells, which also project to the parvocellular geniculate layers, give a strong blue-ON response to stimuli designed to modulate S-cones. Thus, S-cone and medium- or long-wavelength-sensitive cone opponent signals arise from morphologically distinct ganglion cell types that project in parallel to the lateral geniculate nucleus.