Sequential processing in vision: The interaction of sensitivity regulation and temporal dynamics

Melanopsin-mediated amplification of cone signals in the human visual cortex

The ambient daylight variation is coded by melanopsin photoreceptors and their luxotonic activity increases towards midday when colour temperatures are cooler, and irradiances are higher. Although melanopsin and cone photoresponses can be mediated via separate pathways, the connectivity of melanopsin cells across all levels of the retina enables them to modify cone signals. The downstream effects of melanopsin-cone interactions on human vision are however, incompletely understood. Here, we determined how the change in daytime melanopsin activation affects the human cone pathway signals in the visual cortex. A 5-primary silent-substitution method was developed to evaluate the dependence of cone-mediated signals on melanopsin activation by spectrally tuning the lights and stabilizing the rhodopsin activation under a constant cone photometric luminance. The retinal (white noise electroretinogram) and cortical responses (visual evoked potential) were simultaneously recorded with the photoreceptor-directed lights in 10 observers. By increasing the melanopsin activation, a reverse response pattern was observed with cone signals being supressed in the retina by 27% (p = 0.03) and subsequently amplified by 16% (p = 0.01) as they reach the cortex. We infer that melanopsin activity can amplify cone signals at sites distal to retinal bipolar cells to cause a decrease in the psychophysical Weber fraction for cone vision.

Brightness perception under photopic conditions: experiments and modeling with contributions of S-cone and ipRGC

In 1924, the CIE published and standardized the photopic luminous efficiency function. Based on the standardized curve, luminous flux in lumens, luminance in cd/m[Formula: see text], and illuminance in lux are determined by an integral of the curve and the incident light spectra in photometers and are considered physical brightness. However, human brightness perception is not only weighted by this simple determination, but is a more complicated combination of all L-cones, M-cones, S-cones, rods and later ipRGCs, which was partly described by the equivalent brightness of Fotios et al. with the correction factor [Formula: see text]. Recently, new research has demonstrated the role of ipRGCs in human light perception. However, it is still unclear how these signal components of the human visual system are involved in the overall human brightness perception. In this work, human brightness perception under photopic conditions was investigated by visual experiments with 28 subjects under 25 different light spectra. In this way, the contributions of the signal components can be investigated. An optimization process was then performed on the resulting database. The results show that not only the [Formula: see text] component, but also the S-cones and ipRGC play a role, although it is smaller. Thus, the visually scaled brightness model based on the database optimization was constructed using not only illuminance but also S-cones and ipRGC with [Formula: see text] of 0.9554 and RMSE of 4.7802. These results are much better than the brightness model after Fotios et al. using only S-cones ([Formula: see text] = 0.8161, RMSE = 9.7123) and the traditional model without S-cones and ipRGC ([Formula: see text] = 0.8121, RMSE = 9.8171).

Protocol for isolation of melanopsin and rhodopsin in the human eye using silent substitution

Melanopsin-mediated visual and non-visual functions are difficult to study in vivo. To isolate melanopsin responses, non-standard light stimulation instruments are required, with at least as many primaries as photoreceptor classes in the eye. In this protocol, we describe the physical light calibrations of the display instrumentation, control of stimulus artefacts, and correction of individual between-eye differences in human observers. The protocol achieves complete photoreceptor silent substitution in psychophysical, pupillometry, and electroretinographic experiments for probing melanopsin, rod, and cone function. For complete details on the use and execution of this protocol, please refer to Uprety et al. (2022).1.

Detection and discrimination of achromatic contrast: A ganglion cell perspective

The magnocellular (MC) pathway in the primate has much higher achromatic contrast sensitivity than the parvocellular (PC) pathway, and is implicated in luminance contrast detection. But MC pathway responses tend to saturate at lower achromatic contrast than do PC pathway responses. It has been proposed that the PC pathway plays a major role in discriminating suprathreshold achromatic contrast, because the MC pathway is in saturation. This has been termed the pulsed-pedestal protocol. To test this hypothesis, responses of MC and PC pathway ganglion cells have been examined under suprathreshold conditions with stimulus configurations similar to those in psychophysical tests. For MC cells, response saturation was much less for flashed or moving edges than for sinusoidal modulation, and MC cell thresholds predicted for these stimuli were similar to psychophysical discrimination (and detection) data. Results suggest the protocol is not effective in segregating MC and PC function.

Relationship Between Flicker Modulation Sensitivity and Retinal Ganglion Cell Related Layer Thicknesses

Purpose

Early detection of structural changes in retinal ganglion cells (RGCs) and corresponding changes in visual function is important in early degenerative diseases of the retina, but the sensitivity of both measurements is limited by the inherent variability in healthy subjects. This study investigates the relationships between RGC-related layer thicknesses and foveal and parafoveal flicker modulation sensitivity (FMS) across photopic and mesopic light levels in healthy subjects.

Methods

Photopic and mesopic FMS was measured in 56 young adults, at the point of fixation and at an eccentricity of 5 degrees, in each of the four quadrants. Spectral-domain optical coherence tomography (SD-OCT) was used to measure retinal thicknesses. Relationships between foveal and parafoveal FMS and the retinal thickness in the corresponding region were examined after adjusting for confounding variables.

Results

Total macular and inner retinal layer (IRL) thicknesses in the parafoveal ring were significant predictors of photopic (P = 0.034) and mesopic (P = 0.034) parafoveal FMS, respectively. The superior peripapillary retinal nerve fiber layer (pRNFL) thickness was a contributing factor to the inferior parafoveal FMS (photopic: P = 0.006 and mesopic: P = 0.021) and the inferior pRNFL thickness was also a contributing factor to the superior parafoveal FMS (photopic: P < 0.001 and mesopic: P = 0.015).

Conclusions

The pRNFL thicknesses predict parafoveal FMS for both mesopic and photopic conditions in healthy eyes.

Translational Relevance

The measurement of rapid flicker sensitivity in the parafoveal retina together with the pRNFL thickness profiles measured before the onset of disease, may provide a more sensitive biomarker for detecting loss of sensitivity caused by the earliest neurodegenerative changes in the eyes.

PupilEXT: Flexible Open-Source Platform for High-Resolution Pupillometry in Vision Research

The human pupil behavior has gained increased attention due to the discovery of the intrinsically photosensitive retinal ganglion cells and the afferent pupil control path's role as a biomarker for cognitive processes. Diameter changes in the range of 10-2 mm are of interest, requiring reliable and characterized measurement equipment to accurately detect neurocognitive effects on the pupil. Mostly commercial solutions are used as measurement devices in pupillometry which is associated with high investments. Moreover, commercial systems rely on closed software, restricting conclusions about the used pupil-tracking algorithms. Here, we developed an open-source pupillometry platform consisting of hardware and software competitive with high-end commercial stereo eye-tracking systems. Our goal was to make a professional remote pupil measurement pipeline for laboratory conditions accessible for everyone. This work's core outcome is an integrated cross-platform (macOS, Windows and Linux) pupillometry software called PupilEXT, featuring a user-friendly graphical interface covering the relevant requirements of professional pupil response research. We offer a selection of six state-of-the-art open-source pupil detection algorithms (Starburst, Swirski, ExCuSe, ElSe, PuRe and PuReST) to perform the pupil measurement. A developed 120-fps pupillometry demo system was able to achieve a calibration accuracy of 0.003 mm and an averaged temporal pupil measurement detection accuracy of 0.0059 mm in stereo mode. The PupilEXT software has extended features in pupil detection, measurement validation, image acquisition, data acquisition, offline pupil measurement, camera calibration, stereo vision, data visualization and system independence, all combined in a single open-source interface, available at https://github.com/openPupil/Open-PupilEXT.

A quantitative description of macaque ganglion cell responses to natural scenes: the interplay of time and space

KEY POINTS

Responses to natural scenes are the business of the retina. We find primate ganglion cell responses to such scenes consistent with those to simpler stimuli. A biophysical model confirmed this and predicted ganglion cell responses with close to retinal reliability. Primate ganglion cell responses to natural scenes were driven by temporal variations in colour and luminance over the receptive field centre caused by eye movements, and little influenced by interaction of centre and surround with structure in the scene. We discuss implications in the context of efficient coding of the visual environment. Much information in a higher spatiotemporal frequency band is concentrated in the magnocellular pathway.

ABSTRACT

Responses of visual neurons to natural scenes provide a link between classical descriptions of receptive field structure and visual perception of the natural environment. A natural scene video with a movement pattern resembling that of primate eye movements was used to evoke responses from macaque ganglion cells. Cell responses were well described through known properties of cell receptive fields. Different analyses converge to show that responses primarily derive from the temporal pattern of stimulation derived from eye movements, rather than spatial receptive field structure beyond centre size and position. This was confirmed using a model that predicted ganglion cell responses close to retinal reliability, with only a small contribution of the surround relative to the centre. We also found that the spatiotemporal spectrum of the stimulus is modified in ganglion cell responses, and this can reduce redundancy in the retinal signal. This is more pronounced in the magnocellular pathway, which is much better suited to transmit the detailed structure of natural scenes than the parvocellular pathway. Whitening is less important for chromatic channels. Taken together, this shows how a complex interplay across space, time and spectral content sculpts ganglion cell responses.

Melanopsin hypersensitivity dominates interictal photophobia in migraine

PURPOSE

To define the melanopsin and cone luminance retinogeniculate pathway contributions to photophobia in healthy controls and migraineurs.

METHODS

Healthy controls and migraineurs were categorized according to the International Classification of Headache Disorders criteria. Photophobia was measured under full-field illumination using electromyography in response to narrowband lights spanning the melanopsin and cone luminance action spectra. Migraineurs were tested during their interictal headache-free period. Melanopsin-mediated post-illumination pupil responses quantified intrinsically photosensitive Retinal Ganglion Cell (ipRGC) function.

RESULTS

A model combining the melanopsin and cone luminance action spectra best described photophobia thresholds in controls and migraineurs; melanopsin contributions were ∼1.5× greater than cone luminance. In the illumination range causing photophobia, migraineurs had lower photophobia thresholds (∼0.55 log units; p < 0.001) and higher post-illumination pupil response amplitudes (p = 0.03) than controls.

CONCLUSION

Photophobia is driven by melanopsin and cone luminance inputs to the cortex via the retino-thalamocortical pathway. In migraineurs, lower photophobia thresholds reflect hypersensitivity of ipRGC and cone luminance pathways, with the larger and prolonged post-illumination pupil response amplitude indicative of a supranormal melanopsin response. Our findings inform artificial lighting strategies incorporating luminaires with low melanopsin excitation and photopic luminance to limit the lighting conditions leading to photophobia.

Rod Photoresponse Kinetics Limit Temporal Contrast Sensitivity in Mesopic Vision

The mammalian visual system operates over an extended range of ambient light levels by switching between rod and cone photoreceptors. Rod-driven vision is sluggish, highly sensitive, and operates in dim or scotopic lights, whereas cone-driven vision is brisk, less sensitive, and operates in bright or photopic lights. At intermediate or mesopic lights, vision transitions seamlessly from rod-driven to cone-driven, despite the profound differences in rod and cone response dynamics. The neural mechanisms underlying such a smooth handoff are not understood. Using an operant behavior assay, electrophysiological recordings, and mathematical modeling we examined the neural underpinnings of the mesopic visual transition in mice of either sex. We found that rods, but not cones, drive visual sensitivity to temporal light variations over much of the mesopic range. Surprisingly, speeding up rod photoresponse recovery kinetics in transgenic mice improved visual sensitivity to slow temporal variations, in the range where perceptual sensitivity is governed by Weber's law of sensation. In contrast, physiological processes acting downstream from phototransduction limit sensitivity to high frequencies and temporal resolution. We traced the paradoxical control of visual temporal sensitivity to rod photoresponses themselves. A scenario emerges where perceptual sensitivity is limited by: (1) the kinetics of neural processes acting downstream from phototransduction in scotopic lights, (2) rod response kinetics in mesopic lights, and (3) cone response kinetics as light levels rise into the photopic range.SIGNIFICANCE STATEMENT Our ability to detect flickering lights is constrained by the dynamics of the slowest step in the visual pathway. Cone photoresponse kinetics limit visual temporal sensitivity in bright (photopic) lights, whereas mechanisms in the inner retina limit sensitivity in dim (scotopic) lights. The neural mechanisms underlying the transition between scotopic and photopic vision in mesopic lights, when both rods are cones are active, are unknown. This study provides a missing link in this mechanism by establishing that rod photoresponse kinetics limit temporal sensitivity during the mesopic transition. Surprisingly, this range is where Weber's Law of Sensation governs temporal contrast sensitivity in mouse. Our results will help guide future studies of complex and dynamic interactions between rod-cone signals in the mesopic retina.

Visual Temporal Contrast Sensitivity in the Behaving Mouse Shares Fundamental Properties with Human Psychophysics

The mammalian visual system has a remarkable capacity to detect differences in contrast across time, which is known as temporal contrast sensitivity (TCS). Details of the underlying neural mechanisms are rapidly emerging as a result of a series of elegant electrophysiological studies performed largely with the mouse as an experimental model. However, rigorous psychophysical methods are necessary to pair the electrophysiology with temporal visual behavior in mouse. The optomotor response is frequently used as a proxy for retinal temporal processing in rodents. However, subcortical reflexive pathways drive the optomotor response rather than cortical decision-making areas. To address this problem, we have developed an operant behavior assay that measures TCS in behaving mice. Mice were trained to perform a forced-choice visual task and were tested daily on their ability to distinguish flickering from nonflickering overhead lights. Correct responses (Hit and Correct Rejections) were rewarded. Contrast, temporal frequency, and mean illumination of the flicker were the independent variables. We validated and applied the theory of signal detection to estimate the discriminability factor (d´), a measure of performance that is independent of response bias and motivation. The empirical contrast threshold was defined as the contrast necessary to elicit d´ = 1 and TCS as the inverse of the contrast threshold. With this approach, we established in the mouse a model of human vision that shares fundamental properties of human temporal psychophysics such as Weber adaptation in response to low temporal frequency flicker and illumination-dependent increases in critical flicker frequency as predicted by the Ferry–Porter law.

Cone and melanopsin contributions to human brightness estimation

We determined the contributions of cone and melanopsin luminance signaling to human brightness perception. The absolute brightness of four narrowband primary lights presented in a full-field Ganzfeld was estimated in two conditions, either cone luminance-equated (186.7-1,867.0  cd·m^-2) or melanopsin luminance-equated (31.6-316.3  melanopsin cd·m^-2). We show that brightness estimations for each primary light follow an approximately linear increase with increasing cone or melanopsin luminance (in log units), but are not equivalent for primary lights equated with either cone or melanopsin luminance. Instead, brightness estimations result from a combined interaction between cone and melanopsin signaling. Analytical modeling with wavelength-dependent coefficients signifies that melanopsin luminance positively correlates with brightness magnitudes, and the cone luminance has two contribution components, one that is additive to melanopsin luminance and a second that is negative, implying an adaptation process. These results provide a new framework for evaluating the physiological basis of brightness perception and have direct practical applications for the development of energy-efficient light sources.

Extrinsic cone-mediated post-receptoral noise inhibits the rod temporal impulse response function

We determined how extrinsic white noise correlating with cone inputs to the three primary visual pathways affects both rod-pathway temporal contrast sensitivity and the impulse response function. A four-primary photostimulator provided independent control of rod and cone photoreceptor excitations under mesopic illumination (20 photopic Td). We show that rod-pathway temporal contrast sensitivity uniformly decreases across all temporal frequencies in the presence of cone noise correlating with the inferred magnocellular, parvocellular, or koniocellular pathways. The rod-pathway temporal impulse response functions derived using the Stork-Falk procedure (with a minimum phase assumption) had lower amplitudes in the pathway-specific cone noise. Therefore, cone noise impairs rod-pathway temporal contrast sensitivity without delaying rod-pathway signal transmission.

Melanopsin photoreception contributes to human visual detection, temporal and colour processing

The visual consequences of melanopsin photoreception in humans are not well understood. Here we studied melanopsin photoreception using a technique of photoreceptor silent substitution with five calibrated spectral lights after minimising the effects of individual differences in optical pre-receptoral filtering and desensitising penumbral cones in the shadow of retinal blood vessels. We demonstrate that putative melanopsin-mediated image-forming vision corresponds to an opponent S-OFF L + M-ON response property, with an average temporal resolution up to approximately 5 Hz, and >10x higher thresholds than red-green colour vision. With a capacity for signalling colour and integrating slowly changing lights, melanopsin-expressing intrinsically photosensitive retinal ganglion cells maybe the fifth photoreceptor type for peripheral vision.

A Temporal White Noise Analysis for Extracting the Impulse Response Function of the Human Electroretinogram

PURPOSE

We introduce a method for determining the impulse response function (IRF) of the ERG derived from responses to temporal white noise (TWN) stimuli.

METHODS

This white noise ERG (wnERG) was recorded in participants with normal trichromatic vision to full-field (Ganzfeld) and 39.3° diameter focal stimuli at mesopic and photopic mean luminances and at different TWN contrasts. The IRF was obtained by cross-correlating the TWN stimulus with the wnERG.

RESULTS

We show that wnERG recordings are highly repeatable, with good signal-to-noise ratio, and do not lead to blink artifacts. The wnERG resembles a flash ERG waveform with an initial negativity (N1) followed by a positivity (P1), with amplitudes that are linearly related to stimulus contrast. These N1 and N1-P1 components showed commonalties in implicit times with the a- and b-waves of flash ERGs. There was a clear transition from rod- to cone-driven wnERGs at ∼1 photopic cd.m-2. We infer that oscillatory potentials found with the flash ERG, but not the wnERG, may reflect retinal nonlinearities due to the compression of energy into a short time period during a stimulus flash.

CONCLUSION

The wnERG provides a new approach to study the physiology of the retina using a stimulation method with adaptation and contrast conditions similar to natural scenes to allow for independent variation of stimulus strength and mean luminance, which is not possible with the conventional flash ERG.

TRANSLATIONAL RELEVANCE

The white noise ERG methodology will be of benefit for clinical studies and animal models in the evaluation of hypotheses related to cellular redundancy to understand the effects of disease on specific visual pathways.

Asymmetries of Dark and Bright Negative Afterimages Are Paralleled by Subcortical ON and OFF Poststimulus Responses

Humans are more sensitive to luminance decrements than increments, as evidenced by lower thresholds and shorter latencies for dark stimuli. This asymmetry is consistent with results of neurophysiological recordings in dorsal lateral geniculate nucleus (dLGN) and primary visual cortex (V1) of cat and monkey. Specifically, V1 population responses demonstrate that darks elicit higher levels of activation than brights, and the latency of OFF responses in dLGN and V1 is shorter than that of ON responses. The removal of a dark or bright disc often generates the perception of a negative afterimage, and here we ask whether there also exist asymmetries for negative afterimages elicited by dark and bright discs. If so, do the poststimulus responses of subcortical ON and OFF cells parallel such afterimage asymmetries? To test these hypotheses, we performed psychophysical experiments in humans and single-cell/S-potential recordings in cat dLGN. Psychophysically, we found that bright afterimages elicited by luminance decrements are stronger and last longer than dark afterimages elicited by luminance increments of equal sizes. Neurophysiologically, we found that ON cells responded to the removal of a dark disc with higher firing rates that were maintained for longer than OFF cells to the removal of a bright disc. The ON and OFF cell asymmetry was most pronounced at long stimulus durations in the dLGN. We conclude that subcortical response strength differences between ON and OFF channels parallel the asymmetries between bright and dark negative afterimages, further supporting a subcortical origin of bright and dark afterimage perception.SIGNIFICANCE STATEMENT Afterimages are physiological aftereffects following stimulation of the eye, the study of which helps us to understand how our visual brain generates visual perception in the absence of physical stimuli. We report, for the first time to our knowledge, asymmetries between bright and dark negative afterimages elicited by luminance decrements and increments, respectively. Bright afterimages are stronger and last longer than dark afterimages. Subcortical neuronal recordings of poststimulus responses of ON and OFF cells reveal similar asymmetries with respect to response strength and duration. Our results suggest that subcortical differences between ON and OFF channels help explain intensity and duration asymmetries between bright and dark afterimages, supporting the notion of a subcortical origin of bright and dark afterimages.

Perifoveal L- and M-cone-driven temporal contrast sensitivities at different retinal illuminances

We established a protocol using a well-established LED stimulator to measure temporal contrast sensitivities driven by sine-wave modulation of L- and M-cones in the perifovea using triple silent substitution. The stimulus was presented in an annular field (2° inner diameter, 13° outer diameter). We validated this technique by studying the contrast sensitivity of three color normal observers at 10 different temporal frequencies (between 1 and 28 Hz) over a large range of retinal illuminances (between 0.07 and 587 phot Td), spanning the complete mesopic range. In one subject, sensitivities to counterphase modulation of L- and M-cones and in-phase modulation of L, M, and S-cones were additionally measured, which putatively reflected the parvo- and magnocellular retinogeniculate pathways, respectively. Furthermore, we performed measurements of temporal contrast sensitivities as a function of frequency at 294 phot Td in two protanopes, in two deuteranopes, and in one subject with S-cone monochromacy. Quality of isolation was satisfactory and we were able to reproduce known physiological patterns of temporal vision, such as the typical temporal contrast sensitivity functions of the L- and M-cone, the parvo- and magnocellular retinogeniculate pathways, as well as the light adaptation curves. These results will help determine optimal stimulus conditions in future studies. Results from the dichromats and the S-cone monochromat also support the quality of isolation of our protocol and underpin its potential clinical value.

Luminance and chromatic signals interact differently with melanopsin activation to control the pupil light response

Intrinsically photosensitive retinal ganglion cells (ipRGCs) express the photopigment melanopsin. These cells receive afferent inputs from rods and cones, which provide inputs to the postreceptoral visual pathways. It is unknown, however, how melanopsin activation is integrated with postreceptoral signals to control the pupillary light reflex. This study reports human flicker pupillary responses measured using stimuli generated with a five-primary photostimulator that selectively modulated melanopsin, rod, S-, M-, and L-cone excitations in isolation, or in combination to produce postreceptoral signals. We first analyzed the light adaptation behavior of melanopsin activation and rod and cones signals. Second, we determined how melanopsin is integrated with postreceptoral signals by testing with cone luminance, chromatic blue-yellow, and chromatic red-green stimuli that were processed by magnocellular (MC), koniocellular (KC), and parvocellular (PC) pathways, respectively. A combined rod and melanopsin response was also measured. The relative phase of the postreceptoral signals was varied with respect to the melanopsin phase. The results showed that light adaptation behavior for all conditions was weaker than typical Weber adaptation. Melanopsin activation combined linearly with luminance, S-cone, and rod inputs, suggesting the locus of integration with MC and KC signals was retinal. The melanopsin contribution to phasic pupil responses was lower than luminance contributions, but much higher than S-cone contributions. Chromatic red-green modulation interacted with melanopsin activation nonlinearly as described by a “winner-takes-all” process, suggesting the integration with PC signals might be mediated by a postretinal site.

A Computational Framework for Realistic Retina Modeling

Computational simulations of the retina have led to valuable insights about the biophysics of its neuronal activity and processing principles. A great number of retina models have been proposed to reproduce the behavioral diversity of the different visual processing pathways. While many of these models share common computational stages, previous efforts have been more focused on fitting specific retina functions rather than generalizing them beyond a particular model. Here, we define a set of computational retinal microcircuits that can be used as basic building blocks for the modeling of different retina mechanisms. To validate the hypothesis that similar processing structures may be repeatedly found in different retina functions, we implemented a series of retina models simply by combining these computational retinal microcircuits. Accuracy of the retina models for capturing neural behavior was assessed by fitting published electrophysiological recordings that characterize some of the best-known phenomena observed in the retina: adaptation to the mean light intensity and temporal contrast, and differential motion sensitivity. The retinal microcircuits are part of a new software platform for efficient computational retina modeling from single-cell to large-scale levels. It includes an interface with spiking neural networks that allows simulation of the spiking response of ganglion cells and integration with models of higher visual areas.

Macaque retinal ganglion cell responses to visual patterns: harmonic composition, noise, and psychophysical detectability

The goal of these experiments was to test how well cell responses to visual patterns can be predicted from the sinewave tuning curve. Magnocellular (MC) and parvocellular (PC) ganglion cell responses to different spatial waveforms (sinewave, squarewave, and ramp waveforms) were measured across a range of spatial frequencies. Sinewave spatial tuning curves were fit with standard Gaussian models. From these fits, waveforms and spatial tuning of a cell's responses to the other waveforms were predicted for different harmonics by scaling in amplitude for the power in the waveform's Fourier expansion series over spatial frequency. Since higher spatial harmonics move at a higher temporal frequency, an additional scaling for each harmonic by the MC (bandpass) or PC (lowpass) temporal response was included, together with response phase. Finally, the model included a rectifying nonlinearity. This provided a largely satisfactory estimation of MC and PC cell responses to complex waveforms. As a consequence of their transient responses, MC responses to complex waveforms were found to have significantly more energy in higher spatial harmonic components than PC responses. Response variance (noise) was also quantified as a function of harmonic component. Noise increased to some degree for the higher harmonics. The data are relevant for psychophysical detection or discrimination of visual patterns, and we discuss the results in this context.

Contrast adaptation in the Limulus lateral eye

Luminance and contrast adaptation are neuronal mechanisms employed by the visual system to adjust our sensitivity to light. They are mediated by an assortment of cellular and network processes distributed across the retina and visual cortex. Both have been demonstrated in the eyes of many vertebrates, but only luminance adaptation has been shown in invertebrate eyes to date. Since the computational benefits of contrast adaptation should apply to all visual systems, we investigated whether this mechanism operates in horseshoe crab eyes, one of the best-understood neural networks in the animal kingdom. The spike trains of optic nerve fibers were recorded in response to light stimuli modulated randomly in time and delivered to single ommatidia or the whole eye. We found that the retina adapts to both the mean luminance and contrast of a white-noise stimulus, that luminance- and contrast-adaptive processes are largely independent, and that they originate within an ommatidium. Network interactions are not involved. A published computer model that simulates existing knowledge of the horseshoe crab eye did not show contrast adaptation, suggesting that a heretofore unknown mechanism may underlie the phenomenon. This mechanism does not appear to reside in photoreceptors because white-noise analysis of electroretinogram recordings did not show contrast adaptation. The likely site of origin is therefore the spike discharge mechanism of optic nerve fibers. The finding of contrast adaption in a retinal network as simple as the horseshoe crab eye underscores the broader importance of this image processing strategy to vision.

Neural locus of color afterimages

After fixating on a colored pattern, observers see a similar pattern in complementary colors when the stimulus is removed [1-6]. Afterimages were important in disproving the theory that visual rays emanate from the eye, in demonstrating interocular interactions, and in revealing the independence of binocular vision from eye movements. Afterimages also prove invaluable in exploring selective attention, filling in, and consciousness. Proposed physiological mechanisms for color afterimages range from bleaching of cone photopigments to cortical adaptation [4-9], but direct neural measurements have not been reported. We introduce a time-varying method for evoking afterimages, which provides precise measurements of adaptation and a direct link between visual percepts and neural responses [10]. We then use in vivo electrophysiological recordings to show that all three classes of primate retinal ganglion cells exhibit subtractive adaptation to prolonged stimuli, with much slower time constants than those expected of photoreceptors. At the cessation of the stimulus, ganglion cells generate rebound responses that can provide afterimage signals for later neurons. Our results indicate that afterimage signals are generated in the retina but may be modified like other retinal signals by cortical processes, so that evidence presented for cortical generation of color afterimages is explainable by spatiotemporal factors that modify all signals.

Mesopic rod and S-cone interactions revealed by modulation thresholds

We analyzed mesopic rod and S-cone interactions in terms of their contributions to the blue-yellow opponent pathway. Stimuli were generated using a four-primary colorimeter. Mixed rod and S-cone modulation thresholds (constant L-, M-cone excitation) were measured as a function of their phase difference. Modulation amplitude was equated using threshold units and contrast ratios. This study identified three interaction types: (1) a linear and antagonistic rod:S-cone interaction, (2) probability summation, and (3) a previously unidentified mutual nonlinear reinforcement. Linear rod:S-cone interactions occur within the blue-yellow opponent pathway. Probability summation involves signaling by different postreceptoral pathways. The origin of the nonlinear reinforcement is possibly at the photoreceptors.

Combination of rod and cone inputs in parasol ganglion cells of the magnocellular pathway

This study investigates how rod and cone inputs are combined in the magnocellular (MC) pathway in the mesopic luminance range, when both rods and cones are active. Responses of parafoveal MC ganglion cells from macaque retina were measured as a function of temporal frequency (0.62-20 Hz) or contrast (0.05-0.55) at mesopic light levels (0.2, 2, 20, and 200 td). Stimuli were of three modulation types: (1) isolated rod stimuli (only rod signals were modulated), (2) isolated cone stimuli (only cone luminance signals from long- and middle-wavelength sensitive cones were modulated), and (3) combined rod and cone stimuli (both rod and cone luminance signals were modulated in phase, as with conventional stimuli). The results showed that under mesopic conditions, the relative rod and cone inputs to the MC cells varied with light level and they are combined linearly prior to saturation. Further, rod contrast gain is relatively stable over the mesopic range while cone contrast gain increased with light level. Finally, the measured rod and cone inputs are consistent with the measured human temporal contrast sensitivity functions under comparable stimulation conditions.

Retinal ganglion cell adaptation to small luminance fluctuations

To accommodate the wide input range over which the visual system operates within the narrow output range of spiking neurons, the retina adjusts its sensitivity to the mean light level so that retinal ganglion cells can faithfully signal contrast, or relative deviations from the mean luminance. Given the large operating range of the visual system, the majority of work on luminance adaptation has involved logarithmic changes in light level. We report that luminance gain controls are recruited for remarkably small fluctuations in luminance as well. Using spike recordings from the rat optic tract, we show that ganglion cell responses to a brief flash of light are modulated in amplitude by local background fluctuations as little as 15% contrast. The time scale of the gain control is rapid (<125 ms), at least for on cells. The retinal locus of adaptation precedes the ganglion cell spike generator because response gain changes of on cells were uncorrelated with firing rate. The mechanism seems to reside within the inner retinal network and not in the photoreceptors, because the adaptation profiles of on and off cells differed markedly. The response gain changes follow Weber's law, suggesting that network mechanisms of luminance adaptation described in previous work modulates retinal ganglion cell sensitivity, not just when we move between different lighting environments, but also as our eyes scan a visual scene. Finally, we show that response amplitude is uniformly reduced for flashes on a modulated background that has spatial contrast, indicating that another gain control that integrates luminance signals nonlinearly over space operates within the receptive field center of rat ganglion cells.

Weber's law implies neural discharge more regular than a Poisson process

Weber's law is one of the basic laws in psychophysics, but the link between this psychophysical behavior and the neuronal response has not yet been established. In this paper, we carried out an analysis on the spike train statistics when Weber's law holds, and found that the efferent spike train of a single neuron is less variable than a Poisson process. For population neurons, Weber's law is satisfied only when the population size is small (< 10 neurons). However, if the population neurons share a weak correlation in their discharges and individual neuronal spike train is more regular than a Poisson process, Weber's law is true without any restriction on the population size. Biased competition attractor network also demonstrates that the coefficient of variation of interspike interval in the winning pool should be less than one for the validity of Weber's law. Our work links Weber's law with neural firing property quantitatively, shedding light on the relation between psychophysical behavior and neuronal responses.

Magnocellular and parvocellular pathway mediated luminance contrast discrimination in amblyopia

To evaluate whether luminance contrast discrimination losses in amblyopia on putative magnocellular (MC) and parvocellular (PC) pathway tasks reflect deficits at retinogeniculate or cortical sites. Fifteen amblyopes including six anisometropes, seven strabismics, two mixed and 12 age-matched controls were investigated. Contrast discrimination was measured using established psychophysical procedures that differentiate MC and PC processing. Data were described with a model of the contrast response of primate retinal ganglion cells. All amblyopes and controls displayed the same contrast signatures on the MC and PC tasks, with three strabismics having reduced sensitivity. Amblyopic PC contrast gain was similar to electrophysiological estimates from visually normal, non-human primates. Sensitivity losses evident in a subset of the amblyopes reflect cortical summation deficits, with no change in retinogeniculate contrast responses. The data do not support the proposal that amblyopic contrast sensitivity losses on MC and PC tasks reflect retinogeniculate deficits, but rather are due to anomalous post-retinogeniculate cortical processing of retinal signals.

The challenges natural images pose for visual adaptation

Advances in our understanding of natural image statistics and of gain control within the retinal circuitry are leading to new insights into the classic problem of retinal light adaptation. Here we review what we know about how rapid adaptation occurs during active exploration of the visual scene. Adaptational mechanisms must balance the competing demands of adapting quickly, locally, and reliably, and this balance must be maintained as lighting conditions change. Multiple adaptational mechanisms in different locations within the retina act in concert to accomplish this task, with lighting conditions dictating which mechanisms dominate.