Relative contributions of melanopsin to brightness discrimination when hue and luminance also vary

What can the eye see with melanopsin?

A subpopulation of human retinal ganglion cells contains the melanopsin photopigment, allowing them to act as a fifth photoreceptor class. These ganglion cells project to the visual cortex, but to reveal its intrinsic contribution to conscious vision is technically challenging as it requires melanopsin to be separated from the responses originating in the rods and three cone classes. Using a display engineered to isolate the melanopic visual response, we show that it detects lowpass spatial (≤0.35 cycles per degree) and temporal image content (≤1 Hz) but cannot reconstruct the stimulus form necessary for object recognition. We demonstrate that a model of the spatially diffuse intrinsically-photosensitive retinal ganglion cells' sampling structure is predictive of the measured image reconstruction limits of melanopic spatial vision. Separately, we find that under five-photoreceptor silent substitution conditions, rod pathways alone can support form vision in bright lighting when typically thought to be in saturation. Form vision that is absent from melanopsin can be only perceived in mixtures of both melanopsin and rod signals because it is the rod pathway that sees the form. Our findings show that melanopsin's unique tuning to the diffuse and slow-changing elements in the world provides a stabilized reference point for vision.

Melanopsin-mediated amplification of cone signals in the human visual cortex

The ambient daylight variation is coded by melanopsin photoreceptors and their luxotonic activity increases towards midday when colour temperatures are cooler, and irradiances are higher. Although melanopsin and cone photoresponses can be mediated via separate pathways, the connectivity of melanopsin cells across all levels of the retina enables them to modify cone signals. The downstream effects of melanopsin-cone interactions on human vision are however, incompletely understood. Here, we determined how the change in daytime melanopsin activation affects the human cone pathway signals in the visual cortex. A 5-primary silent-substitution method was developed to evaluate the dependence of cone-mediated signals on melanopsin activation by spectrally tuning the lights and stabilizing the rhodopsin activation under a constant cone photometric luminance. The retinal (white noise electroretinogram) and cortical responses (visual evoked potential) were simultaneously recorded with the photoreceptor-directed lights in 10 observers. By increasing the melanopsin activation, a reverse response pattern was observed with cone signals being supressed in the retina by 27% (p = 0.03) and subsequently amplified by 16% (p = 0.01) as they reach the cortex. We infer that melanopsin activity can amplify cone signals at sites distal to retinal bipolar cells to cause a decrease in the psychophysical Weber fraction for cone vision.

Are ipRGCs involved in human color vision? Hints from physiology, psychophysics, and natural image statistics

Human photoreceptors consist of cones, rods, and melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs). First studied in circadian regulation and pupillary control, ipRGCs project to a variety of brain centers suggesting a broader involvement beyond non-visual functions. IpRGC responses are stable, long-lasting, and with a particular codification of photoreceptor signals. In comparison with the transient and adaptive nature of cone and rod signals, ipRGCs' signaling might provide an ecological advantage to different attributes of color vision. Previous studies have indicated melanopsin's influence on visual responses yet its contribution to color perception in humans remains debated. We summarized evidence and hypotheses (from physiology, psychophysics, and natural image statistics) about direct and indirect involvement of ipRGCs in human color vision, by first briefly assessing the current knowledge about the role of melanopsin and ipRGCs in vision and codification of spectral signals. We then approached the question about melanopsin activation eliciting a color percept, discussing studies using the silent substitution method. Finally, we explore various avenues through which ipRGCs might impact color perception indirectly, such as through involvement in peripheral color matching, post-receptoral pathways, color constancy, long-term chromatic adaptation, and chromatic induction. While there is consensus about the role of ipRGCs in brightness perception, confirming its direct contribution to human color perception requires further investigation. We proposed potential approaches for future research, emphasizing the need for empirical validation and methodological thoroughness to elucidate the exact role of ipRGCs in human color vision.

Melanopsin enhances image persistence

Contributions of the inner retinal photopigment melanopsin to human visual perception are incompletely understood. Here, we use a four-primary display to produce stimuli differing in melanopsin versus cone contrast in psychophysical paradigms in eight subjects with normal color vision. We address two predictions from electrophysiological recordings of the melanopsin system in non-human mammals: melanopsin influences color and/or supports image persistence under visual fixation. We first construct chromatic contrast sensitivity contours for stimuli differing in melanopsin excitation presented as a central annulus (10°) or peripheral (22.5°) spot. We find that although including melanopsin contrast produces modest changes in the average chromatic coordinates in both eccentricities, this occurs equally at low (0.5 Hz) and higher (3.75 Hz) temporal frequencies, arguing that it reflects divergence in cone spectral sensitivity in our participants from that captured in standardized cone fundamentals rather than a melanopsin contribution to color. We continue to ask whether the established ability of melanopsin to sustain firing of visual neurons under extended light exposure has a visual correlate, using the optical illusion of Troxler fading in which blurred spots in periphery disappear during visual fixation. We find that introducing additional melanopsin contrast (+28% Michelson contrast) to either bright or dark spots increases fading latency by 35% ± 8.8% and 41% ± 13.6%, respectively. Our data argue that the primary contribution of melanopsin to perception under these conditions is not to provide a color percept but rather to enhance persistence of low spatial frequency patterns during visual fixation.

PySilSub: An open-source Python toolbox for implementing the method of silent substitution in vision and nonvisual photoreception research

The normal human retina contains several classes of photosensitive cell-rods for low-light vision, three cone classes for daylight vision, and intrinsically photosensitive retinal ganglion cells (ipRGCs) expressing melanopsin for non-image-forming functions, including pupil control, melatonin suppression, and circadian photoentrainment. The spectral sensitivities of the photoreceptors overlap significantly, which means that most lights will stimulate all photoreceptors to varying degrees. The method of silent substitution is a powerful tool for stimulating individual photoreceptor classes selectively and has found much use in research and clinical settings. The main hardware requirement for silent substitution is a spectrally calibrated light stimulation system with at least as many primaries as there are photoreceptors under consideration. Device settings that will produce lights to selectively stimulate the photoreceptor(s) of interest can be found using a variety of analytic and algorithmic approaches. Here we present PySilSub (https://github.com/PySilentSubstitution/pysilsub), a novel Python package for silent substitution featuring flexible support for individual colorimetric observer models (including human and mouse observers), multiprimary stimulation devices, and solving silent substitution problems with linear algebra and constrained numerical optimization. The toolbox is registered with the Python Package Index and includes example data sets from various multiprimary systems. We hope that PySilSub will facilitate the application of silent substitution in research and clinical settings.

Protocol for isolation of melanopsin and rhodopsin in the human eye using silent substitution

Melanopsin-mediated visual and non-visual functions are difficult to study in vivo. To isolate melanopsin responses, non-standard light stimulation instruments are required, with at least as many primaries as photoreceptor classes in the eye. In this protocol, we describe the physical light calibrations of the display instrumentation, control of stimulus artefacts, and correction of individual between-eye differences in human observers. The protocol achieves complete photoreceptor silent substitution in psychophysical, pupillometry, and electroretinographic experiments for probing melanopsin, rod, and cone function. For complete details on the use and execution of this protocol, please refer to Uprety et al. (2022).1.

Melanopsin-driven surround induction on the red/green balance of yellow

To test the potential role of melanopsin-dependent ipRGCs in surround induction effects, we used a four-channel projector apparatus to hold the cone activity in a surround constant while varying the amount of melanopsin activity between two levels: low (baseline) and high (136% of the baseline). Rods were partially controlled by having the subjects complete conditions after either adapting to a bright field or darkness. The subjects adjusted the red/green balance of a 2.5° central target that varied in its ratio of L and M cones, but was equiluminant with the surround, to a perceptual null point (neither reddish nor greenish). When the surround melanopsin activity was higher, the subjects set their yellow balances at significantly higher L/(L+M) ratios, suggesting the high melanopsin surround was inducing greenishness into the central yellow stimulus. This is consistent with surround brightness effects that show the induction of greenishness into a central yellow test by high luminance surrounds. This potentially provides further evidence for a general role of melanopsin activity in brightness perception.

Melanopsin photoreception differentially modulates rod-mediated and cone-mediated human temporal vision

To evaluate the nature of interactions between visual pathways transmitting the slower melanopsin and faster rod and cone signals, we implement a temporal phase summation paradigm in human observers using photoreceptor-directed stimuli. We show that melanopsin stimulation interacts with and alters both rod-mediated and cone-mediated vision regardless of whether it is perceptually visible or not. Melanopsin-rod interactions result in either inhibitory or facilitatory summation depending on the temporal frequency and photoreceptor pathway contrast sensitivity. Moreover, by isolating rod vision, we reveal a bipartite intensity response property of the rod pathway in photopic lighting that extends its operational range at lower frequencies to beyond its classic saturation limits but at the expense of attenuating sensitivity at higher frequencies. In comparison, melanopsin-cone interactions always lead to facilitation. These interactions can be described by linear or probability summations and potentially involve multiple intraretinal and visual cortical pathways to set human visual contrast sensitivity.

•

Melanopsin ipRGCs support vision independent of the rod and cone signals

•

Rod pathways mediate robust visual responses in daylight

•

Temporal contrast sensitivity is contingent on the melanopsin excitation level

•

Visual performance is collectively regulated by melanopsin, rod and cone pathways

Hyperspectral characterization of natural lighting environments

Lights are primary drivers of some crucial biological functions including vision and regulation of circadian rhythm. To understand the light exposure pattern that we experience in a daily life, many past studies measured the spectral composition of natural daylight and artificial lighting. The aim of this book chapter is to introduce a novel method to characterize directional spectral variation in natural lighting environments. An omnidirectional hyperspectral illumination map stores the spectra of lights coming from every direction toward a single point in a scene. Such illumination maps allow us to simulate a spatial light exposure pattern that reaches our eyes, providing useful resources to research areas such as chronobiology, vision science and any other fields which benefit from knowledge about the spectral nature of visual lighting environments.

Melanopic stimulation does not alter psychophysical threshold sensitivity for luminance flicker

In addition to the rod and cone photoreceptors the retina contains intrinsically photosensitive retinal ganglion cells (ipRGCs). These cells express the photopigment melanopsin and are known to be involved in reflexive visual functions such as pupil response and photo-entrainment of the circadian rhythm. It is possible that the ipRGCs contribute to conscious visual perception, either by providing an independent signal to the geniculo-striate pathway, or by interacting with and thus modifying signals arising from “classical” retinal ganglion cells that combine and contrast cone input. Here, we tested for the existence of an interaction by asking if a 350% change in melanopsin stimulation alters psychophysical sensitivity for the detection of luminance flicker. In Experiment 1, we tested for a change in the threshold for detecting luminance flicker in three participants after they adapted to backgrounds with different degrees of tonic melanopsin stimulation. In Experiments 2 and 3, this test was repeated, but now for luminance flicker presented on a transient pedestal of melanopsin stimulation. Across the three experiments, no effect of melanopsin stimulation upon threshold flicker sensitivity was found. Our results suggest that even large changes in melanopsin stimulation do not affect near-threshold, cone-mediated visual perception.

Light adaptation characteristics of melanopsin

Following photopigment bleaching, the rhodopsin and cone-opsins show a characteristic exponential regeneration in the dark with a photocycle dependent on the retinal pigment epithelium. Melanopsin pigment regeneration in animal models requires different pathways to rods and cones. To quantify melanopsin-mediated light adaptation in humans, we first estimated its photopigment regeneration kinetics through the photo-bleach recovery of the intrinsic melanopsin pupil light response (PLR). An intense broadband light (~120,000 Td) bleached 43% of melanopsin compared to 86% of the cone-opsins. Recovery from a 43% bleach was 3.4X slower for the melanopsin than cone-opsin. Post-bleach melanopsin regeneration followed an exponential growth with a 2.5 min time-constant (τ) that required 11.2 min for complete recovery; the half-bleaching level (I_p) was ~ 4.47 log melanopic Td (16.10 log melanopsin effective photons.cm^-2.s^-1; 8.25 log photoisomerisations.photoreceptor^-1.s^-1). The effect on the cone-directed PLR of the level of the melanopsin excitation during continuous light adaptation was then determined. We observed that cone-directed pupil constriction amplitudes increased by ~ 10% when adapting lights had a higher melanopic excitation but the same mean photometric luminance. Our findings suggest that melanopsin light adaptation enhances cone signalling along the non-visual retina-brain axis. Parameters τ and I_p will allow estimation of the level of melanopsin bleaching in any light units; the data have implications for quantifying the relative contributions of putative melanopsin pathways to regulate the post-bleach photopigment regeneration and adaptation.

Optimizing methods to isolate melanopsin-directed responses

The intrinsic melanopsin photoresponse may initiate visual signals that differ in spatiotemporal characteristics from the cone-opsin- and rhodopsin-mediated signals. Applying the CIE standard observer functions in silent-substitution methods can require individual differences in photoreceptor spectral sensitivities and pre-receptoral filtering to be corrected; failure to do so can lead to the intrusion of more sensitive cone processes with putative melanopsin-directed stimuli. Here we evaluate heterochromatic flicker photometry (HFP) and photoreceptor-directed temporal white noise as techniques to limit the effect of these individual differences. Individualized luminous efficiency functions (V(λ)) were compared to the CIE standard observer functions. We show that adapting chromaticities used in silent-substitution methods can deviate by up to 54% in luminance when estimated with the individual and standard observer functions. These deviations lead to inadvertent cone intrusions in the visual functions measured with melanopsin-directed stimuli. To eliminate the intrusions, individual HFP corrections are sufficient at low frequencies (∼1Hz) but temporal white noise is also required at higher frequencies to desensitize penumbral cones. We therefore recommend the selective application of individualized observer calibration and/or temporal white noise in silent-substitution paradigms when studying melanopsin-directed photoresponses.

The Lighting Environment, Its Metrology, and Non-visual Responses

International standard CIE S 026:2018 provides lighting professionals and field researchers in chronobiology with a method to characterize light exposures with respect to non-visual photoreception and responses. This standard defines five spectral sensitivity functions that describe optical radiation for its ability to stimulate each of the five α-opic retinal photoreceptor classes that contribute to the non-visual effects of light in humans via intrinsically-photosensitive retinal ganglion cells (ipRGCs). The CIE also recently published an open-access α-opic toolbox that calculates all the quantities and ratios of the α-opic metrology in the photometric, radiometric and photon systems, based on either a measured (user-defined) spectrum or selected illuminants (A, D65, E, FL11, LED-B3) built into the toolbox. For a wide variety of ecologically-valid conditions, the melanopsin-based photoreception of ipRGCs has been shown to account for the spectral sensitivity of non-visual responses, from shifting the timing of nocturnal sleep and melatonin secretion to regulating steady-state pupil diameter. Recent findings continue to confirm that the photopigment melanopsin also plays a role in visual responses, and that melanopsin-based photoreception may have a significant influence on brightness perception and aspects of spatial vision. Although knowledge concerning the extent to which rods and cones interact with ipRGCs in driving non-visual effects is still growing, a CIE position statement recently used melanopic equivalent daylight (D65) illuminance in preliminary guidance on applying "proper light at the proper time" to manipulate non-visual responses. Further guidance on this approach is awaited from the participants of the 2nd International Workshop on Circadian and Neurophysiological Photometry (in Manchester, August 2019). The new α-opic metrology of CIE S 026 enables traceable measurements and a formal, quantitative specification of personal light exposures, photic interventions and lighting designs. Here, we apply this metrology to everyday light sources including a natural daylight time series, a range of LED lighting products and, using the toobox, to a smartphone display screen. This collection of examples suggests ways in which variations in the melanopic content of light over the day can be adopted in strategies that use light to support human health and well-being.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

Selective amplification of ipRGC signals accounts for interictal photophobia in migraine

Second only to headache, photophobia is the most debilitating symptom reported by people with migraine. While the melanopsin-containing intrinsically photosensitive retinal ganglion cells (ipRGCs) are thought to play a role, how cone and melanopsin signals are integrated in this pathway to produce visual discomfort is poorly understood. We studied 60 people: 20 without headache and 20 each with interictal photophobia from migraine with or without visual aura. Participants viewed pulses of spectral change that selectively targeted melanopsin, the cones, or both and rated the degree of visual discomfort produced by these stimuli while we recorded pupil responses. We examined the data within a model that describes how cone and melanopsin signals are weighted and combined at the level of the retina and how this combined signal is transformed into a rating of discomfort or pupil response. Our results indicate that people with migraine do not differ from headache-free controls in the manner in which melanopsin and cone signals are combined. Instead, people with migraine demonstrate an enhanced response to integrated ipRGC signals for discomfort. This effect of migraine is selective for ratings of visual discomfort, in that an enhancement of pupil responses was not seen in the migraine group, nor were group differences found in surveys of other behaviors putatively linked to ipRGC function (chronotype, seasonal sensitivity, presence of a photic sneeze reflex). By revealing a dissociation in the amplification of discomfort vs. pupil response, our findings suggest a postretinal alteration in processing of ipRGC signals for photophobia in migraine.