Human trichromacy revisited

Melanopsin-mediated amplification of cone signals in the human visual cortex

The ambient daylight variation is coded by melanopsin photoreceptors and their luxotonic activity increases towards midday when colour temperatures are cooler, and irradiances are higher. Although melanopsin and cone photoresponses can be mediated via separate pathways, the connectivity of melanopsin cells across all levels of the retina enables them to modify cone signals. The downstream effects of melanopsin-cone interactions on human vision are however, incompletely understood. Here, we determined how the change in daytime melanopsin activation affects the human cone pathway signals in the visual cortex. A 5-primary silent-substitution method was developed to evaluate the dependence of cone-mediated signals on melanopsin activation by spectrally tuning the lights and stabilizing the rhodopsin activation under a constant cone photometric luminance. The retinal (white noise electroretinogram) and cortical responses (visual evoked potential) were simultaneously recorded with the photoreceptor-directed lights in 10 observers. By increasing the melanopsin activation, a reverse response pattern was observed with cone signals being supressed in the retina by 27% (p = 0.03) and subsequently amplified by 16% (p = 0.01) as they reach the cortex. We infer that melanopsin activity can amplify cone signals at sites distal to retinal bipolar cells to cause a decrease in the psychophysical Weber fraction for cone vision.

castleCSF - A contrast sensitivity function of color, area, spatiotemporal frequency, luminance and eccentricity

The contrast sensitivity function (CSF) is a fundamental visual model explaining our ability to detect small contrast patterns. CSFs found many applications in engineering, where they can be used to optimize a design for perceptual limits. To serve such a purpose, CSFs must explain possibly a complete set of stimulus parameters, such as spatial and temporal frequency, luminance, and others. Although numerous contrast sensitivity measurements can be found in the literature, none fully explains the complete space of stimulus parameters. Therefore, in this work, we first collect and consolidate contrast sensitivity measurements from 18 studies, which explain the sensitivity variation across the parameters of interest. Then, we build an analytical contrast sensitivity model that explains the data from all those studies. The proposed castleCSF model explains the sensitivity as the function of spatial and temporal frequencies, an arbitrary contrast modulation direction in the color space, mean luminance, and chromaticity of the background, eccentricity, and stimulus area. The proposed model uses the same set of parameters to explain the data from 18 studies with an error of 3.59 dB. The consolidated contrast sensitivity data and the code for the model are publicly available at https://github.com/gfxdisp/castleCSF/.

Are ipRGCs involved in human color vision? Hints from physiology, psychophysics, and natural image statistics

Human photoreceptors consist of cones, rods, and melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs). First studied in circadian regulation and pupillary control, ipRGCs project to a variety of brain centers suggesting a broader involvement beyond non-visual functions. IpRGC responses are stable, long-lasting, and with a particular codification of photoreceptor signals. In comparison with the transient and adaptive nature of cone and rod signals, ipRGCs' signaling might provide an ecological advantage to different attributes of color vision. Previous studies have indicated melanopsin's influence on visual responses yet its contribution to color perception in humans remains debated. We summarized evidence and hypotheses (from physiology, psychophysics, and natural image statistics) about direct and indirect involvement of ipRGCs in human color vision, by first briefly assessing the current knowledge about the role of melanopsin and ipRGCs in vision and codification of spectral signals. We then approached the question about melanopsin activation eliciting a color percept, discussing studies using the silent substitution method. Finally, we explore various avenues through which ipRGCs might impact color perception indirectly, such as through involvement in peripheral color matching, post-receptoral pathways, color constancy, long-term chromatic adaptation, and chromatic induction. While there is consensus about the role of ipRGCs in brightness perception, confirming its direct contribution to human color perception requires further investigation. We proposed potential approaches for future research, emphasizing the need for empirical validation and methodological thoroughness to elucidate the exact role of ipRGCs in human color vision.

Influence of colour vision on attention to, and impression of, complex aesthetic images

Humans exhibit colour vision variations due to genetic polymorphisms, with trichromacy being the most common, while some people are classified as dichromats. Whether genetic differences in colour vision affect the way of viewing complex images remains unknown. Here, we investigated how people with different colour vision focused their gaze on aesthetic paintings by eye-tracking while freely viewing digital rendering of paintings and assessed individual impressions through a decomposition analysis of adjective ratings for the images. Gaze-concentrated areas among trichromats were more highly correlated than those among dichromats. However, compared with the brief dichromatic experience with the simulated images, there was little effect of innate colour vision differences on impressions. These results indicate that chromatic information is instructive as a cue for guiding attention, whereas the impression of each person is generated according to their own sensory experience and normalized through one's own colour space.

Protocol for isolation of melanopsin and rhodopsin in the human eye using silent substitution

Melanopsin-mediated visual and non-visual functions are difficult to study in vivo. To isolate melanopsin responses, non-standard light stimulation instruments are required, with at least as many primaries as photoreceptor classes in the eye. In this protocol, we describe the physical light calibrations of the display instrumentation, control of stimulus artefacts, and correction of individual between-eye differences in human observers. The protocol achieves complete photoreceptor silent substitution in psychophysical, pupillometry, and electroretinographic experiments for probing melanopsin, rod, and cone function. For complete details on the use and execution of this protocol, please refer to Uprety et al. (2022).1.

Melanopsin photoreception differentially modulates rod-mediated and cone-mediated human temporal vision

To evaluate the nature of interactions between visual pathways transmitting the slower melanopsin and faster rod and cone signals, we implement a temporal phase summation paradigm in human observers using photoreceptor-directed stimuli. We show that melanopsin stimulation interacts with and alters both rod-mediated and cone-mediated vision regardless of whether it is perceptually visible or not. Melanopsin-rod interactions result in either inhibitory or facilitatory summation depending on the temporal frequency and photoreceptor pathway contrast sensitivity. Moreover, by isolating rod vision, we reveal a bipartite intensity response property of the rod pathway in photopic lighting that extends its operational range at lower frequencies to beyond its classic saturation limits but at the expense of attenuating sensitivity at higher frequencies. In comparison, melanopsin-cone interactions always lead to facilitation. These interactions can be described by linear or probability summations and potentially involve multiple intraretinal and visual cortical pathways to set human visual contrast sensitivity.

•

Melanopsin ipRGCs support vision independent of the rod and cone signals

•

Rod pathways mediate robust visual responses in daylight

•

Temporal contrast sensitivity is contingent on the melanopsin excitation level

•

Visual performance is collectively regulated by melanopsin, rod and cone pathways

Is melanopsin activation affecting large field color-matching functions?

Color theory is based on the exclusive activation of cones. However, since the discovery of melanopsin expressing cells in the human retina, evidence of its intrusion in brightness and color vision is increasing. We aimed to assess if differences between peripheral or large field and foveal color matches can be accounted for by melanopsin activation or rod intrusion. Photopic color matches by young observers showed that differences between extrafoveal and foveal results cannot be explained by rod intrusion. Furthermore, statistical analyses on existing color-matching functions suggest a role of melanopsin activation, particularly, in large field S fundamentals.

Bongard and Smirnov on the tetrachromacy of extra-foveal vision

In Moscow in the 1950's, the physicist M. M. Bongard developed the use of silent substitution to establish the number of dimensions of human or animal colour vision and to derive colour-matching functions either for whole organisms or for individual neuronal channels. In 1956, he and his colleague M. S. Smirnov reported that extra-foveal human vision was tetrachromatic when tested by the silent-substitution method that they called 'replacement colorimetry'. In the steady state, trichromatic matches were possible in extra-foveal regions, but transients were visible when one such match was replaced by another. If, however, a match was made with four primaries, then a silent substitution was possible; and such matches - unlike trichromatic ones - were stable with light level and with changes in the state of chromatic adaptation. Bongard and Smirnov believed that the fourth receptor had the spectral sensitivity of the rods, but of course they were working long before the discovery of intrinsically photosensitive retinal ganglion cells. On the fiftieth anniversary of Bongard's grievous death, we provide a translation of Bongard and Smirnov's paper on the tetrachromacy of extra-foveal vision. In a commentary, we give the background to their work and provide further details of their apparatus and procedure. We briefly discuss related research and the reception in the West of Bongard and Smirnov's claims. We suggest that an analogy can be made between the tetrachromacy of the parafovea and the 'weak tetrachromacy' of heterozygotes for anomalous colour vision, whose trichromatic matches are not stable with chromatic adaptation.

Maximum possible contrast level for silent substitution: a theoretical model applied to melanopsin stimulation

For any given set of light sources stimulating the photoreceptors of the retina, the theoretical levels of illumination producing the smallest and the largest expression of one photoreceptor with fixed stimulation for the others are analytically computed. The cases of four, five, and more light sources are studied. We show that, for contrast optimization, only as many light sources as photoreceptors do matter and that, in the case of four light sources, the maximum contrast achievable for melanopsin lies at the intersection of the lines joining the sources in the CIE xy chromaticity diagram. This result is used to obtain the optimal position of four Gaussian primaries of equal bandwidth. In addition, we derive a procedure to construct level maps for melanopsin contrast overlying the diagram. In the second part of the paper, the interpersonal variability of the perceived stimulation is shown to be globally reduced if the bandwidth of the light sources is increased and, under some assumptions, if a light source is added.

Light adaptation characteristics of melanopsin

Following photopigment bleaching, the rhodopsin and cone-opsins show a characteristic exponential regeneration in the dark with a photocycle dependent on the retinal pigment epithelium. Melanopsin pigment regeneration in animal models requires different pathways to rods and cones. To quantify melanopsin-mediated light adaptation in humans, we first estimated its photopigment regeneration kinetics through the photo-bleach recovery of the intrinsic melanopsin pupil light response (PLR). An intense broadband light (~120,000 Td) bleached 43% of melanopsin compared to 86% of the cone-opsins. Recovery from a 43% bleach was 3.4X slower for the melanopsin than cone-opsin. Post-bleach melanopsin regeneration followed an exponential growth with a 2.5 min time-constant (τ) that required 11.2 min for complete recovery; the half-bleaching level (I_p) was ~ 4.47 log melanopic Td (16.10 log melanopsin effective photons.cm^-2.s^-1; 8.25 log photoisomerisations.photoreceptor^-1.s^-1). The effect on the cone-directed PLR of the level of the melanopsin excitation during continuous light adaptation was then determined. We observed that cone-directed pupil constriction amplitudes increased by ~ 10% when adapting lights had a higher melanopic excitation but the same mean photometric luminance. Our findings suggest that melanopsin light adaptation enhances cone signalling along the non-visual retina-brain axis. Parameters τ and I_p will allow estimation of the level of melanopsin bleaching in any light units; the data have implications for quantifying the relative contributions of putative melanopsin pathways to regulate the post-bleach photopigment regeneration and adaptation.

Population Models, Not Analyses, of Human Neuroscience Measurements

Selectivity for many basic properties of visual stimuli, such as orientation, is thought to be organized at the scale of cortical columns, making it difficult or impossible to measure directly with noninvasive human neuroscience measurement. However, computational analyses of neuroimaging data have shown that selectivity for orientation can be recovered by considering the pattern of response across a region of cortex. This suggests that computational analyses can reveal representation encoded at a finer spatial scale than is implied by the spatial resolution limits of measurement techniques. This potentially opens up the possibility to study a much wider range of neural phenomena that are otherwise inaccessible through noninvasive measurement. However, as we review in this article, a large body of evidence suggests an alternative hypothesis to this superresolution account: that orientation information is available at the spatial scale of cortical maps and thus easily measurable at the spatial resolution of standard techniques. In fact, a population model shows that this orientation information need not even come from single-unit selectivity for orientation tuning, but instead can result from population selectivity for spatial frequency. Thus, a categorical error of interpretation can result whereby orientation selectivity can be confused with spatial frequency selectivity. This is similarly problematic for the interpretation of results from numerous studies of more complex representations and cognitive functions that have built upon the computational techniques used to reveal stimulus orientation. We suggest in this review that these interpretational ambiguities can be avoided by treating computational analyses as models of the neural processes that give rise to measurement. Building upon the modeling tradition in vision science using considerations of whether population models meet a set of core criteria is important for creating the foundation for a cumulative and replicable approach to making valid inferences from human neuroscience measurements. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Optimizing methods to isolate melanopsin-directed responses

The intrinsic melanopsin photoresponse may initiate visual signals that differ in spatiotemporal characteristics from the cone-opsin- and rhodopsin-mediated signals. Applying the CIE standard observer functions in silent-substitution methods can require individual differences in photoreceptor spectral sensitivities and pre-receptoral filtering to be corrected; failure to do so can lead to the intrusion of more sensitive cone processes with putative melanopsin-directed stimuli. Here we evaluate heterochromatic flicker photometry (HFP) and photoreceptor-directed temporal white noise as techniques to limit the effect of these individual differences. Individualized luminous efficiency functions (V(λ)) were compared to the CIE standard observer functions. We show that adapting chromaticities used in silent-substitution methods can deviate by up to 54% in luminance when estimated with the individual and standard observer functions. These deviations lead to inadvertent cone intrusions in the visual functions measured with melanopsin-directed stimuli. To eliminate the intrusions, individual HFP corrections are sufficient at low frequencies (∼1Hz) but temporal white noise is also required at higher frequencies to desensitize penumbral cones. We therefore recommend the selective application of individualized observer calibration and/or temporal white noise in silent-substitution paradigms when studying melanopsin-directed photoresponses.

Plant scientists' research attention is skewed towards colourful, conspicuous and broadly distributed flowers

Scientists' research interests are often skewed toward charismatic organisms, but quantifying research biases is challenging. By combining bibliometric data with trait-based approaches and using a well-studied alpine flora as a case study, we demonstrate that morphological and colour traits, as well as range size, have significantly more impact on species choice for wild flowering plants than traits related to ecology and rarity. These biases should be taken into account to inform more objective plant conservation efforts.

A Review of Silent Substitution Devices for Melanopsin Stimulation in Humans

One way to study the specific response of the non-visual melanopsin photoreceptors of the human eye is to silence the response of cones and rods. Melanopsin photoreceptors (ipRGC), highlighted in the early 2000s, are intimately linked to the circadian rhythm and therefore to our sleep and wakefulness. Rest and sleep regulation, health and cognitive functions are all linked to ipRGC and play an important role in work and human relationships. Thus, we believe that the study of ipRGC responses is important.We searched and reviewed scientific articles describing instrumentation dedicated to these studies. PubMed lists more than 90,000 articles created since the year 2000 that contain the word circadian but only 252 with silent substitution. In relation to melanopsin, we found 39 relevant articles from which only 11 give a device description for humans, which is incomplete in most cases. We did not find any consensus for light intensity description, melanopsin contrast, sequences of melanopsin light stimulation and optical setup to expose the retina to the light.

Plasticity in perception: insights from color vision deficiencies

Inherited color vision deficiencies typically result from a loss or alteration of the visual photopigments absorbing light and thus impact the very first step of seeing. There is growing interest in how subsequent steps in the visual pathway might be calibrated to compensate for the altered receptor signals, with the possibility that color coding and color percepts might be less severely impacted than the receptor differences predict. These compensatory adjustments provide important insights into general questions about sensory plasticity and the sensory and cognitive processes underlying how we experience color.

Perfect appearance match between self-luminous and surface colors can be performed with isomeric spectra

Surface color results from a reflected light bounced off a material, such as a paper. By contrast, self-luminous color results directly from an emitting light, such as a Liquid Crystal (LC) display. These are completely different mechanisms, and thus, surface color and self-luminous color cannot be matched even though both have identical tristimulus values. In fact, previous research has reported that metameric color matching fails among diverse media. However, the reason for this failure remains unclear. In the present study, we created isomeric color-matching pairs between self-luminous and surface colors by modulating the spectral distribution of the light for surface colors. Then, we experimentally verified whether such color matching can be performed. The results show that isomeric color matching between self-luminous and surface colors can be performed for all participants. However, metameric color matching fails for most participants, indicating that differences in the spectral distributions rather than the different color-generating mechanisms themselves are the reason for the color matching failure between different devices. We experimentally demonstrated that there is no essential problem in cross-media color matching by generating isomeric pairs. Our results can be considered to be of great significance not only for color science, but also for the color industry.

Melanopsin and the Intrinsically Photosensitive Retinal Ganglion Cells: Biophysics to Behavior

The mammalian visual system encodes information over a remarkable breadth of spatiotemporal scales and light intensities. This performance originates with its complement of photoreceptors: the classic rods and cones, as well as the intrinsically photosensitive retinal ganglion cells (ipRGCs). IpRGCs capture light with a G-protein-coupled receptor called melanopsin, depolarize like photoreceptors of invertebrates such as Drosophila, discharge electrical spikes, and innervate dozens of brain areas to influence physiology, behavior, perception, and mood. Several visual responses rely on melanopsin to be sustained and maximal. Some require ipRGCs to occur at all. IpRGCs fulfill their roles using mechanisms that include an unusual conformation of the melanopsin protein, an extraordinarily slow phototransduction cascade, divisions of labor even among cells of a morphological type, and unorthodox configurations of circuitry. The study of ipRGCs has yielded insight into general topics that include photoreceptor evolution, cellular diversity, and the steps from biophysical mechanisms to behavior.

Crosstalk: The diversity of melanopsin ganglion cell types has begun to challenge the canonical divide between image-forming and non-image-forming vision

Melanopsin ganglion cells have defied convention since their discovery almost 20 years ago. In the years following, many types of these intrinsically photosensitive retinal ganglion cells (ipRGCs) have emerged. In the mouse retina, there are currently six known types (M1-M6) of melanopsin ganglion cells, each with unique morphology, mosaics, connections, physiology, projections, and functions. While melanopsin-expressing cells are usually associated with behaviors like circadian photoentrainment and the pupillary light reflex, the characterization of multiple types has demonstrated a reach that may extend far beyond non-image-forming vision. In fact, studies have shown that individual types of melanopsin ganglion cells have the potential to impact image-forming functions like contrast sensitivity and color opponency. Thus, the goal of this review is to summarize the morphological and functional aspects of the six known types of melanopsin ganglion cells in the mouse retina and to highlight their respective roles in non-image-forming and image-forming vision. Although many melanopsin ganglion cell types do project to image-forming brain targets, it is important to note that this is only the first step in determining their influence on image-forming vision. Even so, the visual system has canonically been divided into these two functional realms and melanopsin ganglion cells have begun to challenge the boundary between them, providing an overlap of visual information that is complementary rather than redundant. Further studies on these ganglion cell photoreceptors will no doubt continue to illustrate an ever-expanding role for melanopsin ganglion cells in image-forming vision.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

Reconciling Color Vision Models With Midget Ganglion Cell Receptive Fields

Midget retinal ganglion cells (RGCs) make up the majority of foveal RGCs in the primate retina. The receptive fields of midget RGCs exhibit both spectral and spatial opponency and are implicated in both color and achromatic form vision, yet the exact mechanisms linking their responses to visual perception remain unclear. Efforts to develop color vision models that accurately predict all the features of human color and form vision based on midget RGCs provide a case study connecting experimental and theoretical neuroscience, drawing on diverse research areas such as anatomy, physiology, psychophysics, and computer vision. Recent technological advances have allowed researchers to test some predictions of color vision models in new and precise ways, producing results that challenge traditional views. Here, we review the progress in developing models of color-coding receptive fields that are consistent with human psychophysics, the biology of the primate visual system and the response properties of midget RGCs.

Melanopsin contributions to non-visual and visual function

Melanopsin is a short-wavelength-sensitive photopigment that was discovered only around 20 years ago. It is expressed in the cell bodies and processes of a subset of retinal ganglion cells in the retina (the intrinsically photosensitive retinal ganglion cells; ipRGCs), thereby allowing them to signal light even in the absence of cone and rod input. Many of the fundamental properties of melanopsin signalling in humans for both visual (e.g. detection, discrimination, brightness estimation) and non-visual function (e.g. melatonin suppression, circadian phase shifting) remain to be elucidated. Here, we give an overview of what we know about melanopsin contributions in visual function and non-visual function.

Effects of Blue Light on Dynamic Vision

Dynamic vision is crucial to not only animals’ hunting behaviors but also human activities, and yet little is known about how to enhance it, except for extensive trainings like athletics do. Exposure to blue light has been shown to enhance human alertness (Chellappa et al., 2011), perhaps through intrinsically photosensitive retinal ganglion cells (ipRGCs), which are sensitive to motion perception as revealed by animal studies. However, it remains unknown whether blue light can enhance human dynamic vision, a motion-related ability. We conducted five experiments under blue or orange light to test three important components of dynamic vision: eye pursuit accuracy (EPA, Experiment 1), kinetic visual acuity (KVA, Experiment 1 and 2), and dynamic visual acuity (DVA, Experiment 3–5). EPA was measured by the distance between the position of the fixation and the position of the target when participants tracked a target dot. In the KVA task, participants reported three central target numbers (randomly chosen from 0 to 9) moving toward participants in the depth plane, with speed threshold calculated by a staircase procedure. In the DVA task, three numbers were presented along the meridian line on the same depth plane, with motion direction (Experiment 3) and difficulty level (Experiment 4) manipulated, and a blue light filter lens was used to test the ipRGCs contribution (Experiment 5). Results showed that blue light enhanced EPA and DVA, but reduced KVA. Further, DVA enhancement was modulated by difficulty level: blue light enhancement effect was found only with hard task in the downward motion in Experiment 3 and with the low contrast target in Experiment 4. However, this blue light enhancement effect was not caused by mechanism of the ipRGCs, at least not in the range we tested. In this first study demonstrating the relationship between different components of dynamic vision and blue light, our findings that DVA can be enhanced under blue light with hard but not easy task indicate that blue light can enhance dynamic visual discrimination when needed.

Evidence for an impact of melanopsin activation on unique white perception

Current models of human color vision only consider cone inputs at photopic light levels, yet it is unclear whether the recently discovered melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs) contribute to color perception. Using a lab-made five-primary photostimulator that can independently control the stimulations of rods, cones, and ipRGCs in human retina, we determined the observer's unique white perception, an equilibrium point for signals arising from the opponent mechanisms of color vision, under different levels of melanopsin activation. We found changing melanopsin activation levels shifts the equilibrium point in the chromatic pathways. Our results suggest potential evidence for an impact of melanopsin activation on unique white perception and the existing color vision model for the periphery may need to be revised by incorporating melanopsin signaling.

Melanopsin photoreception contributes to human visual detection, temporal and colour processing

The visual consequences of melanopsin photoreception in humans are not well understood. Here we studied melanopsin photoreception using a technique of photoreceptor silent substitution with five calibrated spectral lights after minimising the effects of individual differences in optical pre-receptoral filtering and desensitising penumbral cones in the shadow of retinal blood vessels. We demonstrate that putative melanopsin-mediated image-forming vision corresponds to an opponent S-OFF L + M-ON response property, with an average temporal resolution up to approximately 5 Hz, and >10x higher thresholds than red-green colour vision. With a capacity for signalling colour and integrating slowly changing lights, melanopsin-expressing intrinsically photosensitive retinal ganglion cells maybe the fifth photoreceptor type for peripheral vision.

Photopigments and the dimensionality of animal color vision

Early color-matching studies established that normal human color vision is trichromatic. Subsequent research revealed a causal link between trichromacy and the presence in the retina of three classes of cone photopigments. Over the years, measurements of the photopigment complements of other species have expanded greatly and these are frequently used to predict the dimensionality of an animal's color vision. This review provides an account of how the linkage between the number of active photopigments and the dimensions of human color vision developed, summarizes the various mechanisms that can impact photopigment spectra and number, and provides an across-species survey to examine cases where the photopigment link to the dimensionality of color vision has been claimed. The literature reveals numerous instances where the human model fails to account for the ways in which the visual systems of other animals exploit information obtained from the presence of multiple photopigments in support of their behavior.

The human visual cortex response to melanopsin-directed stimulation is accompanied by a distinct perceptual experience

The photopigment melanopsin supports reflexive visual functions in people, such as pupil constriction and circadian photoentrainment. What contribution melanopsin makes to conscious visual perception is less studied. We devised a stimulus that targeted melanopsin separately from the cones using pulsed (3-s) spectral modulations around a photopic background. Pupillometry confirmed that the melanopsin stimulus evokes a response different from that produced by cone stimulation. In each of four subjects, a functional MRI response in area V1 was found. This response scaled with melanopic contrast and was not easily explained by imprecision in the silencing of the cones. Twenty additional subjects then observed melanopsin pulses and provided a structured rating of the perceptual experience. Melanopsin stimulation was described as an unpleasant, blurry, minimal brightening that quickly faded. We conclude that isolated stimulation of melanopsin is likely associated with a response within the cortical visual pathway and with an evoked conscious percept.

Pupil response components: attention-light interaction in patients with Parinaud's syndrome

Covertly shifting attention to a brighter or darker image (without moving one’s eyes) is sufficient to evoke pupillary constriction or dilation, respectively. One possibility is that this attentional modulation involves the pupillary light response pathway, which pivots around the olivary pretectal nucleus. We investigate this possibility by studying patients with Parinaud’s syndrome, where the normal pupillary light response is strongly impaired due to lesions in the pretectal area. Four patients and nine control participants covertly attended (while maintaining fixation at the center of a monitor screen) to one of two disks located in the left and right periphery: one brighter, the other darker than the background. Patients and control subjects behaved alike, showing smaller pupils when attending to the brighter stimulus (despite no eye movements); consistent results were obtained with a dynamic version of the stimulus. We interpret this as proof of principle that attention to bright or dark stimuli can dynamically modulate pupil size in patients with Parinaud’s syndrome, suggesting that attention acts independently of the pretectal circuit for the pupillary light response and indicating that several components of the pupillary response can be isolated – including one related to the focus of covert attention.

Human Visual Cortex Responses to Rapid Cone and Melanopsin-Directed Flicker

Signals from cones are recombined in postreceptoral channels [luminance, L + M; red-green, L - M; blue-yellow, S - (L + M)]. The melanopsin-containing retinal ganglion cells are also active at daytime light levels and recent psychophysical results suggest that melanopsin contributes to conscious vision in humans. Here, we measured BOLD fMRI responses to spectral modulations that separately targeted the postreceptoral cone channels and melanopsin. Responses to spatially uniform (27.5° field size, central 5° obscured) flicker at 0.5, 1, 2, 4, 8, 16, 32, and 64 Hz were recorded from areas V1, V2/V3, motion-sensitive area MT, and the lateral occipital complex. In V1 and V2/V3, higher temporal sensitivity was observed to L + M + S (16 Hz) compared with L - M flicker (8 Hz), consistent with psychophysical findings. Area MT was most sensitive to rapid (32 Hz) flicker of either L + M + S or L - M. We found S cone responses only in areas V1 and V2/V3 (peak frequency: 4-8 Hz). In addition, we studied an L + M modulation and found responses that were effectively identical at all temporal frequencies to those recorded for the L + M + S modulation. Finally, we measured the cortical response to melanopsin-directed flicker and compared this response with control modulations that addressed stimulus imprecision and the possibility of stimulation of cones in the shadow of retinal blood vessels (penumbral cones). For our stimulus conditions, melanopsin flicker did not elicit a cortical response exceeding that of the control modulations. We note that failure to control for penumbral cone stimulation could be mistaken for a melanopsin response.

SIGNIFICANCE STATEMENT

The retina contains cone photoreceptors and ganglion cells that contain the photopigment melanopsin. Cones provide brightness and color signals to visual cortex. Melanopsin influences circadian rhythm and the pupil, but its contribution to cortex and perception is less clear. We measured the response of human visual cortex with fMRI using spectral modulations tailored to stimulate the cones and melanopsin separately. We found that cortical responses to cone signals vary systematically across visual areas. Differences in temporal sensitivity for achromatic, red-green, and blue-yellow stimuli generally reflect the known perceptual properties of vision. We found that melanopsin signals do not produce a measurable response in visual cortex at temporal frequencies between 0.5 and 64 Hz at daytime light levels.

Can colour vision re-evolve? Variation in the X-linked opsin locus of cathemeral Azara's owl monkeys (Aotus azarae azarae)

BACKGROUND

Do evolutionary specializations lead to evolutionary constraint? This appears plausible, particularly when specialization leads to loss of complex adaptations. In the owl monkey lineage, nocturnality clearly arose from a diurnal ancestor. This behavioural shift was accompanied by morphological changes in the eye and orbit and complete loss of colour vision via missense mutations in the gene encoding the short-wave sensitive visual pigment (SWS opsin). Interestingly, at least one subspecies of owl monkey, Azara's owl monkey (Aotus azarae azarae), has regained activity in daylight. Given that all primate species that are active in daylight, including primarily diurnal species and species that are active during both day and night, have at least dichromatic colour vision, it seems reasonable to propose that dichromacy would be adaptive in A. a. azarae. With a disabled SWS opsin, the main avenue available for Azara's owl monkeys to re-evolve colour vision is via a polymorphism in the intact X-linked opsin locus, which commonly occurs in other New World monkeys. To examine this possibility we assayed variation in the X-linked opsin of A. a. azarae, focusing on the three exons (3, 4 and 5) that control spectral sensitivity.

RESULTS

We found low opsin genetic variation on a population level, and no differences at the three main sites that lead to variation in spectral sensitivity in the opsins of other New World monkeys. Two rare alleles with single amino acid variants are segregating in the population, but previous functional studies indicate that these are unlikely to affect spectral sensitivity.

CONCLUSIONS

Genetic constraint on the re-evolution of colour vision is likely operating in Azara's owl monkey, which may affect the niche that this subspecies is able to occupy.

Advances in understanding the molecular basis of the first steps in color vision

Serving as one of our primary environmental inputs, vision is the most sophisticated sensory system in humans. Here, we present recent findings derived from energetics, genetics and physiology that provide a more advanced understanding of color perception in mammals. Energetics of cis-trans isomerization of 11-cis-retinal accounts for color perception in the narrow region of the electromagnetic spectrum and how human eyes can absorb light in the near infrared (IR) range. Structural homology models of visual pigments reveal complex interactions of the protein moieties with the light sensitive chromophore 11-cis-retinal and that certain color blinding mutations impair secondary structural elements of these G protein-coupled receptors (GPCRs). Finally, we identify unsolved critical aspects of color tuning that require future investigation.

Selective stimulation of penumbral cones reveals perception in the shadow of retinal blood vessels

In 1819, Johann Purkinje described how a moving light source that displaces the shadow of the retinal blood vessels to adjacent cones can produce the entopic percept of a branching tree. Here, we describe a novel method for producing a similar percept. We used a device that mixes 56 narrowband primaries under computer control, in conjunction with the method of silent substitution, to present observers with a spectral modulation that selectively targeted penumbral cones in the shadow of the retinal blood vessels. Such a modulation elicits a clear Purkinje-tree percept. We show that the percept is specific to penumbral L and M cone stimulation and is not produced by selective penumbral S cone stimulation. The Purkinje-tree percept was strongest at 16 Hz and fell off at lower (8 Hz) and higher (32 Hz) temporal frequencies. Selective stimulation of open-field cones that are not in shadow, with penumbral cones silenced, also produced the percept, but it was not seen when penumbral and open-field cones were modulated together. This indicates the need for spatial contrast between penumbral and open-field cones to create the Purkinje-tree percept. Our observation provides a new means for studying the response of retinally stabilized images and demonstrates that penumbral cones can support spatial vision. Further, the result illustrates a way in which silent substitution techniques can fail to be silent. We show that inadvertent penumbral cone stimulation can accompany melanopsin-directed modulations that are designed only to silence open-field cones. This in turn can result in visual responses that might be mistaken as melanopsin-driven.

A five-primary photostimulator suitable for studying intrinsically photosensitive retinal ganglion cell functions in humans

Intrinsically photosensitive retinal ganglion cells (ipRGCs) can respond to light directly through self-contained photopigment, melanopsin. IpRGCs also receive synaptic inputs from rods and cones. Thus, studying ipRGC functions requires a novel photostimulating method that can account for all of the photoreceptor inputs. Here, we introduced an inexpensive LED-based five-primary photostimulator that can control the excitations of rods, S-, M-, L-cones, and melanopsin-containing ipRGCs in humans at constant background photoreceptor excitation levels, a critical requirement for studying the adaptation behavior of ipRGCs with rod, cone, or melanopsin input. We described the theory and technical aspects (including optics, electronics, software, and calibration) of the five-primary photostimulator. Then we presented two preliminary studies using the photostimulator we have implemented to measure melanopsin-mediated pupil responses and temporal contrast sensitivity function (TCSF). The results showed that the S-cone input to pupil responses was antagonistic to the L-, M- or melanopsin inputs, consistent with an S-OFF and (L + M)-ON response property of primate ipRGCs (Dacey et al., 2005). In addition, the melanopsin-mediated TCSF had a distinctive pattern compared with L + M or S-cone mediated TCSF. Other than controlling individual photoreceptor excitation independently, the five-primary photostimulator has the flexibility in presenting stimuli modulating any combination of photoreceptor excitations, which allows researchers to study the mechanisms by which ipRGCs combine various photoreceptor inputs.

Melanopsin-expressing intrinsically photosensitive retinal ganglion cells in retinal disease

Melanopsin-containing intrinsically photosensitive retinal ganglion cells (ipRGCs) are a class of photoreceptors with established roles in non-image-forming processes. Their contributions to image-forming vision may include the estimation of brightness. Animal models have been central for understanding the physiological mechanisms of ipRGC function and there is evidence of conservation of function across species. Intrinsically photosensitive retinal ganglion cells can be divided into five ganglion cell subtypes that show morphological and functional diversity. Research in humans has established that ipRGCs signal environmental irradiance to entrain the central body clock to the solar day for regulating circadian processes and sleep. In addition, ipRGCs mediate the pupil light reflex (PLR), making the PLR a readily accessible behavioral marker of ipRGC activity. Less is known about ipRGC function in retinal and optic nerve disease, with emerging research providing insight into their function in diabetes, retinitis pigmentosa, glaucoma, and hereditary optic neuropathy. We briefly review the anatomical distributions, projections, and basic physiological mechanisms of ipRGCs and their proposed and known functions in animals and humans with and without eye disease. We introduce a paradigm for differentiating inner and outer retinal inputs to the pupillary control pathway in retinal disease and apply this paradigm to patients with age-related macular degeneration (AMD). In these cases of patients with AMD, we provide the initial evidence that ipRGC function is altered and that the dysfunction is more pronounced in advanced disease. Our perspective is that with refined pupillometry paradigms, the PLR can be extended to AMD assessment as a tool for the measurement of inner and outer retinal dysfunction.

Contributions of rhodopsin, cone opsins, and melanopsin to postreceptoral pathways inferred from natural image statistics

Visual neural representation is constrained by the statistical properties of the environment. Prior analysis of cone pigment excitations for natural images revealed three principal components corresponding to the major retinogeniculate pathways identified by anatomical and physiological studies in primates. Here, principal component analyses were conducted on the excitations of rhodopsin, cone opsins, and melanopsin for nine hyperspectral images under 21 natural illuminants. The results suggested that rhodopsin and melanopsin may contribute to the three major retinogeniculate pathways. Rhodopsin and melanopsin may provide additional constraints in natural scene statistics, leading to new components that cannot be revealed by analysis based on cone opsin excitations only.

The Verriest Lecture: Visual properties of metameric blacks beyond cone vision

The generic framework of metamerism implies that the number of sensors is smaller than the dimension of the stimulus. The metameric black paradigm was introduced by Wyszecki [Farbe2, 39 (1953)] and developed by Cohen and Kappauf [Am. J. Psychol.95, 537 (1982)]. Within a multireceptor and multiprimary scheme, we investigate how far the choice of illumination can isolate a photoreceptor response. The spectral profiles of the fundamental metamers that correspond to a collection of (x,y) values over the chromaticity diagram are shown. When the luminance is set at a fixed value, the relative excitation of the melanopsin cells and of the rods elicited by the fundamental metamers varies over the chromaticity diagram. The range of excitation of the melanopsin cells and of the rods that could be achieved at a given chromaticity, by manipulating the metameric black content, is examined. When only the melanopsin excitation is manipulated, the range of melanopsin excitation that can be achieved is rather limited. On the chromaticity diagram, the largest range of variation of the rods and the melanopsin cells excitation is obtained for (x,y) chromaticity coordinates near (1/3,1/3). Extension of Cohen's procedure to rod and cone metamers is proposed. The higher the number of spectral bands, the wider the choice of metameric lights.

The nocturnal bottleneck and the evolution of activity patterns in mammals

In 1942, Walls described the concept of a 'nocturnal bottleneck' in placental mammals, where these species could survive only by avoiding daytime activity during times in which dinosaurs were the dominant taxon. Walls based this concept of a longer episode of nocturnality in early eutherian mammals by comparing the visual systems of reptiles, birds and all three extant taxa of the mammalian lineage, namely the monotremes, marsupials (now included in the metatherians) and placentals (included in the eutherians). This review describes the status of what has become known as the nocturnal bottleneck hypothesis, giving an overview of the chronobiological patterns of activity. We review the ecological plausibility that the activity patterns of (early) eutherian mammals were restricted to the night, based on arguments relating to endothermia, energy balance, foraging and predation, taking into account recent palaeontological information. We also assess genes, relating to light detection (visual and non-visual systems) and the photolyase DNA protection system that were lost in the eutherian mammalian lineage. Our conclusion presently is that arguments in favour of the nocturnal bottleneck hypothesis in eutherians prevail.

Adaptation to steady light by intrinsically photosensitive retinal ganglion cells

Intrinsically photosensitive retinal ganglion cells (ipRGCs) are recently discovered photoreceptors in the mammalian eye. These photoreceptors mediate primarily nonimage visual functions, such as pupillary light reflex and circadian photoentrainment, which are generally expected to respond to the absolute light intensity. The classical rod and cone photoreceptors, on the other hand, mediate image vision by signaling contrast, accomplished by adaptation to light. Experiments by others have indicated that the ipRGCs do, in fact, light-adapt. We found the same but, in addition, have now quantified this light adaptation for the M1 ipRGC subtype. Interestingly, in incremental-flash-on-background experiments, the ipRGC's receptor current showed a flash sensitivity that adapted in background light according to the Weber-Fechner relation, well known to describe the adaptation behavior of rods and cones. Part of this light adaptation by ipRGCs appeared to be triggered by a Ca(2+) influx, in that the flash response elicited in the absence of extracellular Ca(2+) showed a normal rising phase but a slower decay phase, resulting in longer time to peak and higher sensitivity. There is, additionally, a prominent Ca(2+)-independent component of light adaptation not typically seen in rods and cones or in invertebrate rhabdomeric photoreceptors.