Color appearance and the end of Hering's Opponent-Colors Theory

Visual image reconstructed without semantics from human brain activity using linear image decoders and nonlinear noise suppression

In recent years, substantial strides have been made in the field of visual image reconstruction, particularly in its capacity to generate high-quality visual representations from human brain activity while considering semantic information. This advancement not only enables the recreation of visual content but also provides valuable insights into the intricate processes occurring within high-order functional brain regions, contributing to a deeper understanding of brain function. However, considering fusion semantics in reconstructing visual images from brain activity involves semantic-to-image guide reconstruction and may ignore underlying neural computational mechanisms, which does not represent true reconstruction from brain activity. In response to this limitation, our study introduces a novel approach that combines linear mapping with nonlinear noise suppression to reconstruct visual images perceived by subjects based on their brain activity patterns. The primary challenge associated with linear mapping lies in its susceptibility to noise interference. To address this issue, we leverage a flexible denoised deep convolutional neural network, which can suppress noise from linear mapping. Our investigation encompasses linear mapping as well as the training of shallow and deep autoencoder denoised neural networks, including a pre-trained, state-of-the-art denoised neural network. The outcome of our study reveals that combining linear image decoding with nonlinear noise reduction significantly enhances the quality of reconstructed images from human brain activity. This suggests that our methodology holds promise for decoding intricate perceptual experiences directly from brain activity patterns without semantic information. Moreover, the model has strong neural explanatory power because it shares structural and functional similarities with the visual brain.

Warm versus cool colors and their relation to color perception

The distinction between warm and cool colors is widely considered a fundamental aspect of human color experience, but whether it reflects properties of color perception or color associations remains unclear. We examined how the warm-cool division is related to perceptual landmarks of color coding and color appearance. Observers made warm-cool ratings for 36 hue angles at three luminance levels and also estimated the angles for their unique (e.g., yellow or red) and binary (e.g., orange) hues. The warm-cool dimension was reliably identified by most observers, was consistent across lightness levels, and varied along an orangish-red to greenish-blue dimension that is intermediate to both the principal chromatic dimensions of early cone-opponent (cardinal) or perceptual-opponent (red-green and blue-yellow) axes. When the stimuli were projected into a uniform color space (CIELAB), a close correspondence was found between the warm-cool dimension and the perceived strength (saturation) of different hues, based on the LAB chroma. Specifically, the peak warm and cool values were hue angles with the weakest saturation, and the boundaries between the two categories corresponded to hue angles with the highest saturation. This pattern could arise if vision is selectively adapted to the spectra of warm and cool colors and provides a potential basis for the strong but unexplained asymmetries in color coding built into perceptually uniform color spaces.

Do we feel colours? A systematic review of 128 years of psychological research linking colours and emotions

Colour is an integral part of natural and constructed environments. For many, it also has an aesthetic appeal, with some colours being more pleasant than others. Moreover, humans seem to systematically and reliably associate colours with emotions, such as yellow with joy, black with sadness, light colours with positive and dark colours with negative emotions. To systematise such colour-emotion correspondences, we identified 132 relevant peer-reviewed articles published in English between 1895 and 2022. These articles covered a total of 42,266 participants from 64 different countries. We found that all basic colour categories had systematic correspondences with affective dimensions (valence, arousal, power) as well as with discrete affective terms (e.g., love, happy, sad, bored). Most correspondences were many-to-many, with systematic effects driven by lightness, saturation, and hue ('colour temperature'). More specifically, (i) LIGHT and DARK colours were associated with positive and negative emotions, respectively; (ii) RED with empowering, high arousal positive and negative emotions; (iii) YELLOW and ORANGE with positive, high arousal emotions; (iv) BLUE, GREEN, GREEN-BLUE, and WHITE with positive, low arousal emotions; (v) PINK with positive emotions; (vi) PURPLE with empowering emotions; (vii) GREY with negative, low arousal emotions; and (viii) BLACK with negative, high arousal emotions. Shared communication needs might explain these consistencies across studies, making colour an excellent medium for communication of emotion. As most colour-emotion correspondences were tested on an abstract level (i.e., associations), it remains to be seen whether such correspondences translate to the impact of colour on experienced emotions and specific contexts.

The origin of color categories

To what extent does concept formation require language? Here, we exploit color to address this question and ask whether macaque monkeys have color concepts evident as categories. Macaques have similar cone photoreceptors and central visual circuits to humans, yet they lack language. Whether Old World monkeys such as macaques have consensus color categories is unresolved, but if they do, then language cannot be required. If macaques do not have color categories, then color categories in humans are unlikely to derive from innate properties of visual encoding and likely to depend on cognitive abilities such as language that differ between monkeys and humans. We tested macaques by adapting a match-to-sample paradigm used in humans to uncover color categories from errors in matches, and we analyzed the data using computational simulations that assess the possibility of unrecognized distortions in the perceptual uniformity of color space. The results provide evidence that humans have consensus cognitive color categories and macaques do not. One animal showed evidence for a private color category, demonstrating that monkeys have the capacity to form color categories even if they do not form consensus color categories. Taken together, the results imply that consensus color categories in humans, for which there is ample evidence, must depend upon language or other cognitive abilities.

The concept of cone opponency may extend beyond accommodation, to myopiagenesis and emmetropization, for a better peripheral defocus lens

Myopia has ever-rising prevalence in the past few decades globally. Its pathogenesis is still not adequately elucidated especially at the signal transduction level. For the environmental risk factors, there is a large body of fragmented knowledge about the visual inputs for accommodation, myopiagenesis and emmetropization, with the latter two being essentially local processes. The red-green and yellow-blue chromatic pathways, together with the underlying L-M and S-(L+M) cone opponency, seem to be the common denominator amongst them. In this review, experimental and observational evidence are summarized to delineate the interplay of them. This review may establish the pivotal role of longitudinal chromatic aberration (LCA) for a mechanistic approach to future research in myopia control. This review looks into the mechanistic processes underlying myopiagenesis and emmetropization, specifically focusing on chromatic aberration and cone opponency in vision as pivotal components. The roles of longitudinal chromatic aberration (LCA) and cone contrast in myopia onset and development are intriguing. How visual input and chromatic pathways (specifically, red-green and blue-yellow cone opponency) contribute to accommodation that may trigger emmetropization mechanisms, thereby influencing eye growth patterns are explored and discussed. In brief, this manuscript delves into the physiology of visual processing and highlights a foundational aspect of visual science that may account for a "Go" or "Stop" signaling in axial eye growth. It further proposes a metric to gauge myopia-inhibiting optical devices such as the peripheral defocus lenses, for its best iteration. Future research in the above-mentioned areas is warranted.

Temporal and spatial analysis of event-related potentials in response to color saliency differences among various color vision types

Introduction

Human color vision exhibits significant diversity that cannot be fully explained by categorical classifications. Understanding how individuals with different color vision phenotypes perceive, recognize, and react to the same physical stimuli provides valuable insights into sensory characteristics. This study aimed to identify behavioral and neural differences between different color visions, primarily classified as typical trichromats and anomalous trichromats, in response to two chromatic stimuli, blue-green and red, during an attention-demanding oddball task.

Methods

We analyzed the P3 component of event-related potentials (ERPs), associated with attention, and conducted a broad spatiotemporal exploration of neural differences. Behavioral responses were also analyzed to complement neural data. Participants included typical trichromats (n = 13) and anomalous trichromats (n = 5), and the chromatic stimuli were presented in an oddball paradigm.

Results

Typical trichromats exhibited faster potentiation from the occipital to parietal regions in response to the more salient red stimulus, particularly in the area overlapping with the P3 component. In contrast, anomalous trichromats revealed faster potentiation to the expected more salient blue-green stimulus in the occipital to parietal regions, with no other significant neural differences between stimuli. Comparisons between the color vision types showed no significant overall neural differences.

Discussion

The large variability in red-green sensitivity among anomalous trichromats, along with neural variability not fully explained by this sensitivity, likely contributed to the absence of clear neural distinctions based on color saliency. While reaction times were influenced by red-green sensitivity, neural signals showed ambiguity regarding saliency differences. These findings suggest that factors beyond red-green sensitivity influenced neural activity related to color perception and cognition in minority color vision phenotypes. Further research with larger sample sizes is needed to more comprehensively explore these neural dynamics and their broader implications.

A circuit motif for color in the human foveal retina

The neural pathways that start human color vision begin in the complex synaptic network of the foveal retina where signals originating in long (L), middle (M), and short (S) wavelength-sensitive cone photoreceptor types are compared through antagonistic interactions, referred to as opponency. In nonhuman primates, two cone opponent pathways are well established: an L vs. M cone circuit linked to the midget ganglion cell type, often called the red-green pathway, and an S vs. L + M cone circuit linked to the small bistratified ganglion cell type, often called the blue-yellow pathway. These pathways have been taken to correspond in human vision to cardinal directions in a trichromatic color space, providing the parallel inputs to higher-level color processing. Yet linking cone opponency in the nonhuman primate retina to color mechanisms in human vision has proven particularly difficult. Here, we apply connectomic reconstruction to the human foveal retina to trace parallel excitatory synaptic outputs from the S-ON (or "blue-cone") bipolar cell to the small bistratified cell and two additional ganglion cell types: a large bistratified ganglion cell and a subpopulation of ON-midget ganglion cells, whose synaptic connections suggest a significant and unique role in color vision. These two ganglion cell types are postsynaptic to both S-ON and L vs. M opponent midget bipolar cells and thus define excitatory pathways in the foveal retina that merge the cardinal red-green and blue-yellow circuits, with the potential for trichromatic cone opponency at the first stage of human vision.

Low luminance contrast's effect on the color appearance of S-cone patterns

There is a surprisingly strong effect on color appearance when low levels of luminance contrast are added to visual targets in which only S-cones are modulated. This phenomenon can be studied with checkerboard patterns composed of alternating S-cone-modulated checks and gray checks. + S checks look purple when surrounded by slightly brighter gray checks but look highly desaturated (lavender, almost white) when surrounded by darker gray checks. -S checks change in hue with luminance contrast; they look yellow when surrounded by darker gray checks but are greener when surrounded by lighter checks. Psychophysical paired comparisons confirm these perceptions. Furthermore, visual evoked potentials (VEPs) recorded from human posterior cortex indicate that signals evoked by low luminance contrast interact nonlinearly with S-cone-evoked signals in early cortical color processing. Our new psychophysics and electrophysiology results prove that human perception of color appearance is not based on neural computations within a separate, isolated color system. Rather, signals evoked by color contrast and luminance contrast interact to produce the colors we see.

Chromatic visual evoked potentials: A review of physiology, methods and clinical applications

Objective assessment of the visual system can be performed electrophysiologically using the visual evoked potential (VEP). In many clinical circumstances, this is performed using high contrast achromatic patterns or diffuse flash stimuli. These methods are clinically valuable but they may only assess a subset of possible physiological circuitries within the visual system, particularly those involved in achromatic (luminance) processing. The use of chromatic VEPs (cVEPs) in addition to standard VEPs can inform us of the function or dysfunction of chromatic pathways. The chromatic VEP has been well studied in human health and disease. Yet, to date our knowledge of their underlying mechanisms and applications remains limited. This likely reflects a heterogeneity in the methodology, analysis and conclusions of different works, which leads to ambiguity in their clinical use. This review sought to identify the primary methodologies employed for recording cVEPs. Furthermore cVEP maturation and application in understanding the function of the chromatic system under healthy and diseased conditions are reviewed. We first briefly describe the physiology of normal colour vision, before describing the methodologies and historical developments which have led to our understanding of cVEPs. We thereafter describe the expected maturation of the cVEP, followed by reviewing their application in several disorders: congenital colour vision deficiencies, retinal disease, glaucoma, optic nerve and neurological disorders, diabetes, amblyopia and dyslexia. We finalise the review with recommendations for testing and future directions.

Unique yellow shifts for small and brief stimuli in the central retina

The spectral locus of unique yellow was determined for flashes of different sizes (<11 arcmin) and durations (<500 ms) presented in and near the fovea. An adaptive optics scanning laser ophthalmoscope was used to minimize the effects of higher-order aberrations during simultaneous stimulus delivery and retinal imaging. In certain subjects, parafoveal cones were classified as L, M, or S, which permitted the comparison of unique yellow measurements with variations in local L/M ratios within and between observers. Unique yellow shifted to longer wavelengths as stimulus size or duration was reduced. This effect is most pronounced for changes in size and more apparent in the fovea than in the parafovea. The observed variations in unique yellow are not entirely predicted from variations in L/M ratio and therefore implicate neural processes beyond photoreception.

Cone-Opponent Ganglion Cells in the Primate Fovea Tuned to Noncardinal Color Directions

A long-standing question in vision science is how the three cone photoreceptor types-long (L), medium (M), and short (S) wavelength sensitive-combine to generate our perception of color. Hue perception can be described along two opponent axes: red-green and blue-yellow. Psychophysical measurements of color appearance indicate that the cone inputs to the red-green and blue-yellow opponent axes are M vs. L + S and L vs. M + S, respectively. However, the "cardinal directions of color space" revealed by psychophysical measurements of color detection thresholds following adaptation are L vs. M and S vs. L + M. These cardinal directions match the most common cone-opponent retinal ganglion cells (RGCs) in the primate retina. Accordingly, the cone opponency necessary for color appearance is thought to be established in the cortex. While neurons with the appropriate M vs. L + S and L vs. M + S opponency have been reported in the retina and lateral geniculate nucleus, their existence continues to be debated. Resolving this long-standing debate is necessary because a complete account of the cone opponency in the retinal output is critical for understanding how downstream neural circuits process color. Here, we performed adaptive optics calcium imaging to noninvasively measure foveal RGC light responses in the living Macaca fascicularis eye. We confirm the presence of L vs. M + S and M vs. L + S neurons with noncardinal cone opponency and demonstrate that cone-opponent signals in the retinal output are more diverse than classically thought.

Are ipRGCs involved in human color vision? Hints from physiology, psychophysics, and natural image statistics

Human photoreceptors consist of cones, rods, and melanopsin-expressing intrinsically photosensitive retinal ganglion cells (ipRGCs). First studied in circadian regulation and pupillary control, ipRGCs project to a variety of brain centers suggesting a broader involvement beyond non-visual functions. IpRGC responses are stable, long-lasting, and with a particular codification of photoreceptor signals. In comparison with the transient and adaptive nature of cone and rod signals, ipRGCs' signaling might provide an ecological advantage to different attributes of color vision. Previous studies have indicated melanopsin's influence on visual responses yet its contribution to color perception in humans remains debated. We summarized evidence and hypotheses (from physiology, psychophysics, and natural image statistics) about direct and indirect involvement of ipRGCs in human color vision, by first briefly assessing the current knowledge about the role of melanopsin and ipRGCs in vision and codification of spectral signals. We then approached the question about melanopsin activation eliciting a color percept, discussing studies using the silent substitution method. Finally, we explore various avenues through which ipRGCs might impact color perception indirectly, such as through involvement in peripheral color matching, post-receptoral pathways, color constancy, long-term chromatic adaptation, and chromatic induction. While there is consensus about the role of ipRGCs in brightness perception, confirming its direct contribution to human color perception requires further investigation. We proposed potential approaches for future research, emphasizing the need for empirical validation and methodological thoroughness to elucidate the exact role of ipRGCs in human color vision.

Cone-Opponent Ganglion Cells in the Primate Fovea Tuned to Non-Cardinal Color Directions

A long-standing question in vision science is how the three cone photoreceptor types - long (L), medium (M) and short (S) wavelength sensitive - combine to generate our perception of color. Hue perception can be described along two opponent axes: red-green and blue-yellow. Psychophysical measurements of color appearance indicate that the cone inputs to the red-green and blue-yellow opponent axes are M vs. L+S and L vs. M+S, respectively. However, the "cardinal directions of color space" revealed by psychophysical measurements of color detection thresholds are L vs. M and S vs. L+M. The cardinal directions match the most common cone-opponent retinal ganglion cells (RGCs) in the primate retina. Accordingly, the cone opponency necessary for color appearance is thought to be established in cortex. However, small populations with the appropriate M vs. L+S and L vs. M+S cone-opponency have been reported in large surveys of cone inputs to primate RGCs and their projections to the lateral geniculate nucleus (LGN) yet their existence continues to be debated. Resolving this long-standing open question is needed as a complete account of the cone-opponency in the retinal output is critical for efforts to understand how downstream neural circuits process color. Here, we performed adaptive optics calcium imaging to longitudinally and noninvasively measurements of the foveal RGC light responses in the living macaque eye. We confirm the presence of L vs. M+S and M vs. L+S neurons with non-cardinal cone-opponency and demonstrate that cone-opponent signals in the retinal output are substantially more diverse than classically thought.