Calibrating Vision: Concepts and Questions

The idea that visual coding and perception are shaped by experience and adjust to changes in the environment or the observer is universally recognized as a cornerstone of visual processing, yet the functions and processes mediating these calibrations remain in many ways poorly understood. In this article we review a number of facets and issues surrounding the general notion of calibration, with a focus on plasticity within the encoding and representational stages of visual processing. These include how many types of calibrations there are - and how we decide; how plasticity for encoding is intertwined with other principles of sensory coding; how it is instantiated at the level of the dynamic networks mediating vision; how it varies with development or between individuals; and the factors that may limit the form or degree of the adjustments. Our goal is to give a small glimpse of an enormous and fundamental dimension of vision, and to point to some of the unresolved questions in our understanding of how and why ongoing calibrations are a pervasive and essential element of vision.

Do You See What I See? Diversity in Human Color Perception

In our tendency to discuss the objective properties of the external world, we may fail to notice that our subjective perceptions of those properties differ between individuals. Variability at all levels of the color vision system creates diversity in color perception, from discrimination to color matching, appearance, and subjective experience, such that each of us lives in a unique perceptual world. In this review, I discuss what is known about individual differences in color perception and its determinants, particularly considering genetically mediated variability in cone photopigments and the paradoxical effects of visual environments in both contributing to and counteracting individual differences. I make the case that, as well as being of interest in their own right and crucial for a complete account of color vision, individual differences can be used as a methodological tool in color science for the insights that they offer about the underlying mechanisms of perception. Expected final online publication date for the Annual Review of Vision Science, Volume 8 is September 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

The Retinal Basis of Vertebrate Color Vision

The jawless fish that were ancestral to all living vertebrates had four spectral cone types that were probably served by chromatic-opponent retinal circuits. Subsequent evolution of photoreceptor spectral sensitivities is documented for many vertebrate lineages, giving insight into the ecological adaptation of color vision. Beyond the photoreceptors, retinal color processing is best understood in mammals, especially the blueON system, which opposes short- against long-wavelength receptor responses. For other vertebrates that often have three or four types of cone pigment, new findings from zebrafish are extending older work on teleost fish and reptiles to reveal rich color circuitry. Here, horizontal cells establish diverse and complex spectral responses even in photoreceptor outputs. Cone-selective connections to bipolar cells then set up color-opponent synaptic layers in the inner retina, which lead to a large variety of color-opponent channels for transmission to the brain via retinal ganglion cells.

Diverse Cell Types, Circuits, and Mechanisms for Color Vision in the Vertebrate Retina

Synaptic interactions to extract information about wavelength, and thus color, begin in the vertebrate retina with three classes of light-sensitive cells: rod photoreceptors at low light levels, multiple types of cone photoreceptors that vary in spectral sensitivity, and intrinsically photosensitive ganglion cells that contain the photopigment melanopsin. When isolated from its neighbors, a photoreceptor confounds photon flux with wavelength and so by itself provides no information about color. The retina has evolved elaborate color opponent circuitry for extracting wavelength information by comparing the activities of different photoreceptor types broadly tuned to different parts of the visible spectrum. We review studies concerning the circuit mechanisms mediating opponent interactions in a range of species, from tetrachromatic fish with diverse color opponent cell types to common dichromatic mammals where cone opponency is restricted to a subset of specialized circuits. Distinct among mammals, primates have reinvented trichromatic color vision using novel strategies to incorporate evolution of an additional photopigment gene into the foveal structure and circuitry that supports high-resolution vision. Color vision is absent at scotopic light levels when only rods are active, but rods interact with cone signals to influence color perception at mesopic light levels. Recent evidence suggests melanopsin-mediated signals, which have been identified as a substrate for setting circadian rhythms, may also influence color perception. We consider circuits that may mediate these interactions. While cone opponency is a relatively simple neural computation, it has been implemented in vertebrates by diverse neural mechanisms that are not yet fully understood.

Color and the Cone Mosaic

Vision is limited by the measurements taken by the cone photoreceptors. To provide useful perceptual representations, the brain must go beyond the measurements and make inferences about the scene being viewed. This article considers the first stages of spatiochromatic vision. We show how spatial and chromatic information become intertwined by the optics of the eye and because of the structure of the retinal cone mosaic, and we consider the consequent implications for perception. Because there is at most one cone at each retinal location, the standard treatment of human trichromacy does not apply at fine spatial scales. Rather, trichromacy results from a perceptual inference based on measurements from cones of different classes at different locations. Our treatment emphasizes linking physics, biology, and computation with the goal of providing a framework for a larger understanding of how the brain interprets photoreceptor excitations to see objects and their properties.

Curing color blindness--mice and nonhuman primates

It has been possible to use viral-mediated gene therapy to transform dichromatic (red-green color-blind) primates to trichromatic. Even though the third cone type was added after the end of developmental critical periods, treated animals acquired red-green color vision. What happened in the treated animals may represent a recapitulation of the evolution of trichromacy, which seems to have evolved with the acquisition of a third cone type without the need for subsequent modification to the circuitry. Some transgenic mice in which a third cone type was added also acquired trichromacy. However, compared with treated primates, red-green color vision in mice is poor, indicating large differences between mice and monkeys in their ability to take advantage of the new input. These results have implications for understanding the limits and opportunities for using gene therapy to treat vision disorders caused by defects in cone function.

Unsupervised learning of cone spectral classes from natural images

The first step in the evolution of primate trichromatic color vision was the expression of a third cone class not present in ancestral mammals. This observation motivates a fundamental question about the evolution of any sensory system: how is it possible to detect and exploit the presence of a novel sensory class? We explore this question in the context of primate color vision. We present an unsupervised learning algorithm capable of both detecting the number of spectral cone classes in a retinal mosaic and learning the class of each cone using the inter-cone correlations obtained in response to natural image input. The algorithm's ability to classify cones is in broad agreement with experimental evidence about functional color vision for a wide range of mosaic parameters, including those characterizing dichromacy, typical trichromacy, anomalous trichromacy, and possible tetrachromacy.

The genetics of normal and defective color vision

The contributions of genetics research to the science of normal and defective color vision over the previous few decades are reviewed emphasizing the developments in the 25years since the last anniversary issue of Vision Research. Understanding of the biology underlying color vision has been vaulted forward through the application of the tools of molecular genetics. For all their complexity, the biological processes responsible for color vision are more accessible than for many other neural systems. This is partly because of the wealth of genetic variations that affect color perception, both within and across species, and because components of the color vision system lend themselves to genetic manipulation. Mutations and rearrangements in the genes encoding the long, middle, and short wavelength sensitive cone pigments are responsible for color vision deficiencies and mutations have been identified that affect the number of cone types, the absorption spectra of the pigments, the functionality and viability of the cones, and the topography of the cone mosaic. The addition of an opsin gene, as occurred in the evolution of primate color vision, and has been done in experimental animals can produce expanded color vision capacities and this has provided insight into the underlying neural circuitry.

Gene therapy for red-green colour blindness in adult primates

Red-green colour blindness, which results from the absence of either the long- (L) or middle- (M) wavelength-sensitive visual photopigments, is the most common single locus genetic disorder. Here, the possibility of curing colour blindness using gene therapy was explored in experiments on adult monkeys that had been colour blind since birth. A third type of cone pigment was added to dichromatic retinas, providing the receptoral basis for trichromatic colour vision. This opened a new avenue to explore the requirements for establishing the neural circuits for a new dimension of colour sensation. Classic visual deprivation experiments1 have led to the expectation that neural connections established during development would not appropriately process an input that was not present from birth. Therefore, it was believed that treatment of congenital vision disorders would be ineffective unless administered to the very young. Here, however, addition of a third opsin in adult red-green colour-deficient primates was sufficient to produce trichromatic colour vision behaviour. Thus, trichromacy can arise from a single addition of a third cone class and it does not require an early developmental process. This provides a positive outlook for the potential of gene therapy to cure adult vision disorders.

Response to Comment on "Emergence of Novel Color Vision in Mice Engineered to Express a Human Cone Photopigment"

Makous suggests that the novel color vision documented in knock-in mice neither requires visual system plasticity nor implies the emergence of a new dimension of sensory experience. We explain why we disagree.