Asymmetries of Dark and Bright Negative Afterimages Are Paralleled by Subcortical ON and OFF Poststimulus Responses

Encoding luminance surfaces in the visual cortex of mice and monkeys: difference in responses to edge and center

Luminance and spatial contrast provide information on the surfaces and edges of objects. We investigated neural responses to black and white surfaces in the primary visual cortex (V1) of mice and monkeys. Unlike primates that use their fovea to inspect objects with high acuity, mice lack a fovea and have low visual acuity. It thus remains unclear whether monkeys and mice share similar neural mechanisms to process surfaces. The animals were presented with white or black surfaces and the population responses were measured at high spatial and temporal resolution using voltage-sensitive dye imaging. In mice, the population response to the surface was not edge-dominated with a tendency to center-dominance, whereas in monkeys the response was edge-dominated with a "hole" in the center of the surface. The population response to the surfaces in both species exhibited suppression relative to a grating stimulus. These results reveal the differences in spatial patterns to luminance surfaces in the V1 of mice and monkeys and provide evidence for a shared suppression process relative to grating.

Stronger tilt aftereffects in individuals diagnosed with schizophrenia spectrum disorders but not bipolar disorder

An altered use of context and experience to interpret incoming information has been posited to explain schizophrenia symptoms. The visual system can serve as a model system for examining how context and experience guide perception and the neural mechanisms underlying putative alterations. The influence of prior experience on current perception is evident in visual aftereffects, the perception of the "opposite" of a previously viewed stimulus. Aftereffects are associated with neural adaptation and concomitant change in strength of lateral inhibitory connections in visually responsive neurons. In a previous study, we observed stronger aftereffects related to orientation (tilt aftereffects) but not luminance (negative afterimages) in individuals diagnosed with schizophrenia, which we interpreted as potentially suggesting altered cortical (but not subcortical) adaptability and local changes in excitatory-inhibitory interactions. Here, we tested whether stronger tilt aftereffects were specific to individuals with schizophrenia or extended to individuals with bipolar disorder. We measured tilt aftereffects and negative afterimages in 32 individuals with bipolar disorder, and compared aftereffect strength to a previously reported group of 36 individuals with schizophrenia and 22 healthy controls. We observed stronger tilt aftereffects, but not negative afterimages, in individuals with schizophrenia as compared to both controls and individuals with bipolar disorder, who did not differ from each other. These results mitigate concerns that stronger tilt aftereffects in schizophrenia are a consequence of medication or of the psychosocial consequences of a severe mental illness.

Dynamic Recruitment of the Feedforward and Recurrent Mechanism for Black-White Asymmetry in the Primary Visual Cortex

Black and white information is asymmetrically distributed in natural scenes, evokes asymmetric neuronal responses, and causes asymmetric perceptions. Recognizing the universality and essentiality of black-white asymmetry in visual information processing, the neural substrates for black-white asymmetry remain unclear. To disentangle the role of the feedforward and recurrent mechanisms in the generation of cortical black-white asymmetry, we recorded the V1 laminar responses and LGN responses of anesthetized cats of both sexes. In a cortical column, we found that black-white asymmetry starts at the input layer and becomes more pronounced in the output layer. We also found distinct dynamics of black-white asymmetry between the output layer and the input layer. Specifically, black responses dominate in all layers after stimulus onset. After stimulus offset, black and white responses are balanced in the input layer, but black responses still dominate in the output layer. Compared with that in the input layer, the rebound response in the output layer is significantly suppressed. The relative suppression strength evoked by white stimuli is notably stronger and depends on the location within the ON-OFF cortical map. A model with delayed and polarity-selective cortical suppression explains black-white asymmetry in the output layer, within which prominent recurrent connections are identified by Granger causality analysis. In addition to black-white asymmetry in response strength, the interlaminar differences in spatial receptive field varied dynamically. Our findings suggest that the feedforward and recurrent mechanisms are dynamically recruited for the generation of black-white asymmetry in V1.SIGNIFICANCE STATEMENT Black-white asymmetry is universal and essential in visual information processing, yet the neural substrates for cortical black-white asymmetry remain unknown. Leveraging V1 laminar recordings, we provided the first laminar pattern of black-white asymmetry in cat V1 and found distinct dynamics of black-white asymmetry between the output layer and the input layer. Comparing black-white asymmetry across three visual hierarchies, the LGN, V1 input layer, and V1 output layer, we demonstrated that the feedforward and recurrent mechanisms are dynamically recruited for the generation of cortical black-white asymmetry. Our findings not only enhance our understanding of laminar processing within a cortical column but also elucidate how feedforward connections and recurrent connections interact to shape neuronal response properties.

Luminance Contrast Shifts Dominance Balance between ON and OFF Pathways in Human Vision

Human vision processes light and dark stimuli in visual scenes with separate ON and OFF neuronal pathways. In nature, stimuli lighter or darker than their local surround have different spatial properties and contrast distributions (Ratliff et al., 2010; Cooper and Norcia, 2015; Rahimi-Nasrabadi et al., 2021). Similarly, in human vision, we show that luminance contrast affects the perception of lights and darks differently. At high contrast, human subjects of both sexes locate dark stimuli faster and more accurately than light stimuli, which is consistent with a visual system dominated by the OFF pathway. However, at low contrast, they locate light stimuli faster and more accurately than dark stimuli, which is consistent with a visual system dominated by the ON pathway. Luminance contrast was strongly correlated with multiple ON/OFF dominance ratios estimated from light/dark ratios of performance errors, missed targets, or reaction times (RTs). All correlations could be demonstrated at multiple eccentricities of the central visual field with an ON-OFF perimetry test implemented in a head-mounted visual display. We conclude that high-contrast stimuli are processed faster and more accurately by OFF pathways than ON pathways. However, the OFF dominance shifts toward ON dominance when stimulus contrast decreases, as expected from the higher-contrast sensitivity of ON cortical pathways (Kremkow et al., 2014; Rahimi-Nasrabadi et al., 2021). The results highlight the importance of contrast polarity in visual field measurements and predict a loss of low-contrast vision in humans with ON pathway deficits, as demonstrated in animal models (Sarnaik et al., 2014).SIGNIFICANCE STATEMENT ON and OFF retino-thalamo-cortical pathways respond differently to luminance contrast. In both animal models and humans, low contrasts drive stronger responses from ON pathways, whereas high contrasts drive stronger responses from OFF pathways. We demonstrate that these ON-OFF pathway differences have a correlate in human vision. At low contrast, humans locate light targets faster and more accurately than dark targets but, as contrast increases, dark targets become more visible than light targets. We also demonstrate that contrast is strongly correlated with multiple light/dark ratios of visual performance in central vision. These results provide a link between neuronal physiology and human vision while emphasizing the importance of stimulus polarity in measurements of visual fields and contrast sensitivity.

Cortical mechanisms of visual brightness

The primary visual cortex signals the onset of light and dark stimuli with ON and OFF cortical pathways. Here, we demonstrate that both pathways generate similar response increments to large homogeneous surfaces and their response average increases with surface brightness. We show that, in cat visual cortex, response dominance from ON or OFF pathways is bimodally distributed when stimuli are smaller than one receptive field center but unimodally distributed when they are larger. Moreover, whereas small bright stimuli drive opposite responses from ON and OFF pathways (increased versus suppressed activity), large bright surfaces drive similar response increments. We show that this size-brightness relation emerges because strong illumination increases the size of light surfaces in nature and both ON and OFF cortical neurons receive input from ON thalamic pathways. We conclude that visual scenes are perceived as brighter when the average response increments from ON and OFF cortical pathways become stronger.

Mazade et al. find that the visual cortex encodes brightness differently for small than large stimuli. Bright small stimuli drive cortical pathways signaling lights and suppress cortical pathways signaling darks. Conversely, large surfaces drive response increments from both pathways and appear brightest when the response average is strongest.

Coding strategy for surface luminance switches in the primary visual cortex of the awake monkey

Both surface luminance and edge contrast of an object are essential features for object identification. However, cortical processing of surface luminance remains unclear. In this study, we aim to understand how the primary visual cortex (V1) processes surface luminance information across its different layers. We report that edge-driven responses are stronger than surface-driven responses in V1 input layers, but luminance information is coded more accurately by surface responses. In V1 output layers, the advantage of edge over surface responses increased eight times and luminance information was coded more accurately at edges. Further analysis of neural dynamics shows that such substantial changes for neural responses and luminance coding are mainly due to non-local cortical inhibition in V1’s output layers. Our results suggest that non-local cortical inhibition modulates the responses elicited by the surfaces and edges of objects, and that switching the coding strategy in V1 promotes efficient coding for luminance.

How brightness is encoded in the visual cortex remains incompletely understood. By recording from macaque V1, the authors revealed a switch from surface to edge encoding that is mediated by widespread inhibition in the output layers of the cortex.

From Receptive to Perceptive Fields: Size-Dependent Asymmetries in Both Negative Afterimages and Subcortical On and Off Post-Stimulus Responses

Negative afterimages are perceptual phenomena that occur after physical stimuli disappear from sight. Their origin is linked to transient post-stimulus responses of visual neurons. The receptive fields (RFs) of these subcortical ON- and OFF-center neurons exhibit antagonistic interactions between central and surrounding visual space, resulting in selectivity for stimulus polarity and size. These two features are closely intertwined, yet their relationship to negative afterimage perception remains unknown. Here we tested whether size differentially affects the perception of bright and dark negative afterimages in humans of both sexes, and how this correlates with neural mechanisms in subcortical ON and OFF cells. Psychophysically, we found a size-dependent asymmetry whereby dark disks produce stronger and longer-lasting negative afterimages than bright disks of equal contrast at sizes >0.8°. Neurophysiological recordings from retinal and relay cells in female cat dorsal lateral geniculate nucleus showed that subcortical ON cells exhibited stronger sustained post-stimulus responses to dark disks, than OFF cells to bright disks, at sizes >1°. These sizes agree with the emergence of center-surround antagonism, revealing stronger suppression to opposite-polarity stimuli for OFF versus ON cells, particularly in dorsal lateral geniculate nucleus. Using a network-based retino-geniculate model, we confirmed stronger antagonism and temporal transience for OFF-cell post-stimulus rebound responses. A V1 population model demonstrated that both strength and duration asymmetries can be propagated to downstream cortical areas. Our results demonstrate how size-dependent antagonism impacts both the neuronal post-stimulus response and the resulting afterimage percepts, thereby supporting the idea of perceptual RFs reflecting the underlying neuronal RF organization of single cells.SIGNIFICANCE STATEMENT Visual illusions occur when sensory inputs and perceptual outcomes do not match, and provide a valuable tool to understand transformations from neural to perceptual responses. A classic example are negative afterimages that remain visible after a stimulus is removed from view. Such perceptions are linked to responses in early visual neurons, yet the details remain poorly understood. Combining human psychophysics, neurophysiological recordings in cats and retino-thalamo-cortical computational modeling, our study reveals how stimulus size and the receptive-field structure of subcortical ON and OFF cells contributes to the parallel asymmetries between neural and perceptual responses to bright versus dark afterimages. Thus, this work provides a deeper link from the underlying neural mechanisms to the resultant perceptual outcomes.

Stronger tilt aftereffects in persons with schizophrenia

Individuals with schizophrenia may fail to appropriately use temporal context and apply past environmental regularities to the interpretation of incoming sensory information. Here we use the visual system as a test bed for investigating how prior experience shapes perception in individuals with schizophrenia. Specifically, we use visual aftereffects, illusory percepts resulting from prior exposure to visual input, to measure the influence of prior events on current processing. At a neural level, visual aftereffects arise due to attenuation in the responses of neurons that code the features of the prior stimulus (neuronal adaptation) and subsequent disinhibition of neurons signaling activity at the opposite end of the feature dimension. In the current study, we measured tilt aftereffects and negative afterimages, 2 types of aftereffects that reflect, respectively, adaptation of cortical orientation-coding neurons and adaptation of subcortical and retinal luminance-coding cells in persons with schizophrenia (PSZ; n = 36) and demographically matched healthy controls (HC; n = 22). We observed stronger tilt aftereffects in PSZ compared to HC, but no difference in negative afterimages. Stronger tilt aftereffects were related to more severe negative symptoms. These data suggest oversensitivity to recent regularities, in the form of stronger visual adaptation, at cortical, but not subcortical, levels in schizophrenia. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Dynamics of Contrast Decrement and Increment Responses in Human Visual Cortex

Purpose

The goal of the present experiments was to determine whether electrophysiologic response properties of the ON and OFF visual pathways observed in animal experimental models can be observed in humans.

Methods

Steady-state visual evoked potentials (SSVEPs) were recorded in response to equivalent magnitude contrast increments and decrements presented within a probe-on-pedestal Westheimer sensitization paradigm. The probes were modulated with sawtooth temporal waveforms at a temporal frequency of 3 or 2.73 Hz. SSVEP response waveforms and response spectra for incremental and decremental stimuli were analyzed as a function of stimulus size and visual field location in 67 healthy adult participants.

Results

SSVEPs recorded at the scalp differ between contrast decrements and increments of equal Weber contrast: SSVEP responses were larger in amplitude and shorter in latency for contrast decrements than for contrast increments. Both increment and decrement responses were larger for displays that were scaled for cortical magnification.

Conclusions

In a fashion that parallels results from the early visual system of cats and monkeys, two key properties of ON versus OFF pathways found in single-unit recordings are recapitulated at the population level of activity that can be observed with scalp electrodes, allowing differential assessment of ON and OFF pathway activity in human.

Translational Relevance

As data from preclinical models of visual pathway dysfunction point to differential damage to subtypes of retinal ganglion cells, this approach may be useful in future work on disease detection and treatment monitoring.

Altered short-term neural plasticity related to schizotypal traits: Evidence from visual adaptation

Abnormalities in synaptic plasticity are argued to underlie the neural dysconnectivity observed in schizophrenia. One way to measure synaptic plasticity is through sensory adaptation, whereby sensory neurons exhibit reduced sensitivity after sustained stimulus exposure. Evidence for decreased adaptation in individuals with schizophrenia is currently inconclusive, possibly due to heterogeneity in clinical and medication status across samples. Here we circumvent these confounds by examining whether altered adaptation is represented sub-clinically in the general population. To test this we used three paradigms from visual perception research that provide a precise and non-invasive index of adaptation in the visual system. Two paradigms involve a class of illusory percepts termed visual aftereffects. The third relies on a visual phenomenon termed binocular rivalry, where incompatible stimuli are presented to the two eyes and observers alternate between perceiving exclusively one stimulus or a combination of the two (i.e. mixed perception). We analyzed the strength and dynamics of visual adaptation in these paradigms, in relation to schizotypy. Our results showed that increased schizotypal traits were related to reduced orientation, but not luminance, aftereffect strength (Exp. 1). Further, increased schizotypy was related to a greater proportion of mixed perception during binocular rivalry (Exp. 1 and 2). Given that visual adaption is well understood at cellular and computational levels, our data suggest that short-term plasticity in the visual system can provide important information about the disease mechanisms of schizophrenia.

A review of visual aftereffects in schizophrenia

Psychosis-a cardinal symptom of schizophrenia-has been associated with a failure to appropriately create or use stored regularities about past states of the world to guide the interpretation of incoming information, which leads to abnormal perceptions and beliefs. The visual system provides a test bed for investigating the role of prior experience and prediction, as accumulated knowledge of the world informs our current perception. More specifically, the strength of visual aftereffects, illusory percepts that arise after prolonged viewing of a visual stimulus, can serve as a valuable measure of the influence of prior experience on current visual processing. In this paper, we review findings from a largely older body of work on visual aftereffects in schizophrenia, attempt to reconcile discrepant findings, highlight the role of antipsychotic medication, consider mechanistic interpretations for behavioral effects, and propose directions for future research.

Age-related changes in ON and OFF responses to luminance increments and decrements

Impulse response functions for an incremental luminous pulse (ON flash) or a decremental luminous pulse (OFF flash) were derived for twelve young (19-24 years old) and ten old (65-84 years old) observers. Thresholds were measured for two pulses separated by stimulus-onset-asynchronies from 13.3 to 186.7 ms. The pulses had a spatial Gaussian shape and were presented as increments or decrements on a 15  cd/m² equal-energy white background, having the same chromaticity as the pulse. A spatial four-alternative forced-choice method was combined with a staircase procedure. Retinal illuminance was equated individually by heterochromatic flicker photometry and using a 2.3-mm exit pupil in a Maxwellian-view optical system to reduce the effects of age-related changes and individual variations in lens density and pupil size. Luminance ON- and OFF-impulse response functions calculated from the threshold data revealed significant age-related changes in the response amplitude of both first excitatory and first inhibitory phases. However, there were no significant changes in the time to the first peak or the second peak. These age-related changes in luminance varying ON- and OFF-impulse response functions (IRFs), reflecting putative properties of the magnocellular pathway, are discussed in relation to motion detection and the balance of ON and OFF pathways across the life span.