Segmentation decreases the magnitude of the tilt illusion

The role of lateral modulation in orientation-specific adaptation effect

Center-surround modulation in visual processing reflects a normalization process of contrast gain control in the responsive neurons. Prior adaptation to a clockwise (CW) tilted grating, for example, leads to the percept of counterclockwise tilt in a vertical grating, referred to as the tilt-aftereffect (TAE). We previously reported that the magnitude of the TAE is modulated by adding a same-orientation annular surround to an adapter, suggesting inhibitory lateral modulation. To further examine the property of this lateral modulation effect on the perception of a central target, we here used center-surround sinusoidal patterns as adapters and varied the adapter surround and center orientations independently. The target had the same spatial extent as the adapter center with no physical overlap with the adapter surround. Participants were asked to judge the target orientation as tilted either CW or counterclockwise from vertical after adaptation. Results showed that, when the surround orientation was held constant, the TAE magnitude was determined by the adapter center, peaking between 10° and 20° of tilt. More important, the adapter surround orientation modulated the adaptation effect such that the TAE magnitude first decreased and then increased as the surround orientation became increasingly more different from that of the center, suggesting that the surround modulation effect was indeed orientation specific. Our data can be accounted for by a divisive inhibition model, in which (1) the adaptation effect is represented by increasing the normalizing constant and (2) the surround modulation is captured by two multiplicative sensitivity parameters determined by the adapter surround orientation.

Moderate Alcohol Intake Changes Visual Perception by Enhancing V1 Inhibitory Surround Interactions

Moderate alcohol consumption is considered to enhance the cortical GABA-ergic inhibitory system and it also variously affects visual perception. However, little behavioral evidence indicates changes of visual perception due to V1 modulated by alcohol intoxication. In this study, we investigated this issue by using center-surround tilt illusion (TI) as a probe of V1 inhibitory interactions, by taking into account possible higher-order effects. Participants conducted TI measures under sober, moderate alcohol intoxication, and placebo states. We found alcohol significantly increased repulsive TI effect and weakened orientation discrimination performance, which is consistent with the increase of lateral inhibition between orientation sensitive V1 neurons caused by alcohol intoxication. We also observed no visible changes in the data for global orientation processing but a presence of global attentional modulation. Thus, our results provide psychophysics evidence that alcohol changed V1 processing, which affects visual perception of contextual stimuli.

Flexible contextual modulation of naturalistic texture perception in peripheral vision

Peripheral vision comprises most of our visual field, and is essential in guiding visual behavior. Its characteristic capabilities and limitations, which distinguish it from foveal vision, have been explained by the most influential theory of peripheral vision as the product of representing the visual input using summary statistics. Despite its success, this account may provide a limited understanding of peripheral vision, because it neglects processes of perceptual grouping and segmentation. To test this hypothesis, we studied how contextual modulation, namely the modulation of the perception of a stimulus by its surrounds, interacts with segmentation in human peripheral vision. We used naturalistic textures, which are directly related to summary-statistics representations. We show that segmentation cues affect contextual modulation, and that this is not captured by our implementation of the summary-statistics model. We then characterize the effects of different texture statistics on contextual modulation, providing guidance for extending the model, as well as for probing neural mechanisms of peripheral vision.

Perceptual Mechanisms of Visual Hallucinations and Illusions in Psychosis

Psychosis has been associated with neural anomalies across a number of brain regions and cortical networks. Nevertheless, the exact pathophysiology of the disorder remains unclear. Aberrant visual perceptions such as hallucinations are evident in psychosis, while the occurrence of visual distortions is elevated in individuals with genetic liability for psychosis. The overall goals of this project are to: (1) use psychophysical tasks and neuroimaging to characterize deficits in visual perception; (2) acquire a mechanistic understanding of these deficits through development and validation of a computational model; and (3) determine if said mechanisms mark genetic liability for psychosis. Visual tasks tapping both low- and high-level visual processing are being completed as individuals with psychotic disorders (IPD), first-degree biological siblings of IPDs (SibIPDs) and healthy controls (HCs) undergo 248-channel magneto-encephalography (MEG) recordings followed by 7 Tesla functional magnetic resonance imaging (MRI). By deriving cortical source signals from MEG and MRI data, we will characterize the timing, location and coordination of neural processes. We hypothesize that IPDs prone to visual hallucinations will exhibit deviant functions within early visual cortex, and that aberrant contextual influences on visual perception will involve higher-level visual cortical regions and be associated with visual hallucinations. SibIPDs who experience visual distortions-but not hallucinations-are hypothesized to exhibit deficits in higher-order visual processing reflected in abnormal inter-regional neural synchronization. We hope the results lead to the development of targeted interventions for psychotic disorders, as well as identify useful biomarkers for aberrant neural functions that give rise to psychosis.

Interaction of contexts in context-dependent orientation estimation

The processing of a visual stimulus is known to be influenced by the statistics in recent visual history and by the stimulus' visual surround. Such contextual influences lead to perceptually salient phenomena, such as the tilt aftereffect and the tilt illusion. Despite much research on the influence of an isolated context, it is not clear how multiple, possibly competing sources of contextual influence interact. Here, using psychophysical methods, we compared the combined influence of multiple contexts to the sum of the isolated context influences. The results showed large deviations from linear additivity for adjacent or overlapping contexts, and remarkably, clear additivity when the contexts were sufficiently separated. Specifically, for adjacent or overlapping contexts, the combined effect was often lower than the sum of the isolated component effects (sub-additivity), or was more influenced by one component than another (selection). For contexts that were separated in time (600 ms), the combined effect measured the exact sum of the isolated component effects (in degrees of bias). Overall, the results imply an initial compressive transformation during visual processing, followed by selection between the processed parts.

Luminance-contrast properties of texture-shape and texture-surround suppression of contour shape

Studies have revealed that textures suppress the processing of the shapes of contours they surround. One manifestation of texture-surround suppression is the reduction in the magnitude of adaptation-induced contour-shape aftereffects when the adaptor contour is surrounded by a texture. Here we utilize this phenomenon to investigate the nature of the first-order inputs to texture-surround suppression of contour shape by examining its selectivity to luminance polarity and the magnitude of luminance contrast. Stimuli were constructed from sinusoidal-shaped strings of either "bright" or "dark" elongated Gaussians. Observers adapted to pairs of contours, and the aftereffect was measured as the shift in the apparent shape frequency of subsequently presented test contours. We found that the suppression of the contour-shape aftereffect by a surround texture made of similar contours was maximal when the adaptor's center and surround contours were of the same polarity, revealing polarity specificity of the surround-suppression effect. We also measured the effect of varying the relative contrasts of the adaptor's center and surround and found that the reduction in the contour-shape aftereffect was determined by the surround-to-center contrast ratio. Finally, we measured the selectivity to luminance polarity of the texture-shape aftereffect itself and found that it was reduced when the adaptors and tests were of opposite luminance polarity. We conclude that texture-surround suppression of contour-shape as well as texture-shape processing itself depend on "on-off" luminance-polarity channel interactions. These selectivities may constitute an important neural substrate underlying efficient figure-ground segregation and image segmentation.

Touch engages visual spatial contextual processing

The spatial context in which we view a visual stimulus strongly determines how we perceive the stimulus. In the visual tilt illusion, the perceived orientation of a visual grating is affected by the orientation signals in its surrounding context. Conceivably, the spatial context in which a visual grating is perceived can be defined by interactive multisensory information rather than visual signals alone. Here, we tested the hypothesis that tactile signals engage the neural mechanisms supporting visual contextual modulation. Because tactile signals also convey orientation information and touch can selectively interact with visual orientation perception, we predicted that tactile signals would modulate the visual tilt illusion. We applied a bias-free method to measure the tilt illusion while testing visual-only, tactile-only or visuo-tactile contextual surrounds. We found that a tactile context can influence visual tilt perception. Moreover, combining visual and tactile orientation information in the surround results in a larger tilt illusion relative to the illusion achieved with the visual-only surround. These results demonstrate that the visual tilt illusion is subject to multisensory influences and imply that non-visual signals access the neural circuits whose computations underlie the contextual modulation of vision.

Effects of V1 surround modulation tuning on visual saliency and the tilt illusion

Neurons in the primary visual cortex respond to oriented stimuli placed in the center of their receptive field, yet their response is modulated by stimuli outside the receptive field (the surround). Classically, this surround modulation is assumed to be strongest if the orientation of the surround stimulus aligns with the neuron's preferred orientation, irrespective of the actual center stimulus. This neuron-dependent surround modulation has been used to explain a wide range of psychophysical phenomena, such as biased tilt perception and saliency of stimuli with contrasting orientation. However, several neurophysiological studies have shown that for most neurons surround modulation is instead center dependent: it is strongest if the surround orientation aligns with the center stimulus. As the impact of such center-dependent modulation on the population level is unknown, we examine this using computational models. We find that with neuron-dependent modulation the biases in orientation coding, commonly used to explain the tilt illusion, are larger than psychophysically reported, but disappear with center-dependent modulation. Therefore we suggest that a mixture of the two modulation types is necessary to quantitatively explain the psychophysically observed biases. Next, we find that under center-dependent modulation average population responses are more sensitive to orientation differences between stimuli, which in theory could improve saliency detection. However, this effect depends on the specific saliency model. Overall, our results thus show that center-dependent modulation reduces coding bias, while possibly increasing the sensitivity to salient features. NEW & NOTEWORTHY Neural responses in the primary visual cortex are modulated by stimuli surrounding the receptive field. Most earlier studies assume this modulation depends on the neuron's tuning properties, but experiments have shown that instead it depends mostly on the stimulus characteristics. We show that this simple change leads to neural coding that is less biased and under some conditions more sensitive to salient features.

Adaptation in the visual cortex: a case for probing neuronal populations with natural stimuli

The perception of, and neural responses to, sensory stimuli in the present are influenced by what has been observed in the past—a phenomenon known as adaptation. We focus on adaptation in visual cortical neurons as a paradigmatic example. We review recent work that represents two shifts in the way we study adaptation, namely (i) going beyond single neurons to study adaptation in populations of neurons and (ii) going beyond simple stimuli to study adaptation to natural stimuli. We suggest that efforts in these two directions, through a closer integration of experimental and modeling approaches, will enable a more complete understanding of cortical processing in natural environments.

Visual Contextual Effects of Orientation, Contrast, Flicker, and Luminance: All Are Affected by Normal Aging

The perception of a visual stimulus can be markedly altered by spatial interactions between the stimulus and its surround. For example, a grating stimulus appears lower in contrast when surrounded by a similar pattern of higher contrast: a phenomenon known as surround suppression of perceived contrast. Such center–surround interactions in visual perception are numerous and arise from both cortical and pre-cortical neural circuitry. For example, perceptual surround suppression of luminance and flicker are predominantly mediated pre-cortically, whereas contrast and orientation suppression have strong cortical contributions. Here, we compare the perception of older and younger observers on a battery of tasks designed to assess such visual contextual effects. For all visual dimensions tested (luminance, flicker, contrast, and orientation), on average the older adults showed greater suppression of central targets than the younger adult group. The increase in suppression was consistent in magnitude across all tasks, suggesting that normal aging produces a generalized, non-specific alteration to contextual processing in vision.

Putting low-level vision into global context: Why vision cannot be reduced to basic circuits

To cope with the complexity of vision, most models in neuroscience and computer vision are of hierarchical and feedforward nature. Low-level vision, such as edge and motion detection, is explained by basic low-level neural circuits, whose outputs serve as building blocks for more complex circuits computing higher level features such as shape and entire objects. There is an isomorphism between states of the outer world, neural circuits, and perception, inspired by the positivistic philosophy of the mind. Here, we show that although such an approach is conceptually and mathematically appealing, it fails to explain many phenomena including crowding, visual masking, and non-retinotopic processing.

3D surface configuration modulates 2D symmetry detection

We investigated whether three-dimensional (3D) information in a scene can affect symmetry detection. The stimuli were random dot patterns with 15% dot density. We measured the coherence threshold, or the proportion of dots that were the mirror reflection of the other dots in the other half of the image about a central vertical axis, at 75% accuracy with a 2AFC paradigm under various 3D configurations produced by the disparity between the left and right eye images. The results showed that symmetry detection was difficult when the corresponding dots across the symmetry axis were on different frontoparallel or inclined planes. However, this effect was not due to a difference in distance, as the observers could detect symmetry on a slanted surface, where the depth of the two sides of the symmetric axis was different. The threshold was reduced for a hinge configuration where the join of two slanted surfaces coincided with the axis of symmetry. Our result suggests that the detection of two-dimensional (2D) symmetry patterns is subject to the 3D configuration of the scene; and that coplanarity across the symmetry axis and consistency between the 2D pattern and 3D structure are important factors for symmetry detection.

The tilt illusion: phenomenology and functional implications

The perceived orientation of a line or grating is affected by the orientation structure of the surrounding image: the tilt illusion. Here, I offer a selective review of the literature on the tilt illusion, focusing on functional aspects. The review explores the merits of mechanistic accounts of the tilt illusion based upon sensory gain control in which neuronal responses are normalized by the pooled activity of other units. The role of inhibition between orientation-selective neurons is discussed, and it is argued that their associated disinhibition must also be taken into account in order to model the full angular dependence of the tilt illusion on surround orientation. Parallels are drawn with adaptation as modulation by the temporal rather than spatial context within which an image fragment is processed. The chromatic selectivity of the tilt illusion and the extent of its dependence on the visibility of the surround are used to infer characteristics of the neuronal normalization pools and the loci in the cortical processing hierarchy at which gain control operates. Finally, recent evidence is discussed as to the possible clinical relevance of the tilt illusion as a biomarker for schizophrenia.