Flanker effects in peripheral contrast discrimination--psychophysics and modeling

Weakened untuned gain control is associated with schizophrenia while atypical orientation-tuned suppression depends on visual acuity

Perceptual distortions are core features of psychosis. Weakened contrast surround suppression has been proposed as a neural mechanism underlying atypical perceptual experiences. Although previous work has measured suppression by asking participants to report the perceived contrast of a low-contrast target surrounded by a high-contrast surround, it is possible to modulate perceived contrast solely by manipulating the orientation of a matched-contrast center and surround. Removing the bottom-up segmentation cue of contrast difference and isolating orientation-dependent suppression may clarify the neural processes responsible for atypical surround suppression in psychosis. We examined surround suppression across a spectrum of psychotic psychopathology including people with schizophrenia (PSZ; N = 31) and people with bipolar disorder (PBD; N = 29), first-degree biological relatives of these patient groups (PBDrel, PSZrel; N = 28, N = 21, respectively), and healthy controls (N = 29). PSZ exhibited reduced surround suppression across orientations; although group differences were minimal at the condition that produced the strongest suppression. PBD and PSZrel exhibited intermediate suppression, whereas PBDrel performed most similarly to controls. Intriguingly, group differences in orientation-dependent surround suppression magnitude were moderated by visual acuity. A simulation in which visual acuity and/or focal attention interact with untuned gain control reproduces the observed pattern of results, including the lack of group differences when orientation of center and surround are the same. Our findings further elucidate perceptual mechanisms of impaired center-surround processing in psychosis and provide insights into the effects of visual acuity on orientation-dependent suppression in PSZ.

Masking, crowding, and grouping: Connecting low and mid-level vision

An important task for vision science is to build a unitary framework of low- and mid-level vision. As a step on this way, our study examined differences and commonalities between masking, crowding and grouping-three processes that occur through spatial interactions between neighbouring elements. We measured contrast thresholds as functions of inter-element spacing and eccentricity for Gabor detection, discrimination and contour integration, using a common stimulus grid consisting of nine Gabor elements. From these thresholds, we derived a) the baseline contrast necessary to perform each task and b) the spatial extent over which task performance was stable. This spatial window can be taken as an indicator of field size, where elements that fall within a putative field are readily combined. We found that contrast thresholds were universally modulated by inter-element distance, with a shallower and inverted effect for grouping compared with masking and crowding. Baseline contrasts for detecting stimuli and discriminating their properties were positively linked across the tested retinal locations (parafovea and near periphery), whereas those for integrating elements and discriminating their properties were negatively linked. Meanwhile, masking and crowding spatial windows remained uncorrelated across eccentricity, although they were correlated across participants. This suggests that the computation performed by each type of visual field operates over different distances that co-varies across observers, but not across retinal locations. Contrast-processing units may thus lie at the core of the shared idiosyncrasies across tasks reported in many previous studies, despite the fundamental differences in the extent of their spatial windows.

Contrast adaptation improves spatial integration

The effects of contrast adaptation and contrast area summation (spatial integration) were investigated using a contrast discrimination task. The task consisted of a target of variable size, and a pedestal with a fixed base contrast. Discrimination performance was examined for a condition in which the pedestal size was fixed, equal to the largest target size, and for a condition in which the pedestal size matched the target size and thus varied with it. Repeated performance of the task produced rapid within-session improvements for both conditions. For stimuli with a matching size of target and pedestal, the performance improved only for the larger targets, indicating the development of spatial integration, which was initially absent for these stimuli. However, the improvements were mostly temporary, and were not fully retained between subsequent daily sessions. The temporary nature of the sensitivity gains implies that they resulted, at least in part, from rapid adaptation to the stimulus contrast. We suggest that adaptation decorrelates and thus reduces the spatial noise generated by a high-contrast pedestal, leading to improved spatial integration (area summation) and better contrast sensitivity. A decorrelation model successfully predicted our experimental results.

Effects of muscarinic and nicotinic receptors on contextual modulation in macaque area V1

Context affects the salience and visibility of image elements in visual scenes. Collinear flankers can enhance or decrease the perceptual and neuronal sensitivity to flanked stimuli. These effects are mediated through lateral interactions between neurons in the primary visual cortex (area V1), in conjunction with feedback from higher visual areas. The strength of lateral interactions is affected by cholinergic neuromodulation. Blockade of muscarinic receptors should increase the strength of lateral intracortical interactions, while nicotinic blockade should reduce thalamocortical feed-forward drive. Here we test this proposal through local iontophoretic application of the muscarinic receptor antagonist scopolamine and the nicotinic receptor antagonist mecamylamine, while recording single cells in parafoveal representations in awake fixating macaque V1. Collinear flankers generally reduced neuronal contrast sensitivity. Muscarinic and nicotinic receptor blockade equally reduced neuronal contrast sensitivity. Contrary to our hypothesis, flanker interactions were not systematically affected by either receptor blockade.

Flexible contextual modulation of naturalistic texture perception in peripheral vision

Peripheral vision comprises most of our visual field, and is essential in guiding visual behavior. Its characteristic capabilities and limitations, which distinguish it from foveal vision, have been explained by the most influential theory of peripheral vision as the product of representing the visual input using summary statistics. Despite its success, this account may provide a limited understanding of peripheral vision, because it neglects processes of perceptual grouping and segmentation. To test this hypothesis, we studied how contextual modulation, namely the modulation of the perception of a stimulus by its surrounds, interacts with segmentation in human peripheral vision. We used naturalistic textures, which are directly related to summary-statistics representations. We show that segmentation cues affect contextual modulation, and that this is not captured by our implementation of the summary-statistics model. We then characterize the effects of different texture statistics on contextual modulation, providing guidance for extending the model, as well as for probing neural mechanisms of peripheral vision.

Excitatory and inhibitory lateral interactions effects on contrast detection are modulated by tRNS

Contrast sensitivity for a Gabor signal is affected by collinear high-contrast Gabor flankers. The flankers reduce (inhibitory effect) or increase (facilitatory effect) sensitivity, at short (2λ) and intermediate (6λ) target-to-flanker separation respectively. We investigated whether these inhibitory/facilitatory sensitivity effects are modulated by transcranial random noise stimulation (tRNS) applied to the occipital and frontal cortex of human observers during task performance. Signal detection theory was used to measure sensitivity (d’) and the Criterion (C) in a contrast detection task, performed with sham or tRNS applied over the occipital or the frontal cortex. After occipital stimulation results show a tRNS-dependent increased sensitivity for the single Gabor signal of low but not high contrast. Moreover, results suggest a dissociation of the tRNS effect when the Gabor signal is presented with the flankers, consisting in a general increased sensitivity at 2λ where the flankers had an inhibitory effect (reduction of inhibition) and a decreased sensitivity at 6λ where the flankers had a facilitatory effect on the Gabor signal (reduction of facilitation). After a frontal stimulation, no specific effect of the tRNS was found. We account for these complex interactions between tRNS and flankers by assuming that tRNS not only enhances feedforward input from the Gabor signal to the cortex, but also enhances the excitatory or inhibitory lateral intracortical input from the flankers. The boosted lateral input depends on the excitation-inhibition (E/I) ratio, namely when the lateral input is weak, it is boosted by tRNS with consequent modification of the contrast-dependent E/I ratio.

Lateral effects in pattern vision

There is a large literature on lateral effects in pattern vision but no consensus about them or comprehensive model of them. This paper reviews the literature with a focus on the effects of parallel context in the central fovea. It describes seven experiments that measure detection and discrimination thresholds in annular and Gabor-pattern contexts at different separations. It presents a model of these effects, which is an elaboration of Foley's (1994) model. The model describes the results well, and it shows that lateral context affects the response to the target by both multiplicative excitation and additive inhibition. Both lateral effects extend for several wavelengths beyond the target. They vary in relative strength, producing near suppression and far enhancement of the response to the target. The model describes the detection and discrimination results well, and it also describes the results of experiments on lateral effects on perceived contrast. The model is consistent with the physiology of V1 cells.

Contextual influences in the peripheral retina of patients with macular degeneration

Macular degeneration (MD) is the leading cause of low vision in the elderly population worldwide. In case of complete bilateral loss of central vision, MD patients start to show a preferred retinal region for fixation (PRL). Previous literature has reported functional changes that are connected with the emergence of the PRL. In this paper, we question whether the PRL undergoes a use-dependent cortical reorganization that alters the range of spatial lateral interactions between low-level filters. We asked whether there is a modulation of the excitatory/inhibitory lateral interactions or whether contextual influences are well accounted for by the same law that describes the integration response in normal viewers. In a group of 13 MD patients and 7 age-matched controls, we probed contextual influences by measuring the contrast threshold for a vertical target Gabor, flanked by two collinear high-contrast Gabors. Contextual influences of the collinear flankers were indicated by the changes in contrast threshold obtained at different target-to-flanker distances (λs) relative to the baseline orthogonal condition. Results showed that MDs had higher thresholds in the baseline condition and functional impairment in the identification tasks. Moreover, at the shortest λ, we found facilitatory rather than inhibitory contextual influence. No difference was found between the PRL and a symmetrical retinal position (non-PRL). By pulling together data from MD and controls we showed that in the periphery this inversion occurs when the target threshold approach the flankers’ contrast (about 1:3 ratio) and that for patients it does occur in both the PRL and a symmetrical retinal position (non-PRL). We conclude that contrary to previous interpretations, this modulation doesn’t seem to reflect use-dependent cortical reorganization but rather, it might result from a reduction of contrast gain for the target that promotes target-flankers grouping.

Single additive mechanism predicts lateral interactions effects-computational model

The mechanism underlying the lateral interactions (LI) phenomenon is still an enigma. Over the years, several groups have tried to explain the phenomenon and suggested models to predict its psychophysical results. Most of these models comprise both inhibitory and facilitatory mechanisms for describing the LI phenomenon. Their studies' assumption that a significant inhibition mechanism exists is based on the classical interpretation of the threshold elevation perceived in psychophysical experiments. In this work, we suggest a different interpretation of the threshold elevation obtained experimentally. Our model proposes and demonstrates how a facilitatory additive mechanism can solely predict both the facilitation and "inhibition" aspects of the phenomenon, without the need for an additional inhibitory mechanism, at least for the two flankers' configurations. Though the model is simple it succeeds to predict the LI effect under a large variety of stimuli configurations and parameters. The model is in agreement with both classical and recent psychophysical and neurophysiological results. We suggest that the LI mechanism plays a role in creating an educated guess to form a continuation of gratings and textures based on the surrounding visual stimuli.

The effect of spatial frequency on peripheral collinear facilitation

The detection of a Gabor patch (target) can be decreased or improved by the presence of co-oriented Gabor patches (flankers) having the same spatial frequency as the target. These phenomena are thought to be mediated by lateral interactions. Depending on the distance between target and flankers, commonly defined as a multiple of the wavelength (λ) of the carrier, flankers can increase or decrease a target's detectability. Studies with foveal presentation showed that for target-to-flankers distances<2λ contrast thresholds for the central target increase, while for target-to-flankers distances>3λ contrast thresholds decrease. Earlier studies on collinear facilitation at the near-periphery of the visual field (4° of eccentricity) showed inconsistent facilitation (Shani & Sagi, 2005, Vision Research, 45, 2009-2024) whereas more recent studies showed consistent facilitation for larger separations (7-8λ) (Maniglia et al., 2011, PLoS ONE, 6, e25568; Lev & Polat, 2011, Vision Research, 51, 2488-2498). However, all of these studies used medium-to-high spatial frequencies (3-8 cpd). In this study we tested lower spatial frequencies (1, 2, and 3 cpd) with different target-to-flankers distances. The rationale was that near-peripheral vision is tuned for lower spatial frequencies and this could be reflected in collinear facilitation. Results show consistent collinear facilitation at 8λ for all the spatial frequencies tested, but also show collinear facilitation at shorter target-to-flanker distance (6λ) for the lowest spatial frequencies tested (1 cpd). Additionally, collinear facilitation decreases as spatial frequency increases; opposite to the findings of Polat (2009, Spatial Vision, 22, 179-193) in the fovea, indicating a different spatial frequency tuning between foveal and peripheral lateral interactions.

Perceptual grouping across eccentricity

Across the visual field, progressive differences exist in neural processing as well as perceptual abilities. Expansion of stimulus scale across eccentricity compensates for some basic visual capacities, but not for high-order functions. It was hypothesized that as with many higher-order functions, perceptual grouping ability should decline across eccentricity. To test this prediction, psychophysical measurements of grouping were made across eccentricity. Participants indicated the dominant grouping of dot grids in which grouping was based upon luminance, motion, orientation, or proximity. Across trials, the organization of stimuli was systematically decreased until perceived grouping became ambiguous. For all stimulus features, grouping ability remained relatively stable until 40°, beyond which thresholds significantly elevated. The pattern of change across eccentricity varied across stimulus feature, in which stimulus scale, dot size, or stimulus size interacted with eccentricity effects. These results demonstrate that perceptual grouping of such stimuli is not reliant upon foveal viewing, and suggest that selection of dominant grouping patterns from ambiguous displays operates similarly across much of the visual field.

Coaxial anisotropy of cortical point spread in human visual areas

A focal stimulus triggers neural activity that spreads to cortical regions far beyond the stimulation site, creating a so-called "cortical point spread" (CPS). Animal studies found that V1 neurons possess lateral connections with neighboring neurons that prefer similar orientations and to neurons representing visuotopic regions that are constrained by their preferred orientation axis. Although various roles in visual processing are proposed for this anatomical anisotropy of lateral connections, evidence for a corresponding "functional" anisotropy in CPS is lacking or inconsistent in animal studies and absent in humans. To explore functional anisotropy, we inspected axial constraints on CPS in human visual cortex using functional magnetic resonance imaging. We defined receptive fields (RFs) of unit gray matter volumes and delineated the spatial extents of CPS in visuotopic space. The CPS triggered by foveal stimuli exhibited coaxial anisotropy with larger spatial extents along the axis of stimulus orientation. Furthermore, the spatial extents of CPS along the coaxial direction increased with an increasing similarity of local sites to the CPS-inducing stimulus in orientation preference. From CPS driven by multifocal stimuli, the coaxially biased spread was also found in cortical regions in the periphery, albeit reduced in degree, and was invariant to a varying degree of radial relationship between stimuli and RF positions of local sites, rejecting radial bias as an origin of coaxial anisotropy. Our findings provide a bridge between the anatomical anisotropy seen in animal visual cortex and a possible network property supporting spatial contextual effects in human visual perception.

Responses to second-order texture modulations undergo surround suppression

First-order (contrast) surround suppression has been well characterized both psychophysically and physiologically,but relatively little is known as to whether the perception of second-order visual stimuli exhibits analogous center–surround interactions. Second-order surround suppression was characterized by requiring subjects to detect second-order modulation in stimuli presented alone or embedded in a surround.Both contrast- (CM) and orientation-modulated (OM) stimuli were used. For most subjects and both OM and CM stimuli, second-order surrounds caused thresholds to be higher, indicative of second-order suppression. For CM stimuli, suppression was orientation-specific, i.e., higher thresholds for parallel than for orthogonal surrounds. However, the evidence for orientation specificity of suppression for OM stimuli was weaker. These results suggest that normalization, leading to surround suppression, operates at multiple stages in cortical processing.

Reducing crowding by weakening inhibitory lateral interactions in the periphery with perceptual learning

We investigated whether lateral masking in the near-periphery, due to inhibitory lateral interactions at an early level of central visual processing, could be weakened by perceptual learning and whether learning transferred to an untrained, higher-level lateral masking known as crowding. The trained task was contrast detection of a Gabor target presented in the near periphery (4°) in the presence of co-oriented and co-aligned high contrast Gabor flankers, which featured different target-to-flankers separations along the vertical axis that varied from 2λ to 8λ. We found both suppressive and facilitatory lateral interactions at target-to-flankers distances (2λ - 4λ and 8λ, respectively) that were larger than those found in the fovea. Training reduces suppression but does not increase facilitation. Most importantly, we found that learning reduces crowding and improves contrast sensitivity, but has no effect on visual acuity (VA). These results suggest a different pattern of connectivity in the periphery with respect to the fovea as well as a different modulation of this connectivity via perceptual learning that not only reduces low-level lateral masking but also reduces crowding. These results have important implications for the rehabilitation of low-vision patients who must use peripheral vision to perform tasks, such as reading and refined figure-ground segmentation, which normal sighted subjects perform in the fovea.

Psychometric functions for detection and discrimination with and without flankers

Recent studies have reported that flanking stimuli broaden the psychometric function and lower detection thresholds. In the present study, we measured psychometric functions for detection and discrimination with and without flankers to investigate whether these effects occur throughout the contrast continuum. Our results confirm that lower detection thresholds with flankers are accompanied by broader psychometric functions. Psychometric functions for discrimination reveal that discrimination thresholds with and without flankers are similar across standard levels, and that the broadening of psychometric functions with flankers disappears as standard contrast increases, to the point that psychometric functions at high standard levels are virtually identical with or without flankers. Threshold-versus-contrast (TvC) curves with flankers only differ from TvC curves without flankers in occasional shallower dippers and lower branches on the left of the dipper, but they run virtually superimposed at high standard levels. We discuss differences between our results and other results in the literature, and how they are likely attributed to the differential vulnerability of alternative psychophysical procedures to the effects of presentation order. We show that different models of flanker facilitation can fit the data equally well, which stresses that succeeding at fitting a model does not validate it in any sense.

An exploration of the spatial scale over which orientation-dependent surround effects affect contour detection

Contour detection is a crucial component of visual processing; however, performance on contour detection tasks can vary depending on the context of the visual scene. S. C. Dakin and N. J. Baruch (2009) showed that detection of a contour in an array of distracting elements depends on the orientation of flanking elements. Here, using a line of five collinear Gabor elements ("target contour") in a field of distractor Gabor elements, we systematically measured the effects of eccentricity, spacing, and spatial frequency on contour detection performance in three different contexts: randomly oriented distractors (control condition), flanking distractors (on either side of the collinear Gabors) aligned approximately parallel to the target contour, and flanking distractors aligned approximately orthogonal to the target contour. In the control condition, contour detection performance was best for larger Gabors (2 cpd) spaced farther apart (1.2°). Parallel flankers reduced performance for intermediate and large spacings and sizes compared to the control condition, while orthogonal flankers increased performance for the smallest spacing and size compared to the control condition. The results are fit by a model in which collinear facilitation, which is size-dependent but can persist for several degrees of visual angle, competes with orientation-dependent suppression from the flanking context when elements are separated by less than a degree of visual angle.

Beyond multiple pattern analyzers modeled as linear filters (as classical V1 simple cells): useful additions of the last 25 years

This review briefly discusses processes that have been suggested in the last 25 years as important to the intermediate stages of visual processing of patterns. Five categories of processes are presented: (1) Higher-order processes including FRF structures; (2) Divisive contrast nonlinearities including contrast normalization; (3) Subtractive contrast nonlinearities including contrast comparison; (4) Non-classical receptive fields (surround suppression, cross-orientation inhibition); (5) Contour integration.

Suppressive lateral interactions at parafoveal representations in primary visual cortex

The perceptual salience and visibility of image elements is influenced by other elements in their vicinity. The perceptual effect of image elements on an adjacent target element depends on their relative orientation. Collinear flanking elements usually improve sensitivity for the target element, whereas orthogonal elements have a weaker effect. It is believed that the collinear flankers exert these effects through lateral interactions between neurons in the primary visual cortex (area V1), but the precise mechanisms underlying these contextual interactions remain unknown. Here, we directly examined this question by recording the effects of flankers on the responses of V1 neurons at parafoveal representations while monkeys performed a fixation task or a contrast detection task. We found, unexpectedly, that collinear flankers reduce the monkeys' perceptual sensitivity for a central target element. This behavioral effect was explained by a flanker-induced increase in the activity of V1 neurons in the absence of the central target stimulus, which reduced the amplitude of the target response. Our results indicate that the dominant effect of collinear flankers in parafoveal vision is suppression and suggest that these suppressive effects are caused by a decrease in the dynamic range of neurons coding the central target.

High-resolution BOLD fMRI measurements of local orientation-dependent contextual modulation show a mismatch between predicted V1 output and local BOLD response

The blood oxygenation level-dependent (BOLD) functional MRI response to suppressive neural activity has not been tested on a fine spatial scale. Using Gabor patches placed in the near periphery, we precisely localized individual regions of interest in primary visual cortex and measured the response at a range of contrasts in two different contexts: with parallel and with orthogonal flanking Gabor patches. Psychophysical measurements confirmed strong suppression of the target Gabor response when flanked by parallel Gabors. However, the BOLD response to the target with parallel flankers decreased as the target contrast increased, which contradicts psychophysical estimates of local neural activity.

Suppression pathways saturate with contrast for parallel surrounds but not for superimposed cross-oriented masks

Contrast masking from parallel grating surrounds (doughnuts) and superimposed orthogonal masks have different characteristics. However, it is not known whether the saturation of the underlying suppression that has been found for parallel doughnut masks depends on (i) relative mask and target orientation, (ii) stimulus eccentricity or (iii) surround suppression. We measured contrast-masking functions for target patches of grating in the fovea and in the periphery for cross-oriented superimposed and doughnut masks and parallel doughnut masks. When suppression was evident, the factor that determined whether it accelerated or saturated was whether the mask stimulus was crossed or parallel. There are at least two interpretations of the asymptotic behaviour of the parallel surround mask. (1) Suppression arises from pathways that saturate with (mask) contrast. (2) The target is processed by a mechanism that is subject to surround suppression at low target contrasts, but a less sensitive mechanism that is immune from surround suppression 'breaks through' at higher target contrasts. If the mask can be made less potent, then masking functions should shift downwards, and sideways for the two accounts, respectively. We manipulated the potency of the mask by varying the size of the hole in a parallel doughnut mask. The results provided strong evidence for the first account but not the second. On the view that response compression becomes more severe progressing up the visual pathway, our results suggest that superimposed cross-orientation suppression precedes orientation tuned surround suppression. These results also reveal a previously unrecognized similarity between surround suppression and crowding (Pelli, Palomares, & Majaj, 2004).

Adapting to altered image statistics using processed video

Perceptual systems can be altered by immersing observers in environments with statistical properties that differ from those naturally encountered. Here we present a novel method for placing observers in naturalistic audio visual environments whose statistics can be manipulated in very targeted ways. We present the results of a case study that used this method. Observers were exposed to an environment where there was a novel statistical relationship between two simple, visual patterns in otherwise natural scenes. Exposure to this altered environment strengthened perceptual interactions between the two patterns.

Long-range suppressive interactions between S-cone and luminance channels

Surround suppression (SS) refers to a reduction in the effective stimulus contrast in one visual location produced by a stimulus presented in an adjacent location. This type of suppression is tuned for orientation and spatial frequency and is thought to be a cortical process. In this paper we used psychophysical measurements to determine whether S-cone-driven signals are affected by surround suppression and, if so, whether S-cone and achromatic signals interact at spatially-remote locations. Our results revealed three important aspects of surround suppression. Firstly, we show that S-cone probes are suppressed by simultaneous S-cone contrast surrounds and that this suppression has the characteristics of a cortical mechanism. Secondly, we show that when probes and surrounds are presented simultaneously, there are no suppressive interactions between S-cone and luminance stimuli. Finally, we demonstrate that this apparent independence is an artifact of signal timing: when the S-cone components of the stimuli precede the luminance components by approximately 40 ms, we find a significant interaction between the two pathways. The amplitude of this interaction depends critically upon the relative onset times of the two components. These results indicate that some component of surround suppression depends on neural computations that occur after the S- and luminance pathways are combined in striate cortex. In addition, the strong dependence of the magnitude of surround suppression on temporal ordering suggests that much of the effect is driven by transient signals.

Spatial Offset of Test Field Elements from Surround Elements Affects the Strength of Motion Aftereffects

Static movement aftereffects (MAEs) were measured after adaptation to vertical square-wave luminance gratings drifting horizontally within a central window in a surrounding stationary vertical grating. The relationship between the stationary test grating and the surround was manipulated by varying the alignment of the stationary stripes in the window and those in the surround, and the type of outline separating the window and the surround [no outline, black outline (invisible on black stripes), and red outline (visible throughout its length)]. Offsetting the stripes in the window significantly increased both the duration and ratings of the strength of MAEs. Manipulating the outline had no significant effect on either measure of MAE strength. In a second experiment, in which the stationary test fields alone were presented, participants judged how segregated the test field appeared from its surround. In contrast to the MAE measures, outline as well as offset contributed to judged segregation. In a third experiment, in which test-stripe offset was systematically manipulated, segregation ratings rose with offset. However, MAE strength was greater at medium than at either small or large (180° phase shift) offsets. The effects of these manipulations on the MAE are interpreted in terms of a spatial mechanism which integrates motion signals along collinear contours of the test field and surround, and so causes a reduction of motion contrast at the edges of the test field.

Space and time in visual context

No sensory stimulus is an island unto itself; rather, it can only properly be interpreted in light of the stimuli that surround it in space and time. This can result in entertaining illusions and puzzling results in psychological and neurophysiological experiments. We concentrate on perhaps the best studied test case, namely orientation or tilt, which gives rise to the notorious tilt illusion and the adaptation tilt after-effect. We review the empirical literature and discuss the computational and statistical ideas that are battling to explain these conundrums, and thereby gain favour as more general accounts of cortical processing.

Mirror symmetrical transfer of perceptual learning by prism adaptation

Recent study of [Sugita, Y. (1996) Global plasticity in adult visual cortex following reversal of visual input. Nature, 380, 523-526.] demonstrated that prism adaptation to reversed retinal input generates the transfer of neuronal activities in monkey V1 to the opposite visual cortex. This raises the question if perceptual learning on one side of the visual field can transfer to the other side. We tested this in using the Gabor lateral masking paradigm. Before adaptation, long-range interaction was induced vertically on one side (i.e., the right) of the visual field with training (perceptual learning). Prism adaptation was achieved by wearing right-left reversing goggles. During adaptation period, perceptual learning transferred to a mirror symmetrical region across the vertical meridian. Results in the post adaptation period revealed that both learning and transfer persisted for over three months. These results provide direct evidence of transferred perceptual plasticity across the visual field, the underlying mechanism of which is supported by the mirror symmetrical connection between the right and left cortices.

Perceptual learning in contrast detection: presence and cost of shifts in response criteria

Contemporary theoretical accounts of perceptual learning typically assume that observers are either unbiased or stably biased across the course of learning. However, standard methods for estimating thresholds, as they are typically used, do not allow this assumption to be tested. We present an approach that allows for this test specific to perceptual learning for contrast detection. We show that reliable decreases in detection thresholds and increases in hit rates are not uniformly accompanied by reliable increases in sensitivity (d'), but are regularly accompanied by reliable liberal shifts in response criteria (c). In addition, we estimate the extent to which sensitivity could have increased in the absence of these liberal shifts. The results pose a challenge to the assumption that perceptual learning has limited or no impact on response criteria.

Explaining the footsteps, belly dancer, Wenceslas, and kickback illusions

The footsteps illusion (FI) demonstrates that an object's background can have a profound effect on the object's perceived speed. This illusion consists of a yellow bar and a blue bar that move over a black-and-white, striped background. Although the bars move at a constant rate, they appear to repeatedly accelerate and decelerate in antiphase with each other. Previously, this illusion has been explained in terms of the variations in contrast at the leading and trailing edges of the bars that occur as the bars traverse the striped background. Here, we show that this explanation is inadequate and instead propose that for each bar, the bar's leading edge, trailing edge, lateral edges, and the surrounding background edges all contribute to the bar's perceived speed and that the degree to which each edge contributes to the motion percept is determined by that edge's contrast. We show that this theory can explain all the data on the FI as well as the belly dancer and Wenceslas illusions. We conclude by presenting a new illusion, the kickback illusion, which, although geometrically similar to the FI, is mediated by a different mechanism, namely, reverse phi motion.

Contrast dependency in perceptual filling-in

Two experiments were conducted to investigate how stimulus contrast affected the time required for perceptual filling-in. The stimuli consisted of a Gabor patch (target) and a circular grating region (surround). In Experiment 1, the target contrast was manipulated, and the surround contrast was fixed. Filling-in was significantly delayed with higher target contrast, but this delay was observed only when the target contrast exceeded the surround contrast. In Experiment 2, however, a much smaller effect of changing the surround contrast occurred. Possible reasons for this asymmetric effect are discussed.

Two distinct mechanisms of suppression in human vision

Cortical visual neurons in the cat and monkey are inhibited by stimuli surrounding their receptive fields (surround suppression) or presented within their receptive fields (cross-orientation or overlay suppression). We show that human contrast sensitivity is similarly affected by two distinct suppression mechanisms. In agreement with the animal studies, human surround suppression is tightly tuned to the orientation and spatial frequency of the test, unlike overlay suppression. Using a double-masking paradigm, we also show that in humans, overlay suppression precedes surround suppression in the processing sequence. Surprisingly, we find that, unlike overlay suppression, surround suppression is only strong in the periphery (> 1 degree eccentricity). This result argues for a new functional distinction between foveal and peripheral operations.

The effect of spatial configuration on surround suppression of contrast sensitivity

Contrast sensitivity is known to be strongly influenced by the target surround, yet the role of the surround interaction in visual processing remains unclear. Previously, we have shown that the surround strongly suppresses contrast sensitivity in the periphery when the surround spatial frequency and orientation match those of the target (Petrov, Carandini, & McKee, 2005). Here, we explore how various spatial characteristics of the iso-oriented and frequency-matched surround, such as surround phase and spatial layout, affect suppression. We manipulated surround geometry (annulus ring, half annulus, and bow tie) and its separation from the target (both laterally and in depth) and varied the position of the half-annulus and bow-tie surrounds with respect to Gabor target's orientation and with respect to its location in the visual field (i.e., radial vs. tangential surrounds). We also compared monoptic, dichoptic, and binocular surround suppression. Except for a significant radial-tangential anisotropy, only the area of the surround and the lateral separation between the surround and target had a significant effect on the magnitude of suppression. We showed that, although suppression amplitude remains constant with stimulus eccentricity, the lateral extent of suppression scales in proportion to the eccentricity. The most surprising finding was that the extent of surround suppression does not scale with stimulus size or spatial frequency. We suggest that the properties of surround suppression are best explained by a mechanism that selects salient targets for subsequent saccades.

Contextual effects in fine spatial discriminations

The context in which a pattern is viewed can greatly affect its apparent contrast, a phenomenon commonly attributed to pooled contrast gain control processes. A low-contrast surround may slightly enhance apparent contrast, whereas increasing the contrast of the surround leads to a monotonic decline in contrast appearance. We ask here how the presence of a patterned surround affects the ability to perform fine, suprathreshold orientation, contrast, and spatial frequency discriminations as a function of surround contrast and phase. Our results revealed an unexpected dip in performance when center and surround were in phase and similar in contrast. These results suggest that additional processes, perhaps those involved in scene segregation, play a role in contextual effects on discrimination.

Eccentricity effects on lateral interactions

We attempted to resolve an apparent conflict between the lack of psychophysical evidence of collinear facilitation at the near-periphery and physiological evidence from the monkey showing collinear effects extra-fovealy. We compared collinear and orthogonal configurations to discount facilitation due to reduced positional uncertainty. Detection thresholds were measured for Gabor targets at eccentricities of 0 degrees - 4 degrees, flanked by collinear or orthogonal flankers. Like in previous reports in the literature, results varied among subjects when the stimulus position was off-fixation. We found reduced facilitation at eccentricities as small as 1 degrees - 2 degrees. Moreover, facilitation did not increase when the stimuli were M-scaled or when observers received more practice. However, a larger proportion of subjects showed collinear facilitation when attention was directed to the tested configurations. The results suggest that differences in allocation of attention along the visual field may affect the underlying lateral interactions, consequently resulting in eccentricity effects as well as inter-observer variability.

Task-dependent modulation of target-flanker lateral interactions in vision

Visibility of a central target Gabor element often improves in the presence of collinear flankers. Such lateral interactions may reflect fundamental mechanisms underlying the perceptual integration of contours in early vision. We recently reported (Freeman, Sagi, & Driver, 2001) attentional modulation of these interactions. Here, we test whether this modulation is task dependent. Subjects had to detect a near-threshold central target while performing a secondary discrimination task on one pair of flankers that could appear with another distractor pair (one pair collinear with the target, the other orthogonal). Central target thresholds were lowered when collinear flankers were judged for the secondary task, but only when this task concerned the global spatial relationship between these flankers (discrimination of their Vernier offset or global orientation). Other secondary tasks involving discriminating the local orientations, contrasts, or colors of the relevant flanker pair produced no such attentional modulation. However, this task-dependent modulation was observed only when two flanker pairs were present, not for displays with only a single flanker pair. Top-down modulation of lateral interactions may function to select between overlapping potential contours whenever the global spatial properties of one are task relevant.

Facilitation of contrast detection in near-peripheral vision

Foveal detection of a Gabor patch (target) is facilitated by collinear, displaced high-contrast flankers. Polat and Sagi reported that the same phenomenon occurred in the periphery, but no data were presented [Proc. Natl. Acad. Sci. 91 (1994) 1206]. Others have found no facilitation in a limited number of conditions tested. To resolve this apparent conflict, we measured lateral facilitation in the near-periphery using a range of stimulus parameters. We found facilitation for a range of target-flanker distances for peripheral eccentricities up to 6 degrees , but the magnitude of the effect was less than found in central vision. Facilitation varied across subjects and with spatial frequency. Flanker contrast had no effect over the range evaluated (10-80%). Equal facilitation was found for two global arrangements of the stimulus pattern. Facilitation was found using a temporal, but not a spatial two-alternative forced-choice paradigm, accounting for the different results among previous studies. This finding supports previous indications of the role of attention in altering such facilitation. The value of facilitation from lateral interactions for persons with central vision impairment, who have to shift their attention to a peripheral locus constantly, needs to be examined.

Associative learning in early vision

Sensory discriminations often improve with practice (perceptual learning). Recent results show that practice does not necessarily lead to the best possible performance on the task. It was shown that learning a task (contrast discrimination) that has already reached saturation could be enabled by a contextual change in the stimulus (the addition of surrounding flankers) during practice. Psychophysical results with varying context show a behavior that is described by a network of local visual processors with horizontal recurrent interactions. We describe a mathematical learning rule for the modification of cortical synapses that is inspired by the experimental results and apply it to recurrent cortical networks that respond to external stimuli. The model predicts that repeated presentation of the same stimulus leads to saturation of synaptic modification, such that the strengths of recurrent connections depend on the configuration of the stimulus but not on its amplitude. When a new stimulus is introduced, the modification is rekindled until a new equilibrium is reached. This effect may explain the saturation of perceptual learning when practicing a certain task repeatedly. We present simulations of contrast discrimination in a simplified model of a cortical column in the primary visual cortex and show that performance of the model is reminiscent of context-dependent perceptual learning.

Effects on orientation perception of manipulating the spatio–temporal prior probability of stimuli

Spatial and temporal regularities commonly exist in natural visual scenes. The knowledge of the probability structure of these regularities is likely to be informative for an efficient visual system. Here we explored how manipulating the spatio-temporal prior probability of stimuli affects human orientation perception. Stimulus sequences comprised four collinear bars (predictors) which appeared successively towards the foveal region, followed by a target bar with the same or different orientation. Subjects' orientation perception of the foveal target was biased towards the orientation of the predictors when presented in a highly ordered and predictable sequence. The discrimination thresholds were significantly elevated in proportion to increasing prior probabilities of the predictors. Breaking this sequence, by randomising presentation order or presentation duration, decreased the thresholds. These psychophysical observations are consistent with a Bayesian model, suggesting that a predictable spatio-temporal stimulus structure and an increased probability of collinear trials are associated with the increasing prior expectation of collinear events. Our results suggest that statistical spatio-temporal stimulus regularities are effectively integrated by human visual cortex over a range of spatial and temporal positions, thereby systematically affecting perception.

Electrophysiological correlates of lateral interactions in human visual cortex

Detection thresholds for visually presented targets can be influenced by the nature of information in adjacent regions of the visual field. For example, detection thresholds for low-contrast Gabor patches decrease when flanked by patches that are oriented collinearly rather than orthogonally with the target. Such results are consistent with the known microanatomy of primary visual cortex, where long-range horizontal connections link cortical columns with common orientation preferences. To investigate the neural bases of collinearity effects, we recorded event-related brain potentials (ERPs) together with psychophysical measures for targets flanked by collinear vs. orthogonal gratings. Human volunteers performed a contrast discrimination task on a target grating presented at a perifoveal location. For targets flanked by collinear stimuli, we observed an increased positive polarity voltage deflection in the occipital scalp-recorded ERPs between 80 to 140 ms after stimulus onset. Such a midline occipital scalp voltage distribution of this ERP collinearity effect is consistent with a generator in primary visual cortex. Two later negative voltage ERP deflections (latencies of 245-295 and 300-350 ms) were focused at lateral occipital scalp sites, a pattern consistent with activity in extrastriate visual cortex. These ERP effects were correlated with improved contrast discrimination for central targets presented with collinear flanks. These results demonstrate that the integration of local flanking elements with a central stimulus can occur as early as 80 ms in human visual cortex, but this includes processes occurring at longer latencies and appears to involve both striate and extrastriate visual areas.

Collinear contextual suppression

The context of a target can modulate behavioral as well as neural responses to that target. For example, target processing can be suppressed by iso-oriented surrounds whereas it can be facilitated by collinear contextual elements. Here, we present experiments in which collinear elements exert strong suppression whereas iso-oriented contextual surrounds yield no contextual modulation--contrary to most studies in this field. We suggest that contextual suppression depends strongly on the spatial arrangement of the context pointing to the influence of Gestalt factors in contextual modulation.

Response suppression in v1 agrees with psychophysics of surround masking

When a target stimulus is embedded in a high contrast surround, the target appears reduced in contrast and is harder to detect, and neural responses in visual cortex are suppressed. We used functional magnetic resonance imaging (fMRI) and psychophysics to quantitatively compare these physiological and perceptual effects. Observers performed a contrast discrimination task on a contrast-reversing sinusoidal target grating. The target was either presented in isolation or embedded in a high-contrast surround. While observers performed the task, we also measured fMRI responses as a function of target contrast, both with and without a surround. We found that the surround substantially increased the psychophysical thresholds while reducing fMRI responses. The two data sets were compared, on the basis of the assumption that a fixed response difference is required for correct discrimination, and we found that the psychophysics accounted for 96.5% of the variance in the measured V1 responses. The suppression in visual areas V2 and V3 was stronger, too strong to agree with psychophysics. The good quantitative agreement between psychophysical thresholds and V1 responses suggests V1 as a plausible candidate for mediating surround masking.

Context-enabled learning in the human visual system

Training was found to improve the performance of humans on a variety of visual perceptual tasks. However, the ability to detect small changes in the contrast of simple visual stimuli could not be improved by repetition. Here we show that the performance of this basic task could be modified after the discrimination of the stimulus contrast was practised in the presence of similar laterally placed stimuli, suggesting a change in the local neuronal circuit involved in the task. On the basis of a combination of hebbian and anti-hebbian synaptic learning rules compatible with our results, we propose a mechanism of plasticity in the visual cortex that is enabled by a change in the context.