Lateral interactions between targets and flankers in low-level vision depend on attention to the flankers

The moment of awareness influences the content of awareness in orientation repulsion

Through the neurally evolving process of dynamic contextual modulation of perceptual contents, it remains unclear how the content of awareness is determined. Here we quantified the visual illusion of orientation repulsion, wherein the target appears tilted against the surrounding's orientation, and examined whether its extent changed when the target awareness was quickened by a preceding flanker. Independently of spatial cueing, repulsion was reduced when the flanker preceded the target by 100 ms compared with when they appeared simultaneously. We confirmed that the preceding flanker quickened the awareness of a nearby target relative to distant ones by 40 ms. Furthermore, the preceding flanker that was greater than 7 degrees away from the target still evoked such reduction of repulsion. These findings imply that the content of awareness is determined by the temporal interaction of two distinct processes: one controls the moment of awareness, and the other represents the perceptual content.

Context-dependent attentional spotlight in pulvinar-V1 interaction

Spatial attention is often described as a mental spotlight that enhances information processing at the attended location. Using fMRI, we investigated background connectivity between the pulvinar and V1 in relation to focused versus diffused attention allocation, in weak and strong crowding contexts. Our findings revealed that focused attention led to enhanced correlations between the pulvinar and V1. Notably, this modulation was initiated by the pulvinar, and the strength of the modulation was dependent on the saliency of the target. These findings suggest that the pulvinar initiates information reweighting to V1, which underlies attentional selection in cluttered scenes.

The stabilization of visibility for sequentially presented, low-contrast objects: Experiments and neural field model

In any environment, events transpire in temporal sequences. The general principle governing such sequences is that each instance of the event is influenced by its predecessors. It is shown here that this principle is true for a fundamental aspect of visual perception: visibility. A series of nine psychophysical experiments and associated neural dynamic simulations provide evidence that two non-stimulus factors, self-excitation and short-term memory, stabilize the visibility of a simple low-contrast object (a line segment) as it moves over a sequence of unpredictable locations. Stabilization was indicated by the very low probability of visible-to-invisible switches, and dependence on preceding visibility states was indicated by hysteresis as the contrast of the object was gradually decreased or increased. The contribution of self-excitation to stabilization was indicated by increased visible-to-invisible switching (decreased hysteresis) following adaptation of the visibility state, and the contribution of memory to stabilization was indicated by visibility "bridging" long blank intervals separating each relocation of the object. Because of the unpredictability of the relocations of the object, its visibility at one location pre-shapes visibility at its next location via persisting subthreshold activation of detectors surrounding the low-contrast object. All effects were modeled, including contributions from adaptation and recurrent inhibition, with a single set of parameter values.

Increasing the spatial extent of attention strengthens surround suppression

Here we investigate how the extent of spatial attention affects center-surround interaction in visual motion processing. To do so, we measured motion direction discrimination thresholds in humans using drifting gratings and two attention conditions. Participants were instructed to limit their attention to the central part of the stimulus under the narrow attention condition, and to both central and surround parts under the wide attention condition. We found stronger surround suppression under the wide attention condition. The magnitude of the attention effect increased with the size of the surround when the stimulus had low contrast, but did not change when it had high contrast. Results also showed that attention had a weaker effect when the center and surround gratings drifted in opposite directions. Next, to establish a link between the behavioral results and the neuronal response characteristics, we performed computer simulations using the divisive normalization model. Our simulations showed that using smaller versus larger multiplicative attentional gain and parameters derived from the medial temporal (MT) area of the cortex, the model can successfully predict the observed behavioral results. These findings reveal the critical role of spatial attention on surround suppression and establish a link between neuronal activity and behavior. Further, these results also suggest that the reduced surround suppression found in certain clinical disorders (e.g., schizophrenia and autism spectrum disorder) may be caused by abnormal attention mechanisms.

Cortical Synchrony as a Mechanism of Collinear Facilitation and Suppression in Early Visual Cortex

Stimulus-induced oscillations and synchrony among neuronal populations in visual cortex are well-established phenomena. Their functional role in cognition are, however, not well-understood. Recent studies have suggested that neural synchrony may underlie perceptual grouping as stimulus-frequency relationships and stimulus-dependent lateral connectivity profiles can determine the success or failure of synchronization among neuronal groups encoding different stimulus elements. We suggest that the same mechanism accounts for collinear facilitation and suppression effects where the detectability of a target Gabor stimulus is improved or diminished by the presence of collinear flanking Gabor stimuli. We propose a model of oscillators which represent three neuronal populations in visual cortex with distinct receptive fields reflecting the target and two flankers, respectively, and whose connectivity is determined by the collinearity of the presented Gabor stimuli. Our model simulations confirm that neuronal synchrony can indeed explain known collinear facilitation and suppression effects for attended and unattended stimuli.

Collinear search impairment is luminance contrast invariant

Collinear search impairment (CSI) is a phenomenon where a task-irrelevant collinear structure impairs a target search in a visual display. It has been suggested that CSI is monocular, occurs without the participants' access to consciousness and is possibly processed at an early visual site (e.g. V1). This effect has frequently been compared with a well-documented opposite effect called attentional capture (AC), in which salient and task-irrelevant basic features (e.g. color, orientation) enhance target detection. However, whether this phenomenon can be attributed to non-attentional factors such as collinear facilitation (CF) has not yet been formally tested. Here we used one well-established property of CF, i.e. that target contrast modulates its effect direction (facilitation vs suppression), to examine whether CSI shared similar signature profiles along different contrast levels. In other words, we tested whether CSI previously observed at the supra-threshold level was reduced or reversed at near-threshold contrast levels. Our results showed that, regardless of the luminance contrast levels, participants spent a longer time searching for targets displayed on the salient singleton collinear structure than those displayed off the structure. Contrast invariance suggests that it is unlikely that CSI is exclusively sub-served by an early vision mechanism (e.g. CF).

A nonspatial sound modulates processing of visual distractors in a flanker task

Successful navigation of information-rich, multimodal environments involves processing of both auditory and visual information. The extent to which information within each modality is processed varies due to many factors, but the influence of auditory stimuli on the processing of visual stimuli in these multimodal environments is not well understood. Previous research has shown that a preceding sound leads to decreased reaction times in visual tasks (Bertelson, 1967). The current study examines if a non-spatial, task-irrelevant sound additionally alters processing of visual distractors that flank a central target. We utilized a version of a flanker task in which participants responded to a central letter surrounded by two irrelevant flanker letters. When these flankers are associated with a conflicting response, a congruency effect occurs such that reaction time to the target is slowed (Eriksen & Eriksen, 1974). In two experiments using this task, results showed that a preceding tone caused general speeding of reaction time across flanker types, consistent with alerting. The tone also caused decreased variation in response time. Critically, the tone modulated the congruency effect, with a greater speeding for congruent flankers than for incongruent flankers. This suggests that the influence of flanker identity was more intense after tone presentation, consistent with a nonspatial sound increasing perceptual and/or response-association processing of flanking stimuli.

Anodal transcranial direct current stimulation reduces collinear lateral inhibition in normal peripheral vision

Collinear flanking stimuli can reduce the detectability of a Gabor target presented in peripheral vision. This phenomenon is called collinear lateral inhibition and it may contribute to crowding in peripheral vision. Perceptual learning can reduce collinear lateral inhibition in peripheral vision, however intensive training is required. Our aim was to assess whether modulation of collinear lateral inhibition can be achieved within a short time-frame using a single 20-minute session of primary visual cortex anodal transcranial direct current stimulation (a-tDCS). Thirteen observers with normal vision performed a 2AFC contrast detection task with collinear flankers positioned at a distance of 2λ from the target (lateral inhibition) or 6λ (control condition). The stimuli were presented 6° to the left of a central cross and fixation was monitored with an infra-red eye tracker. Participants each completed two randomly sequenced, single-masked stimulation sessions; real anodal tDCS and sham tDCS. For the 2λ separation condition, a-tDCS induced a significant reduction in detection threshold (reduced lateral inhibition). Sham stimulation had no effect. No effects of a-tDCS were observed for the 6λ separation condition. This result lays the foundation for future work investigating whether a-tDCS may be useful as a visual rehabilitation tool for individuals with central vision loss who are reliant on peripheral vision.

TMS reveals inhibitory extrastriate cortico-cortical feedback modulation of V1 activity in humans

The interaction between the primary visual cortex (V1) and extrastriate visual areas provides the first building blocks in our perception of the world. V2, in particular, seems to play a crucial role in shaping contextual modulation information through feedback projections to V1. However, whether this feedback is inhibitory or excitatory is still unclear. In order to test the nature of V2 feedback to V1, we used neuronavigation-guided offline inhibitory transcranial magnetic stimulation (TMS) on V2 before testing participants on collinear facilitation, a contrast detection task with lateral masking. This contextual modulation task is thought to rely on horizontal connections in V1 and possibly extrastriate feedback. Results showed that when inhibitory TMS was delivered over V2, contrast thresholds decreased for targets presented in the contralateral hemifield, consistent with the retinotopic mapping of this area, while having no effect for targets presented in the ipsilateral hemifield or after control (CZ) stimulation. These results suggest that feedback from V2 to V1 during contextual modulation is mostly inhibitory, corroborating recent observations in monkey electrophysiology and extending this mechanism to human visual system. Moreover, we provide for the first time direct evidence of the involvement of extrastriate visual areas in collinear facilitation.

Dorsolateral prefrontal neurons mediate subjective decisions and their variation in humans

Subjective decisions play a vital role in human behavior because, while often grounded in fact, they are inherently based on personal beliefs that can vary broadly within and between individuals. While these properties set subjective decisions apart from many other sensorimotor processes and are of wide sociological impact, their single-neuronal basis in humans is unknown. Here we find cells in the dorsolateral prefrontal cortex (dlPFC) that reflect variations in the subjective decisions of humans when performing opinion-based tasks. These neurons changed their activities gradually as the participants transitioned between choice options but also reflected their unique point of conversion at equipoise. Focal disruption of the dlPFC, by contrast, diminished gradation between opposing decisions but had little effect on sensory perceptual choices or their motor report. These findings suggest that the human dlPFC plays an important role in subjective decisions and propose a mechanism for mediating their variation during opinion formation.

Cognitive load effects on early visual perceptual processing

Contrast-based early visual processing has largely been considered to involve autonomous processes that do not need the support of cognitive resources. However, as spatial attention is known to modulate early visual perceptual processing, we explored whether cognitive load could similarly impact contrast-based perception. We used a dual-task paradigm to assess the impact of a concurrent working memory task on the performance of three different early visual tasks. The results from Experiment 1 suggest that cognitive load can modulate early visual processing. No effects of cognitive load were seen in Experiments 2 or 3. Together, the findings provide evidence that under some circumstances cognitive load effects can penetrate the early stages of visual processing and that higher cognitive function and early perceptual processing may not be as independent as was once thought.

Crowding with Negatively Conditioned Flankers and Targets

Crowding refers to the phenomenon of increased difficulty in identifying a peripherally presented stimulus when it is surrounded by adjacent flankers compared to when it is presented in isolation. The aim of the present study was to investigate the influence of flanker and target emotion on crowding effects. Therefore, Landolt rings with certain opening directions were conditioned with neutral or negative pictures. These conditioned stimuli were afterwards used in a visual crowding task, in which the critical spacing (75% threshold) was assessed for emotional flankers as well as for emotional targets. Larger crowding effects were observed for negatively relative to neutrally conditioned flankers, indicating more interference with negative flankers. Additionally, for participants showing a strong evaluative conditioning effect, smaller crowding effects were found for negatively relative to neutrally conditioned targets, indicating enhanced identification of negative target stimuli. In conclusion, crowding effects are modulated by both flanker and target emotion, suggesting that high-level stimulus features survive crowding and influence recognition performance. The study further shows that evaluative conditioning can be a useful tool to study the effect of emotion on rather early perceptual processes.

Chunking as a rational strategy for lossy data compression in visual working memory

The nature of capacity limits for visual working memory has been the subject of an intense debate that has relied on models that assume items are encoded independently. Here we propose that instead, similar features are jointly encoded through a "chunking" process to optimize performance on visual working memory tasks. We show that such chunking can: (a) facilitate performance improvements for abstract capacity-limited systems, (b) be optimized through reinforcement, (c) be implemented by center-surround dynamics, and (d) increase effective storage capacity at the expense of recall precision. Human performance on a variant of a canonical working memory task demonstrated performance advantages, precision detriments, interitem dependencies, and trial-to-trial behavioral adjustments diagnostic of performance optimization through center-surround chunking. Models incorporating center-surround chunking provided a better quantitative description of human performance in our study as well as in a meta-analytic dataset, and apparent differences in working memory capacity across individuals were attributable to individual differences in the implementation of chunking. Our results reveal a normative rationale for center-surround connectivity in working memory circuitry, call for reevaluation of memory performance differences that have previously been attributed to differences in capacity, and support a more nuanced view of visual working memory capacity limitations: strategic tradeoff between storage capacity and memory precision through chunking contribute to flexible capacity limitations that include both discrete and continuous aspects. (PsycINFO Database Record

A shape-level flanker facilitation effect in contour integration and the role of shape complexity

The detection of an object in the visual field requires the visual system to integrate a variety of local features into a single object. How these local processes and their global integration is influenced by the presence of other shapes in the visual field is poorly understood. The detectability (contour integration) of a central target object in the form of a two dimensional Gaborized contour was compared in the presence or absence of nearby surrounding objects. A 2-AFC staircase procedure added orientation jitter to the constituent Gabor patches to determine the detectability of the target contour. The set of contours was generated using shape profiles of everyday objects and geometric forms. Experiment 1 examined the effect of three types of congruencies between the target and two flanking contours (contour shape, symmetry and familiarity). Experiment 2 investigated the effect of varying the number and spatial positions of the flankers. In addition, a measure of shape complexity (reciprocal of shape compactness) was used to assess the effects of contour complexity on detection. Across both experiments the detectability of the target contour increased when the target and flanker had the same shape and this was related to both the number of flankers and the complexity of the target shapes. Another factor that modulated this shape-level flanker facilitation effect was the presence of symmetry. The overall results are consistent with a contour integration process in which the visual system incorporates contextual information to extract the most likely smooth contour within a noise field.

Attention enhances apparent perceptual organization

Perceptual organization and selective attention are two crucial processes that influence how we perceive visual information. The former structures complex visual inputs into coherent units, whereas the later selects relevant information. Attention and perceptual organization can modulate each other, affecting visual processing and performance in various tasks and conditions. Here, we tested whether attention can alter the way multiple elements appear to be perceptually organized. We manipulated covert spatial attention using a rapid serial visual presentation task, and measured perceptual organization of two multielements arrays organized by luminance similarity as rows or columns, at both the attended and unattended locations. We found that the apparent perceptual organization of the multielement arrays is intensified when attended and attenuated when unattended. We ruled out response bias as an alternative explanation. These findings reveal that attention enhances the appearance of perceptual organization, a midlevel vision process, altering the way we perceive our visual environment.

The Temporal Dynamic Relationship Between Attention and Crowding: Electrophysiological Evidence From an Event-Related Potential Study

Visual crowding is the difficulty experienced in identifying a target flanked by other objects within the peripheral visual field. Despite extensive research conducted on this topic, the precise relationship between attention and crowding is still debatable. One perspective suggests that crowding is a bottom-up and pre-attentive process, while another suggests that crowding is top-down and attentional. A third perspective proposes that crowding is a combination of bottom-up and top-down processes. To address this debate, the current study manipulated the attention and distance between targets and flankers, while simultaneously measuring event-related potentials, in human participants. Results indicated that, compared to uncrowded targets, crowded targets elicited more negative frontal N1 and P2 activity and a less negative occipital N1 activity, regardless of whether targets were attended or unattended, and a more positive occipital P2 activity when they were attended. Furthermore, the crowded minus uncrowded difference amplitude was more negative over the frontal region and more positive over the occipital region when the targets were attended, compared to when they were unattended during the N1 and P2 stages. This suggests that crowding, a concept that originates from Gestalt grouping, occurs automatically and can be modulated by attention.

Interference in lateral masking stimuli - The effects of relative phase, position, orientation, and spatial frequency

Lateral masking has been defined as the perception of a visual target stimulus being impaired when other stimuli are present in its adjacent surroundings. In such cases it has generally been assumed that the target stimulus presented along with a masking stimulus has the same stimulus power as when presented alone and that the reduced visibility reflects interactions in the visual system. It has, however, become clear that there may be interference between such stimuli [5]. Such interference, which takes place in the stimuli and is independent of the visual system, has the potential to reduce the stimulus power of target stimuli. The present report asks, employing 2-Dimensional Gabor functions as stimuli, how interference effects may depend on (1) relative spatial phase, (2) separation between target and masking stimuli, (3) difference in orientation, and (4) difference in spatial frequency between masking and target stimuli. Interference was estimated numerically based on the sums of the amplitudes in the Fourier spectra and the norms of these spectra. Clear evidence for interference was demonstrated with both measures. All the four parameters have the ability to influence the amount of interference. These findings, therefore, emphasize that one cannot count on a target stimulus presented along with masking stimuli to have the same stimulus power as when it is presented by itself.

Can perceptual grouping unfold in the absence of awareness? Comparing grouping during continuous flash suppression and sandwich masking

In this study we examined whether grouping by luminance similarity and grouping by connectedness can occur in the absence of visual awareness, using a priming paradigm and two methods to render the prime invisible, CFS and sandwich masking under matched conditions. For both groupings, significant response priming effects were observed when the prime was reported invisible under sandwich masking, but none were obtained under CFS. These results provide evidence for unconscious grouping, converging with previous findings showing that visual awareness is not essential for certain perceptual organization processes to occur. They are also consistent with findings indicating that processing during CFS is limited, and suggest the involvement of higher visual areas in perceptual organization. Moreover, these results demonstrate that whether a process can occur without awareness is dependent on the level at which the suppression induced by the method used for rendering the stimulus inaccessible to awareness takes place.

Contour interpolation: A case study in Modularity of Mind

In his monograph Modularity of Mind (1983), philosopher Jerry Fodor argued that mental architecture can be partly decomposed into computational organs termed modules, which were characterized as having nine co-occurring features such as automaticity, domain specificity, and informational encapsulation. Do modules exist? Debates thus far have been framed very generally with few, if any, detailed case studies. The topic is important because it has direct implications on current debates in cognitive science and because it potentially provides a viable framework from which to further understand and make hypotheses about the mind's structure and function. Here, the case is made for the modularity of contour interpolation, which is a perceptual process that represents non-visible edges on the basis of how surrounding visible edges are spatiotemporally configured. There is substantial evidence that interpolation is domain specific, mandatory, fast, and developmentally well-sequenced; that it produces representationally impoverished outputs; that it relies upon a relatively fixed neural architecture that can be selectively impaired; that it is encapsulated from belief and expectation; and that its inner workings cannot be fathomed through conscious introspection. Upon differentiating contour interpolation from a higher-order contour representational ability ("contour abstraction") and upon accommodating seemingly inconsistent experimental results, it is argued that interpolation is modular to the extent that the initiating conditions for interpolation are strong. As interpolated contours become more salient, the modularity features emerge. The empirical data, taken as a whole, show that at least certain parts of the mind are modularly organized.

Lateral masking effects on contrast sensitivity in rats

Changes in target visibility may be produced by additional stimulus elements at adjacent locations. Such contextual effects may reflect lateral interactions of stimulus representations in early cortical areas. It has been reported that the organization of orientation preference found in primates and cats visual cortex differs from that found in rodents, suggesting functional distinctions across species. In order to examine effects of lateral interactions at a perceptual level, contrast sensitivity in rats was measured for Gabor patches masked by two additional patches. Rats responded to target onset, and perceptual indices were based upon reaction time distributions across levels of luminance contrast. It was found that contrast sensitivity of targets without lateral masks corresponded to levels previously reported. For all measurements, the presence of sustained lateral masks systematically reduced sensitivity to targets, demonstrating interference by adjacent elements across levels of contrast. Effects of mask orientation or separation were not observed. These results may reflect reported non-systematic topography of orientation tuning across the cortex in rodents. Results suggest that intrinsic lateral connections in early processing areas play a minimal role in stimulus integration for rats.

Configuration-Specific Attentional Modulation of Flanker – Target Lateral Interactions

Elements of a contour are often easier to detect when they possess collinearity, with their local orientations matching the global orientation of the contour. We recently reported attentional modulation of such lateral interactions between a central near-threshold target Gabor patch and flanking high-contrast patches (Freeman et al, 2001 Nature Neuroscience4 1032–1036). Here, we examined whether such attentional effects reflect specific modulation of mechanisms sensitive to collinear configurations, or instead more general modulation of sensitivity to either the global or local orientation-components of the stimulus. Thresholds for detecting a central Gabor target were measured, while observers also judged the Vernier alignment between one pair of flankers and ignored a second flanker pair (when present). Target contrast-thresholds were facilitated only when attending collinear flankers. There was no facilitation when attending flankers that shared only local orientation with the target, or flankers that fell on a global axis aligned with target orientation but having orthogonal local orientation. Ignored collinear flankers had no effect on target thresholds. These results demonstrate strong and specific attentional modulation of contour-integration mechanisms in early vision sensitive to collinear configurations.

Single additive mechanism predicts lateral interactions effects-computational model

The mechanism underlying the lateral interactions (LI) phenomenon is still an enigma. Over the years, several groups have tried to explain the phenomenon and suggested models to predict its psychophysical results. Most of these models comprise both inhibitory and facilitatory mechanisms for describing the LI phenomenon. Their studies' assumption that a significant inhibition mechanism exists is based on the classical interpretation of the threshold elevation perceived in psychophysical experiments. In this work, we suggest a different interpretation of the threshold elevation obtained experimentally. Our model proposes and demonstrates how a facilitatory additive mechanism can solely predict both the facilitation and "inhibition" aspects of the phenomenon, without the need for an additional inhibitory mechanism, at least for the two flankers' configurations. Though the model is simple it succeeds to predict the LI effect under a large variety of stimuli configurations and parameters. The model is in agreement with both classical and recent psychophysical and neurophysiological results. We suggest that the LI mechanism plays a role in creating an educated guess to form a continuation of gratings and textures based on the surrounding visual stimuli.

The effect of spatial frequency on peripheral collinear facilitation

The detection of a Gabor patch (target) can be decreased or improved by the presence of co-oriented Gabor patches (flankers) having the same spatial frequency as the target. These phenomena are thought to be mediated by lateral interactions. Depending on the distance between target and flankers, commonly defined as a multiple of the wavelength (λ) of the carrier, flankers can increase or decrease a target's detectability. Studies with foveal presentation showed that for target-to-flankers distances<2λ contrast thresholds for the central target increase, while for target-to-flankers distances>3λ contrast thresholds decrease. Earlier studies on collinear facilitation at the near-periphery of the visual field (4° of eccentricity) showed inconsistent facilitation (Shani & Sagi, 2005, Vision Research, 45, 2009-2024) whereas more recent studies showed consistent facilitation for larger separations (7-8λ) (Maniglia et al., 2011, PLoS ONE, 6, e25568; Lev & Polat, 2011, Vision Research, 51, 2488-2498). However, all of these studies used medium-to-high spatial frequencies (3-8 cpd). In this study we tested lower spatial frequencies (1, 2, and 3 cpd) with different target-to-flankers distances. The rationale was that near-peripheral vision is tuned for lower spatial frequencies and this could be reflected in collinear facilitation. Results show consistent collinear facilitation at 8λ for all the spatial frequencies tested, but also show collinear facilitation at shorter target-to-flanker distance (6λ) for the lowest spatial frequencies tested (1 cpd). Additionally, collinear facilitation decreases as spatial frequency increases; opposite to the findings of Polat (2009, Spatial Vision, 22, 179-193) in the fovea, indicating a different spatial frequency tuning between foveal and peripheral lateral interactions.

Training improves visual processing speed and generalizes to untrained functions

Studies show that manipulating certain training features in perceptual learning determines the specificity of the improvement. The improvement in abnormal visual processing following training and its generalization to visual acuity, as measured on static clinical charts, can be explained by improved sensitivity or processing speed. Crowding, the inability to recognize objects in a clutter, fundamentally limits conscious visual perception. Although it was largely considered absent in the fovea, earlier studies report foveal crowding upon very brief exposures or following spatial manipulations. Here we used GlassesOff's application for iDevices to train foveal vision of young participants. The training was performed at reading distance based on contrast detection tasks under different spatial and temporal constraints using Gabor patches aimed at testing improvement of processing speed. We found several significant improvements in spatio-temporal visual functions including near and also non-trained far distances. A remarkable transfer to visual acuity measured under crowded conditions resulted in reduced processing time of 81 ms, in order to achieve 6/6 acuity. Despite a subtle change in contrast sensitivity, a robust increase in processing speed was found. Thus, enhanced processing speed may lead to overcoming foveal crowding and might be the enabling factor for generalization to other visual functions.

Invisible collinear structures impair search

Visual attention and perceptual grouping both help us from being overloaded by the vast amount of information, and attentional search is delayed when a target overlaps with a snake-like collinear distractor (Jingling & Tseng, 2013). We assessed whether awareness of the collinear distractor is required for this modulation. We first identified that visible long (=9 elements), but not short (=3 elements) collinear distractor slowed observers' detection of an overlapping target. Then we masked part of a long distractor (=9 elements) with continuous flashing color patches (=6 elements) so that the combined dichoptic percept to observers' awareness was a short collinear distractor (=3 elements). We found that the invisible collinear parts, like visible ones, can form a continuous contour to impair search, suggesting that conscious awareness is not a pre-requisite for contour integration and its interaction with selective attention.

Better target detection in the presence of collinear flankers under high working memory load

There are multiple ways in which working memory can influence selective attention. Aside from the content-specific effects of working memory on selective attention, whereby attention is more likely to be directed towards information that matches the contents of working memory, the mere level of load on working memory has also been shown to have an effect on selective attention. Specifically, high load on working memory is associated with increased processing of irrelevant information. In most demonstrations of the effect to-date, this has led to impaired target performance, leaving open the possibility that the effect partly reflects an increase in general task difficulty under high load. Here we show that working memory load can result in a performance gain when processing of distracting information aids target performance. The facilitation in the detection of a low-contrast Gabor stimulus in the presence of collinear flanking Gabors was greater when load on a concurrent working memory task was high, compared to low. This finding suggests that working memory can interact with selective attention at an early stage in visual processing.

Attention-dependent early cortical suppression contributes to crowding

Crowding, the identification difficulty for a target in the presence of nearby flankers, is ubiquitous in spatial vision and is considered a bottleneck of object recognition and visual awareness. Despite its significance, the neural mechanisms of crowding are still unclear. Here, we performed event-related potential and fMRI experiments to measure the cortical interaction between the target and flankers in human subjects. We found that the magnitude of the crowding effect was closely associated with an early suppressive cortical interaction. The cortical suppression was reflected in the earliest event-related potential component (C1), which originated in V1, and in the BOLD signal in V1, but not other higher cortical areas. Intriguingly, spatial attention played a critical role in the manifestation of the suppression. These findings provide direct and converging evidence that attention-dependent V1 suppression contributes to crowding at a very early stage of visual processing.

Perceptual grouping across eccentricity

Across the visual field, progressive differences exist in neural processing as well as perceptual abilities. Expansion of stimulus scale across eccentricity compensates for some basic visual capacities, but not for high-order functions. It was hypothesized that as with many higher-order functions, perceptual grouping ability should decline across eccentricity. To test this prediction, psychophysical measurements of grouping were made across eccentricity. Participants indicated the dominant grouping of dot grids in which grouping was based upon luminance, motion, orientation, or proximity. Across trials, the organization of stimuli was systematically decreased until perceived grouping became ambiguous. For all stimulus features, grouping ability remained relatively stable until 40°, beyond which thresholds significantly elevated. The pattern of change across eccentricity varied across stimulus feature, in which stimulus scale, dot size, or stimulus size interacted with eccentricity effects. These results demonstrate that perceptual grouping of such stimuli is not reliant upon foveal viewing, and suggest that selection of dominant grouping patterns from ambiguous displays operates similarly across much of the visual field.

Brain networks supporting perceptual grouping and contour selection

The human visual system groups local elements into global objects seemingly without effort. Using a contour integration task and EEG source level analyses, we tested the hypothesis that perceptual grouping requires a top-down selection, rather than a passive pooling, of neural information that codes local elements in the visual image. The participants were presented visual displays with or without a hidden contour. Two tasks were performed: a central luminance-change detection task and a peripheral contour detection task. Only in the contour-detection task could we find differential brain activity between contour and non-contour conditions, within a distributed brain network including parietal, lateral occipital and primary visual areas. Contour processing was associated with an inflow of information from lateral occipital into primary visual regions, as revealed from the slope of phase differences between source level oscillations within these areas. The findings suggest that contour integration results from a selection of neural information from lower visual areas, and that this selection is driven by the lateral occipital cortex.

Adaptation to leftward-shifting prisms enhances local processing in healthy individuals

In healthy individuals, adaptation to left-shifting prisms has been shown to simulate the symptoms of hemispatial neglect, including a reduction in global processing that approximates the local bias observed in neglect patients. The current study tested whether leftward prism adaptation can more specifically enhance local processing abilities. In three experiments, the impact of local and global processing was assessed through tasks that measure susceptibility to illusions that are known to be driven by local or global contextual effects. Susceptibility to the rod-and-frame illusion - an illusion disproportionately driven by both local and global effects depending on frame size - was measured before and after adaptation to left- and right-shifting prisms. A significant increase in rod-and-frame susceptibility was found for the left-shifting prism group, suggesting that adaptation caused an increase in local processing effects. The results of a second experiment confirmed that leftward prism adaptation enhances local processing, as assessed with susceptibility to the simultaneous-tilt illusion. A final experiment employed a more specific measure of the global effect typically associated with the rod-and-frame illusion, and found that although the global effect was somewhat diminished after leftward prism adaptation, the trend failed to reach significance (p=.078). Rightward prism adaptation had no significant effects on performance in any of the experiments. Combined, these findings indicate that leftward prism adaptation in healthy individuals can simulate the local processing bias of neglect patients primarily through an increased sensitivity to local visual cues, and confirm that prism adaptation not only modulates lateral shifts of attention, but also prompts shifts from one level of processing to another.

fMRI correlates of object-based attentional facilitation vs. suppression of irrelevant stimuli, dependent on global grouping and endogenous cueing

Theories of object-based attention often make two assumptions: that attentional resources are facilitatory, and that they spread automatically within grouped objects. Consistent with this, ignored visual stimuli can be easier to process, or more distracting, when perceptually grouped with an attended target stimulus. But in past studies, the ignored stimuli often shared potentially relevant features or locations with the target. In this fMRI study, we measured the effects of attention and grouping on Blood Oxygenation Level Dependent (BOLD) responses in the human brain to entirely task-irrelevant events. Two checkerboards were displayed each in opposite hemifields, while participants responded to check-size changes in one pre-cued hemifield, which varied between blocks. Grouping (or segmentation) between hemifields was manipulated between blocks, using common (vs. distinct) motion cues. Task-irrelevant transient events were introduced by randomly changing the color of either checkerboard, attended or ignored, at unpredictable intervals. The above assumptions predict heightened BOLD signals for irrelevant events in attended vs. ignored hemifields for ungrouped contexts, but less such attentional modulation under grouping, due to automatic spreading of facilitation across hemifields. We found the opposite pattern, in primary visual cortex. For ungrouped stimuli, BOLD signals associated with task-irrelevant changes were lower, not higher, in the attended vs. ignored hemifield; furthermore, attentional modulation was not reduced but actually inverted under grouping, with higher signals for events in the attended vs. ignored hemifield. These results challenge two popular assumptions underlying object-based attention. We consider a broader biased-competition framework: task-irrelevant stimuli are suppressed according to how strongly they compete with task-relevant stimuli, with intensified competition when the irrelevant features or locations comprise the same object.

Rats and humans differ in processing collinear visual features

Behavioral studies in humans and rats demonstrate that visual detection of a target stimulus is sensitive to surrounding spatial patterns. In both species, the detection of an oriented visual target is affected when the surrounding region contains flanking stimuli that are collinear to the target. In many studies, collinear flankers have been shown to improve performance in humans, both absolutely (compared to performance with no flankers) and relative to non-collinear flankers. More recently, collinear flankers have been shown to impair performance in rats both absolutely and relative to non-collinear flankers. However, these observations spanned different experimental paradigms. Past studies in humans have shown that the magnitude and even sign of flanker effects can depend critically on the details of stimulus and task design. Therefore either task differences or species could explain the opposite findings. Here we provide a direct comparison of behavioral data between species and show that these differences persist – collinear flankers improve performance in humans, and impair performance in rats – in spite of controls that match stimuli, experimental paradigm, and learning procedure. There is evidence that the contrasts of the target and the flankers could affect whether surround processing is suppressive or facilitatory. In a second experiment, we explored a range of contrast conditions in the rat, to determine if contrast could explain the lack of collinear facilitation. Using different pairs of target and flanker contrast, the rat’s collinear impairment was confirmed to be robust across a range of contrast conditions. We conclude that processing of collinear features is indeed different between rats and humans. We speculate that the observed difference between rat and human is caused by the combined impact of differences in the statistics in natural retinal images, the representational capacity of neurons in visual cortex, and attention.

Neural substrates of perceptual integration during bistable object perception

The way we perceive an object depends both on feedforward, bottom-up processing of its physical stimulus properties and on top-down factors such as attention, context, expectation, and task relevance. Here we compared neural activity elicited by varying perceptions of the same physical image--a bistable moving image in which perception spontaneously alternates between dissociated fragments and a single, unified object. A time-frequency analysis of EEG changes associated with the perceptual switch from object to fragment and vice versa revealed a greater decrease in alpha (8-12 Hz) accompanying the switch to object percept than to fragment percept. Recordings of event-related potentials elicited by irrelevant probes superimposed on the moving image revealed an enhanced positivity between 184 and 212 ms when the probes were contained within the boundaries of the perceived unitary object. The topography of the positivity (P2) in this latency range elicited by probes during object perception was distinct from the topography elicited by probes during fragment perception, suggesting that the neural processing of probes differed as a function of perceptual state. Two source localization algorithms estimated the neural generator of this object-related difference to lie in the lateral occipital cortex, a region long associated with object perception. These data suggest that perceived objects attract attention, incorporate visual elements occurring within their boundaries into unified object representations, and enhance the visual processing of elements occurring within their boundaries. Importantly, the perceived object in this case emerged as a function of the fluctuating perceptual state of the viewer.

Common mechanisms of human perceptual and motor learning

The adult mammalian brain has a remarkable capacity to learn in both the perceptual and motor domains through the formation and consolidation of memories. Such practice-enabled procedural learning results in perceptual and motor skill improvements. Here, we examine evidence supporting the notion that perceptual and motor learning in humans exhibit analogous properties, including similarities in temporal dynamics and the interactions between primary cortical and higher-order brain areas. These similarities may point to the existence of a common general mechanism for learning in humans.

Is interpolation cognitively encapsulated? Measuring the effects of belief on Kanizsa shape discrimination and illusory contour formation

Contour interpolation is a perceptual process that fills-in missing edges on the basis of how surrounding edges (inducers) are spatiotemporally related. Cognitive encapsulation refers to the degree to which perceptual mechanisms act in isolation from beliefs, expectations, and utilities (Pylyshyn, 1999). Is interpolation encapsulated from belief? We addressed this question by having subjects discriminate briefly-presented, partially-visible fat and thin shapes, the edges of which either induced or did not induce illusory contours (relatable and non-relatable conditions, respectively). Half the trials in each condition incorporated task-irrelevant distractor lines, known to disrupt the filling-in of contours. Half of the observers were told that the visible parts of the shape belonged to a single thing (group strategy); the other half were told that the visible parts were disconnected (ungroup strategy). It was found that distractor lines strongly impaired performance in the relatable condition, but minimally in the non-relatable condition; that strategy did not alter the effects of the distractor lines for either the relatable or non-relatable stimuli; and that cognitively grouping relatable fragments improved performance whereas cognitively grouping non-relatable fragments did not. These results suggest that (1) filling-in effects during illusory contour formation cannot be easily removed via strategy; (2) filling-in effects cannot be easily manufactured from stimuli that fail to elicit interpolation; and (3) actively grouping fragments can readily improve discrimination performance, but only when those fragments form interpolated contours. Taken together, these findings indicate that discriminating filled-in shapes depends on strategy but the filling-in process itself may be encapsulated from belief.

Attentional signatures of perception: multiple object tracking reveals the automaticity of contour interpolation

Multiple object tracking (MOT) is an attentional task wherein observers attempt to track multiple targets among moving distractors. Contour interpolation is a perceptual process that fills-in nonvisible edges on the basis of how surrounding edges (inducers) are spatiotemporally related. In five experiments, we explored the automaticity of interpolation through its influences on tracking. We found that (1) when the edges of targets and distractors jointly formed dynamic illusory or occluded contours, tracking accuracy worsened; (2) when interpolation bound all four targets together, performance improved; (3) when interpolation strength was weakened (by altering the size or relative orientation of inducing edges), tracking effects disappeared; and (4) real and interpolated contours influenced tracking comparably, except that real contours could more effectively shift attention toward distractors. These results suggest that interpolation's characteristics-and, in particular, its automaticity-can be revealed through its attentional influences or "signatures" within tracking. Our results also imply that relatively detailed object representations are formed in parallel, and that such representations can affect tracking when they become relevant to scene segmentation.

Atypical lateral connectivity: a neural basis for altered visuospatial processing in autism

BACKGROUND

Autistic perception encompasses both inferior and superior performance on different types of visuospatial tasks. Influential neurocognitive models relevant to atypical perception (i.e., weak central coherence, enhanced perceptual functioning) can, to differing degrees, account for these findings. However, the neural underpinnings mediating atypical visuospatial autistic perception have yet to be elucidated.

METHODS

In the present study, we used a lateral masking paradigm to assess the functional integrity of lateral interactions mediating visuospatial information processing within early visual areas of autistic (n = 18) and nonautistic (n = 15) observers. Detection thresholds were measured for centrally presented Gabor targets flanked collinearly at different distances (experiment 1) and flanked orthogonally at different contrasts (experiment 2).

RESULTS

Autistic and nonautistic groups showed increased target sensitivity when the distance between collinear targets and flankers was small (3 lambda) but not large (6 lambda). However, the effect of small-distance facilitation was significantly greater for the autistic group. In addition, we observed a group-specific effect of contrast: in the autistic group, target sensitivity was enhanced by low flanker contrasts of both 5% and 10% luminance difference, whereas for the nonautistic group, this effect occurred at 10% contrast only.

CONCLUSIONS

These findings support the idea that atypical visuospatial perception in autism may originate from altered lateral connectivity within primary visual areas, differentially affecting perception at the earliest levels of feature extraction.

Learning to be fast: gain accuracy with speed

Our recent neurophysiological findings provided evidence for collinear facilitation in detecting low-contrast Gabor patches (GPs) and for the abolishment of these collinear interactions by backward masking (BM) (Sterkin et al., 2008; Sterkin, Yehezkel, Bonneh, et al., 2009). We suggested that the suppression induced by the BM eliminates the collinear facilitation. Moreover, our recent study showed that training on a BM task overcomes the BM effect, hence, improves the processing speed (Polat, 2009). Here we applied training on detecting a target that is followed by BM in order to study whether reinforced facilitatory interactions can overcome the suppressive effects induced by BM. Event-Related Potentials (ERPs) were recorded before and after ten training sessions performed on different days. Low-contrast, foveal target GP was simultaneously flanked by two collinear high-contrast GPs. In the BM task, another identical mask was presented at different time-intervals (ISIs). Before training, BM induced suppression of target detection, at the ISI of 50 ms, in agreement with earlier behavioral findings. This ISI coincides with the active time-window of lateral interactions. After training, our results show a remarkable improvement in all behavioral measurements, including percent of correct responses, sensitivity (d'), reaction time (RT) and the decision criterion for this ISI. The ERP results show that before training,BM attenuated the physiological markers of facilitation at the same ISI of 50 ms, measured as the amplitude of the negative N1 peak (latency of 260 ms). After the training, the sensory representation, reflected by P1 peak, has not changed, consistent with the unchanged physical parameters of the stimulus. Instead, the shorter latency (by 20 ms, latency of 240 ms) and the increased amplitude of N1 represent the development of faster and stronger facilitatory lateral interactions between the target and the collinear flankers. Thus, previously effective backward masking became ineffective in disrupting the collinear facilitation. Moreover, a high-amplitude late peak (P4, latency of 610-630 ms) was not affected by training, however its high correlation with RT (95%) before training was significantly decreased (to 76%), consistent with a lower-level representation of a trained skill. We suggest that perceptual learning that strengthens collinear facilitation results in a faster processing speed.

Automatic spread of attentional response modulation along Gestalt criteria in primary visual cortex

Visual attention can select spatial locations, features and objects. Theories of object-based attention claim that attention enhances the representation of all parts of an object, even parts that are not task relevant. We recorded neuronal activity in area V1 of macaque monkeys and observed an automatic spread of attention to image elements outside of the attentional focus when they were bound to an attended stimulus by Gestalt criteria.

Defining the units of competition: influences of perceptual organization on competitive interactions in human visual cortex

Multiple stimuli that are present simultaneously in the visual field compete for neural representation. At the same time, however, multiple stimuli in cluttered scenes also undergo perceptual organization according to certain rules originally defined by the Gestalt psychologists such as similarity or proximity, thereby segmenting scenes into candidate objects. How can these two seemingly orthogonal neural processes that occur early in the visual processing stream be reconciled? One possibility is that competition occurs among perceptual groups rather than at the level of elements within a group. We probed this idea using fMRI by assessing competitive interactions across visual cortex in displays containing varying degrees of perceptual organization or perceptual grouping (Grp). In strong Grp displays, elements were arranged such that either an illusory figure or a group of collinear elements were present, whereas in weak Grp displays the same elements were arranged randomly. Competitive interactions among stimuli were overcome throughout early visual cortex and V4, when elements were grouped regardless of Grp type. Our findings suggest that context-dependent grouping mechanisms and competitive interactions are linked to provide a bottom-up bias toward candidate objects in cluttered scenes.

Suppressive lateral interactions at parafoveal representations in primary visual cortex

The perceptual salience and visibility of image elements is influenced by other elements in their vicinity. The perceptual effect of image elements on an adjacent target element depends on their relative orientation. Collinear flanking elements usually improve sensitivity for the target element, whereas orthogonal elements have a weaker effect. It is believed that the collinear flankers exert these effects through lateral interactions between neurons in the primary visual cortex (area V1), but the precise mechanisms underlying these contextual interactions remain unknown. Here, we directly examined this question by recording the effects of flankers on the responses of V1 neurons at parafoveal representations while monkeys performed a fixation task or a contrast detection task. We found, unexpectedly, that collinear flankers reduce the monkeys' perceptual sensitivity for a central target element. This behavioral effect was explained by a flanker-induced increase in the activity of V1 neurons in the absence of the central target stimulus, which reduced the amplitude of the target response. Our results indicate that the dominant effect of collinear flankers in parafoveal vision is suppression and suggest that these suppressive effects are caused by a decrease in the dynamic range of neurons coding the central target.

The influence of orientation and contrast flicker on contour saliency of outlines of everyday objects

One of the most important tasks of the visual system is the extraction of edges and object contours, and the integration of discrete elements to form a coherent global percept. A great deal is known about the spatial properties of contour extraction, but less is known about the dynamics and spatio-temporal aspects. We used Gabor-rendered outlines of real-world objects, where we could manipulate low-level properties, such as element orientation and phase, while incorporating higher-level properties, such as object complexity and identity, to study dynamic relationships in object detection. First we manipulated the time available for integration by changing back and forth between coherent and non-coherent orientations of the contour elements. We then manipulated contrast flicker by reversing the spatial phase of the Gabor elements at various frequencies. We found similar results to earlier studies on contour detection: detection was better for contrast flicker than for orientation flicker, and detection performance was curvature-dependent for orientation flicker but not for contrast flicker. Our results support the existence of at least two temporal frequency channels in the visual system, one low-pass and one band-pass peaking around 10-12 Hz. In addition, we found that object properties, such as identity and complexity, affected detection performance.

Similarity Grouping and Repetition Blindness are Both Influenced by Attention

Previous studies have reported seemingly conflicting results regarding how the amount of stimulus similarity between two simultaneously presented target stimuli impacts perceptual performance. There are many reports of 'repetition blindness', where individuals do worse when shown two similar stimuli relative to two different stimuli. On the other hand, there are reports of 'similarity grouping', where participants perform better when identifying two similar objects relative to two different objects. This manuscript posits that repetition blindness and similarity grouping coexist and can be elicited in the same subjects in a single task. This not only explains the previous opposite effects of stimulus similarity on task performance, but also provides a unique opportunity to directly compare these opposite effects of stimulus similarity with respect to susceptibility to a modulating factor. Since previous studies have provided inconclusive results on whether attentional relevance can modulate the effect of stimulus similarity on task performance, the current manuscript aims to compare repetition blindness and similarity grouping with respect to their susceptibility to attentional relevance. The results of the first experiment confirmed that both repetition blindness and similarity grouping can be elicited in the same experiment, suggesting that repetition blindness and similarity grouping coexist. The results of the second experiment suggest that both repetition blindness and similarity grouping can be modulated by attentional relevance. These results support the explanation of repetition blindness as a token individuation failure. Furthermore, these results suggest that supposedly pre-attentional grouping mechanisms might not operate as independently from top-down attentional modulations as traditionally thought.

Hemodynamic change in occipital lobe during visual search: visual attention allocation measured with NIRS

We examined the changes in regional cerebral blood volume (rCBV) around visual cortex using Near Infrared Spectroscopy (NIRS) when observers attended to visual scenes. The oxygenated and deoxygenated hemoglobin (Oxy-Hb and Deoxy-Hb) concentration changes at occipital lobe were monitored during a dual task. Observers were asked to name a digit superimposed on a scenery picture, while in parallel, they had to detect an on-and-off flickering object in a Change Blindness paradigm. Results showed the typical activation patterns in and around the visual cortex with increases in Oxy-Hb and decreases in Deoxy-Hb. The Oxy-Hb increase doubled when observers could not find the target, as opposed to trials in which they could. The results strongly suggest that active attention to a visual scene enhances Oxy-Hb change much stronger than passive watching, and that attention and Oxy-Hb increases are possibly correlated.