Feature-based attention in early vision for the modulation of figure-ground segregation

Influences of local and global context on local orientation perception

Visual context modulates perception of local orientation attributes. These spatially very localised effects are considered to correspond to specific excitatory-inhibitory connectivity patterns of early visual areas as V1, creating perceptual tilt repulsion and attraction effects. Here, orientation misperception of small Gabor stimuli was used as a probe of this computational structure by sampling a large spatio-orientation space to reveal expected asymmetries due to the underlying neuronal processing. Surprisingly, the results showed a regular iso-orientation pattern of nearby location effects whose reference point was globally modulated by the spatial structure, without any complex interactions between local positions and orientation. This pattern of results was confirmed by the two perceptual parameters of bias and discrimination ability. Furthermore, the response times to stimulus configuration displayed variations that further provided evidence of how multiple early visual stages affect perception of simple stimuli.

Disinhibitory circuit mediated by connections from vasoactive intestinal polypeptide to somatostatin interneurons underlies the paradoxical decrease in spike synchrony with increased border ownership selective neuron firing rate

The activity of border ownership selective (BOS) neurons in intermediate-level visual areas indicates which side of a contour owns a border relative to its classical receptive field and provides a fundamental component of figure-ground segregation. A physiological study reported that selective attention facilitates the activity of BOS neurons with a consistent border ownership preference, defined as two neurons tuned to respond to the same visual object. However, spike synchrony between this pair is significantly suppressed by selective attention. These neurophysiological findings are derived from a biologically-plausible microcircuit model consisting of spiking neurons including two subtypes of inhibitory interneurons, somatostatin (SOM) and vasoactive intestinal polypeptide (VIP) interneurons, and excitatory BOS model neurons. In our proposed model, BOS neurons and SOM interneurons cooperate and interact with each other. VIP interneurons not only suppress SOM interneuron responses but also are activated by feedback signals mediating selective attention, which leads to disinhibition of BOS neurons when they are directing selective attention toward an object. Our results suggest that disinhibition arising from the synaptic connections from VIP to SOM interneurons plays a critical role in attentional modulation of neurons in intermediate-level visual areas.

Vergence eye movements during figure-ground perception

Figure-ground, that is the segmentation of visual information into objects and their surrounding backgrounds, provides structure for visual attention. Recent evidence shows a novel role of vergence eye movements in visual attention. In the present work, vergence responses during figure-ground segregation tasks are psychophysically investigated. We show that during a figure-ground detection task, subjects convergence their eyes. Vergence eye movements are larger in figure trials than in ground trials. In detected figures trials, vergence are stronger than in trials where the figure went unnoticed. Moreover in figure trials, vergence responses are stronger to low-contrast figures than to high-contrast figures. We argue that these discriminative vergence responses have a role in figure-ground.

Interactions Elicited by the Contradiction Between Figure Direction Discrimination and Figure-Ground Segregation

Figure-ground (FG) segregation that separates an object from the rest of the image is a fundamental problem in vision science. A majority of neurons in monkey V2 showed the selectivity to border ownership (BO) that indicates which side of a contour owns the border. Although BO could be a precursor of FG segregation, the contribution of BO to FG segregation has not been clarified. Because FG segregation is the perception of the global region that belongs to an object, whereas BO determination provides the local direction of figure (DOF) along a contour, a spatial integration of BO might be expected for the generation of FG. To understand the mechanisms underlying the perception of figural regions, we investigated the interaction between the local BO determination and the global FG segregation through the quantitative analysis of the visual perception and the spatiotemporal characteristics of eye movements. We generated a set of novel stimuli in which translucency induces local DOF along the contour and global FG independently so that DOF and FG could be either consistent or contradictory. The perceptual responses showed better performance in DOF discrimination than FG segregation, supporting distinct mechanisms for the DOF discrimination and the FG segregation. We examined whether the contradiction between DOF and FG modulates the eye movement while participants judged DOF and FG. The duration of the first eye fixation was modulated by the contradiction during FG segregation but not DOF discrimination, suggesting a sequential processing from the BO determination to the FG segregation. These results of human perception and eye fixation provide important clues for understanding the visual processing for FG segregation.

Modeling the Time-Course of Responses for the Border Ownership Selectivity Based on the Integration of Feedforward Signals and Visual Cortical Interactions

Border ownership (BO) indicates which side of a contour owns a border, and it plays a fundamental role in figure-ground segregation. The majority of neurons in V2 and V4 areas of monkeys exhibit BO selectivity. A physiological work reported that the responses of BO-selective cells show a rapid transition when a presented square is flipped along its classical receptive field (CRF) so that the opposite BO is presented, whereas the transition is significantly slower when a square with a clear BO is replaced by an ambiguous edge, e.g., when the square is enlarged greatly. The rapid transition seemed to reflect the influence of feedforward processing on BO selectivity. Herein, we investigated the role of feedforward signals and cortical interactions for time-courses in BO-selective cells by modeling a visual cortical network comprising V1, V2, and posterior parietal (PP) modules. In our computational model, the recurrent pathways among these modules gradually established the visual progress and the BO assignments. Feedforward inputs mainly determined the activities of these modules. Surrounding suppression/facilitation of early-level areas modulates the activities of V2 cells to provide BO signals. Weak feedback signals from the PP module enhanced the contrast gain extracted in V1, which underlies the attentional modulation of BO signals. Model simulations exhibited time-courses depending on the BO ambiguity, which were caused by the integration delay of V1 and V2 cells and the local inhibition therein given the difference in input stimulus. However, our model did not fully explain the characteristics of crucially slow transition: the responses of BO-selective physiological cells indicated the persistent activation several times longer than that of our model after the replacement with the ambiguous edge. Furthermore, the time-course of BO-selective model cells replicated the attentional modulation of response time in human psychophysical experiments. These attentional modulations for time-courses were induced by selective enhancement of early-level features due to interactions between V1 and PP. Our proposed model suggests fundamental roles of surrounding suppression/facilitation based on feedforward inputs as well as the interactions between early and parietal visual areas with respect to the ambiguity dependence of the neural dynamics in intermediate-level vision.

Neural network model develops border ownership representation through visually guided learning

As Rubin's famous vase demonstrates, our visual perception tends to assign luminance contrast borders to one or other of the adjacent image regions. Experimental evidence for the neuronal coding of such border-ownership in the primate visual system has been reported in neurophysiology. We have investigated exactly how such neural circuits may develop through visually-guided learning. More specifically, we have investigated through computer simulation how top-down connections may play a fundamental role in the development of border ownership representations in the early cortical visual layers V1/V2. Our model consists of a hierarchy of competitive neuronal layers, with both bottom-up and top-down synaptic connections between successive layers, and the synaptic connections are self-organised by a biologically plausible, temporal trace learning rule during training on differently shaped visual objects. The simulations reported in this paper have demonstrated that top-down connections may help to guide competitive learning in lower layers, thus driving the formation of lower level (border ownership) visual representations in V1/V2 that are modulated by higher level (object boundary element) representations in V4. Lastly we investigate the limitations of our model in the more general situation where multiple objects are presented to the network simultaneously.

Spike synchrony generated by modulatory common input through NMDA-type synapses

Common excitatory input to neurons increases their firing rates and the strength of the spike correlation (synchrony) between them. Little is known, however, about the synchronizing effects of modulatory common input. Here, we show that modulatory common input with the slow synaptic kinetics of N-methyl-d-aspartate (NMDA) receptors enhances firing rates and also produces synchrony. Tight synchrony (correlations on the order of milliseconds) always increases with modulatory strength. Unexpectedly, the relationship between strength of modulation and strength of loose synchrony (tens of milliseconds) is not monotonic: The strongest loose synchrony is obtained for intermediate modulatory amplitudes. This finding explains recent neurophysiological results showing that in cortical areas V1 and V2, presumed modulatory top-down input due to contour grouping increases (loose and tight) synchrony but that additional modulatory input due to top-down attention does not change tight synchrony and actually decreases loose synchrony. These neurophysiological findings are understood from our model of integrate-and-fire neurons under the assumption that contour grouping as well as attention lead to additive modulatory common input through NMDA-type synapses. In contrast, circuits with common projections through model α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid receptors did not exhibit the paradoxical decrease of synchrony with increased input. Our results suggest that NMDA receptors play a critical role in top-down response modulation in the visual cortex.

Spatial and feature-based attention in a layered cortical microcircuit model

Directing attention to the spatial location or the distinguishing feature of a visual object modulates neuronal responses in the visual cortex and the stimulus discriminability of subjects. However, the spatial and feature-based modes of attention differently influence visual processing by changing the tuning properties of neurons. Intriguingly, neurons' tuning curves are modulated similarly across different visual areas under both these modes of attention. Here, we explored the mechanism underlying the effects of these two modes of visual attention on the orientation selectivity of visual cortical neurons. To do this, we developed a layered microcircuit model. This model describes multiple orientation-specific microcircuits sharing their receptive fields and consisting of layers 2/3, 4, 5, and 6. These microcircuits represent a functional grouping of cortical neurons and mutually interact via lateral inhibition and excitatory connections between groups with similar selectivity. The individual microcircuits receive bottom-up visual stimuli and top-down attention in different layers. A crucial assumption of the model is that feature-based attention activates orientation-specific microcircuits for the relevant feature selectively, whereas spatial attention activates all microcircuits homogeneously, irrespective of their orientation selectivity. Consequently, our model simultaneously accounts for the multiplicative scaling of neuronal responses in spatial attention and the additive modulations of orientation tuning curves in feature-based attention, which have been observed widely in various visual cortical areas. Simulations of the model predict contrasting differences between excitatory and inhibitory neurons in the two modes of attentional modulations. Furthermore, the model replicates the modulation of the psychophysical discriminability of visual stimuli in the presence of external noise. Our layered model with a biologically suggested laminar structure describes the basic circuit mechanism underlying the attention-mode specific modulations of neuronal responses and visual perception.