Real and illusory contour processing in area V1 of the primate: a cortical balancing act

Dependence of Contextual Modulation in Macaque V1 on Interlaminar Signal Flow

In visual cortex, neural correlates of subjective perception can be generated by modulation of activity from beyond the classical receptive field (CRF). In macaque V1, activity generated by nonclassical receptive field (nCRF) stimulation involves different intracortical circuitry than activity generated by CRF stimulation, suggesting that interactions between neurons across V1 layers differ under CRF and nCRF stimulus conditions. We measured border ownership modulation within large populations of V1 neurons. We found that neurons in single columns preferred the same side of objects located outside of the CRF. In addition, we found that interactions between pairs of neurons situated across feedback/horizontal and input layers differed between CRF and nCRF stimulation. Furthermore, the magnitude of border ownership modulation was predicted by greater information flow from feedback/horizontal to input layers. These results demonstrate that the flow of signals between layers covaries with the degree to which neurons integrate information from beyond the CRF.

Perception of illusory contours in children and adults: An eye-tracking study

The eye-tracking study investigated the perception of subjective Kanizsa and Ehrenstein figures in adults and in children aged 3-4, 5-6, 7-8, and 9-11 years of age. More specifically, the distribution of looking at the inner stimulus part versus the inducing elements was measured for illusory figures, figures with real contours, and control displays. It was hypothesized that longer looking at the inner area of the illusory figures indicates global contour interpolation, whereas longer looking at the inducing elements indicates a local processing mode. According to the results, participants of all ages looked longer at the illusory Kanizsa and Ehrenstein contours than at the figures' inducing elements. However, performance was lowest in the children aged 3-4 years and increased during the preschool period. Moreover, the illusory contour displays elicited comparable visual responses as did the real contour displays. The use of the control displays that contained no contour information ensured that the participants' looking behavior was not driven by a spontaneous tendency to attend to the inner stimulus parts. The study confirms the view that sensitivity to illusory contours emerges very early in life.

Reconstructing visual illusory experiences from human brain activity

Visual illusions provide valuable insights into the brain's interpretation of the world given sensory inputs. However, the precise manner in which brain activity translates into illusory experiences remains largely unknown. Here, we leverage a brain decoding technique combined with deep neural network (DNN) representations to reconstruct illusory percepts as images from brain activity. The reconstruction model was trained on natural images to establish a link between brain activity and perceptual features and then tested on two types of illusions: illusory lines and neon color spreading. Reconstructions revealed lines and colors consistent with illusory experiences, which varied across the source visual cortical areas. This framework offers a way to materialize subjective experiences, shedding light on the brain's internal representations of the world.

Severely Attenuated Visual Feedback Processing in Children on the Autism Spectrum

Individuals on the autism spectrum often exhibit atypicality in their sensory perception, but the neural underpinnings of these perceptual differences remain incompletely understood. One proposed mechanism is an imbalance in higher-order feedback re-entrant inputs to early sensory cortices during sensory perception, leading to increased propensity to focus on local object features over global context. We explored this theory by measuring visual evoked potentials during contour integration as considerable work has revealed that these processes are largely driven by feedback inputs from higher-order ventral visual stream regions. We tested the hypothesis that autistic individuals would have attenuated evoked responses to illusory contours compared with neurotypical controls. Electrophysiology was acquired while 29 autistic and 31 neurotypical children (7-17 years old, inclusive of both males and females) passively viewed a random series of Kanizsa figure stimuli, each consisting of four inducers that were aligned either at random rotational angles or such that contour integration would form an illusory square. Autistic children demonstrated attenuated automatic contour integration over lateral occipital regions relative to neurotypical controls. The data are discussed in terms of the role of predictive feedback processes on perception of global stimulus features and the notion that weakened "priors" may play a role in the visual processing anomalies seen in autism.SIGNIFICANCE STATEMENT Children on the autism spectrum differ from typically developing children in many aspects of their processing of sensory stimuli. One proposed mechanism for these differences is an imbalance in higher-order feedback to primary sensory regions, leading to an increased focus on local object features rather than global context. However, systematic investigation of these feedback mechanisms remains limited. Using EEG and a visual illusion paradigm that is highly dependent on intact feedback processing, we demonstrated significant disruptions to visual feedback processing in children with autism. This provides much needed experimental evidence that advances our understanding of the contribution of feedback processing to visual perception in autism spectrum disorder.

Challenging deep learning models with image distortion based on the abutting grating illusion

Even state-of-the-art deep learning models lack fundamental abilities compared with humans. While many image distortions have been proposed to compare deep learning with humans, they depend on mathematical transformations instead of human cognitive functions. Here, we propose an image distortion based on the abutting grating illusion, which is a phenomenon discovered in humans and animals. The distortion generates illusory contour perception using line gratings abutting each other. We applied the method to MNIST, high-resolution MNIST, and "16-class-ImageNet" silhouettes. Many models, including models trained from scratch and 109 models pretrained with ImageNet or various data augmentation techniques, were tested. Our results show that abutting grating distortion is challenging even for state-of-the-art deep learning models. We discovered that DeepAugment models outperformed other pretrained models. Visualization of early layers indicates that better-performing models exhibit the endstopping property, which is consistent with neuroscience discoveries. Twenty-four human subjects classified distorted samples to validate the distortion.

Spatial frequency representation in V2 and V4 of macaque monkey

Spatial frequency (SF) is an important attribute in the visual scene and is a defining feature of visual processing channels. However, there remain many unsolved questions about how extrastriate areas in primate visual cortex code this fundamental information. Here, using intrinsic signal optical imaging in visual areas of V2 and V4 of macaque monkeys, we quantify the relationship between SF maps and (1) visual topography and (2) color and orientation maps. We find that in orientation regions, low to high SF is mapped orthogonally to orientation; in color regions, which are reported to contain orthogonal axes of color and lightness, low SFs tend to be represented more frequently than high SFs. This supports a population-based SF fluctuation related to the 'color/orientation' organizations. We propose a generalized hypercolumn model across cortical areas, comprised of two orthogonal parameters with additional parameters.

Functionally specific and sparse domain-based micro-networks in monkey V1 and V2

The cerebral cortices of human and nonhuman primate brains are characterized by submillimeter functional domains. However, little is known about the connections of single functional domains. Here, in macaque monkey visual cortex, we have developed a targeted focal electrical stimulation method, coupled with functional optical imaging, to map cortical networks with submillimeter precision in vivo. We find that single functional domains are a part of highly specific and sparse intra-areal and inter-areal micro-networks. Across color-related and orientation-related functionalities, these micro-networks exhibit parallel connection patterns, suggesting a common domain-based architecture. Moreover, these micro-networks shift topographically at a submillimeter scale, suggesting that they serve as a fundamental unit for cortical information processing. Our findings establish a domain-based connectional architecture in the primate brain and present new constraints for cortical map representation.

Dogs (Canis lupus familiaris) are susceptible to the Kanizsa's triangle illusion

The ability to complete partially missing contours is widespread across the animal kingdom, but whether this extends to dogs is still unknown. To address this gap in knowledge, we assessed dogs' susceptibility to one of the most common contour illusions, the Kanizsa's triangle. Six dogs were trained to discriminate a triangle from other geometrical figures using a two-alternative conditioned discrimination task. Once the learning criterion was reached, dogs were presented with the Kanizsa's triangle and a control stimulus, where inducers were rotated around their centre, so as to disrupt what would be perceived as a triangle by a human observer. As a group, dogs chose the illusory triangle significantly more often than control stimuli. At the individual level, susceptibility to the illusion was shown by five out of six dogs. This is the first study where dogs as a group show susceptibility to a visual illusion in the same manner as humans. Moreover, the analyses revealed a negative effect of age on susceptibility, an effect that was also found in humans. Altogether, this suggests that the underling perceptual mechanisms are similar between dogs and humans, and in sharp contrast with other categories of visual illusions to which the susceptibility of dogs has been previously assessed.

Interference of Illusory Contour Perception by a Distractor

The visual system is capable of recognizing objects when object information is widely separated in space, as revealed by the Kanizsa-type illusory contours (ICs). Attentional involvement in perception of ICs is an important topic, and the present study examined whether and how the processing of ICs is interfered with by a distractor. Discrimination between thin and short deformations of an illusory circle was investigated in the absence or presence of a central dynamic patch, with difficulty of discrimination varied in three levels (easy, medium, and hard). Reaction time (RT) was significantly shorter in the absence compared to the presence of the distractor in the easy and medium conditions. Correct rate (CR) was significantly higher in the absence compared to the presence of the distractor in the easy condition, and the magnitude of the difference between CRs of distracted and non-distracted responses significantly reduced as task difficulty increased. These results suggested that perception of ICs is more likely to be vulnerable to distraction when more attentional resources remain available. The present finding supports that attention is engaged in perception of ICs and that distraction of IC processing is associated with perceptual load.

Abrupt darkening under high dynamic range (HDR) luminance invokes facilitation for high-contrast targets and grouping by luminance similarity

When scanning across a scene, luminance can vary by up to 100,000-to-1 (high dynamic range, HDR), requiring multiple normalizing mechanisms spanning from the retina to the cortex to support visual acuity and recognition. Vision models based on standard dynamic range (SDR) luminance contrast ratios below 100-to-1 have limited ability to generalize to real-world scenes with HDR luminance. To characterize how orientation and luminance are linked in brain mechanisms for luminance normalization, we measured orientation discrimination of Gabor targets under HDR luminance dynamics. We report a novel phenomenon, that abrupt 10- to 100-fold darkening engages contextual facilitation, distorting the apparent orientation of a high-contrast central target. Surprisingly, facilitation was influenced by grouping by luminance similarity, as well as by the degree of luminance variability in the surround. These results challenge vision models based solely on activity normalization and raise new questions that will lead to models that perform better in real-world scenes.

The Serpentine Illusion: A Visual Motion Illusion Induced by Phase-Shifted Line Gratings

In a pattern of horizontal lines containing ± 45° zigzagging phase-shifted strips, vivid illusory motion is perceived when the pattern is translated up or down at a moderate speed. Two forms of illusory motion are seen: [i] a motion "racing" along the diagonal interface between the strips and [ii] lateral (sideways) motion of the strip sections. We found the relative salience of these two illusory motions to be strongly influenced by the vertical spacing and length of the line gratings, and the period length of the zigzag strips. Both illusory motions are abolished when the abutting strips are interleaved, separated by a gap or when a real line is superimposed at the interface. Illusory motion is also severely weakened when equiluminant colored grating lines are used. Illusory motion perception is fully restored at < 20% luminance contrast. Using adaptation, we find that line-ends alone are insufficient for illusory motion perception, and that both physical carrier motion and line orientation are required. We finally test a classical spatiotemporal energy model of V1 cells that exhibit direction tuning changes that are consistent with the direction of illusory motion. Taking this data together, we constructed a new visual illusion and surmise its origin to interactions of spatial and temporal energy of the lines and line-ends preferentially driving the magnocellular pathway.

Curvature domains in V4 of macaque monkey

An important aspect of visual object recognition is the ability to perceive object shape. Two basic components of complex shapes are straight and curved contours. A large body of evidence suggests a modular hierarchy for shape representation progressing from simple and complex orientation in early areas V1 and V2, to increasingly complex stages of curvature representation in V4, TEO, and TE. Here, we reinforce and extend the concept of modular representation. Using intrinsic signal optical imaging in Macaque area V4, we find sub-millimeter sized modules for curvature representation that are organized from low to high curvatures as well as domains with complex curvature preference. We propose a possible ‘curvature hypercolumn’ within V4. In combination with previous studies, we suggest that the key emergent functions at each stage of cortical processing are represented in systematic, modular maps.

Functional ultrasound imaging of deep visual cortex in awake nonhuman primates

Nowadays, several techniques exist to study and better understand how the brain works (fMRI, EEG, electrophysiology, etc.). Each has its own advantages and disadvantages (spatiotemporal resolution, maximal recording depth, signal-to-noise ratio, etc.). In this article, we show that the new functional ultrasound (fUS) imaging technique is appropriate to record and map brain activity in awake primates on a scale previously unreachable. It allows distinguishing patterns similar to ocular dominance bands in the visual cortex through all layers of the cortex, which was impossible before with common techniques. This paper demonstrates the utility of fUS imaging for studying brain activity in awake primates and its interest to all neuroscientists.

Deep regions of the brain are not easily accessible to investigation at the mesoscale level in awake animals or humans. We have recently developed a functional ultrasound (fUS) technique that enables imaging hemodynamic responses to visual tasks. Using fUS imaging on two awake nonhuman primates performing a passive fixation task, we constructed retinotopic maps at depth in the visual cortex (V1, V2, and V3) in the calcarine and lunate sulci. The maps could be acquired in a single-hour session with relatively few presentations of the stimuli. The spatial resolution of the technology is illustrated by mapping patterns similar to ocular dominance (OD) columns within superficial and deep layers of the primary visual cortex. These acquisitions using fUS suggested that OD selectivity is mostly present in layer IV but with extensions into layers II/III and V. This imaging technology provides a new mesoscale approach to the mapping of brain activity at high spatiotemporal resolution in awake subjects within the whole depth of the cortex.

The persistent problem of targetless thought

Targetless thought raises a persistent problem for higher-order theories of consciousness. In cases of targetless thought, a subject represents herself as being in a mental state that she in fact lacks. One popular response among proponents of the higher-order theory is to say that it can appear to a subject that she is in a conscious mental state, even though that mental state doesn't exist (Picciuto, 2017; Rosenthal 1997, 2011; Weisberg, 2010). Recently Brown and Lau (2019) and Lau and Rosenthal (2011) have shifted the debate to empirical ground, and offered evidence for real-world cases of targetless thought. In this paper, I give an alternate explanation of the evidence which avoids the need to posit targetless thoughts. As I argue, this challenges the empirical argument for the higher-order view because it shows that the evidence on offer does not discriminate between the first-order and higher-order theories of consciousness.

TMS reveals inhibitory extrastriate cortico-cortical feedback modulation of V1 activity in humans

The interaction between the primary visual cortex (V1) and extrastriate visual areas provides the first building blocks in our perception of the world. V2, in particular, seems to play a crucial role in shaping contextual modulation information through feedback projections to V1. However, whether this feedback is inhibitory or excitatory is still unclear. In order to test the nature of V2 feedback to V1, we used neuronavigation-guided offline inhibitory transcranial magnetic stimulation (TMS) on V2 before testing participants on collinear facilitation, a contrast detection task with lateral masking. This contextual modulation task is thought to rely on horizontal connections in V1 and possibly extrastriate feedback. Results showed that when inhibitory TMS was delivered over V2, contrast thresholds decreased for targets presented in the contralateral hemifield, consistent with the retinotopic mapping of this area, while having no effect for targets presented in the ipsilateral hemifield or after control (CZ) stimulation. These results suggest that feedback from V2 to V1 during contextual modulation is mostly inhibitory, corroborating recent observations in monkey electrophysiology and extending this mechanism to human visual system. Moreover, we provide for the first time direct evidence of the involvement of extrastriate visual areas in collinear facilitation.

Irrational contour synthesis

The mechanisms responsible for generating illusory contours are thought to fulfil an adaptive role in providing estimates of missing contour fragments generated by partial camouflage. One striking apparent counter-example to this view was described in Current Biology 21 (2011) 492-496, which showed that illusory contours could arise in motion displays depicting visible occluding discs occluding and disoccluding thin contours. These motion sequences generate illusory contours even though they play no necessary role in accounting for occlusion and disocclusion of the thin contours. The present work sought to more precisely characterize the quantitative dependence of these 'irrational' contours on the relative contrasts in the image. We show that the perceived strength of the illusory contours generated by these displays depends monotonically on the relative contrast of the occluding and occluded contours and that previous attempts to measure their strength with a method of adjustment appears to be contaminated by response bias. We further show that these illusory contours also arise when the occluding disks are rendered transparent and exhibit similar forms of contrast dependencies. These findings reveal a general methodological problem that can arise using methods of adjustment and provide quantitative data that may be used to identify the neural mechanisms responsible for IC genesis and their perceived strength.

Sounds enhance visual completion processes

Everyday vision includes the detection of stimuli, figure-ground segregation, as well as object localization and recognition. Such processes must often surmount impoverished or noisy conditions; borders are perceived despite occlusion or absent contrast gradients. These illusory contours (ICs) are an example of so-called mid-level vision, with an event-related potential (ERP) correlate at ∼100-150 ms post-stimulus onset and originating within lateral-occipital cortices (the IC_effect). Presently, visual completion processes supporting IC perception are considered exclusively visual; any influence from other sensory modalities is currently unknown. It is now well-established that multisensory processes can influence both low-level vision (e.g. detection) as well as higher-level object recognition. By contrast, it is unknown if mid-level vision exhibits multisensory benefits and, if so, through what mechanisms. We hypothesized that sounds would impact the IC_effect. We recorded 128-channel ERPs from 17 healthy, sighted participants who viewed ICs or no-contour (NC) counterparts either in the presence or absence of task-irrelevant sounds. The IC_effect was enhanced by sounds and resulted in the recruitment of a distinct configuration of active brain areas over the 70-170 ms post-stimulus period. IC-related source-level activity within the lateral occipital cortex (LOC), inferior parietal lobe (IPL), as well as primary visual cortex (V1) were enhanced by sounds. Moreover, the activity in these regions was correlated when sounds were present, but not when absent. Results from a control experiment, which employed amodal variants of the stimuli, suggested that sounds impact the perceived brightness of the IC rather than shape formation per se. We provide the first demonstration that multisensory processes augment mid-level vision and everyday visual completion processes, and that one of the mechanisms is brightness enhancement. These results have important implications for the design of treatments and/or visual aids for low-vision patients.

Spatially selective responses to Kanizsa and occlusion stimuli in human visual cortex

Early visual cortex responds to illusory contours in which abutting lines or collinear edges imply the presence of an occluding surface, as well as to occluded parts of an object. Here we used functional magnetic resonance imaging (fMRI) and population receptive field (pRF) analysis to map retinotopic responses in early visual cortex using bar stimuli defined by illusory contours, occluded parts of a bar, or subtle luminance contrast. All conditions produced retinotopic responses in early visual field maps even though signal-to-noise ratios were very low. We found that signal-to-noise ratios and coherence with independent high-contrast mapping data increased from V1 to V2 to V3. Moreover, we found no differences of signal-to-noise ratios or pRF sizes between the low-contrast luminance and illusion conditions. We propose that all three conditions mapped spatial attention to the bar location rather than activations specifically related to illusory contours or occlusion.

Activity Patterns Elicited by Airflow in the Olfactory Bulb and Their Possible Functions

Olfactory sensory neurons (OSNs) can sense both odorants and airflows. In the olfactory bulb (OB), the coding of odor information has been well studied, but the coding of mechanical stimulation is rarely investigated. Unlike odor-sensing functions of OSNs, the airflow-sensing functions of OSNs are also largely unknown. Here, the activity patterns elicited by mechanical airflow in male rat OBs were mapped using fMRI and correlated with local field potential recordings. In an attempt to reveal possible functions of airflow sensing, the relationship between airflow patterns and physiological parameters was also examined. We found the following: (1) the activity pattern in the OB evoked by airflow in the nasal cavity was more broadly distributed than patterns evoked by odors; (2) the pattern intensity increases with total airflow, while the pattern topography with total airflow remains almost unchanged; and (3) the heart rate, spontaneous respiratory rate, and electroencephalograph power in the β band decreased with regular mechanical airflow in the nasal cavity. The mapping results provide evidence that the signals elicited by mechanical airflow in OSNs are transmitted to the OB, and that the OB has the potential to code and process mechanical information. Our functional data indicate that airflow rhythm in the olfactory system can regulate the physiological and brain states, providing an explanation for the effects of breath control in meditation, yoga, and Taoism practices.SIGNIFICANCE STATEMENT Presentation of odor information in the olfactory bulb has been well studied, but studies about breathing features are rare. Here, using blood oxygen level-dependent functional MRI for the first time in such an investigation, we explored the global activity patterns in the rat olfactory bulb elicited by airflow in the nasal cavity. We found that the activity pattern elicited by airflow is broadly distributed, with increasing pattern intensity and similar topography under increasing total airflow. Further, heart rate, spontaneous respiratory rate in the lung, and electroencephalograph power in the β band decreased with regular airflow in the nasal cavity. Our study provides further understanding of the airflow map in the olfactory bulb in vivo, and evidence for the possible mechanosensitivity functions of olfactory sensory neurons.

The divisive normalization model of V1 neurons: a comprehensive comparison of physiological data and model predictions

The physiological responses of simple and complex cells in the primary visual cortex (V1) have been studied extensively and modeled at different levels. At the functional level, the divisive normalization model (DNM; Heeger DJ. Vis Neurosci 9: 181-197, 1992) has accounted for a wide range of single-cell recordings in terms of a combination of linear filtering, nonlinear rectification, and divisive normalization. We propose standardizing the formulation of the DNM and implementing it in software that takes static grayscale images as inputs and produces firing rate responses as outputs. We also review a comprehensive suite of 30 empirical phenomena and report a series of simulation experiments that qualitatively replicate dozens of key experiments with a standard parameter set consistent with physiological measurements. This systematic approach identifies novel falsifiable predictions of the DNM. We show how the model simultaneously satisfies the conflicting desiderata of flexibility and falsifiability. Our key idea is that, while adjustable parameters are needed to accommodate the diversity across neurons, they must be fixed for a given individual neuron. This requirement introduces falsifiable constraints when this single neuron is probed with multiple stimuli. We also present mathematical analyses and simulation experiments that explicate some of these constraints.

Contextual modulation revealed by optical imaging exhibits figural asymmetry in macaque V1 and V2

Neurons in early visual cortical areas are influenced by stimuli presented well beyond the confines of their classical receptive fields, endowing them with the ability to encode fine-scale features while also having access to the global context of the visual scene. This property can potentially define a role for the early visual cortex to contribute to a number of important visual functions, such as surface segmentation and figure-ground segregation. It is unknown how extraclassical response properties conform to the functional architecture of the visual cortex, given the high degree of functional specialization in areas V1 and V2. We examined the spatial relationships of contextual activations in macaque V1 and V2 with intrinsic signal optical imaging. Using figure-ground stimulus configurations defined by orientation or motion, we found that extraclassical modulation is restricted to the cortical representations of the figural component of the stimulus. These modulations were positive in sign, suggesting a relative enhancement in neuronal activity that may reflect an excitatory influence. Orientation and motion cues produced similar patterns of activation that traversed the functional subdivisions of V2. The asymmetrical nature of the enhancement demonstrated the capacity for visual cortical areas as early as V1 to contribute to figure-ground segregation, and the results suggest that this information can be extracted from the population activity constrained only by retinotopy, and not the underlying functional organization.

Responses in early visual areas to contour integration are context dependent

It has been shown that early visual areas are involved in contour processing. However, it is not clear how local and global context interact to influence responses in those areas, nor has the interarea coordination that yields coherent structural percepts been fully studied, especially in human observers. In this study, we used functional magnetic resonance imaging (fMRI) to measure activity in early visual cortex while observers performed a contour detection task in which alignment of Gabor elements and background clutter were manipulated. Six regions of interest (two regions, containing either the cortex representing the target or the background clutter, in each of areas V1, V2, and V3) were predefined using separate target versus background functional localizer scans. The first analysis using a general linear model showed that in the presence of background clutter, responses in V1 and V2 target regions of interest were significantly stronger to aligned than unaligned contours, whereas when background clutter was absent, no significant difference was observed. The second analysis using interarea correlations showed that with background clutter, there was an increase in V1–V2 coordination within the target regions when perceiving aligned versus unaligned contours; without clutter, however, correlations between V1 and V2 were similar no matter whether aligned contours were present or not. Both the average response magnitude and the connectivity analysis suggest different mechanisms support contour processing with or without background distractors. Coordination between V1 and V2 may play a major role in coherent structure perception, especially with complex scene organization.

Consistency of Border-Ownership Cells across Artificial Stimuli, Natural Stimuli, and Stimuli with Ambiguous Contours

Segmentation and recognition of objects in a visual scene are two problems that are hard to solve separately from each other. When segmenting an ambiguous scene, it is helpful to already know the present objects and their shapes. However, for recognizing an object in clutter, one would like to consider its isolated segment alone to avoid confounds from features of other objects. Border-ownership cells (Zhou et al., 2000) appear to play an important role in segmentation, as they signal the side-of-figure of artificial stimuli. The present work explores the role of border-ownership cells in dorsal macaque visual areas V2 and V3 in the segmentation of natural object stimuli and locally ambiguous stimuli. We report two major results. First, compared with previous estimates, we found a smaller percentage of cells that were consistent across artificial stimuli used previously. Second, we found that the average response of those neurons that did respond consistently to the side-of-figure of artificial stimuli also consistently signaled, as a population, the side-of-figure for borders of single faces, occluding faces and, with higher latencies, even stimuli with illusory contours, such as Mooney faces and natural faces completely missing local edge information. In contrast, the local edge or the outlines of the face alone could not always evoke a significant border-ownership signal. Our results underscore that border ownership is coded by a population of cells, and indicate that these cells integrate a variety of cues, including low-level features and global object context, to compute the segmentation of the scene.

SIGNIFICANCE STATEMENT

To distinguish different objects in a natural scene, the brain must segment the image into regions corresponding to objects. The so-called "border-ownership" cells appear to be dedicated to this task, as they signal for a given edge on which side the object is that owns it. Here, we report that individual border-ownership cells are unreliable when tested across a battery of artificial stimuli used previously but can signal border-ownership consistently as a population. We show that these border-ownership population signals are also suited for signaling border-ownership for natural objects and at longer latency, even for stimuli without local edge information. Our results suggest that border-ownership cells integrate both local, low-level and global, high-level cues to segment the scene.

Global shape integration and illusory form perception in the absence of awareness

Previous research on perceptual organization operations still provides contradictory evidence on whether the integration of sparse local elements into coherently unified shapes and the construction of the illusory form are accomplished without the need of awareness. In the present study, three experiments were conducted in which participants were presented with masked (Experiment 1, SOA=27ms; Experiment 2; SOA=53ms) and unmasked (Experiment 3) primes consisting of geometric shapes (a square or a diamond) that could be congruent or incongruent with subsequent probe stimuli (square vs. diamond). Furthermore, the primes were divided into: a grouping condition (where local elements may group together into global shapes), an illusory condition (where the arrangement of local elements produced illusory shapes) and a hybrid condition (where both operations were presented simultaneously). While no priming effects were found for the shortest SOA (27ms), both grouping and illusory primes produced significant priming effects in the longer SOA (53ms). On the other hand, results in Experiment 3 (unmasked) showed strong priming effects for the grouping of the inducers in both the grouping and the hybrid conditions, and also a significant but weaker priming effect for the illusory condition. Overall, our results support the possibility of the integration of local visual features into a global shape in the absence of awareness and, likewise, they suggest an early -subliminal- construction of the illusory shape, implying that feedback projections from higher to lower visual areas are not crucial in the construction of the illusory form.

Cue combination encoding via contextual modulation of V1 and V2 neurons

Neurons in early visual cortical areas encode the local properties of a stimulus in a number of different feature dimensions such as color, orientation, and motion. It has been shown, however, that stimuli presented well beyond the confines of the classical receptive field can augment these responses in a way that emphasizes these local attributes within the greater context of the visual scene. This mechanism imparts global information to cells that are otherwise considered local feature detectors and can potentially serve as an important foundation for surface segmentation, texture representation, and figure–ground segregation. The role of early visual cortex toward these functions remains somewhat of an enigma, as it is unclear how surface segmentation cues are integrated from multiple feature dimensions. We examined the impact of orientation- and motion-defined surface segmentation cues in V1 and V2 neurons using a stimulus in which the two features are completely separable. We find that, although some cells are modulated in a cue-invariant manner, many cells are influenced by only one cue or the other. Furthermore, cells that are modulated by both cues tend to be more strongly affected when both cues are presented together than when presented individually. These results demonstrate two mechanisms by which cue combinations can enhance salience. We find that feature-specific populations are more frequently encountered in V1, while cue additivity is more prominent in V2. These results highlight how two strongly interconnected areas at different stages in the cortical hierarchy can potentially contribute to scene segmentation.

High-resolution functional MRI identified distinct global intrinsic functional networks of nociceptive posterior insula and S2 regions in squirrel monkey brain

Numerous functional imaging and electrophysiological studies in humans and animals indicate that the two contiguous areas of secondary somatosensory cortex (S2) and posterior insula (pIns) are core regions in nociceptive processing and pain perception. In this study, we tested the hypothesis that the S2-pIns connection serves as a hub for connecting distinct sensory and affective nociceptive processing networks in the squirrel monkey brain. At 9.4T, we first mapped the brain regions that respond to nociceptive heat stimuli with high-resolution fMRI, and then used seed-based resting-state fMRI (rsfMRI) analysis to delineate and refine the global intrinsic functional connectivity circuits of the proximal S2 and pIns regions. In each subject, nociceptive (47.5°C) heat-evoked fMRI activations were detected in many brain regions, including primary somatosensory (S1), S2, pIns, area 7b, anterior cingulate cortex (ACC), primary motor cortex, prefrontal cortex, supplementary motor area, thalamus, and caudate. Using the heat-evoked fMRI activation foci in S2 and pIns as the seeds, voxel-wise whole-brain resting-state functional connectivity (rsFC) analysis revealed strong functional connections between contralateral S2 and pIns, as well as their corresponding regions in the ipsilateral hemisphere. Spatial similarity and overlap analysis identified each region as part of two distinct intrinsic functional networks with 7% overlap: sensory S2-S1-area 7b and affective pIns-ACC-PCC networks. Moreover, a high degree of overlap was observed between the combined rsFC maps of nociceptive S2 and pIns regions and the nociceptive heat-evoked activation map. In summary, our study provides evidence for the existence of two distinct intrinsic functional networks for S2 and pIns nociceptive regions, and these two networks are joined via the S2-pIns connection. Brain regions that are involved in processing nociceptive inputs are also highly interconnected at rest. The presence of robust and distinct S1-S2-area 7b and pIns-ACC-PCC rsFC networks under anesthesia underscores their fundamental roles in processing nociceptive information.

Induction of Kanizsa Contours Requires Awareness of the Inducing Context

It remains unknown to what extent the human visual system interprets information about complex scenes without conscious analysis. Here we used visual masking techniques to assess whether illusory contours (Kanizsa shapes) are perceived when the inducing context creating this illusion does not reach awareness. In the first experiment we tested perception directly by having participants discriminate the orientation of an illusory contour. In the second experiment, we exploited the fact that the presence of an illusory contour enhances performance on a spatial localization task. Moreover, in the latter experiment we also used a different masking method to rule out the effect of stimulus duration. Our results suggest that participants do not perceive illusory contours when they are unaware of the inducing context. This is consistent with theories of a multistage, recurrent process of perceptual integration. Our findings thus challenge some reports, including those from neurophysiological experiments in anaesthetized animals. Furthermore, we discuss the importance to test the presence of the phenomenal percept directly with appropriate methods.

Early suppression effect in human primary visual cortex during Kanizsa illusion processing: A magnetoencephalographic evidence

Detection of illusory contours (ICs) such as Kanizsa figures is known to depend primarily upon the lateral occipital complex. Yet there is no universal agreement on the role of the primary visual cortex in this process; some existing evidence hints that an early stage of the visual response in V1 may involve relative suppression to Kanizsa figures compared with controls. Iso-oriented luminance borders, which are responsible for Kanizsa illusion, may evoke surround suppression in V1 and adjacent areas leading to the reduction in the initial response to Kanizsa figures. We attempted to test the existence, as well as to find localization and timing of the early suppression effect produced by Kanizsa figures in adult nonclinical human participants. We used two sizes of visual stimuli (4.5 and 9.0°) in order to probe the effect at two different levels of eccentricity; the stimuli were presented centrally in passive viewing conditions. We recorded magnetoencephalogram, which is more sensitive than electroencephalogram to activity originating from V1 and V2 areas. We restricted our analysis to the medial occipital area and the occipital pole, and to a 40-120 ms time window after the stimulus onset. By applying threshold-free cluster enhancement technique in combination with permutation statistics, we were able to detect the inverted IC effect-a relative suppression of the response to the Kanizsa figures compared with the control stimuli. The current finding is highly compatible with the explanation involving surround suppression evoked by iso-oriented collinear borders. The effect may be related to the principle of sparse coding, according to which V1 suppresses representations of inner parts of collinear assemblies as being informationally redundant. Such a mechanism is likely to be an important preliminary step preceding object contour detection.

A New Variant of the Ouchi Illusion Reveals Fourier-Component-Based Processing

We report that anomalous motion illusion in a new variant of the Ouchi figure is well predicted by the strength of its Fourier fundamentals and harmonics. The original Ouchi figure consists of a rectangular checkerboard pattern surrounded by an orthogonal rectangular checkerboard pattern, in which illusory relative motion between the two regions is perceived. Although this illusion has been explained in terms of biases in integrating one-dimensional motion signals to determine the two-dimensional motion direction, the physiological mechanism has not been clarified. With our new stimuli, which consisted of thin lines instead of rectangles, we found that the perceived illusion is drastically reduced when the position of each line element is randomly shifted. This is not predicted by simple models of local motion integration along the visible edges. We demonstrate that the relative amplitude of the relevant Fourier fundamentals and harmonics leads to a quantitative prediction. Our analysis was successfully applied to other variants of the Ouchi figure (Khang and Essock 1997 Perception26 585–597), closely predicting the reported rating. The results indicate that the underlying physiological mechanism is sensitive to the Fourier components of the stimuli rather than the visible edges.

How Does the Cerebral Cortex Work? Development, Learning, Attention, and 3-D Vision by Laminar Circuits of Visual Cortex

A key goal of behavioral and cognitive neuroscience is to link brain mechanisms to behavioral functions. The present article describes recent progress toward explaining how the visual cortex sees. Visual cortex, like many parts of perceptual and cognitive neocortex, is organized into six main layers of cells, as well as characteristic sublamina. Here it is proposed how these layered circuits help to realize processes of development, learning, perceptual grouping, attention, and 3-D vision through a combination of bottom-up, horizontal, and top-down interactions. A main theme is that the mechanisms which enable development and learning to occur in a stable way imply properties of adult behavior. These results thus begin to unify three fields: infant cortical development, adult cortical neurophysiology and anatomy, and adult visual perception. The identified cortical mechanisms promise to generalize to explain how other perceptual and cognitive processes work.

The neural representation of objects formed through the spatiotemporal integration of visual transients

Oftentimes, objects are only partially and transiently visible as parts of them become occluded during observer or object motion. The visual system can integrate such object fragments across space and time into perceptual wholes or spatiotemporal objects. This integrative and dynamic process may involve both ventral and dorsal visual processing pathways, along which shape and spatial representations are thought to arise. We measured fMRI BOLD response to spatiotemporal objects and used multi-voxel pattern analysis (MVPA) to decode shape information across 20 topographic regions of visual cortex. Object identity could be decoded throughout visual cortex, including intermediate (V3A, V3B, hV4, LO1-2,) and dorsal (TO1-2, and IPS0-1) visual areas. Shape-specific information, therefore, may not be limited to early and ventral visual areas, particularly when it is dynamic and must be integrated. Contrary to the classic view that the representation of objects is the purview of the ventral stream, intermediate and dorsal areas may play a distinct and critical role in the construction of object representations across space and time.

The Poggendorff illusion driven by real and illusory contour: Behavioral and neural mechanisms

The Poggendorff illusion refers to the phenomenon that the human brain misperceives a diagonal line as being apparently misaligned once the diagonal line is interrupted by two parallel edges, and the size of illusion is negatively correlated with the angle of interception of the oblique, i.e. the sharper the oblique angle, the larger the illusion. This optical illusion can be produced by both real and illusory contour. In this fMRI study, by parametrically varying the oblique angle, we investigated the shared and specific neural mechanisms underlying the Poggendorff illusion induced by real and illusory contour. At the behavioral level, not only the real but also the illusory contours were capable of inducing significant Poggendorff illusion. The size of illusion induced by the real contour, however, was larger than that induced by the illusory contour. At the neural level, real and illusory contours commonly activated more dorsal visual areas, and the real contours specifically activated more ventral visual areas. More importantly, examinations on the parametric modulation effects of the size of illusion revealed the specific neural mechanisms underlying the Poggendorff illusion induced by the real and the illusory contours, respectively. Left precentral gyrus and right middle occipital cortex were specifically involved in the Poggendorff illusion induced by the real contour. On the other hand, bilateral intraparietal sulcus (IPS) and right lateral occipital complex (LOC) were specifically involved in the Poggendorff illusion induced by the illusory contour. Functional implications of the above findings were further discussed.

Network Anisotropy Trumps Noise for Efficient Object Coding in Macaque Inferior Temporal Cortex

How neuronal ensembles compute information is actively studied in early visual cortex. Much less is known about how local ensembles function in inferior temporal (IT) cortex, the last stage of the ventral visual pathway that supports visual recognition. Previous reports suggested that nearby neurons carry information mostly independently, supporting efficient processing (Barlow, 1961). However, others postulate that noise covariation effects may depend on network anisotropy/homogeneity and on how the covariation relates to representation. Do slow trial-by-trial noise covariations increase or decrease IT's object coding capability, how does encoding capability relate to correlational structure (i.e., the spatial pattern of signal and noise redundancy/homogeneity across neurons), and does knowledge of correlational structure matter for decoding? We recorded simultaneously from ∼80 spiking neurons in ∼1 mm(3) of macaque IT under light neurolept anesthesia. Noise correlations were stronger for neurons with correlated tuning, and noise covariations reduced object encoding capability, including generalization across object pose and illumination. Knowledge of noise covariations did not lead to better decoding performance. However, knowledge of anisotropy/homogeneity improved encoding and decoding efficiency by reducing the number of neurons needed to reach a given performance level. Such correlated neurons were found mostly in supragranular and infragranular layers, supporting theories that link recurrent circuitry to manifold representation. These results suggest that redundancy benefits manifold learning of complex high-dimensional information and that subsets of neurons may be more immune to noise covariation than others.

SIGNIFICANCE STATEMENT

How noise affects neuronal population coding is poorly understood. By sampling densely from local populations supporting visual object recognition, we show that recurrent circuitry supports useful representations and that subsets of neurons may be more immune to noise covariation than others.

Specificity of V1-V2 orientation networks in the primate visual cortex

The computation of texture and shape involves integration of features of various orientations. Orientation networks within V1 tend to involve cells which share similar orientation selectivity. However, emergent properties in V2 require the integration of multiple orientations. We now show that, unlike interactions within V1, V1-V2 orientation interactions are much less synchronized and are not necessarily orientation dependent. We find V1-V2 orientation networks are of two types: a more tightly synchronized, orientation-preserving network and a less synchronized orientation-diverse network. We suggest that such diversity of V1-V2 interactions underlies the spatial and functional integration required for computation of higher order contour and shape in V2.

Involvement of the Extrageniculate System in the Perception of Optical Illusions: A Functional Magnetic Resonance Imaging Study

Research on the neural processing of optical illusions can provide clues for understanding the neural mechanisms underlying visual perception. Previous studies have shown that some visual areas contribute to the perception of optical illusions such as the Kanizsa triangle and Müller-Lyer figure; however, the neural mechanisms underlying the processing of these and other optical illusions have not been clearly identified. Using functional magnetic resonance imaging (fMRI), we determined which brain regions are active during the perception of optical illusions. For our study, we enrolled 18 participants. The illusory optical stimuli consisted of many kana letters, which are Japanese phonograms. During the shape task, participants stated aloud whether they perceived the shapes of two optical illusions as being the same or not. During the word task, participants read aloud the kana letters in the stimuli. A direct comparison between the shape and word tasks showed activation of the right inferior frontal gyrus, left medial frontal gyrus, and right pulvinar. It is well known that there are two visual pathways, the geniculate and extrageniculate systems, which belong to the higher-level and primary visual systems, respectively. The pulvinar belongs to the latter system, and the findings of the present study suggest that the extrageniculate system is involved in the cognitive processing of optical illusions.

Including signal intensity increases the performance of blind source separation on brain imaging data

When analyzing brain imaging data, blind source separation (BSS) techniques critically depend on the level of dimensional reduction. If the reduction level is too slight, the BSS model would be overfitted and become unavailable. Thus, the reduction level must be set relatively heavy. This approach risks discarding useful information and crucially limits the performance of BSS techniques. In this study, a new BSS method that can work well even at a slight reduction level is presented. We proposed the concept of "signal intensity" which measures the significance of the source. Only picking the sources with significant intensity, the new method can avoid the overfitted solutions which are nonexistent artifacts. This approach enables the reduction level to be set slight and retains more useful dimensions in the preliminary reduction. Comparisons between the new and conventional algorithms were performed on both simulated and real data.

A conceptual framework of computations in mid-level vision

If a picture is worth a thousand words, as an English idiom goes, what should those words-or, rather, descriptors-capture? What format of image representation would be sufficiently rich if we were to reconstruct the essence of images from their descriptors? In this paper, we set out to develop a conceptual framework that would be: (i) biologically plausible in order to provide a better mechanistic understanding of our visual system; (ii) sufficiently robust to apply in practice on realistic images; and (iii) able to tap into underlying structure of our visual world. We bring forward three key ideas. First, we argue that surface-based representations are constructed based on feature inference from the input in the intermediate processing layers of the visual system. Such representations are computed in a largely pre-semantic (prior to categorization) and pre-attentive manner using multiple cues (orientation, color, polarity, variation in orientation, and so on), and explicitly retain configural relations between features. The constructed surfaces may be partially overlapping to compensate for occlusions and are ordered in depth (figure-ground organization). Second, we propose that such intermediate representations could be formed by a hierarchical computation of similarity between features in local image patches and pooling of highly-similar units, and reestimated via recurrent loops according to the task demands. Finally, we suggest to use datasets composed of realistically rendered artificial objects and surfaces in order to better understand a model's behavior and its limitations.

A temporal window for estimating surface brightness in the Craik-O'Brien-Cornsweet effect

The central edge of an opposing pair of luminance gradients (COC edge) makes adjoining regions with identical luminance appear to be different. This brightness illusion, called the Craik-O'Brien-Cornsweet effect (COCe), can be explained by low-level spatial filtering mechanisms (Dakin and Bex, 2003). Also, the COCe is greatly reduced when the stimulus lacks a frame element surrounding the COC edge (Purves et al., 1999). This indicates that the COCe can be modulated by extra contextual cues that are related to ideas about lighting priors. In this study, we examined whether processing for contextual modulation could be independent of the main COCe processing mediated by the filtering mechanism. We displayed the COC edge and frame element at physically different times. Then, while varying the onset asynchrony between them and changing the luminance contrast of the frame element, we measured the size of the COCe. We found that the COCe was observed in the temporal range of around 600–800 ms centered at the 0 ms (from around −400 to 400 ms in stimulus onset asynchrony), which was much larger than the range of typical visual persistency. More importantly, this temporal range did not change significantly regardless of differences in the luminance contrast of the frame element (5–100%), in the durations of COC edge and/or the frame element (50 or 200 ms), in the display condition (interocular or binocular), and in the type of lines constituting the frame element (solid or illusory lines). Results suggest that the visual system can bind the COC edge and frame element with a temporal window of ~1 s to estimate surface brightness. Information from the basic filtering mechanism and information of contextual cue are separately processed and are linked afterwards.

An Orientation Map for Motion Boundaries in Macaque V2

The ability to extract the shape of moving objects is fundamental to visual perception. However, where such computations are processed in the visual system is unknown. To address this question, we used intrinsic signal optical imaging in awake monkeys to examine cortical response to perceptual contours defined by motion contrast (motion boundaries, MBs). We found that MB stimuli elicit a robust orientation response in area V2. Orientation maps derived from subtraction of orthogonal MB stimuli aligned well with the orientation maps obtained with luminance gratings (LGs). In contrast, area V1 responded well to LGs, but exhibited a much weaker orientation response to MBs. We further show that V2 direction domains respond to motion contrast, which is required in the detection of MB in V2. These results suggest that V2 represents MB information, an important prerequisite for shape recognition and figure-ground segregation.

Orientation domain diversity in macaque area V2

Single orientation domains in primary (V1) and second (V2) visual cortical areas are known to encode the orientation of visual contours. However, the visual world contains multiple and complex contour types. How do these domains handle such complexity? Using optical imaging methods, we have examined orientation response to two types of contours: real (luminance-defined) and illusory (inferred). We find that, unlike area V1, there are multiple types of orientation domain in V2. These include “real only” domains, “higher-order” domains (which respond to an orientation whether real or illusory), and other domains with nonmatching real/illusory orientation preference. We suggest that this plurality of orientation domains in V2 enables the complexities of local and global contour extraction.

Orientation-cue invariant population responses to contrast-modulated and phase-reversed contour stimuli in macaque V1 and V2

Visual scenes can be readily decomposed into a variety of oriented components, the processing of which is vital for object segregation and recognition. In primate V1 and V2, most neurons have small spatio-temporal receptive fields responding selectively to oriented luminance contours (first order), while only a subgroup of neurons signal non-luminance defined contours (second order). So how is the orientation of second-order contours represented at the population level in macaque V1 and V2? Here we compared the population responses in macaque V1 and V2 to two types of second-order contour stimuli generated either by modulation of contrast or phase reversal with those to first-order contour stimuli. Using intrinsic signal optical imaging, we found that the orientation of second-order contour stimuli was represented invariantly in the orientation columns of both macaque V1 and V2. A physiologically constrained spatio-temporal energy model of V1 and V2 neuronal populations could reproduce all the recorded population responses. These findings suggest that, at the population level, the primate early visual system processes the orientation of second-order contours initially through a linear spatio-temporal filter mechanism. Our results of population responses to different second-order contour stimuli support the idea that the orientation maps in primate V1 and V2 can be described as a spatial-temporal energy map.

Receptive field focus of visual area V4 neurons determines responses to illusory surfaces

Illusory figures demonstrate the visual system's ability to infer surfaces under conditions of fragmented sensory input. To investigate the role of midlevel visual area V4 in visual surface completion, we used multielectrode arrays to measure spiking responses to two types of visual stimuli: Kanizsa patterns that induce the perception of an illusory surface and physically similar control stimuli that do not. Neurons in V4 exhibited stronger and sometimes rhythmic spiking responses for the illusion-promoting configurations compared with controls. Moreover, this elevated response depended on the precise alignment of the neuron's peak visual field sensitivity (receptive field focus) with the illusory surface itself. Neurons whose receptive field focus was over adjacent inducing elements, less than 1.5° away, did not show response enhancement to the illusion. Neither receptive field sizes nor fixational eye movements could account for this effect, which was present in both single-unit signals and multiunit activity. These results suggest that the active perceptual completion of surfaces and shapes, which is a fundamental problem in natural visual experience, draws upon the selective enhancement of activity within a distinct subpopulation of neurons in cortical area V4.

Linking brain to behavior for the visual perception of figures and objects

The dissociation of a figure from its background is an essential feat of visual perception, as it allows us to detect, recognize, and interact with shapes and objects in our environment. In order to understand how the human brain gives rise to the perception of figures, we here review experiments that explore the links between activity in visual cortex and performance of perceptual tasks related to figure perception. We organize our review according to a proposed model that attempts to contextualize figure processing within the more general framework of object processing in the brain. Overall, the current literature provides us with individual linking hypotheses as to cortical regions that are necessary for particular tasks related to figure perception. Attempts to reach a more complete understanding of how the brain instantiates figure and object perception, however, will have to consider the temporal interaction between the many regions involved, the details of which may vary widely across different tasks.

Illusory contours: a window onto the neurophysiology of constructing perception

Seeing seems effortless, despite the need to segregate and integrate visual information that varies in quality, quantity, and location. The extent to which seeing passively recapitulates the external world is challenged by phenomena such as illusory contours, an example of visual completion whereby borders are perceived despite their physical absence in the image. Instead, visual completion and seeing are increasingly conceived as active processes, dependent on information exchange across neural populations. How this is instantiated in the brain remains controversial. Divergent models emanate from single-unit and population-level electrophysiology, neuroimaging, and neurostimulation studies. We reconcile discrepant findings from different methods and disciplines, and underscore the importance of taking into account spatiotemporal brain dynamics in generating models of brain function and perception.

Perception of illusory contours forms intermodulation responses of steady state visual evoked potentials as a neural signature of spatial integration

Perception of illusory contours was shown to be a consequence of neural activity related to spatial integration in early visual areas. Candidates for such filling-in phenomena are long-range horizontal connections of neurons in V1/V2, and feedback from higher order visual areas. To get a direct measure of spatial integration in early visual cortex, we presented two differently flickering inducers, which evoked steady-state visual evoked potentials (SSVEPs) while manipulating the formation of an illusory rectangle. As a neural marker of integration we tested differences in amplitudes of intermodulation frequencies i.e. linear combinations of the driving frequencies. These were significantly increased when an illusory rectangle was perceived. Increases were neither due to changes of any of the two driving frequencies nor in the frequency that tagged the processing of the compound object, indicating that results are not a consequence of paying more attention to inducers when the illusory rectangle was visible.

Confuse Your Illusion

A striking example of the constructive nature of visual perception is how the human visual system completes contours of occluded objects. To date, it is unclear whether perceptual completion emerges during early stages of visual processing or whether higher-level mechanisms are necessary. To answer this question, we used transcranial magnetic stimulation to disrupt signaling in V1/V2 and in the lateral occipital (LO) area at different moments in time while participants performed a discrimination task involving a Kanizsa-type illusory figure. Results show that both V1/V2 and higher-level visual area LO are critically involved in perceptual completion. However, these areas seem to be involved in an inverse hierarchical fashion, in which the critical time window for V1/V2 follows that for LO. These results are in line with the growing evidence that feedback to V1/V2 contributes to perceptual completion.

Disambiguating the roles of area V1 and the lateral occipital complex (LOC) in contour integration

Contour integration, the linking of collinear but disconnected visual elements across space, is an essential facet of object and scene perception. Here, we set out to arbitrate between two previously advanced mechanisms of contour integration: serial facilitative interactions between collinear cells in the primary visual cortex (V1) versus pooling of inputs in higher-order visual areas. To this end, we used high-density electrophysiological recordings to assess the spatio-temporal dynamics of brain activity in response to Gabor contours embedded in Gabor noise (so-called "pathfinder displays") versus control stimuli. Special care was taken to elicit and detect early activity stemming from the primary visual cortex, as indexed by the C1 component of the visual evoked potential. Arguing against a purely early V1 account, there was no evidence for contour-related modulations within the C1 timeframe (50-100 ms). Rather, the earliest effects were observed within the timeframe of the N1 component (160-200 ms) and inverse source analysis pointed to principle generators in the lateral occipital complex (LOC) within the ventral visual stream. Source anlaysis also suggested that it was only during this relatively late processing period that contextual effects emerged in hierarchically early visual regions (i.e. V1/V2), consistent with a more distributed process involving recurrent feedback/feedforward interactions between LOC and early visual sensory regions. The distribution of effects uncovered here is consistent with pooling of information in higher order cortical areas as the initial step in contour integration, and that this pooling occurs relatively late in processing rather than during the initial sensory-processing period.

The "side" matters: how configurality is reflected in completion

The perception of figure-ground organization is a highly context-sensitive phenomenon. Accumulating evidence suggests that the so-called completion phenomenon is tightly linked to this figure-ground organization. While many computational models have applied borderline completion algorithms based on the detection of boundary alignments, we point out the problems of this approach. We hypothesize that completion is a result of computing the figure-ground organization. Specifically, the global interactions in the neural network activate the "border-ownership" sensitive neurons at the location where no luminance contrast is given and this activation corresponds to the perception of illusory contours. The implications of this result to the general property of emerging Gestalt percepts are discussed.