Processing of second-order stimuli in the visual cortex

Similarity in motion binds and bends judgments of aspect ratio

It is well known that objects become grouped in perceptual organization when they share some visual feature, like a common direction of motion. Less well known is that grouping can change how people perceive a set of objects. For example, when a pair of shapes consistently share a common region of space, their aspect ratios tend to be perceived as more similar (are attracted toward each other). Conversely, when shapes are assigned to different regions in space their aspect ratios repel from each other. Here we examine whether the visual system produce both attractive and repulsive distortions when the state of grouping between a pair of shapes changes on a moment-to-moment basis. Observers viewed a pair of ellipses that differed in terms of how flat or tall they were and reported the aspect ratio of one ellipse from the pair. Each ellipse was defined by a cloud of coherently-moving dots, and the dots within the two ellipses had either the same or different directions of motion, varying from trial-to-trial. We found that the cued ellipse's aspect ratio was reported to be repelled from the aspect ratio of the uncued ellipse when the shapes had different directions of motion compared to when they had the same direction of motion. These results suggest that the visual system can adaptively alter visual experience based on grouping, in particular, repelling the appearance of objects when they do not appear to go together, and it can do so quickly and flexibly.

Temporal interference stimulation disrupts spike timing in the primate brain

Electrical stimulation can regulate brain activity, producing clear clinical benefits, but focal and effective neuromodulation often requires surgically implanted electrodes. Recent studies argue that temporal interference (TI) stimulation may provide similar outcomes non-invasively. During TI, scalp electrodes generate multiple electrical fields in the brain, modulating neural activity only at their intersection. Despite considerable enthusiasm for this approach, little empirical evidence demonstrates its effectiveness, especially under conditions suitable for human use. Here, using single-neuron recordings in non-human primates, we establish that TI reliably alters the timing, but not the rate, of spiking activity. However, we show that TI requires strategies-high carrier frequencies, multiple electrodes, and amplitude-modulated waveforms-that also limit its effectiveness. Combined, these factors make TI 80 % weaker than other forms of non-invasive brain stimulation. Although unlikely to cause widespread neuronal entrainment, TI may be ideal for disrupting pathological oscillatory activity, a hallmark of many neurological disorders.

Visual motion detection thresholds can be reliably measured during walking and standing

Introduction

In upright standing and walking, the motion of the body relative to the environment is estimated from a combination of visual, vestibular, and somatosensory cues. Associations between vestibular or somatosensory impairments and balance problems are well established, but less is known whether visual motion detection thresholds affect upright balance control. Typically, visual motion threshold values are measured while sitting, with the head fixated to eliminate self-motion. In this study we investigated whether visual motion detection thresholds: (1) can be reliably measured during standing and walking in the presence of natural self-motion; and (2) differ during standing and walking.

Methods

Twenty-nine subjects stood on and walked on a self-paced, instrumented treadmill inside a virtual visual environment projected on a large dome. Participants performed a two-alternative forced choice experiment in which they discriminated between a counterclockwise ("left") and clockwise ("right") rotation of a visual scene. A 6-down 1-up adaptive staircase algorithm was implemented to change the amplitude of the rotation. A psychometric fit to the participants' binary responses provided an estimate for the detection threshold.

Results

We found strong correlations between the repeated measurements in both the walking (R = 0.84, p < 0.001) and the standing condition (R = 0.73, p < 0.001) as well as good agreement between the repeated measures with Bland-Altman plots. Average thresholds during walking (mean = 1.04°, SD = 0.43°) were significantly higher than during standing (mean = 0.73°, SD = 0.47°).

Conclusion

Visual motion detection thresholds can be reliably measured during both walking and standing, and thresholds are higher during walking.

Spatiotemporal cortical dynamics for visual scene processing as revealed by EEG decoding

The human visual system rapidly recognizes the categories and global properties of complex natural scenes. The present study investigated the spatiotemporal dynamics of neural signals involved in visual scene processing using electroencephalography (EEG) decoding. We recorded visual evoked potentials from 11 human observers for 232 natural scenes, each of which belonged to one of 13 natural scene categories (e.g., a bedroom or open country) and had three global properties (naturalness, openness, and roughness). We trained a deep convolutional classification model of the natural scene categories and global properties using EEGNet. Having confirmed that the model successfully classified natural scene categories and the three global properties, we applied Grad-CAM to the EEGNet model to visualize the EEG channels and time points that contributed to the classification. The analysis showed that EEG signals in the occipital electrodes at short latencies (approximately 80 ~ ms) contributed to the classifications, whereas those in the frontal electrodes at relatively long latencies (200 ~ ms) contributed to the classification of naturalness and the individual scene category. These results suggest that different global properties are encoded in different cortical areas and with different timings, and that the combination of the EEGNet model and Grad-CAM can be a tool to investigate both temporal and spatial distribution of natural scene processing in the human brain.

Descending pathways increase sensory neural response heterogeneity to facilitate decoding and behavior

The functional role of heterogeneous spiking responses of otherwise similarly tuned neurons to stimulation, which has been observed ubiquitously, remains unclear to date. Here, we demonstrate that such response heterogeneity serves a beneficial function that is used by downstream brain areas to generate behavioral responses that follows the detailed timecourse of the stimulus. Multi-unit recordings from sensory pyramidal cells within the electrosensory system of Apteronotus leptorhynchus were performed and revealed highly heterogeneous responses that were similar for all cell types. By comparing the coding properties of a given neural population before and after inactivation of descending pathways, we found that heterogeneities were beneficial as decoding was then more robust to the addition of noise. Taken together, our results not only reveal that descending pathways actively promote response heterogeneity within a given cell type, but also uncover a beneficial function for such heterogeneity that is used by the brain to generate behavior.

Visual Characteristics of Adults with Long-Standing History of Dietary Exposure to Mercury in Grassy Narrows First Nation, Canada

Since the 1960s, Grassy Narrows First Nation (Ontario, Canada) has been exposed to methyl mercury (Hg) through fish consumption, resulting from industrial pollution of their territorial waters. This cross-sectional study describes the visual characteristics of adults with documented Hg exposure between 1970 and 1997. Oculo-visual examinations of 80 community members included visual acuity, automated visual fields, optical coherence tomography [OCT], color vision and contrast sensitivity. Median age was 57 years (IQR 51-63) and 55% of participants were women. Median visual acuity was 0.1 logMAR (Snellen 6/6.4; IQR 0-0.2). A total of 26% of participants presented a Visual Field Index inferior to 62%, and qualitative losses assessment showed concentric constriction (18%), end-stage concentric loss (18%), and complex defects (24%). On OCT, retinal nerve fiber layer scans showed 74% of participants within normal/green range. For color testing with the Hardy, Rand, and Rittler test, 40% presented at least one type of color defect, and with the Lanthony D-15 test, median color confusion index was 1.59 (IQR 1.33-1.96). Contrast sensitivity showed moderate loss for 83% of participants. These findings demonstrate important loss of visual field, color vision, and contrast sensitivity in older adults in a context of long-term exposure to Hg in Grassy Narrows First Nation.

A two-stage spectral model for sound texture perception: Synthesis and psychophysics

The natural environment is filled with a variety of auditory events such as wind blowing, water flowing, and fire crackling. It has been suggested that the perception of such textural sounds is based on the statistics of the natural auditory events. Inspired by a recent spectral model for visual texture perception, we propose a model that can describe the perceived sound texture only with the linear spectrum and the energy spectrum. We tested the validity of the model by using synthetic noise sounds that preserve the two-stage amplitude spectra of the original sound. Psychophysical experiment showed that our synthetic noises were perceived as like the original sounds for 120 real-world auditory events. The performance was comparable with the synthetic sounds produced by McDermott-Simoncelli's model which considers various classes of auditory statistics. The results support the notion that the perception of natural sound textures is predictable by the two-stage spectral signals.

Traumatic brain injury: Mechanisms, manifestations, and visual sequelae

Traumatic brain injury (TBI) results when external physical forces impact the head with sufficient intensity to cause damage to the brain. TBI can be mild, moderate, or severe and may have long-term consequences including visual difficulties, cognitive deficits, headache, pain, sleep disturbances, and post-traumatic epilepsy. Disruption of the normal functioning of the brain leads to a cascade of effects with molecular and anatomical changes, persistent neuronal hyperexcitation, neuroinflammation, and neuronal loss. Destructive processes that occur at the cellular and molecular level lead to inflammation, oxidative stress, calcium dysregulation, and apoptosis. Vascular damage, ischemia and loss of blood brain barrier integrity contribute to destruction of brain tissue. This review focuses on the cellular damage incited during TBI and the frequently life-altering lasting effects of this destruction on vision, cognition, balance, and sleep. The wide range of visual complaints associated with TBI are addressed and repair processes where there is potential for intervention and neuronal preservation are highlighted.

Integration of allocentric and egocentric visual information in a convolutional/multilayer perceptron network model of goal-directed gaze shifts

Allocentric (landmark-centered) and egocentric (eye-centered) visual codes are fundamental for spatial cognition, navigation, and goal-directed movement. Neuroimaging and neurophysiology suggest these codes are initially segregated, but then reintegrated in frontal cortex for movement control. We created and validated a theoretical framework for this process using physiologically constrained inputs and outputs. To implement a general framework, we integrated a convolutional neural network (CNN) of the visual system with a multilayer perceptron (MLP) model of the sensorimotor transformation. The network was trained on a task where a landmark shifted relative to the saccade target. These visual parameters were input to the CNN, the CNN output and initial gaze position to the MLP, and a decoder transformed MLP output into saccade vectors. Decoded saccade output replicated idealized training sets with various allocentric weightings and actual monkey data where the landmark shift had a partial influence (R² = 0.8). Furthermore, MLP output units accurately simulated prefrontal response field shifts recorded from monkeys during the same paradigm. In summary, our model replicated both the general properties of the visuomotor transformations for gaze and specific experimental results obtained during allocentric–egocentric integration, suggesting it can provide a general framework for understanding these and other complex visuomotor behaviors.

Analysis and Synthesis of Natural Texture Perception From Visual Evoked Potentials

The primate visual system analyzes statistical information in natural images and uses it for the immediate perception of scenes, objects, and surface materials. To investigate the dynamical encoding of image statistics in the human brain, we measured visual evoked potentials (VEPs) for 166 natural textures and their synthetic versions, and performed a reverse-correlation analysis of the VEPs and representative texture statistics of the image. The analysis revealed occipital VEP components strongly correlated with particular texture statistics. VEPs correlated with low-level statistics, such as subband SDs, emerged rapidly from 100 to 250 ms in a spatial frequency dependent manner. VEPs correlated with higher-order statistics, such as subband kurtosis and cross-band correlations, were observed at slightly later times. Moreover, these robust correlations enabled us to inversely estimate texture statistics from VEP signals via linear regression and to reconstruct texture images that appear similar to those synthesized with the original statistics. Additionally, we found significant differences in VEPs at 200-300 ms between some natural textures and their Portilla-Simoncelli (PS) synthesized versions, even though they shared almost identical texture statistics. This differential VEP was related to the perceptual "unnaturalness" of PS-synthesized textures. These results suggest that the visual cortex rapidly encodes image statistics hidden in natural textures specifically enough to predict the visual appearance of a texture, while it also represents high-level information beyond image statistics, and that electroencephalography can be used to decode these cortical signals.

Human Texture Vision as Multi-Order Spectral Analysis

Texture information plays a critical role in the rapid perception of scenes, objects, and materials. Here, we propose a novel model in which visual texture perception is essentially determined by the 1st-order (2D-luminance) and 2nd-order (4D-energy) spectra. This model is an extension of the dimensionality of the Filter-Rectify-Filter (FRF) model, and it also corresponds to the frequency representation of the Portilla-Simoncelli (PS) statistics. We show that preserving two spectra and randomizing phases of a natural texture image result in a perceptually similar texture, strongly supporting the model. Based on only two single spectral spaces, this model provides a simpler framework to describe and predict texture representations in the primate visual system. The idea of multi-order spectral analysis is consistent with the hierarchical processing principle of the visual cortex, which is approximated by a multi-layer convolutional network.

Contrast-modulated stimuli produce more superimposition and predominate perception when competing with comparable luminance-modulated stimuli during interocular grouping

Interocular grouping (IOG) is a binocular visual function that can arise during multi-stable perception. IOG perception was initiated using split-grating stimuli constructed from luminance (L), luminance-modulated noise (LM) and contrast-modulated noise (CM). In Experiment 1, three different visibility levels were used for L and LM (or first-order) stimuli, and compared to fixed-visibility CM (or second-order) stimuli. Eight binocularly normal participants indicated whether they perceived full horizontal or vertical gratings, superimposition, or other (piecemeal and eye-of-origin) percepts. CM stimuli rarely generated full IOG, but predominantly generated superimposition. In Experiment 2, Levelt's modified laws were tested for IOG in nine participants. Split-gratings presented to each eye contained different visibility LM gratings, or LM and CM gratings. The results for the LM-vs-LM conditions mostly followed the predictions of Levelt's modified laws, whereas the results for the LM-vs-CM conditions did not. Counterintuitively, when high-visibility LM and low-visibility CM split-gratings were used, high-visibility LM components did not predominate IOG perception. Our findings suggest that higher proportions of superimposition during CM-vs-CM viewing are due to binocular combination, rather than mutual inhibition. It implies that IOG percepts are more likely to be mediated at an earlier monocular, rather than a binocular stage. Our previously proposed conceptual framework for conventional binocular rivalry, which includes asymmetric feedback, visual saliency, or a combination of both (Skerswetat et al. Sci Rep 8:14432, 2018), might also account for IOG. We speculate that opponency neurons might mediate coherent percepts when dissimilar information separately enters the eyes.

Interocular ND filter suppression: Eccentricity and luminance polarity effects

The depth and extent of interocular suppression were measured in binocularly normal observers who unilaterally adapted to neutral density (ND) filters (0, 1.5, 2, and 3 ND). Suppression was measured by dichoptically matching sectors of a ring presented to the adapted eye to a fixed contrast contiguous ring presented to the non-adapted eye. Other rings of alternating polarity were viewed binocularly. Rings were defined by luminance (L), luminance with added dynamic binary luminance noise (LM), and contrast modulating the same noise (CM). Interocular suppression depth increased with increasing ND, nearing significance (p = 0.058) for 1.5 ND. For L and LM stimuli, suppression depth across eccentricity (±12° visual field) differed for luminance increment (white) versus luminance decrement (black) stimuli, potentially confounding eccentricity results. Suppression for increment-only (white) luminance stimuli was steeper centrally and extended across the visual field, but was deeper for L than for LM stimuli. Suppression for decrement-only (black) luminance stimuli revealed only central suppression. Suppression was deeper with CM than LM stimuli, suggesting that CM stimuli are extracted in areas receiving predominantly binocular input which may be more sensitive to binocular disruption. Increment (white) luminance stimuli demonstrate deeper interocular suppression in the periphery than decrement (black) stimuli, so they are more sensitive to changes in peripheral suppression. Asymmetry of suppression in the periphery for opposite polarity luminance stimuli may be due to interocular receptive field size mismatch as a result of dark adaptation separately affecting ON and OFF pathways. Clinically, measurement of suppression with CM stimuli may provide the best information about post-combination binocularity.

Unraveling nonlinear electrophysiologic processes in the human visual system with full dimension spectral analysis

Natural sensory signals have nonlinear structures dynamically composed of the carrier frequencies and the variation of the amplitude (i.e., envelope). How the human brain processes the envelope information is still poorly understood, largely due to the conventional analysis failing to quantify it directly. Here, we used a recently developed method, Holo-Hilbert spectral analysis, and steady-state visually evoked potential collected using electroencephalography (EEG) recordings to investigate how the human visual system processes the envelope of amplitude-modulated signals, in this case with a 14 Hz carrier and a 2 Hz envelope. The EEG results demonstrated that in addition to the fundamental stimulus frequencies, 4 Hz amplitude modulation residing in 14 Hz carrier and a broad range of carrier frequencies covering from 8 to 32 Hz modulated by 2 Hz amplitude modulation are also found in the two-dimensional frequency spectrum, which have not yet been recognized before. The envelope of the stimulus is also found to dominantly modulate the response to the incoming signal. The findings thus reveal that the electrophysiological response to amplitude-modulated stimuli is more complex than could be revealed by, for example, Fourier analysis. This highlights the dynamics of neural processes in the visual system.

Modeling second-order boundary perception: A machine learning approach

Visual pattern detection and discrimination are essential first steps for scene analysis. Numerous human psychophysical studies have modeled visual pattern detection and discrimination by estimating linear templates for classifying noisy stimuli defined by spatial variations in pixel intensities. However, such methods are poorly suited to understanding sensory processing mechanisms for complex visual stimuli such as second-order boundaries defined by spatial differences in contrast or texture. We introduce a novel machine learning framework for modeling human perception of second-order visual stimuli, using image-computable hierarchical neural network models fit directly to psychophysical trial data. This framework is applied to modeling visual processing of boundaries defined by differences in the contrast of a carrier texture pattern, in two different psychophysical tasks: (1) boundary orientation identification, and (2) fine orientation discrimination. Cross-validation analysis is employed to optimize model hyper-parameters, and demonstrate that these models are able to accurately predict human performance on novel stimulus sets not used for fitting model parameters. We find that, like the ideal observer, human observers take a region-based approach to the orientation identification task, while taking an edge-based approach to the fine orientation discrimination task. How observers integrate contrast modulation across orientation channels is investigated by fitting psychophysical data with two models representing competing hypotheses, revealing a preference for a model which combines multiple orientations at the earliest possible stage. Our results suggest that this machine learning approach has much potential to advance the study of second-order visual processing, and we outline future steps towards generalizing the method to modeling visual segmentation of natural texture boundaries. This study demonstrates how machine learning methodology can be fruitfully applied to psychophysical studies of second-order visual processing.

Many naturally occurring visual boundaries are defined by spatial differences in features other than luminance, for example by differences in texture or contrast. Quantitative models of such “second-order” boundary perception cannot be estimated using the standard regression techniques (known as “classification images”) commonly applied to “first-order”, luminance-defined stimuli. Here we present a novel machine learning approach to modeling second-order boundary perception using hierarchical neural networks. In contrast to previous quantitative studies of second-order boundary perception, we directly estimate network model parameters using psychophysical trial data. We demonstrate that our method can reveal different spatial summation strategies that human observers utilize for different kinds of second-order boundary perception tasks, and can be used to compare competing hypotheses of how contrast modulation is integrated across orientation channels. We outline extensions of the methodology to other kinds of second-order boundaries, including those in natural images.

Levelt's laws do not predict perception when luminance- and contrast-modulated stimuli compete during binocular rivalry

Incompatible patterns viewed by each of the two eyes can provoke binocular rivalry, a competition of perception. Levelt's first law predicts that a highly visible stimulus will predominate over a less visible stimulus during binocular rivalry. In a behavioural study, we made a counterintuitive observation: high visibility patterns do not always predominate over low visibility patterns. Our results show that none of Levelt's binocular rivalry laws hold when luminance-modulated (LM) patterns compete with contrast-modulated (CM) patterns. We discuss visual saliency, asymmetric feedback, and a combination of both as potential mechanisms to explain the CM versus LM findings. Competing orthogonal LM stimuli do follow Levelt's laws, whereas only the first two laws hold for competing CM stimuli. The current results provide strong psychophysical evidence for the existence of separate processing stages for LM and CM stimuli.

Object size determines the spatial spread of visual time

A key question for temporal processing research is how the nervous system extracts event duration, despite a notable lack of neural structures dedicated to duration encoding. This is in stark contrast with the orderly arrangement of neurons tasked with spatial processing. In this study, we examine the linkage between the spatial and temporal domains. We use sensory adaptation techniques to generate after-effects where perceived duration is either compressed or expanded in the opposite direction to the adapting stimulus' duration. Our results indicate that these after-effects are broadly tuned, extending over an area approximately five times the size of the stimulus. This region is directly related to the size of the adapting stimulus-the larger the adapting stimulus the greater the spatial spread of the after-effect. We construct a simple model to test predictions based on overlapping adapted versus non-adapted neuronal populations and show that our effects cannot be explained by any single, fixed-scale neural filtering. Rather, our effects are best explained by a self-scaled mechanism underpinned by duration selective neurons that also pool spatial information across earlier stages of visual processing.

Envelope statistics of self-motion signals experienced by human subjects during everyday activities: Implications for vestibular processing

There is accumulating evidence that the brain's neural coding strategies are constrained by natural stimulus statistics. Here we investigated the statistics of the time varying envelope (i.e. a second-order stimulus attribute that is related to variance) of rotational and translational self-motion signals experienced by human subjects during everyday activities. We found that envelopes can reach large values across all six motion dimensions (~450 deg/s for rotations and ~4 G for translations). Unlike results obtained in other sensory modalities, the spectral power of envelope signals decreased slowly for low (< 2 Hz) and more sharply for high (>2 Hz) temporal frequencies and thus was not well-fit by a power law. We next compared the spectral properties of envelope signals resulting from active and passive self-motion, as well as those resulting from signals obtained when the subject is absent (i.e. external stimuli). Our data suggest that different mechanisms underlie deviation from scale invariance in rotational and translational self-motion envelopes. Specifically, active self-motion and filtering by the human body cause deviation from scale invariance primarily for translational and rotational envelope signals, respectively. Finally, we used well-established models in order to predict the responses of peripheral vestibular afferents to natural envelope stimuli. We found that irregular afferents responded more strongly to envelopes than their regular counterparts. Our findings have important consequences for understanding the coding strategies used by the vestibular system to process natural second-order self-motion signals.

The singular nature of auditory and visual scene analysis in autism

Individuals with autism spectrum disorder often have difficulty acquiring relevant auditory and visual information in daily environments, despite not being diagnosed as hearing impaired or having low vision. Resent psychophysical and neurophysiological studies have shown that autistic individuals have highly specific individual differences at various levels of information processing, including feature extraction, automatic grouping and top-down modulation in auditory and visual scene analysis. Comparison of the characteristics of scene analysis between auditory and visual modalities reveals some essential commonalities, which could provide clues about the underlying neural mechanisms. Further progress in this line of research may suggest effective methods for diagnosing and supporting autistic individuals.This article is part of the themed issue 'Auditory and visual scene analysis'.

Visual acuity measured with luminance-modulated and contrast-modulated noise letter stimuli in young adults and adults above 50 years old

The human visual system is sensitive in detecting objects that have different luminance level from their background, known as first-order or luminance-modulated (LM) stimuli. We are also able to detect objects that have the same mean luminance as their background, only differing in contrast (or other attributes). Such objects are known as second-order or contrast-modulated (CM), stimuli. CM stimuli are thought to be processed in higher visual areas compared to LM stimuli, and may be more susceptible to ageing. We compared visual acuities (VA) of five healthy older adults (54.0±1.83 years old) and five healthy younger adults (25.4±1.29 years old) with LM and CM letters under monocular and binocular viewing. For monocular viewing, age had no effect on VA [F(1, 8)= 2.50, p> 0.05]. However, there was a significant main effect of age on VA under binocular viewing [F(1, 8)= 5.67, p< 0.05].  Binocular VA with CM letters in younger adults was approximately two lines better than that in older adults. For LM, binocular summation ratios were similar for older (1.16±0.21) and younger (1.15±0.06) adults. For CM, younger adults had higher binocular summation ratio (1.39±0.08) compared to older adults (1.12±0.09). Binocular viewing improved VA with LM letters for both groups similarly. However, in older adults, binocular viewing did not improve VA with CM letters as much as in younger adults. This could reflect a decline of higher visual areas due to ageing process, most likely higher than V1, which may be missed if measured with luminance-based stimuli alone.

Binocular functional architecture for detection of contrast-modulated gratings

Combination of signals from the two eyes is the gateway to stereo vision. To gain insight into binocular signal processing, we studied binocular summation for luminance-modulated gratings (L or LM) and contrast-modulated gratings (CM). We measured 2AFC detection thresholds for a signal grating (0.75c/deg, 216ms) shown to one eye, both eyes, or both eyes out-of-phase. For LM and CM, the carrier noise was in both eyes, even when the signal was monocular. Mean binocular thresholds for luminance gratings (L) were 5.4dB better than monocular thresholds - close to perfect linear summation (6dB). For LM and CM the binocular advantage was again 5-6dB, even when the carrier noise was uncorrelated, anti-correlated, or at orthogonal orientations in the two eyes. Binocular combination for CM probably arises from summation of envelope responses, and not from summation of these conflicting carrier patterns. Antiphase signals produced no binocular advantage, but thresholds were about 1-3dB higher than monocular ones. This is not consistent with simple linear summation, which should give complete cancellation and unmeasurably high thresholds. We propose a three-channel model in which noisy monocular responses to the envelope are binocularly combined in a contrast-weighted sum, but also remain separately available to perception via a max operator. Vision selects the largest of the three responses. With in-phase gratings the binocular channel dominates, but antiphase gratings cancel in the binocular channel and the monocular channels mediate detection. The small antiphase disadvantage might be explained by a subtle influence of background responses on binocular and monocular detection.

Mice Can Use Second-Order, Contrast-Modulated Stimuli to Guide Visual Perception

Visual processing along the primate ventral stream takes place in a hierarchy of areas, characterized by an increase in both complexity of neuronal preferences and invariance to changes of low-level stimulus attributes. A basic type of invariance is form-cue invariance, where neurons have similar preferences in response to first-order stimuli, defined by changes in luminance, and global features of second-order stimuli, defined by changes in texture or contrast. Whether in mice, a now popular model system for early visual processing, visual perception can be guided by second-order stimuli is currently unknown. Here, we probed mouse visual perception and neural responses in areas V1 and LM using various types of second-order, contrast-modulated gratings with static noise carriers. These gratings differ in their spatial frequency composition and thus in their ability to invoke first-order mechanisms exploiting local luminance features. We show that mice can transfer learning of a coarse orientation discrimination task involving first-order, luminance-modulated gratings to the contrast-modulated gratings, albeit with markedly reduced discrimination performance. Consistent with these behavioral results, we demonstrate that neurons in area V1 and LM are less responsive and less selective to contrast-modulated than to luminance-modulated gratings, but respond with broadly similar preferred orientations. We conclude that mice can, at least in a rudimentary form, use second-order stimuli to guide visual perception.

SIGNIFICANCE STATEMENT

To extract object boundaries in natural scenes, the primate visual system does not only rely on differences in local luminance but can also take into account differences in texture or contrast. Whether the mouse, which has a much simpler visual system, can use such second-order information to guide visual perception is unknown. Here we tested mouse perception of second-order, contrast-defined stimuli and measured their neural representations in two areas of visual cortex. We find that mice can use contrast-defined stimuli to guide visual perception, although behavioral performance and neural representations were less robust than for luminance-defined stimuli. These findings shed light on basic steps of feature extraction along the mouse visual cortical hierarchy, which may ultimately lead to object recognition.

Segmentation precedes face categorization under suboptimal conditions

Both categorization and segmentation processes play a crucial role in face perception. However, the functional relation between these subprocesses is currently unclear. The present study investigates the temporal relation between segmentation-related and category-selective responses in the brain, using electroencephalography (EEG). Surface segmentation and category content were both manipulated using texture-defined objects, including faces. This allowed us to study brain activity related to segmentation and to categorization. In the main experiment, participants viewed texture-defined objects for a duration of 800 ms. EEG results revealed that segmentation-related responses precede category-selective responses. Three additional experiments revealed that the presence and timing of categorization depends on stimulus properties and presentation duration. Photographic objects were presented for a long and short (92 ms) duration and evoked fast category-selective responses in both cases. On the other hand, presentation of texture-defined objects for a short duration only evoked segmentation-related but no category-selective responses. Category-selective responses were much slower when evoked by texture-defined than by photographic objects. We suggest that in case of categorization of objects under suboptimal conditions, such as when low-level stimulus properties are not sufficient for fast object categorization, segmentation facilitates the slower categorization process.

Processing deficits of motion of contrast-modulated gratings in anisometropic amblyopia

Several studies have indicated substantial processing deficits for static second-order stimuli in amblyopia. However, less is known about the perception of second-order moving gratings. To investigate this issue, we measured the contrast sensitivity for second-order (contrast-modulated) moving gratings in seven anisometropic amblyopes and ten normal controls. The measurements were performed with non-equated carriers and a series of equated carriers. For comparison, the sensitivity for first-order motion and static second-order stimuli was also measured. Most of the amblyopic eyes (AEs) showed reduced sensitivity for second-order moving gratings relative to their non-amblyopic eyes (NAEs) and the dominant eyes (CEs) of normal control subjects, even when the detectability of the noise carriers was carefully controlled, suggesting substantial processing deficits of motion of contrast-modulated gratings in anisometropic amblyopia. In contrast, the non-amblyopic eyes of the anisometropic amblyopes were relatively spared. As a group, NAEs showed statistically comparable performance to CEs. We also found that contrast sensitivity for static second-order stimuli was strongly impaired in AEs and part of the NAEs of anisometropic amblyopes, consistent with previous studies. In addition, some amblyopes showed impaired performance in perception of static second-order stimuli but not in that of second-order moving gratings. These results may suggest a dissociation between the processing of static and moving second-order gratings in anisometropic amblyopia.

Possible functions of contextual modulations and receptive field nonlinearities: pop-out and texture segmentation

When analyzing a visual image, the brain has to achieve several goals quickly. One crucial goal is to rapidly detect parts of the visual scene that might be behaviorally relevant, while another one is to segment the image into objects, to enable an internal representation of the world. Both of these processes can be driven by local variations in any of several image attributes such as luminance, color, and texture. Here, focusing on texture defined by local orientation, we propose that the two processes are mediated by separate mechanisms that function in parallel. More specifically, differences in orientation can cause an object to "pop out" and attract visual attention, if its orientation differs from that of the surrounding objects. Differences in orientation can also signal a boundary between objects and therefore provide useful information for image segmentation. We propose that contextual response modulations in primary visual cortex (V1) are responsible for orientation pop-out, while a different kind of receptive field nonlinearity in secondary visual cortex (V2) is responsible for orientation-based texture segmentation. We review a recent experiment that led us to put forward this hypothesis along with other research literature relevant to this notion.

Orientation-cue invariant population responses to contrast-modulated and phase-reversed contour stimuli in macaque V1 and V2

Visual scenes can be readily decomposed into a variety of oriented components, the processing of which is vital for object segregation and recognition. In primate V1 and V2, most neurons have small spatio-temporal receptive fields responding selectively to oriented luminance contours (first order), while only a subgroup of neurons signal non-luminance defined contours (second order). So how is the orientation of second-order contours represented at the population level in macaque V1 and V2? Here we compared the population responses in macaque V1 and V2 to two types of second-order contour stimuli generated either by modulation of contrast or phase reversal with those to first-order contour stimuli. Using intrinsic signal optical imaging, we found that the orientation of second-order contour stimuli was represented invariantly in the orientation columns of both macaque V1 and V2. A physiologically constrained spatio-temporal energy model of V1 and V2 neuronal populations could reproduce all the recorded population responses. These findings suggest that, at the population level, the primate early visual system processes the orientation of second-order contours initially through a linear spatio-temporal filter mechanism. Our results of population responses to different second-order contour stimuli support the idea that the orientation maps in primate V1 and V2 can be described as a spatial-temporal energy map.

Luminance- and texture-defined information processing in school-aged children with autism

According to the complexity-specific hypothesis, the efficacy with which individuals with autism spectrum disorder (ASD) process visual information varies according to the extensiveness of the neural network required to process stimuli. Specifically, adults with ASD are less sensitive to texture-defined (or second-order) information, which necessitates the implication of several cortical visual areas. Conversely, the sensitivity to simple, luminance-defined (or first-order) information, which mainly relies on primary visual cortex (V1) activity, has been found to be either superior (static material) or intact (dynamic material) in ASD. It is currently unknown if these autistic perceptual alterations are present in childhood. In the present study, behavioural (threshold) and electrophysiological measures were obtained for static luminance- and texture-defined gratings presented to school-aged children with ASD and compared to those of typically developing children. Our behavioural and electrophysiological (P140) results indicate that luminance processing is likely unremarkable in autistic children. With respect to texture processing, there was no significant threshold difference between groups. However, unlike typical children, autistic children did not show reliable enhancements of brain activity (N230 and P340) in response to texture-defined gratings relative to luminance-defined gratings. This suggests reduced efficiency of neuro-integrative mechanisms operating at a perceptual level in autism. These results are in line with the idea that visual atypicalities mediated by intermediate-scale neural networks emerge before or during the school-age period in autism.

Speed-invariant encoding of looming object distance requires power law spike rate adaptation

Neural representations of a moving object's distance and approach speed are essential for determining appropriate orienting responses, such as those observed in the localization behaviors of the weakly electric fish, Apteronotus leptorhynchus. We demonstrate that a power law form of spike rate adaptation transforms an electroreceptor afferent's response to "looming" object motion, effectively parsing information about distance and approach speed into distinct measures of the firing rate. Neurons with dynamics characterized by fixed time scales are shown to confound estimates of object distance and speed. Conversely, power law adaptation modifies an electroreceptor afferent's response according to the time scales present in the stimulus, generating a rate code for looming object distance that is invariant to speed and acceleration. Consequently, estimates of both object distance and approach speed can be uniquely determined from an electroreceptor afferent's firing rate, a multiplexed neural code operating over the extended time scales associated with behaviorally relevant stimuli.

Individual and age-related variation in chromatic contrast adaptation

Precortical color channels are tuned primarily to the LvsM (stimulation of L and M cones varied, but S cone stimulation held constant) or SvsLM (stimulation of S cones varied, but L and M cone stimulation held constant) cone-opponent (cardinal) axes, but appear elaborated in the cortex to form higher-order mechanisms tuned to both cardinal and intermediate directions. One source of evidence for these higher-order mechanisms has been the selectivity of color contrast adaptation for noncardinal directions, yet the degree of this selectivity has varied widely across the small sample of observers tested in previous studies. This study explored the possible bases for this variation, and in particular tested whether it reflected age-related changes in the distribution or tuning of color mechanisms. Observers included 15 younger (18-22 years of age) and 15 older individuals (66-82), who adapted to temporal modulations along one of four chromatic axes (two cardinal and two intermediate axes) and then matched the hue and contrast of test stimuli lying along eight different directions in the equiluminant plane. All observers exhibited aftereffects that were selective for both the cardinal and intermediate directions, although selectivity was weaker for the intermediate axes. The degree of selectivity increased with the magnitude of adaptation for all axes, and thus adaptation strength alone may account for much of the variance in selectivity among observers. Older observers showed a stronger magnitude of adaptation thus, surprisingly, more conspicuous evidence for higher-order mechanisms. For both age groups the aftereffects were well predicted by response changes in chromatic channels with linear spectral sensitivities, and there was no evidence for weakened channel tuning with aging. The results suggest that higher-order mechanisms may become more exposed in observers or conditions in which the strength of adaptation is greater, and that both chromatic contrast adaptation and the cortical color coding it reflects remain largely intact in the aging visual system.

Evidence for multiple extra-striate mechanisms behind perception of visual motion gradients

Perceiving motion patterns in visual scenes in which speed or motion direction varies over space while average luminance remains constant presents a processing task that requires at least two separate stages of neural spatio-temporal filtering. We have previously probed the transfer of information between these stages of filtering identifying a largely scale invariant process in which narrowband initial motion sensitive filters are coupled with a broad range of spatial frequencies of secondary filters, with an optimal coupling - in terms of optimal observer visual sensitivity - at a frequency ratio of around twelve. In the current work, we used the same stimulus to investigate the possible presence of multiple secondary filtering mechanisms and their associated bandwidths. Using a forced choice psychophysical task with both a detection and an identification component, we presented experimental blocks containing stimuli with one of two different modulator frequencies in each trial to measure the frequency difference at which the detection performance matched the identification of the frequency. We found that at a frequency differences of about 2.2 octaves, performance of both tasks was similar, and the processing could therefore be inferred to occur in independent frequency channels. The same observation was confirmed for stimuli presented at a longer viewing distance. We conclude that for the motion gradient stimuli, there are secondary filtering mechanisms with a moderately broad bandwidth of over 2 octaves that underlie our sensitivity for detecting motion gradients of different modulation frequency. These are likely to be implemented at least in part within the dorsal stream of extra-striate cortex.

Motion-defined contour processing in the early visual cortex

From our daily experience, it is very clear that relative motion cues can contribute to correctly identifying object boundaries and perceiving depth. Motion-defined contours are not only generated by the motion of objects in a scene but also by the movement of an observer's head and body (motion parallax). However, the neural mechanism involved in detecting these contours is still unknown. To explore this mechanism, we extracellularly recorded visual responses of area 18 neurons in anesthetized and paralyzed cats. The goal of this study was to determine if motion-defined contours could be detected by neurons that have been previously shown to detect luminance-, texture-, and contrast-defined contours cue invariantly. Motion-defined contour stimuli were generated by modulating the velocity of high spatial frequency sinusoidal luminance gratings (carrier gratings) by a moving squarewave envelope. The carrier gratings were outside the luminance passband of a neuron, such that presence of the carrier alone within the receptive field did not elicit a response. Most neurons that responded to contrast-defined contours also responded to motion-defined contours. The orientation and direction selectivity of these neurons for motion-defined contours was similar to that of luminance gratings. A given neuron also exhibited similar selectivity for the spatial frequency of the carrier gratings of contrast- and motion-defined contours. These results suggest that different second-order contours are detected in a form-cue invariant manner, through a common neural mechanism in area 18.

Natural versus synthetic stimuli for estimating receptive field models: a comparison of predictive robustness

An ultimate goal of visual neuroscience is to understand the neural encoding of complex, everyday scenes. Yet most of our knowledge of neuronal receptive fields has come from studies using simple artificial stimuli (e.g., bars, gratings) that may fail to reveal the full nature of a neuron's actual response properties. Our goal was to compare the utility of artificial and natural stimuli for estimating receptive field (RF) models. Using extracellular recordings from simple type cells in cat A18, we acquired responses to three types of broadband stimulus ensembles: two widely used artificial patterns (white noise and short bars), and natural images. We used a primary dataset to estimate the spatiotemporal receptive field (STRF) with two hold-back datasets for regularization and validation. STRFs were estimated using an iterative regression algorithm with regularization and subsequently fit with a zero-memory nonlinearity. Each RF model (STRF and zero-memory nonlinearity) was then used in simulations to predict responses to the same stimulus type used to estimate it, as well as to other broadband stimuli and sinewave gratings. White noise stimuli often elicited poor responses leading to noisy RF estimates, while short bars and natural image stimuli were more successful in driving A18 neurons and producing clear RF estimates with strong predictive ability. Natural image-derived RF models were the most robust at predicting responses to other broadband stimulus ensembles that were not used in their estimation and also provided good predictions of tuning curves for sinewave gratings.

Gain control in the response of human visual cortex to plaids

A recent intrinsic signal optical imaging study in tree shrew showed, surprisingly, that the population response of V1 to plaid patterns comprising grating components of equal contrast is predicted by the average of the responses to the individual components (MacEvoy SP, Tucker TR, Fitzpatrick D. Nat Neurosci 12: 637-645, 2009). This prompted us to compare responses to plaids and gratings in human visual cortex as a function of contrast and orientation. We found that the functional MRI (fMRI) blood oxygenation level-dependent (BOLD) responses of areas V1-V3 to a plaid comprising superposed grating components of equal contrast are significantly higher than the responses to a single component. Furthermore, the orientation response profile of a plaid is poorly predicted from a linear combination of the responses to its components. Together, these results indicate that the model of MacEvoy et al. (2009) cannot, without modification, account for the fMRI BOLD response to plaids in human visual cortex.

Predictive coding as a model of the V1 saliency map hypothesis

The predictive coding/biased competition (PC/BC) model is a specific implementation of the predictive coding theory that has previously been shown to provide a detailed account of the response properties of orientation tuned cells in primary visual cortex (V1). Here it is shown that the same model can successfully simulate psychophysical data relating to the saliency of unique items in search arrays, of contours embedded in random texture, and of borders between textured regions. This model thus provides a possible implementation of the hypothesis that V1 generates a bottom-up saliency map. However, PC/BC is very different from previous models of visual salience, in that it proposes that saliency results from the failure of an internal model of simple elementary image components to accurately predict the visual input. Saliency can therefore be interpreted as a mechanism by which prediction errors attract attention in an attempt to improve the accuracy of the brain's internal representation of the world.

A visual field dependent architecture for second order motion processing

The visual system exploits a cortical hierarchy to process complex inputs such as those defined by modulations of motion and/or texture. One class of visual stimuli, composed of alternate stripes of opposing motion requires at least 2 separate stages of computation within this cortical hierarchy, thought to involve cortical area V1 and extra-striate regions like global motion area MT respectively. Using a psychophysical task, we characterise sensitivity to such stimuli containing periodic spatial modulations of motion gradients as a function of the ratio of the spatial parameters at the two processing levels by manipulating the spatial properties of the carrier and modulator. We find band-passed functions for foveal stimulus presentations showing an optimum sensitivity at ratios in the range of r≤10, informative of the coupling relationship between frequency channels at the carrier and modulator levels. An annulus stimulus (excluding the fovea) with a radius of 15.5° exhibited optima of sensitivity at r>15. This difference in the optimal coupling between filtering stages reflects a processing architecture that changes with eccentricity, consistent with the previously observed smaller differences between mean receptive field sizes in striate and extra-striate filtering stages in the fovea compared to the periphery. This is also important for visual psychophysics when comparing sensitivity for first and second order stimuli across retinal eccentricity.

Visual responses to contrast-defined contours with equally spatial-scaled carrier in cat area 18

Contrast-defined contours are one type of second-order contours, across which there are no differences in luminance. Although they can be always perceived, their responses have been only investigated when the spatial frequency of carrier, the background texture whose contrast is modulated to form contours, is much higher than that of contrast-defined contours, due to the interference of responses to luminance contours in other cases. In the present study, we examined visual responses in cat area 18 to the contrast-defined contours with carrier at same spatial frequency equal to neuron's preferred value for luminance contours, by establishing a control stimulus including all the luminance components but lack of the contrast contour information. Using single unit recording and intrinsic optical imaging, we demonstrated that contrast gratings with equally spatial-scaled carrier induced responses in a proportion of cat area 18 neurons with the preferred orientation similar to that for luminance contours, and the responses generated orientation maps similar to those for luminance contours. Our finding suggests that early visual cortex can process second-order contours regardless of the spatial frequency of carriers, in a way similar to the processing of luminance contours. This uniform manner of early visual processing might underlie the visual detection of both luminance contours and non-luminance second-order contours.

Orientation gradient detection exhibits variable coupling between first- and second-stage filtering mechanisms

We investigated sensitivity to orientation modulation using visual stimuli with bandpass filtered noise carriers. We characterized the relationship between the spatial parameters of the modulator and the carrier using a 2-AFC detection task. The relationship between these two parameters is potentially informative of the underlying coupling between first- and second-stage filtering mechanisms, which, in turn, may bear on the interrelationship between striate and extrastriate cortical processing. Our previous experiments on analogous motion stimuli found an optimum sensitivity when the ratio of the carrier and modulator spatial frequency parameters (r) was approximately ten. The current results do not exhibit an optimum sensitivity at a given value of the ratio r. Previous experiments involving second-order modulation sensitivity show an inconsistent range of estimates of optimum sensitivity at values of r between 5 and 50. Our results, using a complementary approach, confirm these discrepancies, demonstrating that the coupling between carrier and modulator frequency parameters depends on a number of stimulus-specific factors, such as contrast sensitivity, stimulus eccentricity, and absolute values of the carrier and modulator spatial frequency parameters. We show that these observations are true for a stimulus limited in eccentricity and that this orientation-modulated stimulus does not exhibit scale invariance. Such processing can not be modeled by a generic filter-rectify-filter model.

What the 'Moonwalk' illusion reveals about the perception of relative depth from motion

When one visual object moves behind another, the object farther from the viewer is progressively occluded and/or disoccluded by the nearer object. For nearly half a century, this dynamic occlusion cue has been thought to be sufficient by itself for determining the relative depth of the two objects. This view is consistent with the self-evident geometric fact that the surface undergoing dynamic occlusion is always farther from the viewer than the occluding surface. Here we use a contextual manipulation ofa previously known motion illusion, which we refer to as the'Moonwalk' illusion, to demonstrate that the visual system cannot determine relative depth from dynamic occlusion alone. Indeed, in the Moonwalk illusion, human observers perceive a relative depth contrary to the dynamic occlusion cue. However, the perception of the expected relative depth is restored by contextual manipulations unrelated to dynamic occlusion. On the other hand, we show that an Ideal Observer can determine using dynamic occlusion alone in the same Moonwalk stimuli, indicating that the dynamic occlusion cue is, in principle, sufficient for determining relative depth. Our results indicate that in order to correctly perceive relative depth from dynamic occlusion, the human brain, unlike the Ideal Observer, needs additional segmentation information that delineate the occluder from the occluded object. Thus, neural mechanisms of object segmentation must, in addition to motion mechanisms that extract information about relative depth, play a crucial role in the perception of relative depth from motion.

Exogenous attention enhances 2nd-order contrast sensitivity

Natural scenes contain a rich variety of contours that the visual system extracts to segregate the retinal image into perceptually coherent regions. Covert spatial attention helps extract contours by enhancing contrast sensitivity for 1st-order, luminance-defined patterns at attended locations, while reducing sensitivity at unattended locations, relative to neutral attention allocation. However, humans are also sensitive to 2nd-order patterns such as spatial variations of texture, which are predominant in natural scenes and cannot be detected by linear mechanisms. We assess whether and how exogenous attention--the involuntary and transient capture of spatial attention--affects the contrast sensitivity of channels sensitive to 2nd-order, texture-defined patterns. Using 2nd-order, texture-defined stimuli, we demonstrate that exogenous attention increases 2nd-order contrast sensitivity at the attended location, while decreasing it at unattended locations, relative to a neutral condition. By manipulating both 1st- and 2nd-order spatial frequency, we find that the effects of attention depend both on 2nd-order spatial frequency of the stimulus and the observer's 2nd-order spatial resolution at the target location. At parafoveal locations, attention enhances 2nd-order contrast sensitivity to high, but not to low 2nd-order spatial frequencies; at peripheral locations attention also enhances sensitivity to low 2nd-order spatial frequencies. Control experiments rule out the possibility that these effects might be due to an increase in contrast sensitivity at the 1st-order stage of visual processing. Thus, exogenous attention affects 2nd-order contrast sensitivity at both attended and unattended locations.

Beyond multiple pattern analyzers modeled as linear filters (as classical V1 simple cells): useful additions of the last 25 years

This review briefly discusses processes that have been suggested in the last 25 years as important to the intermediate stages of visual processing of patterns. Five categories of processes are presented: (1) Higher-order processes including FRF structures; (2) Divisive contrast nonlinearities including contrast normalization; (3) Subtractive contrast nonlinearities including contrast comparison; (4) Non-classical receptive fields (surround suppression, cross-orientation inhibition); (5) Contour integration.

The perceptual expansion of a filled area depends on textural characteristics

According to the Oppel-Kundt illusion, a filled space appears larger than an empty one. In the present research we studied how textural characteristics affect the perceived size of two-dimensional patterns. We investigated the perceived extension of square textures by manipulating spatial frequency and filling microelements' numerosity. Subjects compared the test stimuli with a uniform gray square varied in size and performed the task both with the adjustment and the constant stimuli methods. An illusory increment of area extension was generally found with textured stimuli. The illusory effect increased with spatial frequency and decreased with the microelements' number, indicating an independent processing of these two basic properties. Moreover, the smaller effect found when spatial frequency extraction became harder, confirmed that the illusion involves spatial frequency processing. Finally, the reduced overestimation of areas observed with a weaker subparts' articulation confirmed the relevance of clear distinguishable micropatterns at the basis of the phenomenon. Those results demonstrate the influence of textural statistical properties on perceiving the size of a visual object.

Subcortical representation of non-Fourier image features

A fundamental goal of visual neuroscience is to identify the neural pathways representing different image features. It is widely argued that the early stages of these pathways represent linear features of the visual scene and that the nonlinearities necessary to represent complex visual patterns are introduced later in cortex. We tested this by comparing the responses of subcortical and cortical neurons to interference patterns constructed by summing sinusoidal gratings. Although a linear mechanism can detect the component gratings, a nonlinear mechanism is required to detect an interference pattern resulting from their sum. Consistent with in vitro retinal ganglion cell recordings, we found that interference patterns are represented subcortically by cat LGN Y-cells, but not X-cells. Linear and nonlinear tuning properties of LGN Y-cells were then characterized and compared quantitatively with those of cortical area 18 neurons responsive to interference patterns. This comparison revealed a high degree of similarity between the two neural populations, including the following: (1) the representation of similar spatial frequencies in both their linear and nonlinear responses, (2) comparable orientation selectivity for the high spatial frequency carrier of interference patterns, and (3) the same difference in their temporal frequency selectivity for drifting gratings versus the envelope of interference patterns. The present findings demonstrate that the nonlinear subcortical Y-cell pathway represents complex visual patterns and likely underlies cortical responses to interference patterns. We suggest that linear and nonlinear mechanisms important for encoding visual scenes emerge in parallel through distinct pathways originating at the retina.

Subpopulations of neurons in visual area v2 perform differentiation and integration operations in space and time

The interconnected areas of the visual system work together to find object boundaries in visual scenes. Primary visual cortex (V1) mainly extracts oriented luminance boundaries, while secondary visual cortex (V2) also detects boundaries defined by differences in texture. How the outputs of V1 neurons are combined to allow for the extraction of these more complex boundaries in V2 is as of yet unclear. To address this question, we probed the processing of orientation signals in single neurons in V1 and V2, focusing on response dynamics of neurons to patches of oriented gratings and to combinations of gratings in neighboring patches and sequential time frames. We found two kinds of response dynamics in V2, both of which were different from those of V1 neurons. While V1 neurons in general preferred one orientation, one subpopulation of V2 neurons (“transient”) showed a temporally dynamic preference, resulting in a preference for changes in orientation. The second subpopulation of V2 neurons (“sustained”) responded similarly to V1 neurons, but with a delay. The dynamics of nonlinear responses to combinations of gratings reinforced these distinctions: the dynamics enhanced the preference of V1 neurons for continuous orientations and the preference of V2 transient neurons for discontinuous ones. We propose that transient neurons in V2 perform a differentiation operation on the V1 input, both spatially and temporally, while the sustained neurons perform an integration operation. We show that a simple feedforward network with delayed inhibition can account for the temporal but not for the spatial differentiation operation.

Learning to identify near-threshold luminance-defined and contrast-defined letters in observers with amblyopia

We assessed whether or not the sensitivity for identifying luminance-defined and contrast-defined letters improved with training in a group of amblyopic observers who have passed the critical period of development. In Experiment 1, we tracked the contrast threshold for identifying luminance-defined letters with training in a group of 11 amblyopic observers. Following training, six observers showed a reduction in thresholds, averaging 20%, for identifying luminance-defined letters. This improvement transferred extremely well to the untrained task of identifying contrast-defined letters (average improvement=38%) but did not transfer to an acuity measurement. Seven of the 11 observers were subsequently trained on identifying contrast-defined letters in Experiment 2. Following training, five of these seven observers demonstrated a further improvement, averaging 17%, for identifying contrast-defined letters. This improvement did not transfer to the untrained task of identifying luminance-defined letters. Our findings are consistent with predictions based on the locus of learning for first- and second-order stimuli according to the filter-rectifier-filter model for second-order visual processing.

The processing of feature discontinuities for different cue types in primary visual cortex

This study examines whether neurons in the primary visual cortex (V1) of the cat (also referred to as area 17) are sensitive to boundaries that are delineated by a difference in features other than luminance contrast. Most research on this issue has concentrated on the responses to texture borders (e.g. 'illusory contours') and has found neurons that are sensitive to such borders in V2 and to a lesser extent in V1. Here neurons in cat area 17 (V1) were exposed to borders that were oblique to the orientation preference of the neuron and that were created by differences in phase, orientation or direction of motion of two drifting sinewave gratings. Nearby phase borders evoked increased firing in 15 out of 98 neurons, orientation borders in 18 out of 98, and direction borders in 15 out of 70 neurons recorded in area 17 (V1) of anesthetized cats. The firing rates of these neurons were enhanced when a feature border was presented close to their receptive field, partly independent of the cue involved. Control experiments with a contrast border showed that the enhanced firing was due to a release of suppression rather than facilitation. A conceptual model is presented that can describe the data and uncovers a peculiarity of the phase domain compared to the orientation and direction domain. The model unifies the knowledge gained here about orientation-specific center-surround interactions, contextual effects, and end-stopping. The data and model suggest that these phenomena are part of a single mechanism that enables the brain to detect feature discontinuities across a range of features.

Curvature-based perceptual singularities and texture saliency with early vision mechanisms

Recent work has shown that salient perceptual singularities occur in visual textures even in the absence of feature gradients. In smoothly varying orientation-defined textures, these striking non-smooth percepts can be predicted from two texture curvatures, one tangential and one normal [Proc. Natl. Acad. Sci. USA103, 15704 (2006)]. We address the issue of detecting these perceptual singularities in a biologically plausible manner and present three different models to compute the tangential and normal curvatures using early cortical mechanisms. The first model relies on the response summation of similarly scaled even-symmetric simple cells at different positions by utilizing intercolumnar interactions in the primary visual cortex (V1). The second model is based on intracolumnar interactions in a two-layer mechanism of simple cells having the same orientation tuning but significantly different scales. Our third model uses a three-layer circuit in which both even-symmetric and odd-symmetric receptive fields (RFs) are used to compute all possible directional derivatives of the dominant orientation, from which the tangential and normal curvatures at each spatial position are selected using nonlinear shunting inhibition. We show experimental results of all three models, we outline an extension to oriented textures with multiple dominant orientations at each point, and we discuss how our results may be relevant to the processing of general textures.