Effects of contrast and size on orientation discrimination

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Environmental dynamics shape perceptual decision bias

To interpret the sensory environment, the brain combines ambiguous sensory measurements with knowledge that reflects context-specific prior experience. But environmental contexts can change abruptly and unpredictably, resulting in uncertainty about the current context. Here we address two questions: how should context-specific prior knowledge optimally guide the interpretation of sensory stimuli in changing environments, and do human decision-making strategies resemble this optimum? We probe these questions with a task in which subjects report the orientation of ambiguous visual stimuli that were drawn from three dynamically switching distributions, representing different environmental contexts. We derive predictions for an ideal Bayesian observer that leverages knowledge about the statistical structure of the task to maximize decision accuracy, including knowledge about the dynamics of the environment. We show that its decisions are biased by the dynamically changing task context. The magnitude of this decision bias depends on the observer's continually evolving belief about the current context. The model therefore not only predicts that decision bias will grow as the context is indicated more reliably, but also as the stability of the environment increases, and as the number of trials since the last context switch grows. Analysis of human choice data validates all three predictions, suggesting that the brain leverages knowledge of the statistical structure of environmental change when interpreting ambiguous sensory signals.

Emergence of crowding: The role of contrast and orientation salience

Crowding causes difficulties in judging attributes of an object surrounded by other objects. We investigated crowding for stimuli that isolated either S-cone or luminance mechanisms or combined them. By targeting different retinogeniculate mechanisms with contrast-matched stimuli, we aim to determine the earliest site at which crowding emerges. Discrimination was measured in an orientation judgment task where Gabor targets were presented parafoveally among flankers. In the first experiment, we assessed flanked and unflanked orientation discrimination thresholds for pure S-cone and achromatic stimuli and their combinations. In the second experiment, to capture individual differences, we measured unflanked detection and orientation sensitivity, along with performance under flanker interference for stimuli containing luminance only or combined with S-cone contrast. We confirmed that orientation sensitivity was lower for unflanked S-cone stimuli. When flanked, the pattern of results for S-cone stimuli was the same as for achromatic stimuli with comparable (i.e. low) contrast levels. We also found that flanker interference exhibited a genuine signature of crowding only when orientation discrimination threshold was reliably surpassed. Crowding, therefore, emerges at a stage that operates on signals representing task-relevant featural (here, orientation) information. Because luminance and S-cone mechanisms have very different spatial tuning properties, it is most parsimonious to conclude that crowding takes place at a neural processing stage after they have been combined.

Decision Signals in the Local Field Potentials of Early and Mid-Level Macaque Visual Cortex

The neural basis of perceptual decision making has typically been studied using measurements of single neuron activity, though decisions are likely based on the activity of large neuronal ensembles. Local field potentials (LFPs) may, in some cases, serve as a useful proxy for population activity and thus be useful for understanding the neural basis of perceptual decision making. However, little is known about whether LFPs in sensory areas include decision-related signals. We therefore analyzed LFPs recorded using two 48-electrode arrays implanted in primary visual cortex (V1) and area V4 of macaque monkeys trained to perform a fine orientation discrimination task. We found significant choice information in low (0-30 Hz) and higher (70-500 Hz) frequency components of the LFP, but little information in gamma frequencies (30-70 Hz). Choice information was more robust in V4 than V1 and stronger in LFPs than in simultaneously measured spiking activity. LFP-based choice information included a global component, common across electrodes within an area. Our findings reveal the presence of robust choice-related signals in the LFPs recorded in V1 and V4 and suggest that LFPs may be a useful complement to spike-based analyses of decision making.

Frequency ratio determines discrimination of concentric radial frequency patterns in the peripheral visual field

Using a radial frequency discrimination task that has not been tested in many previous studies, we examined the dependence of the pattern radius (4 to 16 deg) on the radial frequency thresholds of two different types of concentric radial frequency (RF) patterns: constant circular contour frequency (CCF) RF patterns with different radii, which have the constant physical length of modulation cycle in external real-world space, and constant radial frequency magnified RF patterns with different radii, which have the constant cortical length of modulation cycles. These two types RF patterns used as the reference stimuli had an equal maximum orientation difference from circularity regardless of change in radius. The discrimination threshold expressed by the frequency ratio between RF patterns of different frequencies vs. radius functions for the constant CCF RF patterns indicated different functional forms dependent on the modulation amplitude of the RF patterns. The thresholds increased with increasing pattern radius for small modulation amplitude RF patterns but were relatively flattened for large-amplitude RF patterns. This dependence was ascribed to the eccentricity effect wherein the deformation thresholds for discriminating the RF pattern from a circle increase with increasing stimulus eccentricity (Feng et al. 2020). The discrimination thresholds vs. radius functions for the magnified RF patterns were also flattened for different modulation amplitudes and frequencies. The thresholds (frequency ratio) were similar at all eccentricities. Cortical magnification neutralized the eccentricity effect observed for the constant CCF patterns.

Constrained sampling from deep generative image models reveals mechanisms of human target detection

The first steps of visual processing are often described as a bank of oriented filters followed by divisive normalization. This approach has been tremendously successful at predicting contrast thresholds in simple visual displays. However, it is unclear to what extent this kind of architecture also supports processing in more complex visual tasks performed in naturally looking images. We used a deep generative image model to embed arc segments with different curvatures in naturalistic images. These images contain the target as part of the image scene, resulting in considerable appearance variation of target as well as background. Three observers localized arc targets in these images, with an average accuracy of 74.7%. Data were fit by several biologically inspired models, four standard deep convolutional neural networks (CNNs), and a five-layer CNN specifically trained for this task. Four models predicted observer responses particularly well; (1) a bank of oriented filters, similar to complex cells in primate area V1; (2) a bank of oriented filters followed by tuned gain control, incorporating knowledge about cortical surround interactions; (3) a bank of oriented filters followed by local normalization; and (4) the five-layer CNN. A control experiment with optimized stimuli based on these four models showed that the observers' data were best explained by model (2) with tuned gain control. These data suggest that standard models of early vision provide good descriptions of performance in much more complex tasks than what they were designed for, while general-purpose non linear models such as convolutional neural networks do not.

Representation of visual uncertainty through neural gain variability

Uncertainty is intrinsic to perception. Neural circuits which process sensory information must therefore also represent the reliability of this information. How they do so is a topic of debate. We propose a model of visual cortex in which average neural response strength encodes stimulus features, while cross-neuron variability in response gain encodes the uncertainty of these features. To test this model, we studied spiking activity of neurons in macaque V1 and V2 elicited by repeated presentations of stimuli whose uncertainty was manipulated in distinct ways. We show that gain variability of individual neurons is tuned to stimulus uncertainty, that this tuning is specific to the features encoded by these neurons and largely invariant to the source of uncertainty. We demonstrate that this behavior naturally arises from known gain-control mechanisms, and illustrate how downstream circuits can jointly decode stimulus features and their uncertainty from sensory population activity.

Wall patterns influence the perception of interior space

The texture of an object’s surface influences its perceived spatial extent. For example, Hermann von Helmholtz reported that a square patch with black and white stripes appears elongated perpendicular to the stripes’ orientation. This time-honoured finding stands in contrast with more recent recommendations by interior-design experts who suggest that stripe wall patterns make rooms appear elongated in the direction parallel to the stripes’ orientation. In a series of four experiments, we presented stripe wall patterns and varied the orientation of the stripes (horizontal vs. vertical) and their density (number of stripes per degree of visual angle). Subjects estimated the width and height of stereoscopically presented interior spaces. Stripe patterns with higher densities made rooms appear both wider and higher than did stripe patterns with lower densities or plain walls. In contrast to both the predictions from the Helmholtz-square and the design guidelines, this effect was only weakly modulated by pattern orientation, in the sense that rooms appeared elongated in the direction parallel to the stripes’ orientation. We conclude that object-based texture effects cannot be generalised to interior space perception. For a room’s perceived spatial extent, pattern density is more important than pattern orientation.

Laws of concatenated perception: Vision goes for novelty, decisions for perseverance

Every instant of perception depends on a cascade of brain processes calibrated to the history of sensory and decisional events. In the present work, we show that human visual perception is constantly shaped by two contrasting forces exerted by sensory adaptation and past decisions. In a series of experiments, we used multilevel modeling and cross-validation approaches to investigate the impact of previous stimuli and decisions on behavioral reports during adjustment and forced-choice tasks. Our results revealed that each perceptual report is permeated by opposite biases from a hierarchy of serially dependent processes: Low-level adaptation repels perception away from previous stimuli, whereas decisional traces attract perceptual reports toward the recent past. In this hierarchy of serial dependence, "continuity fields" arise from the inertia of decisional templates and not from low-level sensory processes. This finding is consistent with a Two-process model of serial dependence in which the persistence of readout weights in a decision unit compensates for sensory adaptation, leading to attractive biases in sequential perception. We propose a unified account of serial dependence in which functionally distinct mechanisms, operating at different stages, promote the differentiation and integration of visual information over time.

Iconic Memories Die a Sudden Death

Iconic memory is characterized by its large storage capacity and brief storage duration, whereas visual working memory is characterized by its small storage capacity. The limited information stored in working memory is often modeled as an all-or-none process in which studied information is either successfully stored or lost completely. This view raises a simple question: If almost all viewed information is stored in iconic memory, yet one second later most of it is completely absent from working memory, what happened to it? Here, I characterized how the precision and capacity of iconic memory changed over time and observed a clear dissociation: Iconic memory suffered from a complete loss of visual items, while the precision of items retained in memory was only marginally affected by the passage of time. These results provide new evidence for the discrete-capacity view of working memory and a new characterization of iconic memory decay.

A closer look at four-dot masking of a foveated target

Four-dot masking with a common onset mask was recently demonstrated in a fully attended and foveated target (Filmer, Mattingley & Dux, 2015). Here, we replicate and extend this finding by directly comparing a four-dot mask with an annulus mask while probing masking as a function of mask duration, and target-mask separation. Our results suggest that while an annulus mask operates via spatially local contour interactions, a four-dot mask operates through spatially global mechanisms. We also measure how the visual system’s representation of an oriented bar is impacted by a four-dot mask, and find that masking here does not degrade the precision of perceived targets, but instead appears to be driven exclusively by rendering the target completely invisible.

Contrast-dependent orientation discrimination in the mouse

As an important animal model to study the relationship between behaviour and neural activity, the mouse is able to perform a variety of visual tasks, such as orientation discrimination and contrast detection. However, it is not clear how stimulus contrast influences the performance of orientation discrimination in mice. In this study, we used two task designs, two-alternative forced choice (2AFC) and go/no-go, to examine the performance of mice to discriminate two orthogonal orientations at different contrasts. We found that the performance tended to increase with contrast, and the performance at high contrast was better when the stimulus set contained a single contrast than multiple contrasts. Physiological experiments in V1 showed that neural discriminability of two orthogonal orientations increased with contrast. Furthermore, orientation discriminability of V1 neurons at high contrast was higher in the single than in the multiple contrast condition, largely due to smaller response variance in the single contrast condition. Thus, the performance of mice to discriminate orientations at high contrast is adapted to the contrast range in the stimuli, partly attributed to the contrast-range dependent capacity of V1 neurons to discriminate orientations.

Combinatorial neural codes from a mathematical coding theory perspective

Shannon's seminal 1948 work gave rise to two distinct areas of research: information theory and mathematical coding theory. While information theory has had a strong influence on theoretical neuroscience, ideas from mathematical coding theory have received considerably less attention. Here we take a new look at combinatorial neural codes from a mathematical coding theory perspective, examining the error correction capabilities of familiar receptive field codes (RF codes). We find, perhaps surprisingly, that the high levels of redundancy present in these codes do not support accurate error correction, although the error-correcting performance of receptive field codes catches up to that of random comparison codes when a small tolerance to error is introduced. However, receptive field codes are good at reflecting distances between represented stimuli, while the random comparison codes are not. We suggest that a compromise in error-correcting capability may be a necessary price to pay for a neural code whose structure serves not only error correction, but must also reflect relationships between stimuli.

A neural circuit for spatial summation in visual cortex

The response of cortical neurons to a sensory stimulus is modulated by the context. In the visual cortex, for example, stimulation of a pyramidal cell's receptive-field surround can attenuate the cell's response to a stimulus in the centre of its receptive field, a phenomenon called surround suppression. Whether cortical circuits contribute to surround suppression or whether the phenomenon is entirely relayed from earlier stages of visual processing is debated. Here we show that, in contrast to pyramidal cells, the response of somatostatin-expressing inhibitory neurons (SOMs) in the superficial layers of the mouse visual cortex increases with stimulation of the receptive-field surround. This difference results from the preferential excitation of SOMs by horizontal cortical axons. By perturbing the activity of SOMs, we show that these neurons contribute to pyramidal cells' surround suppression. These results establish a cortical circuit for surround suppression and attribute a particular function to a genetically defined type of inhibitory neuron.

Distinct mechanisms for size tuning in primate visual cortex

Most neurons in primary visual cortex (V1) are selective for stimulus size, a property with important implications for salient feature detection. Size selectivity involves dynamic interactions between neuronal circuits that establish the classical (center) and extraclassical (surround) of a neuron's receptive field. Although much is known about the tuning properties and stimulus selectivity of the center and surround subunits, relatively little is known about how these subunits interact to achieve size selectivity. To address this question, we examined the temporal dynamics of size selectivity in two classes of pyramidal neurons at similar hierarchical processing stages in V1 of alert monkeys. These two classes were comprised of neurons in cortical layer 6 with identified projections to the lateral geniculate nucleus. While both neuronal groups displayed comparable levels of size selectivity, the temporal dynamics of their tuning differed significantly. We compared the size tuning profiles of each cell type with a series of sum-of-Gaussian models and discovered that the receptive fields of neurons with fast-conducting axons contained an excitatory center and a suppressive surround with similar onset timing. In contrast, neurons with slow-conducting axons used two center components-an early wide-field component and a delayed narrow-field component that increased activity-in addition to the surround component. The early, wide-field component represents a novel mechanism for cortical neurons to integrate contextual information. These results demonstrate that size tuning in cortical neurons is established via multiple unique mechanisms, dictated by the rich circuit architecture in which neurons are embedded.

Patterns and trajectories in Williams Syndrome: the case of visual orientation discrimination

Williams Syndrome (WS) is a developmental disorder typified by deficits in visuospatial cognition. To understand the nature of this deficit, we characterized how people with WS perceive visual orientation, a fundamental ability related to object identification. We compared WS participants to typically developing children (3-6 years of age) and typical adults in an orientation discrimination task with four stimulus types (small circular, large circular, collinear elongated and parallel elongated gratings). We measured orientation discrimination thresholds and the proportion of orthogonal errors (i.e., mirror-image reversal errors). We evaluated how these metrics (1) are modulated by stimulus condition, and (2) vary with chronological or mental age. We found that orientation perception in WS is comparable to that of typically developing children. Orientation discrimination thresholds were better for elongated gratings than circular gratings across all participant groups. For large circular gratings, the proportion of orthogonal errors was disproportionately greater in WS participants and typically developing 3-6 year old children than in typical adults. Moreover, we found that the ability to judge orientation in WS improves with increasing mental age, but not chronological age. These results suggest that orientation discrimination in WS is developmentally arrested, as opposed to abnormal or delayed.

Contrast adaptation contributes to contrast-invariance of orientation tuning of primate V1 cells

Background

Studies in rodents and carnivores have shown that orientation tuning width of single neurons does not change when stimulus contrast is modified. However, in these studies, stimuli were presented for a relatively long duration (e. g., 4 seconds), making it possible that contrast adaptation contributed to contrast-invariance of orientation tuning. Our first purpose was to determine, in marmoset area V1, whether orientation tuning is still contrast-invariant with the stimulation duration is comparable to that of a visual fixation.

Methodology/Principal Findings

We performed extracellular recordings and examined orientation tuning of single-units using static sine-wave gratings that were flashed for 200 msec. Sixteen orientations and three contrast levels, representing low, medium and high values in the range of effective contrasts for each neuron, were randomly intermixed. Contrast adaptation being a slow phenomenon, cells did not have enough time to adapt to each contrast individually. With this stimulation protocol, we found that the tuning width obtained at intermediate contrast was reduced to 89% (median), and that at low contrast to 76%, of that obtained at high contrast. Therefore, when probed with briefly flashed stimuli, orientation tuning is not contrast-invariant in marmoset V1. Our second purpose was to determine whether contrast adaptation contributes to contrast-invariance of orientation tuning. Stationary gratings were presented, as previously, for 200 msec with randomly varying orientations, but the contrast was kept constant within stimulation blocks lasting >20 sec, allowing for adaptation to the single contrast in use. In these conditions, tuning widths obtained at low contrast were still significantly less than at high contrast (median 85%). However, tuning widths obtained with medium and high contrast stimuli no longer differed significantly.

Conclusions/Significance

Orientation tuning does not appear to be contrast-invariant when briefly flashed stimuli vary in both contrast and orientation, but contrast adaptation partially restores contrast-invariance of orientation tuning.

Orientation discrimination in human vision: Psychophysics and modeling

We evaluated orientation discrimination thresholds using an external noise paradigm. Stimuli were spatiotemporal Gaussian patches of 2D orientation noise band-pass filtered in Fourier domain. Orientation acuity was measured for various combinations of stimulus spatial bandwidth, spatial frequency, and size as a function of orientation bandwidths of the stimuli. Stimulus contrast was matched in multiples of detection threshold. Consistent with the idea that stimulus orientation bandwidth acts as a source of external noise, orientation discrimination thresholds increased monotonically in all conditions with stimulus bandwidth. To interpret these results quantitatively, we first fitted a variance summation model to the data and derived the internal orientation noise, relative sampling efficiency, and orientation tuning of the mechanism underlying orientation discrimination. Due to the equivocal biological nature of these parameters for orientation discrimination, we investigated, with a modeling approach, how neural detectors characterized by a broad orientation tuning may support orientation discrimination. We demonstrated using the ideal-observer theory that while linear models, based on either unimodal filtering or center-surround opponency, predict the monotonic relationship between orientation discrimination threshold and orientation noise, a nonlinear model incorporating a broadband divisive inhibition in the orientation domain is a better candidate due to its contrast invariance. This model, using broad and similar orientation tuning for its excitatory and inhibitory inputs, accounts for the acute orientation acuity of human vision and proves to be robust despite the variance found in natural stimuli.

Orientation discrimination across the visual field: size estimates near contrast threshold

Performance in detection and discrimination tasks can often be made equal across the visual field through appropriate stimulus scaling. The parameter E2 is used to characterize the rate at which stimulus dimensions (e.g., size or contrast) must increase in order to achieve foveal levels of performance. We calculated both size and contrast E2 values for orientation discrimination using a spatial scaling procedure that involves measuring combination size and contrast thresholds for stimuli with constant size-to-contrast ratios. E2 values for size scaling were 5.77 degrees and 5.92 degrees. These values are three to four times larger than those recovered previously using similar stimuli at contrasts well above detection threshold (Sally & Gurnsey, 2003). E2 values for contrast scaling were 324.2 degrees and 44.3 degrees, indicating that for large stimuli little contrast scaling (.3% to 2.3% increase) was required in order to equate performance in the fovea and the largest eccentricity (10 degrees). A similar pattern of results was found using a spatial scaling method that involves measuring contrast thresholds for target identification as a function of size across eccentricities. We conclude that the size scaling for orientation discrimination at near-threshold stimulus contrasts is much larger than that required at suprathreshold contrasts. This may arise, at least in part, from contrast-dependent changes in mechanisms that subserve task performance.

Disclosing disease mechanisms with a spatio-temporal summation paradigm

BACKGROUND

We develop the logic for a stimulus that can evaluate cone-dependent spatial summation and detail the modelling and interpretation of thresholds obtained with this stimulus.

METHODS

Fifteen observers participated, including two young normals tested extensively in control experiments, and a clinical trial based on four observers with age-related macular degeneration (AMD), four age-similar controls and five young observers. Monocular spatial summation functions were measured with contrast-modulated Gabor targets that approximated the optimal visual contrast detector. Thresholds were returned from a yes/no adaptive psychophysical algorithm. By fine titration along the size domain it was demonstrated that the spatial summation of normal observers can be adequately described by a two-component model. A reduced set of variables are proposed for clinical applications and the model was applied to data derived using these variables in persons with AMD and age-similar controls.

RESULTS

We do not find a significant age-related loss of contrast sensitivity in our normal group. On the other hand, persons with early AMD exhibited a 0.41 log unit loss of sensitivity (P=0.04) from age-similar controls, without any change in their maximum summation area (A(max)).

CONCLUSIONS

The nature of the spatial summation is consistent with the interpretation that early AMD produces a decrease in cone input to post-receptoral mechanisms in the absence of neural remodelling.

Contextual effects in fine spatial discriminations

The context in which a pattern is viewed can greatly affect its apparent contrast, a phenomenon commonly attributed to pooled contrast gain control processes. A low-contrast surround may slightly enhance apparent contrast, whereas increasing the contrast of the surround leads to a monotonic decline in contrast appearance. We ask here how the presence of a patterned surround affects the ability to perform fine, suprathreshold orientation, contrast, and spatial frequency discriminations as a function of surround contrast and phase. Our results revealed an unexpected dip in performance when center and surround were in phase and similar in contrast. These results suggest that additional processes, perhaps those involved in scene segregation, play a role in contextual effects on discrimination.

Orientation discrimination across the visual field: matching perceived contrast near threshold

Performance can often be made equal across the visual field by scaling peripherally presented stimuli according to F=1+E/E2 where E2 is the eccentricity at which stimulus size must double to maintain foveal performance levels. Previous studies suggest that E2 for orientation discrimination is in the range of 1.5 degrees -2 degrees when stimuli are presented at contrasts well above detection threshold. Recent psychophysical and physiological evidence suggests spatial reorganization of receptive fields at near-threshold contrasts. Such contrast-dependent changes in receptive field structure might alter the amount of size scaling necessary to equate task performance across the visual field. To examine this question we measured orientation discrimination thresholds for a range of stimulus sizes and eccentricities (0 degrees -15 degrees ). We used the same procedure previously employed except that stimuli were presented at near-threshold contrasts. We controlled for the effects of perceptual contrast on thresholds through a matching procedure. A standard line of 3 degrees in length presented at fixation was set to 2 just noticeable differences above detection threshold. The perceived contrast of all other stimuli was adjusted by the subject to match this one. Orientation discrimination thresholds were then obtained at these matching contrasts for all stimulus sizes and eccentricities. E2 values of 3.42 degrees and 3.50 degrees were recovered for two subjects; these values were about a factor of two larger than E2 values previously found for this task when stimuli were presented at higher physical contrasts.