Binocular Modulation of Monocular V1 Neurons

An anti-Hebbian model for binocular visual plasticity and its attentional modulation

Monocular deprivation during the critical period impairs the cortical structure and visual function of the deprived eye. Conversely, transient occlusion of one eye in adults enhances the predominance of that eye. This counter-intuitive effect of short-term monocular deprivation is a form of homeostatic plasticity. However, whether this sensory plasticity requires attention, and the underlying neural mechanisms remain unclear. Here, through a psychophysical experiment, we demonstrate that the deprivation effect is dramatically attenuated in the absence of attention. We develop a neural computational model incorporating the Hebbian learning rule in interocular inhibitory synapses (i.e., anti-Hebbian learning) to explain the deprivation effect. Our model predicts both the boosting of the deprived eye and its dependence on attention. Moreover, it accounts for other forms of binocular plasticity, including plasticity observed in prolonged binocular rivalry. We suggest that short-term binocular plasticity arises from the plasticity in inhibitory connections between the two monocular pathways.

Simple actions modulate context-dependent visual size perception at late processing stages

A simple button press towards a prime stimulus enhances subsequent visual search for objects that match the prime. The present study investigated whether this action effect is a general phenomenon across different task domains, and the underlying neural mechanisms. The action effect was measured in an unspeeded size-matching task, with the presentation of the central target and the surrounding inducers of the Ebbinghaus illusion together to one eye or separately to each eye, and when repetitive TMS was applied over right primary motor cortex (M1). The results showed that a prior key-press significantly reduced the illusion effect compared to passive viewing. Notably, the action effect persisted with dichoptic presentation of the Ebbinghaus configuration, but disappeared with the right M1 disruption. These results suggest that action guides visual perception to influence human behavior, which mainly affects the late visual processing stage and probably relies on feedback projections from the motor cortex.

Binocular integration of chromatic and luminance signals

Much progress has been made in understanding how the brain combines signals from the two eyes. However, most of this work has involved achromatic (black and white) stimuli, and it is not clear if the same processes apply in color-sensitive pathways. In our first experiment, we measured contrast discrimination ("dipper") functions for four key ocular configurations (monocular, binocular, half-binocular, and dichoptic), for achromatic, isoluminant L-M and isoluminant S-(L+M) sine-wave grating stimuli (L: long-, M: medium-, S: short-wavelength). We find a similar pattern of results across stimuli, implying equivalently strong interocular suppression within each pathway. Our second experiment measured dichoptic masking within and between pathways using the method of constant stimuli. Masking was strongest within-pathway and weakest between S-(L+M) and achromatic mechanisms. Finally, we repeated the dipper experiment using temporal luminance modulations, which produced slightly weaker interocular suppression than for spatially modulated stimuli. We interpret our results in the context of a contemporary two-stage model of binocular contrast gain control, implemented here using a hierarchical Bayesian framework. Posterior distributions of the weight of interocular suppression overlapped with a value of 1 for all dipper data sets, and the model captured well the pattern of thresholds from all three experiments.

Multisensory-inspired modeling and neural correlates for two key binocular interactions

Most binocular vision models assume that the two eyes sum incompletely. However, some facilitatory cortical neurons fire for only one eye, but amplify their firing rates if both eyes are stimulated. These 'binocular gate' neurons closely resemble subthreshold multisensory neurons. Binocular amplification for binocular gate neurons follows a power law, with a compressive exponent. Unexpectedly, this rule also applies to facilitatory true binocular neurons; although driven by either eye, binocular neurons are well modeled as gated amplifiers of their strongest monocular response, if both eyes are stimulated. Psychophysical data follows the same power law as the neural data, with a similar exponent; binocular contrast sensitivity can be modeled as a gated amplification of the more sensitive eye. These results resemble gated amplification phenomena in multisensory integration, and other non-driving modulatory interactions that affect sensory processing. Models of incomplete summation seem unnecessary for V1 facilitatory neurons or contrast sensitivity. However, binocular combination of clearly visible monocular stimuli follows Schrödinger's nonlinear magnitude-weighted average. We find that putatively suppressive binocular neurons closely follow Schrödinger's equation. Similar suppressive multisensory neurons are well documented but seldom studied. Facilitatory binocular neurons and mildly suppressive binocular neurons are likely neural correlates of binocular sensitivity and binocular appearance respectively.

Ocular dominance-dependent binocular combination of monocular neuronal responses in macaque V1

Primates rely on two eyes to perceive depth, while maintaining stable vision when either one eye or both eyes are open. Although psychophysical and modeling studies have investigated how monocular signals are combined to form binocular vision, the underlying neuronal mechanisms, particularly in V1 where most neurons exhibit binocularity with varying eye preferences, remain poorly understood. Here, we used two-photon calcium imaging to compare the monocular and binocular responses of thousands of simultaneously recorded V1 superficial-layer neurons in three awake macaques. During monocular stimulation, neurons preferring the stimulated eye exhibited significantly stronger responses compared to those preferring both eyes. However, during binocular stimulation, the responses of neurons preferring either eye were suppressed on the average, while those preferring both eyes were enhanced, resulting in similar neuronal responses irrespective of their eye preferences, and an overall response level similar to that with monocular viewing. A neuronally realistic model of binocular combination, which incorporates ocular dominance-dependent divisive interocular inhibition and binocular summation, is proposed to account for these findings.

Different rules for binocular combination of luminance flicker in cortical and subcortical pathways

How does the human brain combine information across the eyes? It has been known for many years that cortical normalization mechanisms implement 'ocularity invariance': equalizing neural responses to spatial patterns presented either monocularly or binocularly. Here, we used a novel combination of electrophysiology, psychophysics, pupillometry, and computational modeling to ask whether this invariance also holds for flickering luminance stimuli with no spatial contrast. We find dramatic violations of ocularity invariance for these stimuli, both in the cortex and also in the subcortical pathways that govern pupil diameter. Specifically, we find substantial binocular facilitation in both pathways with the effect being strongest in the cortex. Near-linear binocular additivity (instead of ocularity invariance) was also found using a perceptual luminance matching task. Ocularity invariance is, therefore, not a ubiquitous feature of visual processing, and the brain appears to repurpose a generic normalization algorithm for different visual functions by adjusting the amount of interocular suppression.

A role for ocular dominance in binocular integration

Neurons in the primate primary visual cortex (V1) combine left- and right-eye information to form a binocular output. Controversy surrounds whether ocular dominance, the preference of these neurons for one eye over the other, is functionally relevant. Here, we demonstrate that ocular dominance impacts gain control during binocular combination. We recorded V1 spiking activity while monkeys passively viewed grating stimuli. Gratings were either presented to one eye (monocular), both eyes with the same contrasts (binocular balanced), or both eyes with different contrasts (binocular imbalanced). We found that contrast placed in a neuron's dominant eye was weighted more strongly than contrast placed in a neuron's non-dominant eye. This asymmetry covaried with neurons' ocular dominance. We then tested whether accounting for ocular dominance within divisive normalization improves the fit to neural data. We found that ocular dominance significantly improved model performance, with interocular normalization providing the best fits. These findings suggest that V1 ocular dominance is relevant for response normalization during binocular stimulation.

Sensory eye dominance plasticity in the human adult visual cortex

Sensory eye dominance occurs when the visual cortex weighs one eye's data more heavily than those of the other. Encouragingly, mechanisms underlying sensory eye dominance in human adults retain a certain degree of plasticity. Notably, perceptual training using dichoptically presented motion signal-noise stimuli has been shown to elicit changes in sensory eye dominance both in visually impaired and normal observers. However, the neural mechanisms underlying these learning-driven improvements are not well understood. Here, we measured changes in fMRI responses before and after a five-day visual training protocol to determine the neuroplastic changes along the visual cascade. Fifty visually normal observers received training on a dichoptic or binocular variant of a signal-in-noise (left-right) motion discrimination task over five consecutive days. We show significant shifts in sensory eye dominance following training, but only for those who received dichoptic training. Pattern analysis of fMRI responses revealed that responses of V1 and hMT+ predicted sensory eye dominance for both groups, but only before training. After dichoptic (but not binocular) visual training, responses of V1 changed significantly, and were no longer able to predict sensory eye dominance. Our data suggest that perceptual training-driven changes in eye dominance are driven by a reweighting of the two eyes' data in the primary visual cortex. These findings may provide insight into developing region-targeted rehabilitative paradigms for the visually impaired, particularly those with severe binocular imbalance.

Does V1 response suppression initiate binocular rivalry?

During binocular rivalry (BR) only one eye's view is perceived. Neural underpinnings of BR are debated. Recent studies suggest that primary visual cortex (V1) initiates BR. One trigger might be response suppression across most V1 neurons at the onset of BR. Here, we utilize a variant of BR called binocular rivalry flash suppression (BRFS) to test this hypothesis. BRFS is identical to BR, except stimuli are shown with a ∼1s delay. If V1 response suppression was required to initiate BR, it should occur during BRFS as well. To test this, we compared V1 spiking in two macaques observing BRFS. We found that BRFS resulted in response facilitation rather than response suppression across V1 neurons. However, BRFS still reduces responses in a subset of V1 neurons due to the adaptive effects of asynchronous stimulus presentation. We argue that this selective response suppression could serve as an alternate initiator of BR.

Effects of cortical distance on the Ebbinghaus and Delboeuf illusions

The Ebbinghaus and Delboeuf illusions affect the perceived size of a target circle depending on the size and proximity of circular inducers or a ring. Converging evidence suggests that these illusions are driven by interactions between contours mediated by their cortical distance in primary visual cortex. We tested the effect of cortical distance on these illusions using two methods: First, we manipulated retinal distance between target and inducers in a two-interval forced choice design, finding that targets appeared larger with a closer surround. Next, we predicted that targets presented peripherally should appear larger due to cortical magnification. Hence, we tested the illusion strength when positioning the stimuli at various eccentricities, with results supporting this hypothesis. We calculated estimated cortical distances between illusion elements in each experiment and used these estimates to compare the relationship between cortical distance and illusion strength across our experiments. In a final experiment, we modified the Delboeuf illusion to test whether the influence of the inducers/annuli in this illusion is influenced by an inhibitory surround. We found evidence that an additional outer ring makes targets appear smaller compared to a single-ring condition, suggesting that near and distal contours have antagonistic effects on perceived target size.

Rapid adaptation of primate LGN neurons to drifting grating stimulation

The visual system needs to dynamically adapt to changing environments. Much is known about the adaptive effects of constant stimulation over prolonged periods. However, there are open questions regarding adaptation to stimuli that are changing over time, interrupted, or repeated. Feature-specific adaptation to repeating stimuli has been shown to occur as early as primary visual cortex (V1), but there is also evidence for more generalized, fatigue-like adaptation that might occur at an earlier stage of processing. Here, we show adaptation in the lateral geniculate nucleus (LGN) of awake, fixating monkeys following brief (1 s) exposure to repeated cycles of a 4-Hz drifting grating. We examined the relative change of each neuron's response across successive (repeated) grating cycles. We found that neurons from all cell classes (parvocellular, magnocellular, and koniocellular) showed significant adaptation. However, only magnocellular neurons showed adaptation when responses were averaged to a population response. In contrast to firing rates, response variability was largely unaffected. Finally, adaptation was comparable between monocular and binocular stimulation, suggesting that rapid LGN adaptation is monocular in nature.NEW & NOTEWORTHY Neural adaptation can be defined as reduction of spiking responses following repeated or prolonged stimulation. Adaptation helps adjust neural responsiveness to avoid saturation and has been suggested to improve perceptual selectivity, information transmission, and predictive coding. Here, we report rapid adaptation to repeated cycles of gratings drifting over the receptive field of neurons at the earliest site of postretinal processing, the lateral geniculate nucleus of the thalamus.

Near-field potentials index local neural computations more accurately than population spiking

Local field potentials (LFP) are low-frequency extracellular voltage fluctuations thought to primarily arise from synaptic activity. However, unlike highly localized neuronal spiking, LFP is spatially less specific. LFP measured at one location is not entirely generated there due to far-field contributions that are passively conducted across volumes of neural tissue. We sought to quantify how much information within the locally generated, near-field low-frequency activity (nfLFP) is masked by volume-conducted far-field signals. To do so, we measured laminar neural activity in primary visual cortex (V1) of monkeys viewing sequences of multifeatured stimuli. We compared information content of regular LFP and nfLFP that was mathematically stripped of volume-conducted far-field contributions. Information content was estimated by decoding stimulus properties from neural responses via spatiotemporal multivariate pattern analysis. Volume-conducted information differed from locally generated information in two important ways: (1) for stimulus features relevant to V1 processing (orientation and eye-of-origin), nfLFP contained more information. (2) in contrast, the volume-conducted signal was more informative regarding temporal context (relative stimulus position in a sequence), a signal likely to be coming from elsewhere. Moreover, LFP and nfLFP differed both spectrally as well as spatially, urging caution regarding the interpretations of individual frequency bands and/or laminar patterns of LFP. Most importantly, we found that population spiking of local neurons was less informative than either the LFP or nfLFP, with nfLFP containing most of the relevant information regarding local stimulus processing. These findings suggest that the optimal way to read out local computational processing from neural activity is to decode the local contributions to LFP, with significant information loss hampering both regular LFP and local spiking.

Author’s Contributions

Conceptualization, D.A.T., J.A.W, and A.M.; Data Collection, J.A.W., M.A.C., K.D.; Formal Analysis, D.A.T. and J.A.W.; Data Visualization, D.A.T. and J.A.W.; Original Draft, D.A.T., J.A.W., and A.M.; Revisions and Final Draft, D.A.T., J.A.W., M.A.C., K.D., M.T.W., A.M.B., and A.M.

Competing Interests

The authors declare no conflicts of interest.

Is ocular dominance plasticity a special case of contrast adaptation?

The visual system can regulate its sensitivity depending on the prevailing contrast conditions. This is known as contrast adaptation and reflects contrast gain changes at different stages along the visual pathway. Recently, it has been shown that depriving an eye of visual stimulation for a short period of time can lead to neuroplastic changes in ocular dominance as the result of homeostatic changes in contrast gain. Here we examine, on the basis of previously published results, whether the neuroplastic ocular dominance changes are just manifestation of the mechanism responsible for contrast adaptation. The evidence suggests that these two visual processes are separate and do not have a common neural substrate.

Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity

The brain creates a single visual percept of the world with inputs from two eyes. This means that downstream structures must integrate information from the two eyes coherently. Not only does the brain meet this challenge effortlessly, it also uses small differences between the two eyes' inputs, i.e., binocular disparity, to construct depth information in a perceptual process called stereopsis. Recent studies have advanced our understanding of the neural circuits underlying stereoscopic vision and its development. Here, we review these advances in the context of three binocular properties that have been most commonly studied for visual cortical neurons: ocular dominance of response magnitude, interocular matching of orientation preference, and response selectivity for binocular disparity. By focusing mostly on mouse studies, as well as recent studies using ferrets and tree shrews, we highlight unresolved controversies and significant knowledge gaps regarding the neural circuits underlying binocular vision. We note that in most ocular dominance studies, only monocular stimulations are used, which could lead to a mischaracterization of binocularity. On the other hand, much remains unknown regarding the circuit basis of interocular matching and disparity selectivity and its development. We conclude by outlining opportunities for future studies on the neural circuits and functional development of binocular integration in the early visual system.

Binocular Integration in the Primate Primary Visual Cortex

binocular vision, binocular fusion, binocular combination, LGN, V1.

Laminar microcircuitry of visual cortex producing attention-associated electric fields

Cognitive operations are widely studied by measuring electric fields through EEG and ECoG. However, despite their widespread use, the neural circuitry giving rise to these signals remains unknown because the functional architecture of cortical columns producing attention-associated electric fields has not been explored. Here, we detail the laminar cortical circuitry underlying an attention-associated electric field measured over posterior regions of the brain in humans and monkeys. First, we identified visual cortical area V4 as one plausible contributor to this attention-associated electric field through inverse modeling of cranial EEG in macaque monkeys performing a visual attention task. Next, we performed laminar neurophysiological recordings on the prelunate gyrus and identified the electric-field-producing dipoles as synaptic activity in distinct cortical layers of area V4. Specifically, activation in the extragranular layers of cortex resulted in the generation of the attention-associated dipole. Feature selectivity of a given cortical column determined the overall contribution to this electric field. Columns selective for the attended feature contributed more to the electric field than columns selective for a different feature. Last, the laminar profile of synaptic activity generated by V4 was sufficient to produce an attention-associated signal measurable outside of the column. These findings suggest that the top-down recipient cortical layers produce an attention-associated electric field that can be measured extracortically with the relative contribution of each column depending upon the underlying functional architecture.

Asymmetries around the visual field: From retina to cortex to behavior

Visual performance varies around the visual field. It is best near the fovea compared to the periphery, and at iso-eccentric locations it is best on the horizontal, intermediate on the lower, and poorest on the upper meridian. The fovea-to-periphery performance decline is linked to the decreases in cone density, retinal ganglion cell (RGC) density, and V1 cortical magnification factor (CMF) as eccentricity increases. The origins of polar angle asymmetries are not well understood. Optical quality and cone density vary across the retina, but recent computational modeling has shown that these factors can only account for a small percentage of behavior. Here, we investigate how visual processing beyond the cone photon absorptions contributes to polar angle asymmetries in performance. First, we quantify the extent of asymmetries in cone density, midget RGC density, and V1 CMF. We find that both polar angle asymmetries and eccentricity gradients increase from cones to mRGCs, and from mRGCs to cortex. Second, we extend our previously published computational observer model to quantify the contribution of phototransduction by the cones and spatial filtering by mRGCs to behavioral asymmetries. Starting with photons emitted by a visual display, the model simulates the effect of human optics, cone isomerizations, phototransduction, and mRGC spatial filtering. The model performs a forced choice orientation discrimination task on mRGC responses using a linear support vector machine classifier. The model shows that asymmetries in a decision maker's performance across polar angle are greater when assessing the photocurrents than when assessing isomerizations and are greater still when assessing mRGC signals. Nonetheless, the polar angle asymmetries of the mRGC outputs are still considerably smaller than those observed from human performance. We conclude that cone isomerizations, phototransduction, and the spatial filtering properties of mRGCs contribute to polar angle performance differences, but that a full account of these differences will entail additional contribution from cortical representations.

Pop-out search instigates beta-gated feature selectivity enhancement across V4 layers

Visual search is a workhorse for investigating how attention interacts with processing of sensory information. Attentional selection has been linked to altered cortical sensory responses and feature preferences (i.e., tuning). However, attentional modulation of feature selectivity during search is largely unexplored. Here we map the spatiotemporal profile of feature selectivity during singleton search. Monkeys performed a search where a pop-out feature determined the target of attention. We recorded laminar neural responses from visual area V4. We first identified "feature columns" which showed preference for individual colors. In the unattended condition, feature columns were significantly more selective in superficial relative to middle and deep layers. Attending a stimulus increased selectivity in all layers but not equally. Feature selectivity increased most in the deep layers, leading to higher selectivity in extragranular layers as compared to the middle layer. This attention-induced enhancement was rhythmically gated in phase with the beta-band local field potential. Beta power dominated both extragranular laminar compartments, but current source density analysis pointed to an origin in superficial layers, specifically. While beta-band power was present regardless of attentional state, feature selectivity was only gated by beta in the attended condition. Neither the beta oscillation nor its gating of feature selectivity varied with microsaccade production. Importantly, beta modulation of neural activity predicted response times, suggesting a direct link between attentional gating and behavioral output. Together, these findings suggest beta-range synaptic activation in V4's superficial layers rhythmically gates attentional enhancement of feature tuning in a way that affects the speed of attentional selection.

Exploring the effects of degraded vision on sensorimotor performance

PURPOSE

Many people experience unilateral degraded vision, usually owing to a developmental or age-related disorder. There are unresolved questions regarding the extent to which such unilateral visual deficits impact on sensorimotor performance; an important issue as sensorimotor limitations can constrain quality of life by restricting 'activities of daily living'. Examination of the relationship between visual deficit and sensorimotor performance is essential for determining the functional implications of ophthalmic conditions. This study attempts to explore the effect of unilaterally degraded vision on sensorimotor performance.

METHODS

In Experiment 1 we simulated visual deficits in 30 participants using unilateral and bilateral Bangerter filters to explore whether motor performance was affected in water pouring, peg placing, and aiming tasks. Experiment 2 (n = 74) tested the hypothesis that kinematic measures are associated with visuomotor deficits by measuring the impact of small visual sensitivity decrements created by monocular viewing on sensorimotor interactions with targets presented on a planar surface in aiming, tracking and steering tasks.

RESULTS

In Experiment 1, the filters caused decreased task performance-confirming that unilateral (and bilateral) visual loss has functional implications. In Experiment 2, kinematic measures were affected by monocular viewing in two of three tasks requiring rapid online visual feedback (aiming and steering).

CONCLUSIONS

Unilateral visual loss has a measurable impact on sensorimotor performance. The benefits of binocular vision may be particularly important for some groups (e.g. older adults) where an inability to complete sensorimotor tasks may necessitate assisted living. There is an urgent need to develop rigorous kinematic approaches to the quantification of the functional impact of unilaterally degraded vision and of the benefits associated with treatments for unilateral ophthalmic conditions to enable informed decisions around treatment.

Interocular suppression in primary visual cortex in strabismus: impact of staggering the presentation of stimuli to the eyes

Diplopia (double vision) in strabismus is prevented by suppression of the image emanating from one eye. In a recent study conducted in two macaques raised with exotropia (an outward ocular deviation) but having normal acuity in each eye, simultaneous display of stimuli to each eye did not induce suppression in V1 neurons. Puzzled by this negative result, we have modified our protocol to display stimuli in a staggered sequence, rather than simultaneously. Additional recordings were made in the same two macaques, following two paradigms. In trial type 1, the receptive field in one eye was stimulated with a sine-wave grating while the other eye was occluded. After 5 s, the occluder was removed and the neuron was stimulated for another 5 s. The effect of uncovering the eye, which potentially exposed the animal to diplopia, was quantified by the peripheral retinal interaction index (PRII). In trial type 2, the receptive field in the fixating eye was stimulated with a grating during binocular viewing. After 5 s, a second grating appeared in the receptive field of the nonfixating eye. The impact of the second grating, which had the potential to generate visual confusion, was quantified by the receptive field interaction index (RFII). For 82 units, the mean PRII was 0.48 ± 0.05 (0.50 = no suppression) and the mean RFII was 0.46 ± 0.08 (0.50 = no suppression). These values suggest mild suppression, but the modest decline in spike rate registered during the second epoch of visual stimulation might have been due to neuronal adaptation, rather than interocular suppression. In a few instances neurons showed unequivocal suppression, but overall, these recordings did not support the contention that staggered stimulus presentation is more effective than simultaneous stimulus presentation at evoking interocular suppression in V1 neurons.NEW & NOTEWORTHY In strabismus, double vision is prevented by interocular suppression. It has been reported that inhibition of neuronal firing in the primary visual cortex occurs only when stimuli are presented sequentially, rather than simultaneously. However, these recordings in alert macaques raised with exotropia showed, with rare exceptions, little evidence to support the concept that staggered stimulus presentation is more effective at inducing interocular suppression of V1 neurons.

Binocular Integration of Perceptually Suppressed Visual Information in Amblyopia

Purpose

The purpose of this study was to assess whether motion information from suppressed amblyopic eyes can influence visual perception.

Methods

Participants with normal vision (n = 20) and with amblyopia (n = 20; 11 anisometropic and 9 strabismic/mixed) viewed dichoptic, orthogonal drifting gratings through a mirror stereoscope. Participants continuously reported form and motion percepts as gratings rivaled for 60 seconds. Responses were binned into categories ranging from binocular integration to complete suppression. Periods when the grating presented to the nondominant/amblyopic eye was suppressed were analyzed further to determine the extent of binocular integration of motion.

Results

Individuals with amblyopia experienced longer periods of non-preferred eye suppression than controls. When the non-preferred eye grating was suppressed, binocular integration of motion occurred 48.1 ± 6.2% and 31.2 ± 5.8% of the time in control and amblyopic participants, respectively. Periods of motion integration from the suppressed eye were significantly non-zero for both groups.

Conclusions

Visual information seen only by a suppressed amblyopic eye can be binocularly integrated and influence the overall visual percept. These findings reveal that visual information subjected to interocular suppression can still contribute to binocular vision and suggest the use of appropriate optical correction for the amblyopic eye to improve image quality for binocular combination.

Interocular Suppression in Primary Visual Cortex in Strabismus

People with strabismus acquired during childhood do not experience diplopia (double vision). To investigate how perception of the duplicate image is suppressed, we raised two male monkeys with alternating exotropia by disinserting the medial rectus muscle in each eye at age four weeks. Once the animals were mature, they were brought to the laboratory and trained to fixate a small spot while recordings were made in primary visual cortex (V1). Drifting gratings were presented to the receptive fields of 500 single neurons for eight interleaved conditions: (1) right eye monocular; (2) left eye monocular; (3) right eye's field, right eye fixating; (4) right eye's field, left eye fixating; (5) left eye's field, right eye fixating; (6) left eye's field, left eye fixating; (7) both eyes' fields, right eye fixating; (8) both eyes' fields, left eye fixating. As expected, ocular dominance histograms showed a monocular bias compared with normal animals, but many cells could still be driven via both eyes. Overall, neuronal responses were not affected by switches in ocular fixation. Individual neurons exhibited binocular interactions, but mean population indices indicated no net interocular suppression or facilitation. Even neurons located in cortex with reduced cytochrome oxidase (CO) activity, representing portions of the nasal visual field where perception is suppressed during binocular viewing, showed no net inhibition. These data indicate that V1 neurons do not appear to reflect strabismic suppression and therefore the elimination of diplopia is likely to be mediated at a higher cortical level.SIGNIFICANCE STATEMENT In patients with strabismus, images fall on non-corresponding points in the two retinas. Only one image is perceived, because signals emanating from the other eye that convey the duplicate image are suppressed. The benefit is that diplopia is prevented, but the penalty is that the visual feedback required to adjust eye muscle tone to realign the globes is eliminated. Here, we report the first electrophysiological recordings from the primary visual cortex (V1) in awake monkeys raised with strabismus. The experiments were designed to reveal how perception of double images is avoided.

Shifting eye balance using monocularly directed attention in normal vision

In binocular vision, even without conscious awareness of eye of origin, attention can be selectively biased toward one eye by presenting a visual stimulus uniquely to that eye. Monocularly directed visual cues can bias perceptual dominance, as shown by studies using discrete measures of percept changes in continuous-flash suppression. Here, we use binocular rivalry to determine whether eye-based visual cues can modulate eye balance using continuous percept reporting. Using a dual-task versus single-task paradigm, we investigated whether the attentional load of these cues differentially modulates eye balance. Furthermore, both color-based and motion-based cue stimuli, non-overlaid and peripheral to the rivalry grating stimuli, were used to determine whether shifts in eye balance were stimulus specific. Aligned to cue stimulus onset, time series of percept reports were constructed and averaged across trials and participants. Specifically, for the monocular attention conditions, we found a significant shift in eye balance toward the cued eye and a significant difference in the time taken to switch from the dominating percept, regardless of whether the attention stimuli is color based or motion based. Although we did not find a significant main effect of attentional load, we found a significant interaction effect between the attentionally cued eye and attentional load on the shift in eye balance, indicating an influence of monocular attention on the shift in eye balance.

Decreased Functional Connectivity of the Primary Visual Cortex and the Correlation With Clinical Features in Patients With Intermittent Exotropia

The purpose of this study is to investigate characteristic alterations of functional connectivity (FC) patterns in the primary visual area (V1) in patients with intermittent exotropia (IXT) using resting-state functional magnetic resonance imaging (rs-fMRI) and how they relate to clinical features. Twenty-six IXT patients and 21 age-, sex-, handedness-, and education-matched healthy controls (HCs) underwent rs-fMRI. We performed FC analyses between bilateral V1 and other brain areas and compared FC strength between two groups. A Pearson correlation analysis was used to evaluate the correlation between the FC differences and clinical features. Compared with HCs, patients with IXT showed significantly lower FC of the right V1 with the right calcarine sulcus and right superior occipital gyrus, and the left V1 with right cuneus and right postcentral gyrus. The Newcastle Control Test score was positively correlated with mean FC values between the left inferior parietal lobule and bilateral V1, and between the left supramarginal gyrus and left V1. The duration of IXT was positively correlated with mean FC values between the right inferior occipital gyrus and right V1. Reduced FC between the V1 and various brain regions involved in vision and eye movement processes may be associated with the underlying neural mechanisms of impaired visual function in patients with IXT.

Binocular integration of retinal motion information underlies optic flow processing by the cortex

Locomotion creates various patterns of optic flow on the retina, which provide the observer with information about their movement relative to the environment. However, it is unclear how these optic flow patterns are encoded by the cortex. Here, we use two-photon calcium imaging in awake mice to systematically map monocular and binocular responses to horizontal motion in four areas of the visual cortex. We find that neurons selective to translational or rotational optic flow are abundant in higher visual areas, whereas neurons suppressed by binocular motion are more common in the primary visual cortex. Disruption of retinal direction selectivity in Frmd7 mutant mice reduces the number of translation-selective neurons in the primary visual cortex and translation- and rotation-selective neurons as well as binocular direction-selective neurons in the rostrolateral and anterior visual cortex, blurring the functional distinction between primary and higher visual areas. Thus, optic flow representations in specific areas of the visual cortex rely on binocular integration of motion information from the retina.

•

Translation- and rotation-selective neurons are abundant in higher visual areas

•

Optic-flow-selective neurons in V1 and RL/A rely on retinal direction selectivity

•

Retinal direction selectivity controls functional segregation between V1 and RL/A

•

Binocular integration of retinal motion information underlies optic flow selectivity

Ultra-high field fMRI reveals origins of feedforward and feedback activity within laminae of human ocular dominance columns

Ultra-high field MRI can functionally image the cerebral cortex of human subjects at the submillimeter scale of cortical columns and laminae. Here, we investigate both in concert, by imaging ocular dominance columns (ODCs) in primary visual cortex (V1) across different cortical depths. We ensured that putative ODC patterns in V1 (a) are stable across runs, sessions, and scanners located in different continents, (b) have a width (~1.3 mm) expected from post-mortem and animal work and (c) are absent at the retinotopic location of the blind spot. We then dissociated the effects of bottom-up thalamo-cortical input and attentional feedback processes on activity in V1 across cortical depth. Importantly, the separation of bottom-up information flows into ODCs allowed us to validly compare attentional conditions while keeping the stimulus identical throughout the experiment. We find that, when correcting for draining vein effects and using both model-based and model-free approaches, the effect of monocular stimulation is largest at deep and middle cortical depths. Conversely, spatial attention influences BOLD activity exclusively near the pial surface. Our findings show that simultaneous interrogation of columnar and laminar dimensions of the cortical fold can dissociate thalamocortical inputs from top-down processing, and allow the investigation of their interactions without any stimulus manipulation.

Interocular transfer effects of linear perspective cues and texture gradients in the perceptual rescaling of size

Our objective was to determine whether the influence of linear perspective cues and texture gradients in the perceptual rescaling of stimulus size transfers from one eye to the other. In experiment 1, we systematically added linear perspective cues and texture gradients in a background image of the corridor illusion. To determine whether perceptual size rescaling takes place at earlier or later stages, we tested how the perceived size of top and bottom rings changed under binocular (rings and background presented to both eyes), monocular (rings and background presented to the dominant eye only), and dichoptic (rings and background presented separately to the dominant and nondominant eyes, respectively) viewing conditions. We found differences between viewing conditions in the perceived size of the rings when linear perspective cues, but not texture gradients, were presented. Specifically, linear perspective cues produced a stronger illusion under the monocular compared to the dichoptic viewing condition. Hence, there was partial interocular transfer from the linear perspective cues, suggesting a dominant role of monocular neural populations in mediating the corridor illusion. In experiment 2, we repeated similar procedures with a more traditional Ponzo illusion background. Contrary to findings from experiment 1, there was a full interocular transfer with the presence of the converging lines, suggesting a dominant role of binocular neural populations. We conclude that higher order visual areas, which contain binocular neural populations, are more involved in the perceptual rescaling of size evoked by linear perspective cues in the Ponzo compared to the corridor illusion.

Stimulus Feature-Specific Information Flow Along the Columnar Cortical Microcircuit Revealed by Multivariate Laminar Spiking Analysis

Most of the mammalian neocortex is comprised of a highly similar anatomical structure, consisting of a granular cell layer between superficial and deep layers. Even so, different cortical areas process different information. Taken together, this suggests that cortex features a canonical functional microcircuit that supports region-specific information processing. For example, the primate primary visual cortex (V1) combines the two eyes' signals, extracts stimulus orientation, and integrates contextual information such as visual stimulation history. These processes co-occur during the same laminar stimulation sequence that is triggered by the onset of visual stimuli. Yet, we still know little regarding the laminar processing differences that are specific to each of these types of stimulus information. Univariate analysis techniques have provided great insight by examining one electrode at a time or by studying average responses across multiple electrodes. Here we focus on multivariate statistics to examine response patterns across electrodes instead. Specifically, we applied multivariate pattern analysis (MVPA) to linear multielectrode array recordings of laminar spiking responses to decode information regarding the eye-of-origin, stimulus orientation, and stimulus repetition. MVPA differs from conventional univariate approaches in that it examines patterns of neural activity across simultaneously recorded electrode sites. We were curious whether this added dimensionality could reveal neural processes on the population level that are challenging to detect when measuring brain activity without the context of neighboring recording sites. We found that eye-of-origin information was decodable for the entire duration of stimulus presentation, but diminished in the deepest layers of V1. Conversely, orientation information was transient and equally pronounced along all layers. More importantly, using time-resolved MVPA, we were able to evaluate laminar response properties beyond those yielded by univariate analyses. Specifically, we performed a time generalization analysis by training a classifier at one point of the neural response and testing its performance throughout the remaining period of stimulation. Using this technique, we demonstrate repeating (reverberating) patterns of neural activity that have not previously been observed using standard univariate approaches.

Priming of Attentional Selection in Macaque Visual Cortex: Feature-Based Facilitation and Location-Based Inhibition of Return

Visual search performance varies with stimulus and response history. Priming of pop-out refers to increased accuracy and reduced response time with repeated presentation of particular singleton and distractor features (e.g., a red target among green distractor stimuli), which are abruptly impaired when singleton and distractor features swap (e.g., green target among red distractors). Meanwhile, inhibition of return refers to the slowing of response time when target location repeats. Neurophysiological correlates of both these phenomena have been reported in the frontal eye field (FEF), an area in the frontal lobe contributing to attentional selection and eye movement planning. To understand the mechanistic origin of these adaptive behaviors, we investigated visual cortical area V4, an area providing input to and receiving feedback from FEF, during feature-based priming of pop-out and location-based inhibition of return. Performing a color pop-out task, monkeys exhibited pronounced priming of pop-out and inhibition of return. Neural spiking from V4 revealed earlier target selection associated with priming of pop-out and delayed selection associated with inhibition of return. These results demonstrate substantial involvement of extrastriate visual cortex in behavioral priming and inhibition of return.

Long-term Monocular Deprivation during Juvenile Critical Period Disrupts Binocular Integration in Mouse Visual Thalamus

Study of the neural deficits caused by mismatched binocular vision in early childhood has predominantly focused on circuits in the primary visual cortex (V1). Recent evidence has revealed that neurons in mouse dorsolateral geniculate nucleus (dLGN) can undergo rapid ocular dominance plasticity following monocular deprivation (MD). It remains unclear, however, whether the long-lasting deficits attributed to MD during the critical period originate in the thalamus. Using in vivo two-photon Ca2+ imaging of dLGN afferents in superficial layers of V1 in female and male mice, we demonstrate that 14 d MD during the critical period leads to a chronic loss of binocular dLGN inputs while sparing response strength and spatial acuity. Importantly, MD leads to profoundly mismatched visual tuning properties in remaining binocular dLGN afferents. Furthermore, MD impairs binocular modulation, reducing facilitation of responses of both binocular and monocular dLGN inputs during binocular viewing. As predicted by our findings in thalamic inputs, Ca2+ imaging from V1 neurons revealed spared spatial acuity but impaired binocularity in L4 neurons. V1 L2/3 neurons in contrast displayed deficits in both binocularity and spatial acuity. Our data demonstrate that critical-period MD produces long-lasting disruptions in binocular integration beginning in early binocular circuits in dLGN, whereas spatial acuity deficits first arise from circuits further downstream in V1. Our findings indicate that the development of normal binocular vision and spatial acuity depend upon experience-dependent refinement of distinct stages in the mammalian visual system.SIGNIFICANCE STATEMENT Abnormal binocular vision and reduced acuity are hallmarks of amblyopia, a disorder that affects 2%-5% of the population. It is widely thought that the neural deficits underlying amblyopia begin in the circuits of primary visual cortex. Using in vivo two-photon calcium imaging of thalamocortical axons in mice, we show that depriving one eye of input during a critical period in development chronically impairs binocular integration in thalamic inputs to primary visual cortex. In contrast, visual acuity is spared in thalamic inputs. These findings shed new light on the role for developmental mechanisms in the thalamus in establishing binocular vision and may have critical implications for amblyopia.

Modeling visual performance differences 'around' the visual field: A computational observer approach

Visual performance depends on polar angle, even when eccentricity is held constant; on many psychophysical tasks observers perform best when stimuli are presented on the horizontal meridian, worst on the upper vertical, and intermediate on the lower vertical meridian. This variation in performance 'around' the visual field can be as pronounced as that of doubling the stimulus eccentricity. The causes of these asymmetries in performance are largely unknown. Some factors in the eye, e.g. cone density, are positively correlated with the reported variations in visual performance with polar angle. However, the question remains whether these correlations can quantitatively explain the perceptual differences observed 'around' the visual field. To investigate the extent to which the earliest stages of vision-optical quality and cone density-contribute to performance differences with polar angle, we created a computational observer model. The model uses the open-source software package ISETBIO to simulate an orientation discrimination task for which visual performance differs with polar angle. The model starts from the photons emitted by a display, which pass through simulated human optics with fixational eye movements, followed by cone isomerizations in the retina. Finally, we classify stimulus orientation using a support vector machine to learn a linear classifier on the photon absorptions. To account for the 30% increase in contrast thresholds for upper vertical compared to horizontal meridian, as observed psychophysically on the same task, our computational observer model would require either an increase of ~7 diopters of defocus or a reduction of 500% in cone density. These values far exceed the actual variations as a function of polar angle observed in human eyes. Therefore, we conclude that these factors in the eye only account for a small fraction of differences in visual performance with polar angle. Substantial additional asymmetries must arise in later retinal and/or cortical processing.

V1 microcircuit dynamics: altered signal propagation suggests intracortical origins for adaptation in response to visual repetition

Repetitive visual stimulation profoundly changes sensory processing in the primary visual cortex (V1). We show how the associated adaptive changes are linked to an altered flow of synaptic activation across the V1 laminar microcircuit. Using repeated visual stimulation, we recorded layer-specific responses in V1 of two fixating monkeys. We found that repetition-related spiking suppression was most pronounced outside granular V1 layers that receive the main retinogeniculate input. This repetition-related response suppression was robust to alternating stimuli between the eyes, in line with the notion that repetition-related adaptation is predominantly of cortical origin. Most importantly, current source density (CSD) analysis, which provides an estimate of local net depolarization, revealed that synaptic processing during repeated stimulation was most profoundly affected within supragranular layers, which harbor the bulk of cortico-cortical connections. Direct comparison of the temporal evolution of laminar CSD and spiking activity showed that stimulus repetition first affected supragranular synaptic currents, which translated into a reduction of stimulus-evoked spiking across layers. Together, these results suggest that repetition induces an altered state of intracortical processing that underpins visual adaptation. NEW & NOTEWORTHY Our survival depends on our brains rapidly adapting to ever changing environments. A well-studied form of adaptation occurs whenever we encounter the same or similar stimuli repeatedly. We show that this repetition-related adaptation is supported by systematic changes in the flow of sensory activation across the laminar cortical microcircuitry of primary visual cortex. These results demonstrate how adaptation impacts neuronal interactions across cortical circuits.

Interocular transfer of visual memory - Influence of visual impairment and abnormalities of the optic chiasm

Due to an increased crossing of the optic nerve fibers at the optic chiasm in albinism, the visual cortex receives largely monocular input from the contralateral eye. Here we investigated whether this obstruction of binocular integration at the cortical input stage also impacts on interocular information exchange at the high processing level of visual memory. Interocular transfer (IOT) of visual memory retrieval was tested psychophysically after monocular encoding in 8 albinotic participants and 24 healthy controls. The retrieval performance (hit rate, reaction time, d') was determined when using the same or different eye at encoding. To assess the effect of reduced visual acuity (VA) on recognition, we simulated interocular acuity differences (IOA) in two healthy control groups (each n = 8), i.e., with large (VA: 0.89 vs. 0.12) and small simulated interocular difference (VA: 0.25 vs. 0.12), with the latter matched to that observed in the albinotic participants (VA: 0.20 vs. 0.15). A significant decrease in retrieval performance was observed in controls with simulated strongly reduced VA in one eye (p < 0.0001). For the other conditions and groups, including the albinotic participants, no dependence on VA and no significant difference between using the same or different eye was observed. This indicates interocular transfer and hence interocular information exchange in human albinism. These findings thus provide insights into the scope of plasticity of binocular information processing and inter-hemispherical information flow.

Neurophysiology: Charting the Confluence of the Two Eyes' Information Streams

In primates, the two eyes offer substantially overlapping views of the world. The information they provide is merged into a single, integrated, representation in visual cortex. New evidence changes long-standing ideas about how and where in the processing stream this happens.