The physiology of stereopsis

Interocular suppression in chromoluminance patterns measured with SSVEP

Many cells in the early human visual system respond to either chromatic or luminance contrast or a combination of both. In addition, depending on their location in the visual hierarchy, these cells may receive input from either one eye or both eyes. It is well understood that spatial luminance contrast patterns undergo binocular normalization: Inputs from each eye mutually suppress each other so that monocular and binocular percepts appear similar. Recent reports suggest that interocular normalization computations may depend on spatial and temporal frequency. Here, we examined the effect of chromaticity and spatial frequency on binocular normalization computations using a dichoptic frequency-tagged, steady-state visually evoked potential (SSVEP) paradigm. We found that normalization as indexed by changes in eye-tagged input SSVEP frequencies and intermodulation terms depends significantly on both spatial frequency and color. We also found that binocular combination must occur in neurons that carry half-wave rectified signals due to 1F combination frequencies being present. Overall, our results are not well explained by a model in which neurons that code low spatial frequency color are segregated anatomically in the centers of ocular dominance columns. Significant levels of binocular interaction must occur in neurons that code both color and luminance and in neurons sensitive to both low and high spatial frequencies.

Cortical responses to conflicting binocular stimuli in mouse primary visual cortex

Binocular vision requires that the brain integrate information coming from each eye. These images are combined (fused) to generate a meaningful composite image. Differences between images, within a range, provide useful information about depth (stereopsis). Interocular disparities that are not effectively combined result in diplopia and rivalry. The neural mechanisms underlying these binocular interactions remain poorly understood. Using a combination of visually evoked potential (VEP) recordings, unit recordings, and 2-photon calcium imaging in the binocular region of mouse primary visual cortex (bV1), we probed the neural mechanisms underlying the processing of two distinct forms of disparate binocular signals. Using a dichoptic display, introduction of a spatial interocular phase disparity in grating stimuli reduced VEP magnitude through decreased neuronal firing in the early phase of the response (40-80 ms after stimulus onset, corresponding to the VEP negativity). Introduction of an interocular orientation disparity also decreased VEP magnitude, but this difference was driven by an increase in firing in the late portion of the visual response (100-200 ms after stimulus onset, corresponding to the VEP positivity). This increase in activity was observed for both regular-spiking (putative excitatory) and fast-spiking (putative parvalbumin-positive inhibitory) units. By contrast, visually evoked calcium responses of somatostatin-positive interneurons decreased with introduction of the interocular orientation disparity. Based on these results, we propose that interocular phase differences largely suppress bV1 responses via feedforward thalamocortical interactions, whereas interocular orientation differences prolong visually evoked activity in bV1 through somatostatin-positive interneuron-mediated disinhibition.

Bilateral Alignment of Receptive Fields in the Olfactory Cortex

Each olfactory cortical hemisphere receives ipsilateral odor information directly from the olfactory bulb and contralateral information indirectly from the other cortical hemisphere. Since neural projections to the olfactory cortex (OC) are disordered and nontopographic, spatial information cannot be used to align projections from the two sides like in the visual cortex. Therefore, how bilateral information is integrated in individual cortical neurons is unknown. We have found, in mice, that the odor responses of individual neurons to selective stimulation of each of the two nostrils are significantly correlated, such that odor identity decoding optimized with information arriving from one nostril transfers very well to the other side. Nevertheless, these aligned responses are asymmetric enough to allow decoding of stimulus laterality. Computational analysis shows that such matched odor tuning is incompatible with purely random connections but is explained readily by Hebbian plasticity structuring bilateral connectivity. Our data reveal that despite the distributed and fragmented sensory representation in the OC, odor information across the two hemispheres is highly coordinated.

GABAergic inhibition in human hMT+ predicts visuo-spatial intelligence mediated through the frontal cortex

The prevailing opinion emphasizes fronto-parietal network (FPN) is key in mediating general fluid intelligence (gF). Meanwhile, recent studies show that human MT complex (hMT+), located at the occipito-temporal border and involved in 3D perception processing, also plays a key role in gF. However, the underlying mechanism is not clear, yet. To investigate this issue, our study targets visuo-spatial intelligence, which is considered to have high loading on gF. We use ultra-high field magnetic resonance spectroscopy (MRS) to measure GABA/Glu concentrations in hMT+ combining resting-state fMRI functional connectivity (FC), behavioral examinations including hMT+ perception suppression test and gF subtest in visuo-spatial component. Our findings show that both GABA in hMT+ and frontal-hMT+ functional connectivity significantly correlate with the performance of visuo-spatial intelligence. Further, serial mediation model demonstrates that the effect of hMT+ GABA on visuo-spatial gF is fully mediated by the hMT+ frontal FC. Together our findings highlight the importance in integrating sensory and frontal cortices in mediating the visuo-spatial component of general fluid intelligence.

Feature-specific divisive normalization improves natural image encoding for depth perception

Vision science and visual neuroscience seek to understand how stimulus and sensor properties limit the precision with which behaviorally-relevant latent variables are encoded and decoded. In the primate visual system, binocular disparity-the canonical cue for stereo-depth perception-is initially encoded by a set of binocular receptive fields with a range of spatial frequency preferences. Here, with a stereo-image database having ground-truth disparity information at each pixel, we examine how response normalization and receptive field properties determine the fidelity with which binocular disparity is encoded in natural scenes. We quantify encoding fidelity by computing the Fisher information carried by the normalized receptive field responses. Several findings emerge from an analysis of the response statistics. First, broadband (or feature-unspecific) normalization yields Laplace-distributed receptive field responses, and narrowband (or feature-specific) normalization yields Gaussian-distributed receptive field responses. Second, the Fisher information in narrowband-normalized responses is larger than in broadband-normalized responses by a scale factor that grows with population size. Third, the most useful spatial frequency decreases with stimulus size and the range of spatial frequencies that is useful for encoding a given disparity decreases with disparity magnitude, consistent with neurophysiological findings. Fourth, the predicted patterns of psychophysical performance, and absolute detection threshold, match human performance with natural and artificial stimuli. The current computational efforts establish a new functional role for response normalization, and bring us closer to understanding the principles that should govern the design of neural systems that support perception in natural scenes.

A comparative study of stereopsis in term and preterm children with and without retinopathy of prematurity

PURPOSE

To evaluate stereopsis in term-born, preterm, and preterm children with and without retinopathy of prematurity (ROP) and its treatment.

METHODS

The cross-sectional study included 322 children between 3 and 11 years of age born term or preterm, with or without ROP, and with or without treatment for ROP. The ROP treatments were laser therapy, intravitreal injection (IVI) of anti-vascular endothelial growth factor, or their combination. Stereoacuity was measured using the Titmus Stereo Test, and the results among various age groups were analyzed.

RESULTS

Stereopsis was found to improve with increasing age at testing (P < 0.001) across the entire study population. The term group exhibited significantly better stereoacuity than the preterm group (P < 0.001). At 3-5 years and 6-8 years, the preterm children without ROP exhibited significantly better stereoacuity than did those with ROP (P < 0.001 and P = 0.02, respectively); however, at 9-11 years, both groups exhibited similar stereoacuity (P = 0.34). The stereoacuity in the children with untreated ROP was similar to that of the children with treated ROP in all age groups (P > 0.05). No significant differences in stereopsis were identified between children with ROP treated with laser versus with IVI (P > 0.05). From multivariate analysis, younger age at testing (P = 0.001) and younger gestational age (P < 0.001) were associated with poorer stereopsis.

CONCLUSIONS

Stereopsis development gradually improved with age in all groups. The children born preterm exhibited poorer stereoacuity than those born term. Children with ROP treated with laser photocoagulation versus IVI may exhibit similar levels of stereoacuity. Younger age at testing and gestational age were independent risk factors for poorer stereoacuity.

Cortical Layer-Dependent Signaling in Cognition: Three Computational Modes of the Canonical Circuit

The cerebral cortex performs computations via numerous six-layer modules. The operational dynamics of these modules were studied primarily in early sensory cortices using bottom-up computation for response selectivity as a model, which has been recently revolutionized by genetic approaches in mice. However, cognitive processes such as recall and imagery require top-down generative computation. The question of whether the layered module operates similarly in top-down generative processing as in bottom-up sensory processing has become testable by advances in the layer identification of recorded neurons in behaving monkeys. This review examines recent advances in laminar signaling in these two computations, using predictive coding computation as a common reference, and shows that each of these computations recruits distinct laminar circuits, particularly in layer 5, depending on the cognitive demands. These findings highlight many open questions, including how different interareal feedback pathways, originating from and terminating at different layers, convey distinct functional signals.

Pictorial depth cues elicit the perception of tridimensionality in dogs

The perception of tridimensionality is elicited by binocular disparity, motion parallax, and monocular or pictorial cues. The perception of tridimensionality arising from pictorial cues has been investigated in several non-human animal species. Although dogs can use and discriminate bidimensional images, to date there is no evidence of dogs' ability to perceive tridimensionality in pictures and/or through pictorial cues. The aim of the present study was to assess the perception of tridimensionality in dogs elicited by two pictorial cues: linear perspective and shading. Thirty-two dogs were presented with a tridimensional stimulus (i.e., a ball) rolling onto a planar surface until eventually falling into a hole (control condition) or until reaching and rolling over an illusory hole (test condition). The illusory hole corresponded to the bidimensional pictorial representation of the real hole, in which the pictorial cues of shading and linear perspective created the impression of tridimensionality. In a violation of expectation paradigm, dogs showed a longer looking time at the scene in which the unexpected situation of a ball rolling over an illusory hole occurred. The surprise reaction observed in the test condition suggests that the pictorial cues of shading and linear perspective in the bidimensional image of the hole were able to elicit the perception of tridimensionality in dogs.

Study of stereopsis using a depth sensation detection platform equipped with computer vision technology (DALE3D)

BACKGROUND AND OBJECTIVES

The invention described herein is a prototype based on computer vision technology that measures depth perception and is intended for the early examination of stereopsis.

MATERIALS AND METHODS

The prototype (software and hardware) is a depth perception measurement system that consists on: (a) a screen showing stereoscopic models with a guide point that the subject must point to; (b) a camera capturing the distance between the screen and the subject's finger; and (c) a unit for recording, processing and storing the captured measurements. For test validation, the reproducibility and reliability of the platform were calculated by comparing results with standard stereoscopic tests. A demographic study of depth perception by subgroup analysis is shown. Subjective comparison of the different tests was carried out by means of a satisfaction survey.

RESULTS

We included 94 subjects, 25 children and 69 adults, with a mean age of 34.2 ± 18.9 years; 36.2 % were men and 63.8 % were women. The DALE3D platform obtained good repeatability with an interclass correlation coefficient (ICC) between 0.94 and 0.87, and coefficient of variation (CV) between 0.1 and 0.26. Threshold determining optimal and suboptimal results was calculated for Randot and DALE3D test. Spearman's correlation coefficient, between thresholds was not statistically significant (p value > 0.05). The test was considered more visually appealing and easier to use by the participants (90 % maximum score).

CONCLUSIONS

The DALE3D platform is a potentially useful tool for measuring depth perception with optimal reproducibility rates. Its innovative design makes it a more intuitive tool for children than current stereoscopic tests. Nevertheless, further studies will be needed to assess whether the depth perception measured by the DALE3D platform is a sufficiently reliable parameter to assess stereopsis.

Binocular receptive-field construction in the primary visual cortex

ON and OFF thalamic afferents from the two eyes converge in the primary visual cortex to form binocular receptive fields. The receptive fields need to be diverse to sample our visual world but also similar across eyes to achieve binocular fusion. It is currently unknown how the cortex balances these competing needs between receptive-field diversity and similarity. Our results demonstrate that receptive fields in the cat visual cortex are binocularly matched with exquisite precision for retinotopy, orientation/direction preference, orientation/direction selectivity, response latency, and ON-OFF polarity/structure. Specifically, the average binocular mismatches in retinotopy and ON-OFF structure are tightly restricted to 1/20 and 1/5 of the average receptive-field size but are still large enough to generate all types of binocular disparity tuning. Based on these results, we conclude that cortical receptive fields are binocularly matched with the high precision needed to facilitate binocular fusion while allowing restricted mismatches to process visual depth.

Concurrent attention to hetero-depth surfaces in 3-D visual space is governed by theta rhythm

When simultaneously confronted with multiple attentional targets, visual system employs a time-multiplexing approach in which each target alternates for prioritized access, a mechanism broadly known as rhythmic attentional sampling. For the past decade, rhythmic attentional sampling has received mounting support from converging behavioral and neural findings. However, so compelling are these findings that a critical test ground has been long overshadowed, namely the 3-D visual space where attention is complicated by extraction of the spatial layout of surfaces extending beyond 2-D planes. It remains unknown how attentional deployment to multiple targets is accomplished in the 3-D space. Here, we provided a time-resolved portrait of the behavioral and neural dynamics when participants concurrently attended to two surfaces defined by motion-depth conjunctions. To characterize the moment-to-moment attentional modulation effects, we measured perceptual sensitivity to the hetero-depth surface motions on a fine temporal scale and reconstructed their neural representations using a time-resolved multivariate inverted encoding model. We found that the perceptual sensitivity to the two surface motions rhythmically fluctuated over time at ~4 Hz, with one's enhancement closely tracked by the other's diminishment. Moreover, the behavioral pattern was coupled with an ongoing periodic alternation in strength between the two surface motion representations in the same frequency. Together, our findings provide the first converging evidence of an attentional "pendulum" that rhythmically traverses different stereoscopic depth planes and are indicative of a ubiquitous attentional time multiplexor based on theta rhythm in the 3-D visual space.

The geometry of the vergence-accommodation conflict in mixed reality systems

Mixed reality technologies, such as virtual (VR) and augmented (AR) reality, present promising opportunities to advance education and professional training due to their adaptability to diverse contexts. Distortions in the perceived distance in such mediated conditions, however, are well documented and have imposed nontrivial challenges that complicate and limit transferring task performance in a virtual setting to the unmediated reality (UR). One potential source of the distance distortion is the vergence-accommodation conflict-the discrepancy between the depth specified by the eyes' accommodative state and the angle at which the eyes converge to fixate on a target. The present study involved the use of a manual pointing task in UR, VR, and AR to quantify the magnitude of the potential depth distortion in each modality. Conceptualizing the effect of vergence-accommodation offset as a constant offset to the vergence angle, a model was developed based on the stereoscopic viewing geometry. Different versions of the model were used to fit and predict the behavioral data for all modalities. Results confirmed the validity of the conceptualization of vergence-accommodation as a device-specific vergence offset, which predicted up to 66% of the variance in the data. The fitted parameters indicate that, due to the vergence-accommodation conflict, participants' vergence angle was driven outwards by approximately 0.2°, which disrupted the stereoscopic viewing geometry and produced distance distortion in VR and AR. The implications of this finding are discussed in the context of developing virtual environments that minimize the effect of depth distortion.

Preliminary Evidence for Global Properties in Human Listeners During Natural Auditory Scene Perception

Theories of auditory and visual scene analysis suggest the perception of scenes relies on the identification and segregation of objects within it, resembling a detail-oriented processing style. However, a more global process may occur while analyzing scenes, which has been evidenced in the visual domain. It is our understanding that a similar line of research has not been explored in the auditory domain; therefore, we evaluated the contributions of high-level global and low-level acoustic information to auditory scene perception. An additional aim was to increase the field's ecological validity by using and making available a new collection of high-quality auditory scenes. Participants rated scenes on 8 global properties (e.g., open vs. enclosed) and an acoustic analysis evaluated which low-level features predicted the ratings. We submitted the acoustic measures and average ratings of the global properties to separate exploratory factor analyses (EFAs). The EFA of the acoustic measures revealed a seven-factor structure explaining 57% of the variance in the data, while the EFA of the global property measures revealed a two-factor structure explaining 64% of the variance in the data. Regression analyses revealed each global property was predicted by at least one acoustic variable (R2 = 0.33-0.87). These findings were extended using deep neural network models where we examined correlations between human ratings of global properties and deep embeddings of two computational models: an object-based model and a scene-based model. The results support that participants' ratings are more strongly explained by a global analysis of the scene setting, though the relationship between scene perception and auditory perception is multifaceted, with differing correlation patterns evident between the two models. Taken together, our results provide evidence for the ability to perceive auditory scenes from a global perspective. Some of the acoustic measures predicted ratings of global scene perception, suggesting representations of auditory objects may be transformed through many stages of processing in the ventral auditory stream, similar to what has been proposed in the ventral visual stream. These findings and the open availability of our scene collection will make future studies on perception, attention, and memory for natural auditory scenes possible.

Effect of binocular visual cue availability on fruit and insect grasping performance in two cheirogaleids: Implications for primate origins hypotheses

Forward-facing eyes with parallel optic axes, which provide a wide field of binocular vision and precise depth perception, are among the diagnostic features of crown primates; however, the adaptive significance of this feature remains contentious. Two of the most prominent primate-origins hypotheses propose that either foraging for fruit or nocturnal predation on insects created selective pressures that led to the evolution of diagnostic primate traits, including a wide binocular field. To determine whether either of these hypotheses provides a viable explanation for the evolution of primates' derived eye orientation, the importance of binocular depth cues for the two tasks invoked by these hypotheses was evaluated experimentally in Microcebus murinus and Cheirogaleus medius, cheirogaleids' considered reasonable living analogs of the earliest euprimates. Performance in grasping insects and fruit was evaluated when the animals made use of their full binocular visual field and when their binocular visual field was restricted using a helmet-mounted blinder. Restriction of the binocular field had no effect on fruit grasping performance; however, restriction of the binocular field resulted in a significant deficit in insect predation performance. Differences in behavioral variables also suggest that insect predation is a more visually demanding task than fruit foraging. These results support the role of insect predation, but not fruit foraging, in contributing to the selective pressures that led to the evolution of parallel optic axes and a wide binocular field in crown primates.

Transformations of sensory information in the brain suggest changing criteria for optimality

Neurons throughout the brain modulate their firing rate lawfully in response to sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization in which neurons aim to robustly and efficiently represent sensory information. Our understanding of how this optimization varies across different areas in the brain, however, is still in its infancy. Here, we show that neural sensory responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation towards optimizing for perceptual discrimination. Focusing on the representation of binocular disparities-the slight differences in the retinal images of the two eyes-we re-analyze measurements characterizing neuronal tuning curves in brain areas V1, V2, and MT (middle temporal) in the macaque monkey. We compare these to measurements of the statistics of binocular disparity typically encountered during natural behaviors using a Fisher Information framework. The differences in tuning curve characteristics across areas are consistent with a shift in optimization goals: V1 and V2 population-level responses are more consistent with maximizing the information encoded about naturally occurring binocular disparities, while MT responses shift towards maximizing the ability to support disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective areas of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings emphasize the need to consider not just information preservation and neural resources, but also relevance to behavior, when assessing the optimality of neural codes.

The influence of stereopsis on visual saliency in a proto-object based model of selective attention

Some animals including humans use stereoscopic vision which reconstructs spatial information about the environment from the disparity between images captured by eyes in two separate adjacent locations. Like other sensory information, such stereoscopic information is expected to influence attentional selection. We develop a biologically plausible model of binocular vision to study its effect on bottom-up visual attention, i.e., visual saliency. In our model, the scene is organized in terms of proto-objects on which attention acts, rather than on unbound sets of elementary features. We show that taking into account the stereoscopic information improves the performance of the model in the prediction of human eye movements with statistically significant differences.

Widespread and Multifaceted Binocular Integration in the Mouse Primary Visual Cortex

The brain combines two-dimensional images received from the two eyes to form a percept of three-dimensional surroundings. This process of binocular integration in the primary visual cortex (V1) serves as a useful model for studying how neural circuits generate emergent properties from multiple input signals. Here, we perform a thorough characterization of binocular integration using electrophysiological recordings in the V1 of awake adult male and female mice by systematically varying the orientation and phase disparity of monocular and binocular stimuli. We reveal widespread binocular integration in mouse V1 and demonstrate that the three commonly studied binocular properties-ocular dominance, interocular matching, and disparity selectivity-are independent of each other. For individual neurons, the responses to monocular stimulation can predict the average amplitude of binocular response but not its selectivity. Finally, the extensive and independent binocular integration of monocular inputs is seen across cortical layers in both regular-spiking and fast-spiking neurons, regardless of stimulus design. Our data indicate that the current model of simple feedforward convergence is inadequate to account for binocular integration in mouse V1, thus suggesting an indispensable role played by intracortical circuits in binocular computation.SIGNIFICANCE STATEMENT Binocular integration is an important step of visual processing that takes place in the visual cortex. Studying the process by which V1 neurons become selective for certain binocular disparities is informative about how neural circuits integrate multiple information streams at a more general level. Here, we systematically characterize binocular integration in mice. Our data demonstrate more widespread and complex binocular integration in mouse V1 than previously reported. Binocular responses cannot be explained by a simple convergence of monocular responses, contrary to the prevailing model of binocular integration. These findings thus indicate that intracortical circuits must be involved in the exquisite computation of binocular disparity, which would endow brain circuits with the plasticity needed for binocular development and processing.

Neuronal Representations Supporting Three-Dimensional Vision in Nonhuman Primates

The visual system must reconstruct the dynamic, three-dimensional (3D) world from ambiguous two-dimensional (2D) retinal images. In this review, we synthesize current literature on how the visual system of nonhuman primates performs this transformation through multiple channels within the classically defined dorsal (where) and ventral (what) pathways. Each of these channels is specialized for processing different 3D features (e.g., the shape, orientation, or motion of objects, or the larger scene structure). Despite the common goal of 3D reconstruction, neurocomputational differences between the channels impose distinct information-limiting constraints on perception. Convergent evidence further points to the little-studied area V3A as a potential branchpoint from which multiple 3D-fugal processing channels diverge. We speculate that the expansion of V3A in humans may have supported the emergence of advanced 3D spatial reasoning skills. Lastly, we discuss future directions for exploring 3D information transmission across brain areas and experimental approaches that can further advance the understanding of 3D vision.

Effects of the Loss of Binocular and Motion Parallax on Static Postural Stability

Depth information is important for postural stability and is generated by two visual systems: binocular and motion parallax. The effect of each type of parallax on postural stability remains unclear. We investigated the effects of binocular and motion parallax loss on static postural stability using a virtual reality (VR) system with a head-mounted display (HMD). A total of 24 healthy young adults were asked to stand still on a foam surface fixed on a force plate. They wore an HMD and faced a visual background in the VR system under four visual test conditions: normal vision (Control), absence of motion parallax (Non-MP)/binocular parallax (Non-BP), and absence of both motion and binocular parallax (Non-P). The sway area and velocity in the anteroposterior and mediolateral directions of the center-of-pressure displacements were measured. All postural stability measurements were significantly higher under the Non-MP and Non-P conditions than those under the Control and Non-BP conditions, with no significant differences in the postural stability measurements between the Control and Non-BP conditions. In conclusion, motion parallax has a more prominent effect on static postural stability than binocular parallax, which clarifies the underlying mechanisms of postural instability and informs the development of rehabilitation methods for people with visual impairments.

Transformations of sensory information in the brain reflect a changing definition of optimality

Neurons throughout the brain modulate their firing rate lawfully in response to changes in sensory input. Theories of neural computation posit that these modulations reflect the outcome of a constrained optimization: neurons aim to efficiently and robustly represent sensory information under resource limitations. Our understanding of how this optimization varies across the brain, however, is still in its infancy. Here, we show that neural responses transform along the dorsal stream of the visual system in a manner consistent with a transition from optimizing for information preservation to optimizing for perceptual discrimination. Focusing on binocular disparity - the slight differences in how objects project to the two eyes - we re-analyze measurements from neurons characterizing tuning curves in macaque monkey brain regions V1, V2, and MT, and compare these to measurements of the natural visual statistics of binocular disparity. The changes in tuning curve characteristics are computationally consistent with a shift in optimization goals from maximizing the information encoded about naturally occurring binocular disparities to maximizing the ability to support fine disparity discrimination. We find that a change towards tuning curves preferring larger disparities is a key driver of this shift. These results provide new insight into previously-identified differences between disparity-selective regions of cortex and suggest these differences play an important role in supporting visually-guided behavior. Our findings support a key re-framing of optimal coding in regions of the brain that contain sensory information, emphasizing the need to consider not just information preservation and neural resources, but also relevance to behavior.

Determinants of Learning Anatomy in an Immersive Virtual Reality Environment - A Scoping Review

Given the decline of cadavers as anatomy teaching tools, immersive virtual reality (VR) technology has gained popularity as a potential alternative. To better understand how to maximize the educational potential of VR, this scoping review aimed to identify potential determinants of learning anatomy in an immersive VR environment. A literature search yielded 4523 studies, 25 of which were included after screening. Six common factors were derived from secondary outcomes in these papers: cognitive load, cybersickness, student perceptions, stereopsis, spatial understanding, and interactivity. Further objective research investigating the impact of these factors on anatomy examination performance is required.

Supplementary Information

The online version contains supplementary material available at 10.1007/s40670-022-01701-y.

Stereopsis without correspondence

Stereopsis has traditionally been considered a complex visual ability, restricted to large-brained animals. The discovery in the 1980s that insects, too, have stereopsis, therefore, challenged theories of stereopsis. How can such simple brains see in three dimensions? A likely answer is that insect stereopsis has evolved to produce simple behaviour, such as orienting towards the closer of two objects or triggering a strike when prey comes within range. Scientific thinking about stereopsis has been unduly anthropomorphic, for example assuming that stereopsis must require binocular fusion or a solution of the stereo correspondence problem. In fact, useful behaviour can be produced with very basic stereoscopic algorithms which make no attempt to achieve fusion or correspondence, or to produce even a coarse map of depth across the visual field. This may explain why some aspects of insect stereopsis seem poorly designed from an engineering point of view: for example, paying no attention to whether interocular contrast or velocities match. Such algorithms demonstrably work well enough in practice for their species, and may prove useful in particular autonomous applications. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

CyclinD2-mediated regulation of neurogenic output from the retinal ciliary margin is perturbed in albinism

In albinism, aberrations in the ipsi-/contralateral retinal ganglion cell (RGC) ratio compromise the functional integrity of the binocular circuit. Here, we focus on the mouse ciliary margin zone (CMZ), a neurogenic niche at the embryonic peripheral retina, to investigate developmental processes regulating RGC neurogenesis and identity acquisition. We found that the mouse ventral CMZ generates predominantly ipsilaterally projecting RGCs, but this output is altered in the albino visual system because of CyclinD2 downregulation and disturbed timing of the cell cycle. Consequently, albino as well as CyclinD2-deficient pigmented mice exhibit diminished ipsilateral retinogeniculate projection and poor depth perception. In albino mice, pharmacological stimulation of calcium channels, known to upregulate CyclinD2 in other cell types, augmented CyclinD2-dependent neurogenesis of ipsilateral RGCs and improved stereopsis. Together, these results implicate CMZ neurogenesis and its regulators as critical for the formation and function of the mammalian binocular circuit.

Neural circuits for binocular vision: Ocular dominance, interocular matching, and disparity selectivity

The brain creates a single visual percept of the world with inputs from two eyes. This means that downstream structures must integrate information from the two eyes coherently. Not only does the brain meet this challenge effortlessly, it also uses small differences between the two eyes' inputs, i.e., binocular disparity, to construct depth information in a perceptual process called stereopsis. Recent studies have advanced our understanding of the neural circuits underlying stereoscopic vision and its development. Here, we review these advances in the context of three binocular properties that have been most commonly studied for visual cortical neurons: ocular dominance of response magnitude, interocular matching of orientation preference, and response selectivity for binocular disparity. By focusing mostly on mouse studies, as well as recent studies using ferrets and tree shrews, we highlight unresolved controversies and significant knowledge gaps regarding the neural circuits underlying binocular vision. We note that in most ocular dominance studies, only monocular stimulations are used, which could lead to a mischaracterization of binocularity. On the other hand, much remains unknown regarding the circuit basis of interocular matching and disparity selectivity and its development. We conclude by outlining opportunities for future studies on the neural circuits and functional development of binocular integration in the early visual system.

Strong tuning for stereoscopic depth indicates orientation-specific recurrent circuitry in tree shrew V1

Neurons in the primary visual cortex (V1) are tuned to specific disparities between the two retinal images, which form the neural substrate for stereoscopic vision. We show that V1 neurons in tree shrews, but not in mice, display highly selective responses to narrow ranges of disparity in random-dot stereograms. Surprisingly, V1 neurons in both species show similarly strong tuning to gratings of varying interocular phase differences. This stimulus-dependent dissociation of disparity tuning can be explained by a network model that combines both feedforward and recurrent connections. The features of the model connections are supported by cortical organizations specific to each species. We validate this model by identifying putative inhibitory neurons and confirming their predicted disparity tuning in both species. Together, our studies establish a foundation for using tree shrews in studying binocular vision and raise an exciting possibility of how cortical columns could be uniquely important in computing stereoscopic depth.

Scene-relative object motion biases depth percepts

An important function of the visual system is to represent 3D scene structure from a sequence of 2D images projected onto the retinae. During observer translation, the relative image motion of stationary objects at different distances (motion parallax) provides potent depth information. However, if an object moves relative to the scene, this complicates the computation of depth from motion parallax since there will be an additional component of image motion related to scene-relative object motion. To correctly compute depth from motion parallax, only the component of image motion caused by self-motion should be used by the brain. Previous experimental and theoretical work on perception of depth from motion parallax has assumed that objects are stationary in the world. Thus, it is unknown whether perceived depth based on motion parallax is biased by object motion relative to the scene. Naïve human subjects viewed a virtual 3D scene consisting of a ground plane and stationary background objects, while lateral self-motion was simulated by optic flow. A target object could be either stationary or moving laterally at different velocities, and subjects were asked to judge the depth of the object relative to the plane of fixation. Subjects showed a far bias when object and observer moved in the same direction, and a near bias when object and observer moved in opposite directions. This pattern of biases is expected if subjects confound image motion due to self-motion with that due to scene-relative object motion. These biases were large when the object was viewed monocularly, and were greatly reduced, but not eliminated, when binocular disparity cues were provided. Our findings establish that scene-relative object motion can confound perceptual judgements of depth during self-motion.

Neural Research on Depth Perception and Stereoscopic Visual Fatigue in Virtual Reality

Virtual reality (VR) technology provides highly immersive depth perception experiences; nevertheless, stereoscopic visual fatigue (SVF) has become an important factor currently hindering the development of VR applications. However, there is scant research on the underlying neural mechanism of SVF, especially those induced by VR displays, which need further research. In this paper, a Go/NoGo paradigm based on disparity variations is proposed to induce SVF associated with depth perception, and the underlying neural mechanism of SVF in a VR environment was investigated. The effects of disparity variations as well as SVF on the temporal characteristics of visual evoked potentials (VEPs) were explored. Point-by-point permutation statistical with repeated measures ANOVA results revealed that the amplitudes and latencies of the posterior VEP component P2 were modulated by disparities, and posterior P2 amplitudes were modulated differently by SVF in different depth perception situations. Cortical source localization analysis was performed to explore the original cortex areas related to certain fatigue levels and disparities, and the results showed that posterior P2 generated from the precuneus could represent depth perception in binocular vision, and therefore could be performed to distinguish SVF induced by disparity variations. Our findings could help to extend an understanding of the neural mechanisms underlying depth perception and SVF as well as providing beneficial information for improving the visual experience in VR applications.

The influence of stereoscopic vision on surgical performance in minimal invasive surgery—a substudy of the IDOSP-Study (Influence of 3D- vs. 4 K-Display Systems on Surgical Performance in minimal invasive surgery)

Purpose

This study is a secondary analysis of the IDOSP trial published in the Annals of Surgery 2020. The aim of this study was to examine the influence of stereo acuity on surgical performance in a laparoscopic training parkour with 3D- versus 4 K-2D-display technique.

Methods

The surgical performance of medical students (MS), non-board-certified surgeons (NBC), and board-certified surgeons (BC) was compared using 3D- versus 4 K-2D-display technique at a training parkour in a randomized cross-over trial. Stereo acuity was tested by TNO and Titmus Stereo tests.

Results

Eighty-nine participants were included in this sub-trial. The median stereo acuity for all participants, measured with the Titmus test, was 25 s arc, with TNO test 30 s arc. Higher quality stereo vision, measured with the Titmus test, correlated significantly with a reduced parkour time (r = 0.26, p = 0.02) and error (r = 0.21, p = 0.048) with the 3D screen. The TNO test did not correlate significantly with parkour performance. There was no statistically significant correlation between parkour time nor error and stereo acuity using the 4 K system (p > 0.457 respectively). Higher age showed a significant correlation with lower stereo acuity measured with TNO (r = 0.21, p = 0.014), but not with the Titmus test (r =  − 0.7, p = 0.39). Seven percent of the group “NBC and BC” showed reduced stereo acuity > 120 s arc with the Titmus test and 3% with the TNO test.

Conclusion

High-quality stereo vision is of utmost importance for surgical skills using a 3D-display system. This was most obvious for MS and for tasks that place particularly high demands on hand–eye coordination. The Titmus test was more precise than the TNO test to predict the benefit of a 3D monitor system. Experience and fine motor skills could partly compensate for a poorer stereo acuity.

Trial registration

This trial was registered at clinicaltrials.gov (trial number: NCT03445429, registered February 26, 2018).

Binocular Integration in the Primate Primary Visual Cortex

binocular vision, binocular fusion, binocular combination, LGN, V1.

The role of low-frequency oscillations in three-dimensional perception with depth cues in virtual reality

Currently, vision-related neuroscience studies are undergoing a trend from simplified image stimuli toward more naturalistic stimuli. Virtual reality (VR), as an emerging technology for visual immersion, provides more depth cues for three-dimensional (3D) presentation than two-dimensional (2D) image. It is still unclear whether the depth cues used to create 3D visual perception modulate specific cortical activation. Here, we constructed two visual stimuli presented by stereoscopic vision in VR and graphical projection with 2D image, respectively, and used electroencephalography to examine neural oscillations and their functional connectivity during 3D perception. We find that neural oscillations are specific to delta and theta bands in stereoscopic vision and the functional connectivity in the both bands increase in cortical areas related to visual pathways. These findings indicate that low-frequency oscillations play an important role in 3D perception with depth cues.

A nasal visual field advantage in interocular competition

When our eyes are confronted with discrepant images (yielding incompatible retinal inputs) interocular competition (IOC) is instigated. During IOC, one image temporarily dominates perception, while the other is suppressed. Many factors affecting IOC have been extensively examined. One factor that received surprisingly little attention, however, is the stimulus’ visual hemifield (VHF) of origin. This is remarkable, as the VHF location of stimuli is known to affect visual performance in various contexts. Prompted by exploratory analyses, we examined five independent datasets of breaking continuous flash suppression experiments, to establish the VHF’s role in IOC. We found that targets presented in nasal VHF locations broke through suppression much faster than targets in temporal VHF locations. Furthermore, we found that the magnitude of this nasal advantage depended on how strongly the targets were suppressed: the nasal advantage was larger for the recessive eye than for the dominant eye, and was larger in observers with a greater dominance imbalance between the eyes. Our findings suggest that the nasal advantage reported here originates in processing stages where IOC is resolved. Finally, we propose that a nasal advantage in IOC serves an adaptive role in human vision, as it can aid perception of partially occluded objects.

Variations in intraocular pressure and visual parameters before and after using mobile virtual reality glasses and their effects on the eyes

We examined the effects of using mobile devices with immersive virtual reality for a short period on the physiological parameters of both eyes. The average age of the 50 participants (23 men and 27 women) was 17.72 ± 1.48 years, and refractive error ranged from 0 D to − 5.00 D. All the participants wore + 3.00 D glasses and underwent a 5-min relaxation adjustment through the atomization method. The participants wore immersive virtual reality (VR) glasses to watch a movie on a roller coaster for 10 min. Their relevant physiological parameters of the eyes were measured both before and after using VR glasses. Compared with before VR use, no significant difference (P > 0.05) was observed in the near-horizontal vergence and refractive error but a significant difference (P < 0.05) was observed in the amplitude of accommodation, intraocular pressure, divergence/convergence, and stereopsis after VR use. The corneal elastic coefficient was > 0.2 MPa, and we used Friedenwald’s eye rigidity relationship to obtain the K value (0.065–0.09). Approximately 10% of the participants experienced cybersickness symptoms such as nausea and dizziness. The use of VR to watch three-dimensional movies reduced intraocular pressure, which may help prevent or treat glaucoma. Moreover, the binocular convergence was higher when viewing near-field objects in VR than in the real world. Therefore, individuals with convergence excess may experience symptoms. Binocular parallax is the most likely cause of cybersickness symptoms. Thus, mobile VR devices with higher quality and comfort are necessary.

Stereopsis and Eye Movement Abnormalities in Parkinson’s Disease and Their Clinical Implications

Background

Parkinson’s disease (PD) is not exclusively a motor disorder. Among non-motor features, patients with PD possess sensory visual dysfunctions. Depth perception and oculomotor deficits can significantly impact patients’ motor performance. Stereopsis and eye behavioral study using 3D stimuli may help determine their implications in disease status.

Objective

The objective of this study is to investigate stereopsis and eye movement abnormalities in PD with reliable tools and their correlation with indicators of PD severity. We hypothesize that patients with PD exhibit different eye behaviors and that these differences may correlate to the severity of motor symptoms and cognitive status.

Methods

Control and PD participants were first evaluated for visual acuity, visual field, contrast acuity, and stereo perception with 2D and Titmus stereotests, followed by the assessment with a 3D active shutter system. Eye movement behaviors were assessed by a Tobii X2-60 eye tracker.

Results

Screening visual tests did not reveal any differences between the PD and control groups. With the 3D active shutter system, the PD group demonstrated significantly worse stereopsis. The preserved cognitive function was correlated to a more intact stereo function. Patients with PD had longer visual response times, with a higher number of fixations and bigger saccade amplitude, suggesting fixation stabilization difficulties. Such changes showed a positive correlation with the severity of motor symptoms and a negative correlation with normal cognitive status.

Conclusion

We assessed stereopsis with a 3D active shutter system and oculomotor behaviors with the Tobii eye tracker. Patients with PD exhibit poorer stereopsis and impaired oculomotor behaviors during response time. These deficits were correlated with PD motor and cognitive status. The visual parameters may potentially serve as the clinical biomarkers for PD.

Contextual Modulation of Feedforward Inputs to Primary Visual Cortex

Throughout the brain, parallel processing streams compose the building blocks of complex neural functions. One of the most salient models for studying the functional specialization of parallel visual streams in the primate brain is the lateral geniculate nucleus (LGN) of the dorsal thalamus, through which the parvocellular and magnocellular channels, On-center and Off-center channels, and ipsilateral and contralateral eye channels are maintained and provide the foundation for cortical processing. We examined three aspects of neural processing in these streams: (1) the relationship between extraclassical surround suppression, a widespread visual computation thought to represent a canonical neural computation, and the parallel channels of the LGN; (2) the magnitude of binocular interaction in the parallel streams; and (3) the magnitude of suppression elicited by perceptual competition (binocular rivalry) in each stream. Our results show that surround suppression is almost exclusive to Off channel cells; further, we found evidence for two different components of monocular surround suppression—an early-stage suppression exhibited by all magnocellular cells, and a late-stage suppression exhibited only by Off cells in both the parvocellular and magnocellular pathways. This finding indicates that stream-specific circuits contribute to surround suppression in the primate LGN and suggests a distinct role for suppression in the Off channel to the cortex. We also examined the responses of LGN neurons in alert macaque monkeys to determine whether neurons that supply the cortex with visual information are influenced by stimulation of both eyes. Our results demonstrate that LGN neurons are not influenced by stimulation of the non-dominant eye. This was the case when dichoptic stimuli were presented to classical receptive fields of neurons, extraclassical receptive fields of neurons, and when stimuli were appropriate to produce the perception of binocular rivalry.

V1 as an egocentric cognitive map

We typically distinguish between V1 as an egocentric perceptual map and the hippocampus as an allocentric cognitive map. In this article, we argue that V1 also functions as a post-perceptual egocentric cognitive map. We argue that three well-documented functions of V1, namely (i) the estimation of distance, (ii) the estimation of size, and (iii) multisensory integration, are better understood as post-perceptual cognitive inferences. This argument has two important implications. First, we argue that V1 must function as the neural correlates of the visual perception/cognition distinction and suggest how this can be accommodated by V1's laminar structure. Second, we use this insight to propose a low-level account of visual consciousness in contrast to mid-level accounts (recurrent processing theory; integrated information theory) and higher-level accounts (higher-order thought; global workspace theory). Detection thresholds have been traditionally used to rule out such an approach, but we explain why it is a mistake to equate visibility (and therefore the presence/absence of visual experience) with detection thresholds.

Stereoacuity and its determinants in 7-year-old children: the Lhasa Childhood Eye Study

PURPOSE

To explore the distribution of stereoacuity and to examine its determinants in school-age children in Tibetan plateau, Southwest China.

METHODS

This is the cross-sectional part of a school-based cohort study of 7-year-old children in Lhasa, Tibet Autonomous Region, Southwest China. Children in first year of primary school were invited to undergo a comprehensive examination, including height, weight, visual acuity, cycloplegic autorefraction (1% cyclopentolate), anterior segment, cover and uncover test, and stereoacuity (Titmus Stereo Test).

RESULTS

A total of 1833 eligible subjects were included, with a mean age of 6.82 ± 0.46 years. Mean stereoacuity was 1.78 ± 0.21 in log units (median: 60 arcsec). Children with stereoacuity equal to 40 arcsec and stereoacuity worse than 100 arcsec accounted for 29.24% and 8.18% of the cohort, respectively. Tibetan ethnicity (OR = 1.98; 95%CI, 1.30-3.03), astigmatism (OR = 1.65; 95%CI, 1.26-2.17), strabismus (OR = 2.92; 95%CI, 1.38-6.18), and amblyopia (OR = 3.77; 95%CI, 1.14-12.49) were risk factors for normal stereoacuity (= 40 arcsec). Shorter height, younger age, strabismus, and worse BCVA (P < 0.05 for all) were both related to lower stereoacuity in Spearman correlation analysis and associated with lower stereoacuity in multivariate regression analysis.

CONCLUSION

Stereoacuity maturation does not appear fully completed in 7-year-old children, while few children present stereoacuity worse than 100 arcsec (8.18%). Lower stereoacuity was associated with younger age, shorter height, strabismus, and lower best-corrected visual acuity.

Balanced Binocular Inputs Support Superior Stereopsis

Purpose

Our visual system compares the inputs received from the two eyes to estimate the relative depths of features in the retinal image. We investigated how an imbalance in the strength of the input received from the two eyes affects stereopsis. We also explored the level of agreement between different measurements of sensory eye imbalance.

Methods

We measured the sensory eye imbalance and stereoacuity of 30 normally sighted participants. We made our measurements using a modified amblyoscope. The sensory eye imbalance was assessed through three methods: the difference between monocular contrast thresholds, the difference in dichoptic masking weight, and the contribution of each eye to a fused binocular percept. We referred them as the “threshold imbalance,” “masking imbalance,” and “fusion imbalance,” respectively. The stereoacuity threshold was measured by having subjects discriminate which of four circles were displaced in depth. All of our tests were performed using stimuli of the same spatial frequency (2.5 cycles/degree).

Results

We found a relationship between stereoacuity and sensory eye imbalance. However, this was only the case for fusion imbalance measurement (ρ = 0.52; P = 0.003). Neither the threshold imbalance nor the masking imbalance was significantly correlated with stereoacuity. We also found the threshold imbalance was correlated with both the fusion and masking imbalances (r = 0.46, P = 0.011 and r = 0.49, P = 0.005, respectively). However, a nonsignificant correlation was found between the fusion and masking imbalances.

Conclusions

Our findings suggest that there exist multiple types of sensory eye dominance that can be assessed by different tasks. We find only imbalances in dominance that result in biases to fused percepts are correlated with stereoacuity.

Disparity in Context: Understanding how monocular image content interacts with disparity processing in human visual cortex

Horizontal disparities between the two eyes' retinal images are the primary cue for depth. Commonly used random ot tereograms (RDS) intentionally camouflage the disparity cue, breaking the correlations between monocular image structure and the depth map that are present in natural images. Because of the nonlinear nature of visual processing, it is unlikely that simple computational rules derived from RDS will be sufficient to explain binocular vision in natural environments. In order to understand the interplay between natural scene structure and disparity encoding, we used a depth-image-based-rendering technique and a library of natural 3D stereo pairs to synthesize two novel stereogram types in which monocular scene content was manipulated independent of scene depth information. The half-images of the novel stereograms comprised either random-dots or scrambled natural scenes, each with the same depth maps as the corresponding natural scene stereograms. Using these stereograms in a simultaneous Event-Related Potential and behavioral discrimination task, we identified multiple disparity-contingent encoding stages between 100 ~ 500 msec. The first disparity sensitive evoked potential was observed at ~100 msec after an earlier evoked potential (between ~50-100 msec) that was sensitive to the structure of the monocular half-images but blind to disparity. Starting at ~150 msec, disparity responses were stereogram-specific and predictive of perceptual depth. Complex features associated with natural scene content are thus at least partially coded prior to disparity information, but these features and possibly others associated with natural scene content interact with disparity information only after an intermediate, 2D scene-independent disparity processing stage.

Binocular Vision and Stereopsis Across the Animal Kingdom

Most animals have at least some binocular overlap, i.e., a region of space that is viewed by both eyes. This reduces the overall visual field and raises the problem of combining two views of the world, seen from different vantage points, into a coherent whole. However, binocular vision also offers many potential advantages, including increased ability to see around obstacles and increased contrast sensitivity. One particularly interesting use for binocular vision is comparing information from both eyes to derive information about depth. There are many different ways in which this might be done, but in this review, I refer to them all under the general heading of stereopsis. This review examines the different possible uses of binocular vision and stereopsis and compares what is currently known about the neural basis of stereopsis in different taxa. Studying different animals helps us break free of preconceptions stemming from the way that stereopsis operates in human vision and provides new insights into the different possible forms of stereopsis. Expected final online publication date for the Annual Review of Vision Science, Volume 7 is September 2021. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.

Optics and neural adaptation jointly limit human stereovision

Stereovision is the ability to perceive fine depth variations from small differences in the two eyes' images. Using adaptive optics, we show that even minute optical aberrations that are not clinically correctable, and go unnoticed in everyday vision, can affect stereo acuity. Hence, the human binocular system is capable of using fine details that are not experienced in everyday vision. Interestingly, stereo acuity varied considerably across individuals even when they were provided identical perfect optics. We also found that individuals' stereo acuity is better when viewing with their habitual optics rather than someone else's (better) optics. Together, these findings suggest that the visual system compensates for habitual optical aberrations through neural adaptation and thereby optimizes stereovision uniquely for each individual. Thus, stereovision is limited by small optical aberrations and by neural adaptation to one's own optics.

Natural binocular depth discrimination behavior in mice explained by visual cortical activity

In mice and other mammals, forebrain neurons integrate right and left eye information to generate a three-dimensional representation of the visual environment. Neurons in the visual cortex of mice are sensitive to binocular disparity,^1-3 yet it is unclear whether that sensitivity is linked to the perception of depth.^4-8 We developed a natural task based on the classic visual cliff and pole descent tasks to estimate the psychophysical range of mouse depth discrimination.^5,9 Mice with binocular vision descended to a near (shallow) surface more often when surrounding far (deep) surfaces were progressively more distant. Occlusion of one eye severely impaired their ability to target the near surface. We quantified the distance at which animals make their decisions to estimate the binocular image displacement of the checkerboard pattern on the near and far surfaces. Then, we assayed the disparity sensitivity of large populations of binocular neurons in primary visual cortex (V1) using two-photon microscopy² and quantitatively compared this information available in V1 to their behavioral sensitivity. Disparity information in V1 matches the behavioral performance over the range of depths examined and was resistant to changes in binocular alignment. These findings reveal that mice naturally use stereoscopic cues to guide their behavior and indicate a neural basis for this depth discrimination task.

Cell-type-specific binocular vision guides predation in mice

Predators use vision to hunt, and hunting success is one of evolution's main selection pressures. However, how viewing strategies and visual systems are adapted to predation is unclear. Tracking predator-prey interactions of mice and crickets in 3D, we find that mice trace crickets with their binocular visual fields and that monocular mice are poor hunters. Mammalian binocular vision requires ipsi- and contralateral projections of retinal ganglion cells (RGCs) to the brain. Large-scale single-cell recordings and morphological reconstructions reveal that only a small subset (9 of 40+) of RGC types in the ventrotemporal mouse retina innervate ipsilateral brain areas (ipsi-RGCs). Selective ablation of ipsi-RGCs (<2% of RGCs) in the adult retina drastically reduces the hunting success of mice. Stimuli based on ethological observations indicate that five ipsi-RGC types reliably signal prey. Thus, viewing strategies align with a spatially restricted and cell-type-specific set of ipsi-RGCs that supports binocular vision to guide predation.

Decreased Functional Connectivity of the Primary Visual Cortex and the Correlation With Clinical Features in Patients With Intermittent Exotropia

The purpose of this study is to investigate characteristic alterations of functional connectivity (FC) patterns in the primary visual area (V1) in patients with intermittent exotropia (IXT) using resting-state functional magnetic resonance imaging (rs-fMRI) and how they relate to clinical features. Twenty-six IXT patients and 21 age-, sex-, handedness-, and education-matched healthy controls (HCs) underwent rs-fMRI. We performed FC analyses between bilateral V1 and other brain areas and compared FC strength between two groups. A Pearson correlation analysis was used to evaluate the correlation between the FC differences and clinical features. Compared with HCs, patients with IXT showed significantly lower FC of the right V1 with the right calcarine sulcus and right superior occipital gyrus, and the left V1 with right cuneus and right postcentral gyrus. The Newcastle Control Test score was positively correlated with mean FC values between the left inferior parietal lobule and bilateral V1, and between the left supramarginal gyrus and left V1. The duration of IXT was positively correlated with mean FC values between the right inferior occipital gyrus and right V1. Reduced FC between the V1 and various brain regions involved in vision and eye movement processes may be associated with the underlying neural mechanisms of impaired visual function in patients with IXT.

Specialized contributions of mid-tier stages of dorsal and ventral pathways to stereoscopic processing in macaque

The division of labor between the dorsal and ventral visual pathways has been well studied, but not often with direct comparison at the single-neuron resolution with matched stimuli. Here we directly compared how single neurons in MT and V4, mid-tier areas of the two pathways, process binocular disparity, a powerful cue for 3D perception and actions. We found that MT neurons transmitted disparity signals more quickly and robustly, whereas V4 or its upstream neurons transformed the signals into sophisticated representations more prominently. Therefore, signaling speed and robustness were traded for transformation between the dorsal and ventral pathways. The key factor in this tradeoff was disparity-tuning shape: V4 neurons had more even-symmetric tuning than MT neurons. Moreover, the tuning symmetry predicted the degree of signal transformation across neurons similarly within each area, implying a general role of tuning symmetry in the stereoscopic processing by the two pathways.

Visual Cortex: Binocular Matchmaking

Most binocular neurons in the mammalian visual cortex show matched selectivity for light stimuli presented through either eye. A recent study tracked the responses of individual neurons in early visual cortex over time, revealing that matched binocular selectivity develops through major rearrangements of binocular visual circuits.

Disparity Sensitivity and Binocular Integration in Mouse Visual Cortex Areas

Binocular disparity, the difference between the two eyes' images, is a powerful cue to generate the 3D depth percept known as stereopsis. In primates, binocular disparity is processed in multiple areas of the visual cortex, with distinct contributions of higher areas to specific aspects of depth perception. Mice, too, can perceive stereoscopic depth, and neurons in primary visual cortex (V1) and higher-order, lateromedial (LM) and rostrolateral (RL) areas were found to be sensitive to binocular disparity. A detailed characterization of disparity tuning across mouse visual areas is lacking, however, and acquiring such data might help clarifying the role of higher areas for disparity processing and establishing putative functional correspondences to primate areas. We used two-photon calcium imaging in female mice to characterize the disparity tuning properties of neurons in visual areas V1, LM, and RL in response to dichoptically presented binocular gratings, as well as random dot correlograms (RDC). In all three areas, many neurons were tuned to disparity, showing strong response facilitation or suppression at optimal or null disparity, respectively, even in neurons classified as monocular by conventional ocular dominance (OD) measurements. Neurons in higher areas exhibited broader and more asymmetric disparity tuning curves compared with V1, as observed in primate visual cortex. Finally, we probed neurons' sensitivity to true stereo correspondence by comparing responses to correlated RDC (cRDC) and anticorrelated RDC (aRDC). Area LM, akin to primate ventral visual stream areas, showed higher selectivity for correlated stimuli and reduced anticorrelated responses, indicating higher-level disparity processing in LM compared with V1 and RL.SIGNIFICANCE STATEMENT A major cue for inferring 3D depth is disparity between the two eyes' images. Investigating how binocular disparity is processed in the mouse visual system will not only help delineating the role of mouse higher areas for visual processing, but also shed light on how the mammalian brain computes stereopsis. We found that binocular integration is a prominent feature of mouse visual cortex, as many neurons are selectively and strongly modulated by binocular disparity. Comparison of responses to correlated and anticorrelated random dot correlograms (RDC) revealed that lateromedial area (LM) is more selective to correlated stimuli, while less sensitive to anticorrelated stimuli compared with primary visual cortex (V1) and rostrolateral area (RL), suggesting higher-level disparity processing in LM, resembling primate ventral visual stream areas.

Functional specialization in human dorsal pathway for stereoscopic depth processing

Binocular disparity, a primary cue for stereoscopic depth perception, is widely represented in visual cortex. However, the functional specialization in the disparity processing network remains unclear. Using magnetic resonance imaging-guided transcranial magnetic stimulation, we studied the causal contributions of V3A and MT+ to stereoscopic depth perception. Subjects viewed random-dot stereograms forming transparent planes with various interplane disparities. Their smallest detectable disparity and largest detectable disparity were measured in two experiments. We found that the smallest detectable disparity was affected by V3A, but not MT+ , stimulation. On the other hand, the largest detectable disparity was affected by both V3A and MT+ stimulation. Our results suggest different roles of V3A and MT+ in stereoscopic depth processing.

Predicting Stereopsis in Macular Degeneration

Each of our eyes sees a slightly different view of the physical world. Disparity is the small difference in position of features in the retinal images; stereopsis is the percept of depth from disparity. A distance between corresponding features in the retinal images of the two eyes smaller than the "upper disparity limit" yields a percept of depth; distances greater than this limit cause the two unfused monocular features to appear flattened into the fixation plane. This behavioral disparity limit is consistent with neurophysiological estimates of the largest disparity scale in primate, allowing us to relate physiological limits on plausible binocular interactions to separation between retinal locations. Here we test the hypothesis that this upper disparity limit predicts the presence of coarse stereopsis in humans with macular degeneration (MD), which affects the central retina but typically spares the periphery. The pattern of vision loss can be highly asymmetric, such that an intact location in one eye has a corresponding point in the other eye that lies within affected retina. Nevertheless, some individuals with MD have coarse stereopsis that is useful for eye-hand coordination. Our results show that individuals with MD (n = 25, male and female) have coarse stereopsis when the distance between intact retinal locations is less than the behavioral and physiological upper disparity limit at the corresponding eccentricity. Furthermore, for those without stereopsis, we can predict whether they can achieve stereopsis by using alternate retinal loci at further eccentricities whose separation is below the upper disparity limit.SIGNIFICANCE STATEMENT We show that the largest separation between features in the two eyes that yields a percept of depth in humans is related to the largest disparity scale in macaque medial temporal area and to the estimated size of the receptive fields in human depth-sensitive cortical regions. This upper disparity limit also predicts whether individuals with retinal damage due to macular degeneration will have stereopsis. Individuals have stereopsis when the separation between intact retinal locations in the two eyes is smaller than the upper disparity limit measured behaviorally. Our results indicate the importance of the behavioral upper disparity limit as a predictor for stereopsis in populations with retinal damage.