Binocular stereoscopy in visual areas V-2, V-3, and V-3A of the macaque monkey

Mesoscale organization of ventral and dorsal visual pathways in macaque monkey revealed by 7T fMRI

In human and nonhuman primate brains, columnar (mesoscale) organization has been demonstrated to underlie both lower and higher order aspects of visual information processing. Previous studies have focused on identifying functional preferences of mesoscale domains in specific areas; but there has been little understanding of how mesoscale domains may cooperatively respond to single visual stimuli across dorsal and ventral pathways. Here, we have developed ultrahigh-field 7 T fMRI methods to enable simultaneous mapping, in individual macaque monkeys, of response in both dorsal and ventral pathways to single simple color and motion stimuli. We provide the first evidence that anatomical V2 cytochrome oxidase-stained stripes are well aligned with fMRI maps of V2 stripes, settling a long-standing controversy. In the ventral pathway, a systematic array of paired color and luminance processing domains across V4 was revealed, suggesting a novel organization for surface information processing. In the dorsal pathway, in addition to high quality motion direction maps of MT, MST and V3A, alternating color and motion direction domains in V3 are revealed. As well, submillimeter motion domains were observed in peripheral LIPd and LIPv. In sum, our study provides a novel global snapshot of how mesoscale networks in the ventral and dorsal visual pathways form the organizational basis of visual objection recognition and vision for action.

Cortical Deficits are Correlated with Impaired Stereopsis in Patients with Strabismus

In this study, we explored the neural mechanism underlying impaired stereopsis and possible functional plasticity after strabismus surgery. We enrolled 18 stereo-deficient patients with intermittent exotropia before and after surgery, along with 18 healthy controls. Functional magnetic resonance imaging data were collected when participants viewed three-dimensional stimuli. Compared with controls, preoperative patients showed hypoactivation in higher-level dorsal (visual and parietal) areas and ventral visual areas. Pre- and postoperative activation did not significantly differ in patients overall; patients with improved stereopsis showed stronger postoperative activation than preoperative activation in the right V3A and left intraparietal sulcus. Worse stereopsis and fusional control were correlated with preoperative hypoactivation, suggesting that cortical deficits along the two streams might reflect impaired stereopsis in intermittent exotropia. The correlation between improved stereopsis and activation in the right V3A after surgery indicates that functional plasticity may underlie the improvement of stereopsis. Thus, additional postoperative strategies are needed to promote functional plasticity and enhance the recovery of stereopsis.

The 100 most cited papers on amblyopia: a bibliographic perspective

AIM

To analyze the top 100 most cited papers related to amblyopia.

METHODS

A bibliographic search in the Institute for Scientific Information Web of Knowledge across 55 years was performed.

RESULTS

Eighty-nine of the 100 papers were published in first-quartile journals. Half (50) of the senior authors were from the USA. Most papers dealt with clinical science (72) and included original research (84). Forty-two of the articles related to all three types of amblyopia (refractive, strabismic and deprivation). Thirty-four related to both strabismic and refractive amblyopia. Around two-thirds of the papers dealt with treatment (34) and pathophysiology (30). Almost a quarter (23%) of the papers were multicenter studies. Nearly half (48) of the papers were published between 2000 and 2010. The Pediatric Eye Disease Investigator Group (PEDIG) published the highest number of studies (11), which dealt more with treatment (p = 0.01) and had higher average number of citations per years (p = 0.05). A larger number of articles on the treatment of amblyopia are newer (p = 0.01). There was no correlation between the time of their publication and the number of citations (p = 0.68, r = 0.042).

CONCLUSIONS

Half of the papers were published between 2000 and 2010 and were spearheaded by PEDIG. Most papers dealt with treatment and pathophysiology. This study provides an important historical perspective, emphasizing the need for additional research to better understand this preventable and curable childhood vision impairment.

Large-scale cortico-cerebellar computations for horizontal and vertical vergence in humans

Horizontal and vertical vergence eye movements play a central role in binocular coordination. Neurophysiological studies suggest that cortical and subcortical regions in animals and humans are involved in horizontal vergence. However, little is known about the extent to which the neural mechanism underlying vertical vergence overlaps with that of horizontal vergence. In this study, to explore neural computation for horizontal and vertical vergence, we simultaneously recorded electrooculography (EOG) and whole-head magnetoencephalography (MEG) while presenting large-field stereograms for 29 healthy human adults. The stereograms were designed to produce vergence responses by manipulating horizontal and vertical binocular disparities. A model-based approach was used to assess neural sensitivity to horizontal and vertical disparities via MEG source estimation and the theta-band (4 Hz) coherence between brain activity and EOG vergence velocity. We found similar time-locked neural responses to horizontal and vertical disparity in cortical and cerebellar areas at around 100–250 ms after stimulus onset. In contrast, the low-frequency oscillatory neural activity associated with the execution of vertical vergence differed from that of horizontal vergence. These findings indicate that horizontal and vertical vergence involve partially shared but distinct computations in large-scale cortico-cerebellar networks.

Binocular Integration in the Primate Primary Visual Cortex

binocular vision, binocular fusion, binocular combination, LGN, V1.

What and Where: Location-Dependent Feature Sensitivity as a Canonical Organizing Principle of the Visual System

Traditionally, functional representations in early visual areas are conceived as retinotopic maps preserving ego-centric spatial location information while ensuring that other stimulus features are uniformly represented for all locations in space. Recent results challenge this framework of relatively independent encoding of location and features in the early visual system, emphasizing location-dependent feature sensitivities that reflect specialization of cortical circuits for different locations in visual space. Here we review the evidence for such location-specific encoding including: (1) systematic variation of functional properties within conventional retinotopic maps in the cortex; (2) novel periodic retinotopic transforms that dramatically illustrate the tight linkage of feature sensitivity, spatial location, and cortical circuitry; and (3) retinotopic biases in cortical areas, and groups of areas, that have been defined by their functional specializations. We propose that location-dependent feature sensitivity is a fundamental organizing principle of the visual system that achieves efficient representation of positional regularities in visual experience, and reflects the evolutionary selection of sensory and motor circuits to optimally represent behaviorally relevant information. Future studies are necessary to discover mechanisms underlying joint encoding of location and functional information, how this relates to behavior, emerges during development, and varies across species.

Excitatory Contribution to Binocular Interactions in Human Visual Cortex Is Reduced in Strabismic Amblyopia

Binocular summation in strabismic amblyopia is typically reported as being absent or greatly reduced in behavioral studies and is thought to be because of a preferential loss of excitatory interactions between the eyes. Here, we studied how excitatory and suppressive interactions contribute to binocular contrast interactions along the visual cortical hierarchy of humans with strabismic and anisometropic amblyopia in both sexes, using source-imaged steady-state visual evoked potentials (SSVEP) over a wide range of relative contrast between the two eyes. Dichoptic parallel grating stimuli modulated at unique temporal frequencies in each eye allowed us to quantify spectral response components associated with monocular inputs (self-terms) and the response components because of interaction of the inputs of the two eyes [intermodulation (IM) terms]. Although anisometropic amblyopes revealed a similar pattern of responses to normal-vision observers, strabismic amblyopes exhibited substantially reduced IM responses across cortical regions of interest (V1, V3a, hV4, hMT+ and lateral occipital cortex), indicating reduced interocular interactions in visual cortex. A contrast gain control model that simultaneously fits self- and IM-term responses within each cortical area revealed different patterns of binocular interactions between individuals with normal and disrupted binocularity. Our model fits show that in strabismic amblyopia, the excitatory contribution to binocular interactions is significantly reduced in both V1 and extra-striate cortex, whereas suppressive contributions remain intact. Our results provide robust electrophysiological evidence supporting the view that disruption of binocular interactions in strabismus or amblyopia is because of preferential loss of excitatory interactions between the eyes.SIGNIFICANCE STATEMENT We studied how excitatory and suppressive interactions contribute to binocular contrast interactions along the visual cortical hierarchy of humans with normal and amblyopic vision, using source-imaged SSVEP and frequency-domain analysis of dichoptic stimuli over a wide range of relative contrast between the two eyes. A dichoptic contrast gain control model was used to characterize these interactions in amblyopia and provided a quantitative comparison to normal vision. Our model fits revealed different patterns of binocular interactions between normal and amblyopic vision. Strabismic amblyopia significantly reduced excitatory contributions to binocular interactions, whereas suppressive contributions remained intact. Our results provide robust evidence supporting the view that the preferential loss of excitatory interactions disrupts binocular interactions in strabismic amblyopia.

Decision-related feedback in visual cortex lacks spatial selectivity

Feedback in the brain is thought to convey contextual information that underlies our flexibility to perform different tasks. Empirical and computational work on the visual system suggests this is achieved by targeting task-relevant neuronal subpopulations. We combine two tasks, each resulting in selective modulation by feedback, to test whether the feedback reflected the combination of both selectivities. We used visual feature-discrimination specified at one of two possible locations and uncoupled the decision formation from motor plans to report it, while recording in macaque mid-level visual areas. Here we show that although the behavior is spatially selective, using only task-relevant information, modulation by decision-related feedback is spatially unselective. Population responses reveal similar stimulus-choice alignments irrespective of stimulus relevance. The results suggest a common mechanism across tasks, independent of the spatial selectivity these tasks demand. This may reflect biological constraints and facilitate generalization across tasks. Our findings also support a previously hypothesized link between feature-based attention and decision-related activity.

Feedback modulates visual neurons, thought to help achieve flexible task performance. Here, the authors show decision-related feedback is not only relayed to task-relevant neurons, suggesting a broader mechanism and supporting a previously hypothesized link to feature-based attention.

Exploitation of image statistics with sparse coding in the case of stereo vision

The sparse coding algorithm has served as a model for early processing in mammalian vision. It has been assumed that the brain uses sparse coding to exploit statistical properties of the sensory stream. We hypothesize that sparse coding discovers patterns from the data set, which can be used to estimate a set of stimulus parameters by simple readout. In this study, we chose a model of stereo vision to test our hypothesis. We used the Locally Competitive Algorithm (LCA), followed by a naïve Bayes classifier, to infer stereo disparity. From the results we report three observations. First, disparity inference was successful with this naturalistic processing pipeline. Second, an expanded, highly redundant representation is required to robustly identify the input patterns. Third, the inference error can be predicted from the number of active coefficients in the LCA representation. We conclude that sparse coding can generate a suitable general representation for subsequent inference tasks.

Decoding disparity categories in 3-dimensional images from fMRI data using functional connectivity patterns

Humans use binocular disparity to extract depth information from two-dimensional retinal images in a process called stereopsis. Previous studies usually introduce the standard univariate analysis to describe the correlation between disparity level and brain activity within a given brain region based on functional magnetic resonance imaging (fMRI) data. Recently, multivariate pattern analysis has been developed to extract activity patterns across multiple voxels for deciphering categories of binocular disparity. However, the functional connectivity (FC) of patterns based on regions of interest or voxels and their mapping onto disparity category perception remain unknown. The present study extracted functional connectivity patterns for three disparity conditions (crossed disparity, uncrossed disparity, and zero disparity) at distinct spatial scales to decode the binocular disparity. Results of 27 subjects' fMRI data demonstrate that FC features are more discriminatory than traditional voxel activity features in binocular disparity classification. The average binary classification of the whole brain and visual areas are respectively 87% and 79% at single subject level, and thus above the chance level (50%). Our research highlights the importance of exploring functional connectivity patterns to achieve a novel understanding of 3D image processing.

Vertical size disparity induces enhanced neural responses in good stereo observers

Stereoscopic three-dimensional vision requires cortical processing for horizontal binocular disparity between the two eyes' retinal images. Behavioral and theoretical studies suggest that vertical size disparity is used to recover the viewing geometry and to generate the slant of a large surface. However, unlike horizontal disparity, the relation between stereopsis and neural responses to vertical disparity remains controversial. To determine the role of cortical processing for vertical size disparity in stereopsis, we measured neuromagnetic responses to disparities in people with good and poor stereopsis, using magnetoencephalography (MEG). Healthy adult participants viewed stereograms with a horizontal or vertical size disparity, and judged the perceived slant of the pattern. We assessed neural activity in response to disparities in the visual cortex and the phase locking of oscillatory responses including the alpha frequency range using MEG. For participants with good stereopsis, activity in the visual areas was significantly higher in response to vertical size disparity than to horizontal size disparity. The time-frequency analysis revealed that early neural responses to vertical size disparity were more phase-locked in good stereo participants than in poor stereo participants. These results provide neuromagnetic evidence that vertical-size disparity processing plays a role in good stereo vision.

Generalized Representation of Stereoscopic Surface Shape and Orientation in the Human Visual Cortex

The brain's ability to extract three-dimensional (3D) shape and orientation information from viewed objects is vital in daily life. Stereoscopic 3D surface perception relies on binocular disparity. Neurons selective to binocular disparity are widely distributed among visual areas, but the manner in these areas are involved in stereoscopic 3D surface representation is unclear. To address this, participants were instructed to observe random dot stereograms (RDS) depicting convex and concave curved surfaces and the blood oxygenation level-dependent (BOLD) signal of visual cortices was recorded. Two surface types were: (i) horizontally positioned surfaces defined by shear disparity; and (ii) vertically positioned surfaces defined by compression disparity. The surfaces were presented at different depth positions per trial. Functional magnetic resonance imaging (fMRI) data were classified from early visual areas to higher visual areas. We determined whether cortical areas were selective to shape and orientation by assessing same-type stimuli classification accuracies based on multi-voxel activity patterns per area. To identify whether some areas were related to a more generalized sign of curvature or orientation representation, transfer classification was used by training classifiers on one dataset type and testing classifiers on another type. Same-type stimuli classification results showed that most selected visual areas were selective to shape and all were selective to the orientation of disparity-defined 3D surfaces. Transfer classification results showed that in the dorsal visual area V3A, classification accuracies for the discriminate sign of surface curvature were higher than the baseline of statistical significance for all types of classifications, demonstrating that V3A is related to generalized shape representation. Classification accuracies for discriminating horizontal-vertical surfaces in higher dorsal areas V3A and V7 and ventral area lateral occipital complex (LOC) as well as in some areas of intraparietal sulcus (IPS) were higher than the baseline of statistical significance, indicating their relation to the generalized representation of 3D surface orientation.

Multivariate Analysis of BOLD Activation Patterns Recovers Graded Depth Representations in Human Visual and Parietal Cortex

Navigating through natural environments requires localizing objects along three distinct spatial axes. Information about position along the horizontal and vertical axes is available from an object’s position on the retina, while position along the depth axis must be inferred based on second-order cues such as the disparity between the images cast on the two retinae. Past work has revealed that object position in two-dimensional (2D) retinotopic space is robustly represented in visual cortex and can be robustly predicted using a multivariate encoding model, in which an explicit axis is modeled for each spatial dimension. However, no study to date has used an encoding model to estimate a representation of stimulus position in depth. Here, we recorded BOLD fMRI while human subjects viewed a stereoscopic random-dot sphere at various positions along the depth (z) and the horizontal (x) axes, and the stimuli were presented across a wider range of disparities (out to ∼40 arcmin) compared to previous neuroimaging studies. In addition to performing decoding analyses for comparison to previous work, we built encoding models for depth position and for horizontal position, allowing us to directly compare encoding between these dimensions. Our results validate this method of recovering depth representations from retinotopic cortex. Furthermore, we find convergent evidence that depth is encoded most strongly in dorsal area V3A.

Visual stimulus-driven functional organization of macaque prefrontal cortex

The extent to which the major subdivisions of prefrontal cortex (PFC) can be functionally partitioned is unclear. In approaching the question, it is often assumed that the organization is task dependent. Here we use fMRI to show that PFC can respond in a task-independent way, and we leverage these responses to uncover a stimulus-driven functional organization. The results were generated by mapping the relative location of responses to faces, bodies, scenes, disparity, color, and eccentricity in four passively fixating macaques. The results control for individual differences in functional architecture and provide the first account of a systematic visual stimulus-driven functional organization across PFC. Responses were focused in dorsolateral PFC (DLPFC), in the ventral prearcuate region; and in ventrolateral PFC (VLPFC), extending into orbital PFC. Face patches were in the VLPFC focus and were characterized by a striking lack of response to non-face stimuli rather than an especially strong response to faces. Color-biased regions were near but distinct from face patches. One scene-biased region was consistently localized with different contrasts and overlapped the disparity-biased region to define the DLPFC focus. All visually responsive regions showed a peripheral visual-field bias. These results uncover an organizational scheme that presumably constrains the flow of information about different visual modalities into PFC.

The Organization and Operation of Inferior Temporal Cortex

Inferior temporal cortex (IT) is a key part of the ventral visual pathway implicated in object, face, and scene perception. But how does IT work? Here, I describe an organizational scheme that marries form and function and provides a framework for future research. The scheme consists of a series of stages arranged along the posterior-anterior axis of IT, defined by anatomical connections and functional responses. Each stage comprises a complement of subregions that have a systematic spatial relationship. The organization of each stage is governed by an eccentricity template, and corresponding eccentricity representations across stages are interconnected. Foveal representations take on a role in high-acuity object vision (including face recognition); intermediate representations compute other aspects of object vision such as behavioral valence (using color and surface cues); and peripheral representations encode information about scenes. This multistage, parallel-processing model invokes an innately determined organization refined by visual experience that is consistent with principles of cortical development. The model is also consistent with principles of evolution, which suggest that visual cortex expanded through replication of retinotopic areas. Finally, the model predicts that the most extensively studied network within IT-the face patches-is not unique but rather one manifestation of a canonical set of operations that reveal general principles of how IT works.

Retinal-specific category learning

Virtually all cognitive theories of category learning (such as prototype theory^1-5 and exemplar theory^6-8) view this important skill as a high-level process that uses abstract representations of objects in the world. Because these representations are removed from visual characteristics of the display, such theories suggest that category learning occurs in higher-level (such as association) areas and therefore should be immune to the visual field dependencies that characterize processing of objects mediated by representations in low-level visual areas. Here we challenge that view by describing a fully controlled demonstration of visual-field dependence in category learning. Eye-tracking was used to control gaze while participants either learned rule-based categories known to recruit prefrontal-based explicit reasoning, or information-integration categories known to depend on basal-ganglia-mediated procedural learning⁹. Results showed that learning was visual-field dependent with information-integration categories, but we found no evidence of visual-field dependence with rule-based categories. A theoretical interpretation of this difference is offered in terms of the underlying neurobiology. Finally, these results are situated within the broad perceptual-learning literature in an attempt to motivate further research on the similarities and differences between category and perceptual learning.

Differential patterns of 2D location versus depth decoding along the visual hierarchy

Visual information is initially represented as 2D images on the retina, but our brains are able to transform this input to perceive our rich 3D environment. While many studies have explored 2D spatial representations or depth perception in isolation, it remains unknown if or how these processes interact in human visual cortex. Here we used functional MRI and multi-voxel pattern analysis to investigate the relationship between 2D location and position-in-depth information. We stimulated different 3D locations in a blocked design: each location was defined by horizontal, vertical, and depth position. Participants remained fixated at the center of the screen while passively viewing the peripheral stimuli with red/green anaglyph glasses. Our results revealed a widespread, systematic transition throughout visual cortex. As expected, 2D location information (horizontal and vertical) could be strongly decoded in early visual areas, with reduced decoding higher along the visual hierarchy, consistent with known changes in receptive field sizes. Critically, we found that the decoding of position-in-depth information tracked inversely with the 2D location pattern, with the magnitude of depth decoding gradually increasing from intermediate to higher visual and category regions. Representations of 2D location information became increasingly location-tolerant in later areas, where depth information was also tolerant to changes in 2D location. We propose that spatial representations gradually transition from 2D-dominant to balanced 3D (2D and depth) along the visual hierarchy.

Functional architecture for disparity in macaque inferior temporal cortex and its relationship to the architecture for faces, color, scenes, and visual field

Binocular disparity is a powerful depth cue for object perception. The computations for object vision culminate in inferior temporal cortex (IT), but the functional organization for disparity in IT is unknown. Here we addressed this question by measuring fMRI responses in alert monkeys to stimuli that appeared in front of (near), behind (far), or at the fixation plane. We discovered three regions that showed preferential responses for near and far stimuli, relative to zero-disparity stimuli at the fixation plane. These "near/far" disparity-biased regions were located within dorsal IT, as predicted by microelectrode studies, and on the posterior inferotemporal gyrus. In a second analysis, we instead compared responses to near stimuli with responses to far stimuli and discovered a separate network of "near" disparity-biased regions that extended along the crest of the superior temporal sulcus. We also measured in the same animals fMRI responses to faces, scenes, color, and checkerboard annuli at different visual field eccentricities. Disparity-biased regions defined in either analysis did not show a color bias, suggesting that disparity and color contribute to different computations within IT. Scene-biased regions responded preferentially to near and far stimuli (compared with stimuli without disparity) and had a peripheral visual field bias, whereas face patches had a marked near bias and a central visual field bias. These results support the idea that IT is organized by a coarse eccentricity map, and show that disparity likely contributes to computations associated with both central (face processing) and peripheral (scene processing) visual field biases, but likely does not contribute much to computations within IT that are implicated in processing color.

7 tesla FMRI reveals systematic functional organization for binocular disparity in dorsal visual cortex

The binocular disparity between the views of the world registered by the left and right eyes provides a powerful signal about the depth structure of the environment. Despite increasing knowledge of the cortical areas that process disparity from animal models, comparatively little is known about the local architecture of stereoscopic processing in the human brain. Here, we take advantage of the high spatial specificity and image contrast offered by 7 tesla fMRI to test for systematic organization of disparity representations in the human brain. Participants viewed random dot stereogram stimuli depicting different depth positions while we recorded fMRI responses from dorsomedial visual cortex. We repeated measurements across three separate imaging sessions. Using a series of computational modeling approaches, we report three main advances in understanding disparity organization in the human brain. First, we show that disparity preferences are clustered and that this organization persists across imaging sessions, particularly in area V3A. Second, we observe differences between the local distribution of voxel responses in early and dorsomedial visual areas, suggesting different cortical organization. Third, using modeling of voxel responses, we show that higher dorsal areas (V3A, V3B/KO) have properties that are characteristic of human depth judgments: a simple model that uses tuning parameters estimated from fMRI data captures known variations in human psychophysical performance. Together, these findings indicate that human dorsal visual cortex contains selective cortical structures for disparity that may support the neural computations that underlie depth perception.

Cognitive functions and stereopsis in patients with Parkinson's disease and Alzheimer's disease using 3-dimensional television: a case controlled trial

Stereopsis or depth perception is an awareness of the distances of objects from the observer, and binocular disparity is a necessary component of recognizing objects through stereopsis. In the past studies, patients with neurodegenerative disease (Alzheimer dementia, AD; Parkinson’s disease IPD) have problems of stereopsis but they did not have actual stimulation of stereopsis. Therefore in this study, we used a 3-dimensional (3D) movie on 3D television (TV) for actual stereopsis stimulation. We propose research through analyzing differences between the three groups (AD, IPD, and Controls), and identified relations between the results from the Titmus Stereo Fly Test, and the 3D TV test. The study also looked into factors that affect the 3D TV test. Before allowing the patients to watch TV, we examined Titmus stereo Fly Test and cognitive test. We used the 3D version of a movie, of 17 minutes 1 second duration, and carried out a questionnaire about stereopsis. The scores of the stereopsis questionnaire were decreased in AD patients, compared with in IPD and controls, although they did not have any difference of Titmus Stereo Fly Test scores. In IPD patients, cognitive function (Montreal cognitive assessment, MoCA) scores were correlated with the scores of the stereopsis questionnaire. We could conclude that Titmus fly test could not distinguish between the three groups and cognitive dysfunction contributes to actual stereopsis perception in IPD patients. Therefore the 3D TV test of AD and IPD patients was more effective than Titmus fly test.