Human V4 and ventral occipital retinotopic maps

Human V4 size predicts crowding distance

Visual recognition is limited by both object size (acuity) and spacing. The spacing limit, called "crowding", is the failure to recognize an object in the presence of other objects. Here, we take advantage of individual differences in crowding to investigate its biological basis. Crowding distance, the minimum object spacing needed for recognition, varies 2-fold among healthy adults. We test the conjecture that this variation in psychophysical crowding distance is due to variation in cortical map size. To test this, we make paired measurements of brain and behavior in 49 observers. We use psychophysics to measure crowding distance and calculate λ, the number of letters that fit into each observer's visual field without crowding. In the same observers, we use functional magnetic resonance imaging (fMRI) to measure the surface area A of retinotopic maps V1, V2, V3, and V4. Across observers, λ is proportional to the surface area of V4 but is uncorrelated with the surface area of V1 to V3. The proportional relationship of λ to area of V4 indicates conservation of cortical crowding distance across individuals: letters can be recognized if they are spaced by at least 1.4 mm on the V4 map, irrespective of map size and psychophysical crowding distance. We conclude that the size of V4 predicts the spacing limit of visual perception.

Dynamic categorization rules alter representations in human visual cortex

Everyday tasks often require stimuli to be categorized dynamically, such that an identical object can elicit different responses based on the current decision rule. Traditionally, sensory regions have been viewed as separate from such context-dependent processing, functioning primarily to process incoming inputs. However, an alternative view suggests sensory regions also integrate inputs with current task goals, facilitating more efficient information relay to higher-level areas. Here we test this by asking human participants to visually categorize novel shape stimuli based on different decision boundaries. Using fMRI and multivariate analyses of retinotopically-defined visual areas, we show that cortical shape representations become more distinct across relevant decision boundaries in a context-dependent manner, with the largest changes in discriminability observed for stimuli near the decision boundary. Importantly, these modulations are associated with improved task performance. These findings demonstrate that visual cortex representations are adaptively modulated to support dynamic behavior.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.Significance Statement We demonstrate that remembering a visual stimulus evokes responses in visual cortex that differ in spatial extent compared to seeing the same stimulus. Perception evokes tuned responses in early visual areas that increase in size up the visual hierarchy. Prior work showed that feedback inputs associated with long-term memory originate from later visual areas with larger receptive fields resulting in uniformly wide spatial tuning even in primary visual cortex. We replicate these results and show that the same pattern holds when maintaining in working memory a recently viewed stimulus. That trial-to-trial difficulty is reflected in the accuracy and precision of these representations suggests that visual cortex is flexibly used for processing visuospatial information, regardless of where that information originates.

Human V4 size predicts crowding distance

Visual recognition is limited by both object size (acuity) and spacing. The spacing limit, called "crowding", is the failure to recognize an object in the presence of other objects. Here, we take advantage of individual differences in crowding to investigate its biological basis. Crowding distance, the minimum object spacing needed for recognition, varies 2-fold among healthy adults. We test the conjecture that this variation in psychophysical crowding distance is due to variation in cortical map size. To test this, we made paired measurements of brain and behavior in 50 observers. We used psychophysics to measure crowding distance and calculate λ, the number of letters that fit into each observer's visual field without crowding. In the same observers, we used fMRI to measure the surface area A (mm2) of retinotopic maps V1, V2, V3, and V4. Across observers, λ is proportional to the surface area of V4 but is uncorrelated with the surface area of V1 to V3. The proportional relationship of λ to area of V4 indicates conservation of cortical crowding distance across individuals: letters can be recognized if they are spaced by at least 1.4 mm on the V4 map, irrespective of map size and psychophysical crowding distance. We conclude that the size of V4 predicts the spacing limit of visual perception.

Mapping curvature domains in human V4 using CBV-sensitive layer-fMRI at 3T

Introduction

A full understanding of how we see our world remains a fundamental research question in vision neuroscience. While topographic profiling has allowed us to identify different visual areas, the exact functional characteristics and organization of areas up in the visual hierarchy (beyond V1 & V2) is still debated. It is hypothesized that visual area V4 represents a vital intermediate stage of processing spatial and curvature information preceding object recognition. Advancements in magnetic resonance imaging hardware and acquisition techniques (e.g., non-BOLD functional MRI) now permits the capture of cortical layer-specific functional properties and organization of the human brain (including the visual system) at high precision.

Methods

Here, we use functional cerebral blood volume measures to study the modularity in how responses to contours (curvature) are organized within area V4 of the human brain. To achieve this at 3 Tesla (a clinically relevant field strength) we utilize optimized high-resolution 3D-Echo Planar Imaging (EPI) Vascular Space Occupancy (VASO) measurements.

Results

Data here provide the first evidence of curvature domains in human V4 that are consistent with previous findings from non-human primates. We show that VASO and BOLD tSNR maps for functional imaging align with high field equivalents, with robust time series of changes to visual stimuli measured across the visual cortex. V4 curvature preference maps for VASO show strong modular organization compared to BOLD imaging contrast. It is noted that BOLD has a much lower sensitivity (due to known venous vasculature weightings) and specificity to stimulus contrast. We show evidence that curvature domains persist across the cortical depth. The work advances our understanding of the role of mid-level area V4 in human processing of curvature and shape features.

Impact

Knowledge of how the functional architecture and hierarchical integration of local contours (curvature) contribute to formation of shapes can inform computational models of object recognition. Techniques described here allow for quantification of individual differences in functional architecture of mid-level visual areas to help drive a better understanding of how changes in functional brain organization relate to difference in visual perception.

Neuroanatomical Deficits in Visual Cortex Subregions of Individuals with Psychosis Spectrum Disorders linked to Symptoms, Cognition, and Childhood Trauma

Objective

The visual system is a significant site of pathology in psychosis spectrum disorders. However, there is limited research investigating human visual cortex (VC) subregions in this population. Using data from the Bipolar-Schizophrenia Network on Intermediate Phenotypes Consortium (BSNIP-1, BSNIP-2, PARDIP), this study examined structural measures in VC subregions in individuals with psychosis spectrum disorders.

Methods

Cortical surface area and thickness in five VC subregions (hOc1, hOc2, hOc3v, hOc4v, MT) were quantified using FreeSurfer v7.1.0 and compared between individuals with psychosis ( n =1211) and healthy controls ( n =734). Regional specificity was examined by controlling for total surface area or mean cortical thickness. ComBat was used to harmonize scanner effects. Associations between VC measures and symptom severity, cognition, and childhood trauma scores were assessed.

Results

Individuals with psychosis demonstrated smaller surface area in hOc1, hOc2, and hOc3v, and lower cortical thickness in all five VC subregions compared to healthy controls. Thickness reductions in hOc1, hOc4v, and MT were regionally specific. hOc4v and MT were among the top three regions exhibiting the most robust cortical thickness deficits ( d = -0.38 to -0.40) across all VC and Desikan-Killiany brain regions. Lower thickness in mid-level visual subregions were associated with greater positive symptoms, poorer cognition, and higher childhood trauma scores.

Conclusions

This study demonstrates that the visual cortex is among the most profoundly affected brain regions in psychotic disorders. Different patterns of area and thickness changes across early and mid-level visual subregions, along with their varying associations with clinical measures, suggest distinct developmental and disease-related influences.

Opposite asymmetry in visual perception of humans and macaques

In human adults, visual perception varies throughout the visual field. Performance decreases with eccentricity1,2 and varies around polar angle. At isoeccentric locations, performance is typically higher along the horizontal than vertical meridian (horizontal-vertical asymmetry [HVA]) and along the lower than the upper vertical meridian (vertical meridian asymmetry [VMA]).3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20,21,22,23 It is unknown whether the macaque visual system, the leading animal model for understanding human vision,24,25 also exhibits these performance asymmetries. Here, we investigated whether and how visual field asymmetries differ between these two groups. Human adults and adult macaque monkeys (Macaca nemestrina) performed a two-alternative forced choice (2AFC) motion direction discrimination task for a target presented among distractors at isoeccentric locations. Both groups showed heterogeneous visual sensitivity around the visual field, but there were striking differences between them. Human observers showed a large VMA-their sensitivity was poorest at the upper vertical meridian-a weak horizontal-vertical asymmetry, and lower sensitivity at intercardinal locations. Macaque performance revealed an inverted VMA-their sensitivity was poorest in the lower vertical meridian. The opposite pattern of VMA in macaques and humans revealed in this study may reflect adaptive behavior by increasing discriminability at locations with greater relevance for visuomotor integration. This study reveals that performance also varies as a function of polar angle for monkeys, but in a different manner than in humans, and highlights the need to investigate species-specific similarities and differences in brain and behavior to constrain models of vision and brain function.

ATTENTION MODULATES STIMULUS REPRESENTATIONS IN NEURAL FEATURE DIMENSION MAPS

Computational theories posit that attention is guided by a combination of spatial maps for individual features that can be dynamically weighted according to task goals. Consistent with this framework, when a stimulus contains several features, attending to one or another feature results in stronger fMRI responses in regions preferring the attended feature. We hypothesized that multivariate activation patterns across feature-responsive cortical regions form spatial 'feature dimension maps', which combine to guide attentional priority. We tested this prediction by reconstructing neural feature dimension maps from fMRI activation patterns across retinotopic regions of visual cortex using a spatial inverted encoding model. Participants viewed a peripheral visual stimulus at a random location which always contained moving colored dots. On each trial, participants were precued to report the predominant direction of motion or color of the stimulus, or to attend fixation. Stimulus representations in reconstructed priority maps were selectively enhanced in color-selective regions when color was attended, and in motion-selective regions when motion was attended, and this effect was primarily observed at the stimulus location. While enhancement was localized to the stimulus in color-selective regions, motion-selective regions were globally enhanced when motion was task relevant. These results suggest different cortical regions support spatial maps of different visual features, and that each map is uniquely reweighted based on task demands to guide visual behavior towards the most relevant locations based on important features.

Color and Spatial Frequency Provide Functional Signatures of Retinotopic Visual Areas

Primate vision relies on retinotopically organized cortical parcels defined by representations of hemifield (upper vs lower visual field), eccentricity (fovea vs periphery), and area (V1, V2, V3, V4). Here we test for functional signatures of these organizing principles. We used functional magnetic resonance imaging to measure responses to gratings varying in spatial frequency, color, and saturation across retinotopically defined parcels in two macaque monkeys, and we developed a Sparse Supervised Embedding (SSE) analysis to identify stimulus features that best distinguish cortical parcels from each other. Constraining the SSE model to distinguish just eccentricity representations of the voxels revealed the expected variation of spatial frequency and S-cone modulation with eccentricity. Constraining the model according to the dorsal/ventral location and retinotopic area of each voxel provided unexpected functional signatures, which we investigated further with standard univariate analyses. Posterior parcels (V1) were distinguished from anterior parcels (V4) by differential responses to chromatic and luminance contrast, especially of low-spatial-frequency gratings. Meanwhile, ventral parcels were distinguished from dorsal parcels by differential responses to chromatic and luminance contrast, especially of colors that modulate all three cone types. The dorsal/ventral asymmetry not only resembled differences between candidate dorsal and ventral subdivisions of human V4 but also extended to include all retinotopic visual areas, starting in V1 and increasing from V1 to V4. The results provide insight into the functional roles of different retinotopic areas and demonstrate the utility of SSE as a data-driven tool for generating hypotheses about cortical function and behavior.

An Eccentricity Gradient Reversal across High-Level Visual Cortex

Human visual cortex contains regions selectively involved in perceiving and recognizing ecologically important visual stimuli such as people and places. Located in the ventral temporal lobe, these regions are organized consistently relative to cortical folding, a phenomenon thought to be inherited from how centrally or peripherally these stimuli are viewed with the retina. While this eccentricity theory of visual cortex has been one of the best descriptions of its functional organization, whether or not it accurately describes visual processing in all category-selective regions is not yet clear. Through a combination of behavioral and functional MRI measurements in 27 participants (17 females), we demonstrate that a limb-selective region neighboring well-studied face-selective regions shows tuning for the visual periphery in a cortical region originally thought to be centrally biased. We demonstrate that the spatial computations performed by the limb-selective region are consistent with visual experience and in doing so, make the novel observation that there may in fact be two eccentricity gradients, forming an eccentricity reversal across high-level visual cortex. These data expand the current theory of cortical organization to provide a unifying principle that explains the broad functional features of many visual regions, showing that viewing experience interacts with innate wiring principles to drive the location of cortical specialization.

Dynamic categorization rules alter representations in human visual cortex

Everyday perceptual tasks require sensory stimuli to be dynamically encoded and analyzed according to changing behavioral goals. For example, when searching for an apple at the supermarket, one might first find the Granny Smith apples by separating all visible apples into the categories "green" and "non-green". However, suddenly remembering that your family actually likes Fuji apples would necessitate reconfiguring the boundary to separate "red" from "red-yellow" objects. This flexible processing enables identical sensory stimuli to elicit varied behaviors based on the current task context. While this phenomenon is ubiquitous in nature, little is known about the neural mechanisms that underlie such flexible computation. Traditionally, sensory regions have been viewed as mainly devoted to processing inputs, with limited involvement in adapting to varying task contexts. However, from the standpoint of efficient computation, it is plausible that sensory regions integrate inputs with current task goals, facilitating more effective information relay to higher-level cortical areas. Here we test this possibility by asking human participants to visually categorize novel shape stimuli based on different linear and non-linear boundaries. Using fMRI and multivariate analyses of retinotopically-defined visual areas, we found that shape representations in visual cortex became more distinct across relevant decision boundaries in a context-dependent manner, with the largest changes in discriminability observed for stimuli near the decision boundary. Importantly, these context-driven modulations were associated with improved categorization performance. Together, these findings demonstrate that codes in visual cortex are adaptively modulated to optimize object separability based on currently relevant decision boundaries.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.

Functional localization of visual motion area FST in humans

The fundus of the superior temporal sulcus (FST) in macaques is implicated in the processing of complex motion signals, yet a human homolog remains elusive. Here we considered potential localizers and evaluated their effectiveness in delineating putative FST (pFST), from hMT and MST, two nearby motion-sensitive areas in humans. Nine healthy participants underwent scanning sessions with 2D and 3D motion localizers, as well as population receptive field (pRF) mapping. We observed consistent anterior and inferior activation relative to hMT and MST in response to stimuli that contained coherent 3D, but not 2D, motion. Motion opponency and myelination measures further validated the functional and structural distinction between pFST and hMT/MST. At the same time, standard pRF mapping techniques that reveal the visual field organization of hMT/MST proved suboptimal for delineating pFST. Our findings provide a robust framework for localizing pFST in humans, and underscore its distinct functional role in motion processing.

Spatial attention alters visual cortical representation during target anticipation

Attention enables us to efficiently and flexibly interact with the environment by prioritizing some image features in preparation for responding to a stimulus. Using a concurrent psychophysics- fMRI experiment, we investigated how covert spatial attention affects responses in human visual cortex prior to target onset, and how it affects subsequent behavioral performance. Performance improved at cued locations and worsened at uncued locations, relative to distributed attention, demonstrating a selective tradeoff in processing. Pre-target BOLD responses in cortical visual field maps changed in two ways: First, there was a stimulus-independent baseline shift, positive in map locations near the cued location and negative elsewhere, paralleling the behavioral results. Second, population receptive field centers shifted toward the attended location. Both effects increased in higher visual areas. Together, the results show that spatial attention has large effects on visual cortex prior to target appearance, altering neural response properties throughout and across multiple visual field maps.

Feature-Specific Salience Maps in Human Cortex

Priority map theory is a leading framework for understanding how various aspects of stimulus displays and task demands guide visual attention. Per this theory, the visual system computes a priority map, which is a representation of visual space indexing the relative importance, or priority, of locations in the environment. Priority is computed based on both salience, defined based on image-computable properties; and relevance, defined by an individual's current goals, and is used to direct attention to the highest-priority locations for further processing. Computational theories suggest that priority maps identify salient locations based on individual feature dimensions (e.g., color, motion), which are integrated into an aggregate priority map. While widely accepted, a core assumption of this framework, the existence of independent feature dimension maps in visual cortex, remains untested. Here, we tested the hypothesis that retinotopic regions selective for specific feature dimensions (color or motion) in human cortex act as neural feature dimension maps, indexing salient locations based on their preferred feature. We used fMRI activation patterns to reconstruct spatial maps while male and female human participants viewed stimuli with salient regions defined by relative color or motion direction. Activation in reconstructed spatial maps was localized to the salient stimulus position in the display. Moreover, the strength of the stimulus representation was strongest in the ROI selective for the salience-defining feature. Together, these results suggest that feature-selective extrastriate visual regions highlight salient locations based on local feature contrast within their preferred feature dimensions, supporting their role as neural feature dimension maps.SIGNIFICANCE STATEMENT Identifying salient information is important for navigating the world. For example, it is critical to detect a quickly approaching car when crossing the street. Leading models of computer vision and visual search rely on compartmentalized salience computations based on individual features; however, there has been no direct empirical demonstration identifying neural regions as responsible for performing these dissociable operations. Here, we provide evidence of a critical double dissociation that neural activation patterns from color-selective regions prioritize the location of color-defined salience while minimally representing motion-defined salience, whereas motion-selective regions show the complementary result. These findings reveal that specialized cortical regions act as neural "feature dimension maps" that are used to index salient locations based on specific features to guide attention.

The Bouma law accounts for crowding in 50 observers

Crowding is the failure to recognize an object due to surrounding clutter. Our visual crowding survey measured 13 crowding distances (or "critical spacings") twice in each of 50 observers. The survey includes three eccentricities (0, 5, and 10 deg), four cardinal meridians, two orientations (radial and tangential), and two fonts (Sloan and Pelli). The survey also tested foveal acuity, twice. Remarkably, fitting a two-parameter model-the well-known Bouma law, where crowding distance grows linearly with eccentricity-explains 82% of the variance for all 13 × 50 measured log crowding distances, cross-validated. An enhanced Bouma law, with factors for meridian, crowding orientation, target kind, and observer, explains 94% of the variance, again cross-validated. These additional factors reveal several asymmetries, consistent with previous reports, which can be expressed as crowding-distance ratios: 0.62 horizontal:vertical, 0.79 lower:upper, 0.78 right:left, 0.55 tangential:radial, and 0.78 Sloan-font:Pelli-font. Across our observers, peripheral crowding is independent of foveal crowding and acuity. Evaluation of the Bouma factor, b (the slope of the Bouma law), as a biomarker of visual health would be easier if there were a way to compare results across crowding studies that use different methods. We define a standardized Bouma factor b' that corrects for differences from Bouma's 25 choice alternatives, 75% threshold criterion, and linearly symmetric flanker placement. For radial crowding on the right meridian, the standardized Bouma factor b' is 0.24 for this study, 0.35 for Bouma (1970), and 0.30 for the geometric mean across five representative modern studies, including this one, showing good agreement across labs, including Bouma's. Simulations, confirmed by data, show that peeking can skew estimates of crowding (e.g., greatly decreasing the mean or doubling the SD of log b). Using gaze tracking to prevent peeking, individual differences are robust, as evidenced by the much larger 0.08 SD of log b across observers than the mere 0.03 test-retest SD of log b measured in half an hour. The ease of measurement of crowding enhances its promise as a biomarker for dyslexia and visual health.

Connectivity reveals homology between the visual systems of the human and macaque brains

The visual systems of humans and nonhuman primates share many similarities in both anatomical and functional organization. Understanding the homology and differences between the two systems can provide important insights into the neural basis of visual perception and cognition. This research aims to investigate the homology between human and macaque visual systems based on connectivity, using diffusion tensor imaging and resting-state functional magnetic resonance imaging to construct structural and functional connectivity fingerprints of the visual systems in humans and macaques, and quantitatively analyze the connectivity patterns. By integrating multimodal magnetic resonance imaging, this research explored the homology and differences between the two systems. The results showed that 9 brain regions in the macaque visual system formed highly homologous mapping relationships with 11 brain regions in the human visual system, and the related brain regions between the two species showed highly structure homologous, with their functional organization being essentially conserved across species. Finally, this research generated a homology information map of the visual system for humans and macaques, providing a new perspective for subsequent cross-species analysis.

The Paton prize lecture 2021: A colourful experience leading to a reassessment of colour vision and its theories

In this lecture, given in honour of Sir William Paton, a brilliant scientist and one of Britain's great patrons of biology, I give a personal account of the fundamental issues in colour vision that I have tackled since 1973, when I discovered a cortical zone lying outside the primary visual cortex that is rich in cells with chromatic properties. I do not provide an exhaustive review of colour vision but summarise how my views on colour vision and theories surrounding it have changed in light of that discovery.

Flexible utilization of spatial- and motor-based codes for the storage of visuo-spatial information

Working memory provides flexible storage of information in service of upcoming behavioral goals. Some models propose specific fixed loci and mechanisms for the storage of visual information in working memory, such as sustained spiking in parietal and prefrontal cortex during working memory maintenance. An alternative view is that information can be remembered in a flexible format that best suits current behavioral goals. For example, remembered visual information might be stored in sensory areas for easier comparison to future sensory inputs, or might be re-coded into a more abstract action-oriented format and stored in motor areas. Here, we tested this hypothesis using a visuo-spatial working memory task where the required behavioral response was either known or unknown during the memory delay period. Using functional magnetic resonance imaging (fMRI) and multivariate decoding, we found that there was less information about remembered spatial position in early visual and parietal regions when the required response was known versus unknown. Furthermore, a representation of the planned motor action emerged in primary somatosensory, primary motor, and premotor cortex during the same task condition where spatial information was reduced in early visual cortex. These results suggest that the neural networks supporting working memory can be strategically reconfigured depending on specific behavioral requirements during a canonical visual working memory paradigm.

Relative precision of top-down attentional modulations is lower in early visual cortex compared to mid- and high-level visual areas

Top-down spatial attention enhances cortical representations of behaviorally relevant visual information and increases the precision of perceptual reports. However, little is known about the relative precision of top-down attentional modulations in different visual areas, especially compared with the highly precise stimulus-driven responses that are observed in early visual cortex. For example, the precision of attentional modulations in early visual areas may be limited by the relatively coarse spatial selectivity and the anatomical connectivity of the areas in prefrontal cortex that generate and relay the top-down signals. Here, we used functional MRI (fMRI) and human participants to assess the precision of bottom-up spatial representations evoked by high-contrast stimuli across the visual hierarchy. Then, we examined the relative precision of top-down attentional modulations in the absence of spatially specific bottom-up drive. Whereas V1 showed the largest relative difference between the precision of top-down attentional modulations and the precision of bottom-up modulations, midlevel areas such as V4 showed relatively smaller differences between the precision of top-down and bottom-up modulations. Overall, this interaction between visual areas (e.g., V1 vs. V4) and the relative precision of top-down and bottom-up modulations suggests that the precision of top-down attentional modulations is limited by the representational fidelity of areas that generate and relay top-down feedback signals.NEW & NOTEWORTHY When the relative precision of purely top-down and bottom-up signals were compared across visual areas, early visual areas like V1 showed higher bottom-up precision compared with top-down precision. In contrast, midlevel areas showed similar levels of top-down and bottom-up precision. This result suggests that the precision of top-down attentional modulations may be limited by the relatively coarse spatial selectivity and the anatomical connectivity of the areas generating and relaying the signals.

Cross-dataset reproducibility of human retinotopic maps

Population receptive field (pRF) models fit to fMRI data are used to non-invasively measure retinotopic maps in human visual cortex, and these maps are a fundamental component of visual neuroscience experiments. Here, we examined the reproducibility of retinotopic maps across two datasets: a newly acquired retinotopy dataset from New York University (NYU) (n = 44) and a public dataset from the Human Connectome Project (HCP) (n = 181). Our goal was to assess the degree to which pRF properties are similar across datasets, despite substantial differences in their experimental protocols. The two datasets simultaneously differ in their stimulus apertures, participant pool, fMRI protocol, MRI field strength, and preprocessing pipeline. We assessed the cross-dataset reproducibility of the two datasets in terms of the similarity of vertex-wise pRF estimates and in terms of large-scale polar angle asymmetries in cortical magnification. Within V1, V2, V3, and hV4, the group-median NYU and HCP vertex-wise polar angle estimates were nearly identical. Both eccentricity and pRF size estimates were also strongly correlated between the two datasets, but with a slope different from 1; the eccentricity and pRF size estimates were systematically greater in the NYU data. Next, to compare large-scale map properties, we quantified two polar angle asymmetries in V1 cortical magnification previously identified in the HCP data. The NYU dataset confirms earlier reports that more cortical surface area represents horizontal than vertical visual field meridian, and lower than upper vertical visual field meridian. Together, our findings show that the retinotopic properties of V1, V2, V3, and hV4 can be reliably measured across two datasets, despite numerous differences in their experimental design. fMRI-derived retinotopic maps are reproducible because they rely on an explicit computational model of the fMRI response. In the case of pRF mapping, the model is grounded in physiological evidence of how visual receptive fields are organized, allowing one to quantitatively characterize the BOLD signal in terms of stimulus properties (i.e., location and size). The new NYU Retinotopy Dataset will serve as a useful benchmark for testing hypotheses about the organization of visual areas and for comparison to the HCP 7T Retinotopy Dataset.

Structural Differences Across Multiple Visual Cortical Regions in the Absence of Cone Function in Congenital Achromatopsia

Most individuals with congenital achromatopsia (ACHM) carry mutations that affect the retinal phototransduction pathway of cone photoreceptors, fundamental to both high acuity vision and colour perception. As the central fovea is occupied solely by cones, achromats have an absence of retinal input to the visual cortex and a small central area of blindness. Additionally, those with complete ACHM have no colour perception, and colour processing regions of the ventral cortex also lack typical chromatic signals from the cones. This study examined the cortical morphology (grey matter volume, cortical thickness, and cortical surface area) of multiple visual cortical regions in ACHM (n = 15) compared to normally sighted controls (n = 42) to determine the cortical changes that are associated with the retinal characteristics of ACHM. Surface-based morphometry was applied to T1-weighted MRI in atlas-defined early, ventral and dorsal visual regions of interest. Reduced grey matter volume in V1, V2, V3, and V4 was found in ACHM compared to controls, driven by a reduction in cortical surface area as there was no significant reduction in cortical thickness. Cortical surface area (but not thickness) was reduced in a wide range of areas (V1, V2, V3, TO1, V4, and LO1). Reduction in early visual areas with large foveal representations (V1, V2, and V3) suggests that the lack of foveal input to the visual cortex was a major driving factor in morphological changes in ACHM. However, the significant reduction in ventral area V4 coupled with the lack of difference in dorsal areas V3a and V3b suggest that deprivation of chromatic signals to visual cortex in ACHM may also contribute to changes in cortical morphology. This research shows that the congenital lack of cone input to the visual cortex can lead to widespread structural changes across multiple visual areas.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Binocular rivalry reveals an out-of-equilibrium neural dynamics suited for decision-making

In ambiguous or conflicting sensory situations, perception is often 'multistable' in that it perpetually changes at irregular intervals, shifting abruptly between distinct alternatives. The interval statistics of these alternations exhibits quasi-universal characteristics, suggesting a general mechanism. Using binocular rivalry, we show that many aspects of this perceptual dynamics are reproduced by a hierarchical model operating out of equilibrium. The constitutive elements of this model idealize the metastability of cortical networks. Independent elements accumulate visual evidence at one level, while groups of coupled elements compete for dominance at another level. As soon as one group dominates perception, feedback inhibition suppresses supporting evidence. Previously unreported features in the serial dependencies of perceptual alternations compellingly corroborate this mechanism. Moreover, the proposed out-of-equilibrium dynamics satisfies normative constraints of continuous decision-making. Thus, multistable perception may reflect decision-making in a volatile world: integrating evidence over space and time, choosing categorically between hypotheses, while concurrently evaluating alternatives.

Working memory representations in visual cortex mediate distraction effects

Although the contents of working memory can be decoded from visual cortex activity, these representations may play a limited role if they are not robust to distraction. We used model-based fMRI to estimate the impact of distracting visual tasks on working memory representations in several visual field maps in visual and frontoparietal association cortex. Here, we show distraction causes the fidelity of working memory representations to briefly dip when both the memorandum and distractor are jointly encoded by the population activities. Distraction induces small biases in memory errors which can be predicted by biases in neural decoding in early visual cortex, but not other regions. Although distraction briefly disrupts working memory representations, the widespread redundancy with which working memory information is encoded may protect against catastrophic loss. In early visual cortex, the neural representation of information in working memory and behavioral performance are intertwined, solidifying its importance in visual memory.

The relative roles of visual, parietal, and frontal cortex in working memory have been actively debated. Here, the authors show that distraction impacts visual working memory representations in primary visual areas, indicating that these regions play a key role in the maintenance of working memory.

Human primary visual cortex shows larger population receptive fields for binocular disparity-defined stimuli

The visual perception of 3D depth is underpinned by the brain's ability to combine signals from the left and right eyes to produce a neural representation of binocular disparity for perception and behaviour. Electrophysiological studies of binocular disparity over the past 2 decades have investigated the computational role of neurons in area V1 for binocular combination, while more recent neuroimaging investigations have focused on identifying specific roles for different extrastriate visual areas in depth perception. Here we investigate the population receptive field properties of neural responses to binocular information in striate and extrastriate cortical visual areas using ultra-high field fMRI. We measured BOLD fMRI responses while participants viewed retinotopic mapping stimuli defined by different visual properties: contrast, luminance, motion, correlated and anti-correlated stereoscopic disparity. By fitting each condition with a population receptive field model, we compared quantitatively the size of the population receptive field for disparity-specific stimulation. We found larger population receptive fields for disparity compared with contrast and luminance in area V1, the first stage of binocular combination, which likely reflects the binocular integration zone, an interpretation supported by modelling of the binocular energy model. A similar pattern was found in region LOC, where it may reflect the role of disparity as a cue for 3D shape. These findings provide insight into the binocular receptive field properties underlying processing for human stereoscopic vision.

Advances in Neuroscience, Not Devices, Will Determine the Effectiveness of Visual Prostheses

Background: Innovations in engineering and neuroscience have enabled the development of sophisticated visual prosthetic devices. In clinical trials, these devices have provided visual acuities as high as 20/460, enabled coarse navigation, and even allowed for reading of short words. However, long-term commercial viability arguably rests on attaining even better vision and more definitive improvements in tasks of daily living and quality of life. Purpose: Here we review technological and biological obstacles in the implementation of visual prosthetics. Conclusions: Research in the visual prosthetic field has tackled significant technical challenges, including biocompatibility, signal spread through neural tissue, and inadvertent activation of passing axons; however, significant gaps in knowledge remain in the realm of neuroscience, including the neural code of vision and visual plasticity. We assert that further optimization of prosthetic devices alone will not provide markedly improved visual outcomes without significant advances in our understanding of neuroscience.

Midlevel visual deficits after strokes involving area human V4

We present the results of 51 stroke patients with free central visual fields of which about half suffer from clear deficits of midlevel vision undetected by standard clinical tests. These patients yield significantly elevated thresholds for detection and/or discrimination between forms defined by motion, colour, or line orientation ('texture'). As demonstrated by voxel-based lesion-symptom mapping (VLSM) the underlying lesions involve mainly area human V4 (hV4) located in the posterior third of the fusiform gyrus and extending into the lingual gyrus. Patient's detection thresholds correlate only very weakly between the submodalities tested, indicating partly separate neural networks on mid-level vision for colour, motion, and texture detection. Correlations are far stronger for form discrimination tasks, indicating partly shared mechanisms for even simple form discrimination of distinct visual submodalities. We conclude that deficits of visual perception are far more common after strokes in visual brain areas than is apparent in clinical practice. Our results further clarify the functional organization of midlevel visual cortical areas.

A neurodynamic model of the interaction between color perception and color memory

The memory color effect and Spanish castle illusion have been taken as evidence of the cognitive penetrability of vision. In the same manner, the successful decoding of color-related brain signals in functional neuroimaging studies suggests the retrieval of memory colors associated with a perceived gray object. Here, we offer an alternative account of these findings based on the design principles of adaptive resonance theory (ART). In ART, conscious perception is a consequence of a resonant state. Resonance emerges in a recurrent cortical circuit when a bottom-up spatial pattern agrees with the top-down expectation. When they do not agree, a special control mechanism is activated that resets the network and clears off erroneous expectation, thus allowing the bottom-up activity to always dominate in perception. We developed a color ART circuit and evaluated its behavior in computer simulations. The model helps to explain how traces of erroneous expectations about incoming color are eventually removed from the color perception, although their transient effect may be visible in behavioral responses or in brain imaging. Our results suggest that the color ART circuit, as a predictive computational system, is almost never penetrable, because it is equipped with computational mechanisms designed to constrain the impact of the top-down predictions on ongoing perceptual processing.

Topographic signatures of global object perception in human visual cortex

Our visual system readily groups dynamic fragmented input into global objects. How the brain represents global object perception remains however unclear. To address this question, we recorded brain responses using functional magnetic resonance imaging whilst observers viewed a dynamic bistable stimulus that could either be perceived globally (i.e., as a grouped and coherently moving shape) or locally (i.e., as ungrouped and incoherently moving elements). We further estimated population receptive fields and used these to back-project the brain activity measured during stimulus perception into visual space via a searchlight procedure. Global perception resulted in universal suppression of responses in lower visual cortex accompanied by wide-spread enhancement in higher object-sensitive cortex. However, follow-up experiments indicated that higher object-sensitive cortex is suppressed if global perception lacks shape grouping, and that grouping-related suppression can be diffusely confined to stimulated sites and accompanied by background enhancement once stimulus size is reduced. These results speak to a non-generic involvement of higher object-sensitive cortex in perceptual grouping and point to an enhancement-suppression mechanism mediating the perception of figure and ground.

•

Lower visual cortex activity to grouped vs ungrouped dynamic stimuli is suppressed.

•

When grouping a shape, activity in higher object-sensitive cortex is enhanced.

•

Without shape grouping, activity in higher object-sensitive cortex is suppressed.

•

Grouping-related suppression can be diffusely confined to stimulated cortical sites.

Integration of Motion and Form Cues for the Perception of Self-Motion in the Human Brain

When moving around in the world, the human visual system uses both motion and form information to estimate the direction of self-motion (i.e., heading). However, little is known about cortical areas in charge of this task. This brain-imaging study addressed this question by using visual stimuli consisting of randomly distributed dot pairs oriented toward a locus on a screen (the form-defined focus of expansion [FoE]) but moved away from a different locus (the motion-defined FoE) to simulate observer translation. We first fixed the motion-defined FoE location and shifted the form-defined FoE location. We then made the locations of the motion- and the form-defined FoEs either congruent (at the same location in the display) or incongruent (on the opposite sides of the display). The motion- or the form-defined FoE shift was the same in the two types of stimuli, but the perceived heading direction shifted for the congruent, but not for the incongruent stimuli. Participants (both sexes) made a task-irrelevant (contrast discrimination) judgment during scanning. Searchlight and ROI-based multivoxel pattern analysis revealed that early visual areas V1, V2, and V3 responded to either the motion- or the form-defined FoE shift. After V3, only the dorsal areas V3a and V3B/KO responded to such shifts. Furthermore, area V3B/KO shows a significantly higher decoding accuracy for the congruent than the incongruent stimuli. Our results provide direct evidence showing that area V3B/KO does not simply respond to motion and form cues but integrates these two cues for the perception of heading.SIGNIFICANCE STATEMENT Human survival relies on accurate perception of self-motion. The visual system uses both motion (optic flow) and form cues for the perception of the direction of self-motion (heading). Although human brain areas for processing optic flow and form structure are well identified, the areas responsible for integrating these two cues for the perception of self-motion remain unknown. We conducted fMRI experiments and used multivoxel pattern analysis technique to find human brain areas that can decode the shift in heading specified by each cue alone and the two cues combined. We found that motion and form cues are first processed in the early visual areas and then are likely integrated in the higher dorsal area V3B/KO for the final estimation of heading.

White matter dissection and structural connectivity of the human vertical occipital fasciculus to link vision-associated brain cortex

The vertical occipital fasciculus (VOF) is an association fiber tract coursing vertically at the posterolateral corner of the brain. It is re-evaluated as a major fiber tract to link the dorsal and ventral visual stream. Although previous tractography studies showed the VOF’s cortical projections fall in the dorsal and ventral visual areas, the post-mortem dissection study for the validation remains limited. First, to validate the previous tractography data, we here performed the white matter dissection in post-mortem brains and demonstrated the VOF’s fiber bundles coursing between the V3A/B areas and the posterior fusiform gyrus. Secondly, we analyzed the VOF’s structural connectivity with diffusion tractography to link vision-associated cortical areas of the HCP MMP1.0 atlas, an updated map of the human cerebral cortex. Based on the criteria the VOF courses laterally to the inferior longitudinal fasciculus (ILF) and craniocaudally at the posterolateral corner of the brain, we reconstructed the VOF’s fiber tracts and found the widespread projections to the visual cortex. These findings could suggest a crucial role of VOF in integrating visual information to link the broad visual cortex as well as in connecting the dual visual stream.

Stochastic resonance model of synaesthesia

In synaesthesia, stimulation of one sensory modality evokes additional experiences in another modality (e.g. sounds evoking colours). Along with these cross-sensory experiences, there are several cognitive and perceptual differences between synaesthetes and non-synaesthetes. For example, synaesthetes demonstrate enhanced imagery, increased cortical excitability and greater perceptual sensitivity in the concurrent modality. Previous models suggest that synaesthesia results from increased connectivity between corresponding sensory regions or disinhibited feedback from higher cortical areas. While these models explain how one sense can evoke qualitative experiences in another, they fail to predict the broader phenotype of differences observed in synaesthetes. Here, we propose a novel model of synaesthesia based on the principles of stochastic resonance. Specifically, we hypothesize that synaesthetes have greater neural noise in sensory regions, which allows pre-existing multisensory pathways to elicit supra-threshold activation (i.e. synaesthetic experiences). The strengths of this model are (a) it predicts the broader cognitive and perceptual differences in synaesthetes, (b) it provides a unified framework linking developmental and induced synaesthesias, and (c) it explains why synaesthetic associations are inconsistent at onset but stabilize over time. We review research consistent with this model and propose future studies to test its limits. This article is part of a discussion meeting issue 'Bridging senses: novel insights from synaesthesia'.

Multivariate Analysis of BOLD Activation Patterns Recovers Graded Depth Representations in Human Visual and Parietal Cortex

Navigating through natural environments requires localizing objects along three distinct spatial axes. Information about position along the horizontal and vertical axes is available from an object’s position on the retina, while position along the depth axis must be inferred based on second-order cues such as the disparity between the images cast on the two retinae. Past work has revealed that object position in two-dimensional (2D) retinotopic space is robustly represented in visual cortex and can be robustly predicted using a multivariate encoding model, in which an explicit axis is modeled for each spatial dimension. However, no study to date has used an encoding model to estimate a representation of stimulus position in depth. Here, we recorded BOLD fMRI while human subjects viewed a stereoscopic random-dot sphere at various positions along the depth (z) and the horizontal (x) axes, and the stimuli were presented across a wider range of disparities (out to ∼40 arcmin) compared to previous neuroimaging studies. In addition to performing decoding analyses for comparison to previous work, we built encoding models for depth position and for horizontal position, allowing us to directly compare encoding between these dimensions. Our results validate this method of recovering depth representations from retinotopic cortex. Furthermore, we find convergent evidence that depth is encoded most strongly in dorsal area V3A.

The function of "looking-at-nothing" for sequential sensorimotor tasks: Eye movements to remembered action-target locations

When performing manual actions, eye movements precede hand movements to target locations: Before we grasp an object, we look at it. Eye-hand guidance is even preserved when visual targets are unavailable, e.g., grasping behind an occlusion. This "looking-atnothing" behavior might be functional, e.g., as "deictic pointer" for manual control or as memory-retrieval cue, or a by-product of automatization. Here, it is studied if looking at empty locations before acting on them is beneficial for sensorimotor performance. In five experiments, participants completed a click sequence on eight visual targets for 0-100 trials while they had either to fixate on the screen center or could move their eyes freely. During 50-100 consecutive trials, participants clicked the same sequence on a blank screen with free or fixed gaze. During both phases, participants looked at target locations when gaze shifts were allowed. With visual targets, target fixations led to faster, more precise clicking, fewer errors, and sparser cursor-paths than central fixation. Without visual information, a tiny free-gaze benefit could sometimes be observed and was rather a memory than a motor-calculation benefit. Interestingly, central fixation during learning forced early explicit encoding causing a strong benefit for acting on remembered targets later, independent of whether eyes moved then.

Vascular effects on the BOLD response and the retinotopic mapping of hV4

Despite general acceptance that the retinotopic organisation of human V4 (hV4) takes the form of a single, uninterrupted ventral hemifield, measured retinotopic maps of this visual area are often incomplete. Here, we test hypotheses that artefact from draining veins close to hV4 cause inverted BOLD responses that may serve to obscure a portion of the lower visual quarterfield—including the lower vertical meridian—in some hemispheres. We further test whether correcting such responses can restore the ‘missing’ retinotopic coverage in hV4. Subjects (N = 10) viewed bowtie, ring, drifting bar and full field flash stimuli. Functional EPIs were acquired over approximately 1.5h and analysed to reveal retinotopic maps of early visual cortex, including hV4. Normalised mean maps (which show the average EPI signal amplitude) were constructed by voxel-wise averaging of the EPI time course and used to locate venous eclipses, which can be identified by a decrease in the EPI signal caused by deoxygenated blood. Inverted responses are shown to cluster in these regions and correcting these responses improves maps of hV4 in some hemispheres, including restoring a complete hemifield map in one. A leftwards bias was found whereby 6/10 left hemisphere hV4 maps were incomplete, while this was the case in only 1/10 right hemisphere maps. Incomplete hV4 maps did not correspond with venous artefact in every instance, with incomplete maps being present in the absence of a venous eclipse and complete maps coexisting with a proximate venous eclipse. We also show that mean maps of upper surfaces (near the boundary between cortical grey matter and CSF) provide highly detailed maps of veins on the cortical surface. Results suggest that venous eclipses and inverted voxels can explain some incomplete hV4 maps, but cannot explain the remainder nor the leftwards bias in hV4 coverage reported here.

The Human Connectome Project 7 Tesla retinotopy dataset: Description and population receptive field analysis

About a quarter of human cerebral cortex is dedicated mainly to visual processing. The large-scale spatial organization of visual cortex can be measured with functional magnetic resonance imaging (fMRI) while subjects view spatially modulated visual stimuli, also known as "retinotopic mapping." One of the datasets collected by the Human Connectome Project involved ultrahigh-field (7 Tesla) fMRI retinotopic mapping in 181 healthy young adults (1.6-mm resolution), yielding the largest freely available collection of retinotopy data. Here, we describe the experimental paradigm and the results of model-based analysis of the fMRI data. These results provide estimates of population receptive field position and size. Our analyses include both results from individual subjects as well as results obtained by averaging fMRI time series across subjects at each cortical and subcortical location and then fitting models. Both the group-average and individual-subject results reveal robust signals across much of the brain, including occipital, temporal, parietal, and frontal cortex as well as subcortical areas. The group-average results agree well with previously published parcellations of visual areas. In addition, split-half analyses show strong within-subject reliability, further demonstrating the high quality of the data. We make publicly available the analysis results for individual subjects and the group average, as well as associated stimuli and analysis code. These resources provide an opportunity for studying fine-scale individual variability in cortical and subcortical organization and the properties of high-resolution fMRI. In addition, they provide a set of observations that can be compared with other Human Connectome Project measures acquired in these same participants.

Human frontoparietal cortex represents behaviorally relevant target status based on abstract object features

Searching for items that are useful given current goals, or "target" recognition, requires observers to flexibly attend to certain object properties at the expense of others. This could involve focusing on the identity of an object while ignoring identity-preserving transformations such as changes in viewpoint or focusing on its current viewpoint while ignoring its identity. To effectively filter out variation due to the irrelevant dimension, performing either type of task is likely to require high-level, abstract search templates. Past work has found target recognition signals in areas of ventral visual cortex and in subregions of parietal and frontal cortex. However, target status in these tasks is typically associated with the identity of an object, rather than identity-orthogonal properties such as object viewpoint. In this study, we used a task that required subjects to identify novel object stimuli as targets according to either identity or viewpoint, each of which was not predictable from low-level properties such as shape. We performed functional MRI in human subjects of both sexes and measured the strength of target-match signals in areas of visual, parietal, and frontal cortex. Our multivariate analyses suggest that the multiple-demand (MD) network, including subregions of parietal and frontal cortex, encodes information about an object's status as a target in the relevant dimension only, across changes in the irrelevant dimension. Furthermore, there was more target-related information in MD regions on correct compared with incorrect trials, suggesting a strong link between MD target signals and behavior. NEW & NOTEWORTHY Real-world target detection tasks, such as searching for a car in a crowded parking lot, require both flexibility and abstraction. We investigated the neural basis of these abilities using a task that required invariant representations of either object identity or viewpoint. Multivariate decoding analyses of our whole brain functional MRI data reveal that invariant target representations are most pronounced in frontal and parietal regions, and the strength of these representations is associated with behavioral performance.

Development of population receptive fields in the lateral visual stream improves spatial coding amid stable structural-functional coupling

Human visual cortex encompasses more than a dozen visual field maps across three major processing streams. One of these streams is the lateral visual stream, which extends from V1 to lateral-occipital (LO) and temporal-occipital (TO) visual field maps and plays a prominent role in shape as well as motion perception. However, it is unknown if and how population receptive fields (pRFs) in the lateral visual stream develop from childhood to adulthood, and what impact this development may have on spatial coding. Here, we used functional magnetic resonance imaging and pRF modeling in school-age children and adults to investigate the development of the lateral visual stream. Our data reveal four main findings: 1) The topographic organization of eccentricity and polar angle maps of the lateral stream is stable after age five. 2) In both age groups there is a reliable relationship between eccentricity map transitions and cortical folding: the middle occipital gyrus predicts the transition between the peripheral representation of LO and TO maps. 3) pRFs in LO and TO maps undergo differential development from childhood to adulthood, resulting in increasing coverage of the central visual field in LO and of the peripheral visual field in TO. 4) Model-based decoding shows that the consequence of pRF and visual field coverage development is improved spatial decoding from LO and TO distributed responses in adults vs. children. Together, these results explicate both the development and topography of the lateral visual stream. Our data show that the general structural-functional organization is laid out early in development, but fine-scale properties, such as pRF distribution across the visual field and consequently, spatial precision, become fine-tuned across childhood development. These findings advance understanding of the development of the human visual system from childhood to adulthood and provide an essential foundation for understanding developmental deficits.

A Connectomic Atlas of the Human Cerebrum-Chapter 9: The Occipital Lobe

In this supplement, we build on work previously published under the Human Connectome Project. Specifically, we seek to show a comprehensive anatomic atlas of the human cerebrum demonstrating all 180 distinct regions comprising the cerebral cortex. The location, functional connectivity, and structural connectivity of these regions are outlined, and where possible a discussion is included of the functional significance of these areas. In part 9, we specifically address regions relevant to the occipital lobe and the visual system.

Parcellating Cerebral Cortex: How Invasive Animal Studies Inform Noninvasive Mapmaking in Humans

The cerebral cortex in mammals contains a mosaic of cortical areas that differ in function, architecture, connectivity, and/or topographic organization. A combination of local connectivity (within-area microcircuitry) and long-distance (between-area) connectivity enables each area to perform a unique set of computations. Some areas also have characteristic within-area mesoscale organization, reflecting specialized representations of distinct types of information. Cortical areas interact with one another to form functional networks that mediate behavior, and each area may be a part of multiple, partially overlapping networks. Given their importance to the understanding of brain organization, mapping cortical areas across species is a major objective of systems neuroscience and has been a century-long challenge. Here, we review recent progress in multi-modal mapping of mouse and nonhuman primate cortex, mainly using invasive experimental methods. These studies also provide a neuroanatomical foundation for mapping human cerebral cortex using noninvasive neuroimaging, including a new map of human cortical areas that we generated using a semiautomated analysis of high-quality, multimodal neuroimaging data. We contrast our semiautomated approach to human multimodal cortical mapping with various extant fully automated human brain parcellations that are based on only a single imaging modality and offer suggestions on how to best advance the noninvasive brain parcellation field. We discuss the limitations as well as the strengths of current noninvasive methods of mapping brain function, architecture, connectivity, and topography and of current approaches to mapping the brain's functional networks.

Meridian interference reveals neural locus of motion-induced position shifts

When a Gabor patch moves along a path in one direction while its internal texture drifts orthogonally to this path, it can appear to deviate from its physical path by 45° or more. This double-drift illusion is different from other motion-induced position shift effects in several ways: it has an integration period of over a second; the illusory displacement that accumulates over a second or more is orthogonal to rather than along the motion path; the perceptual deviations are much larger; and they have little or no effect on eye movements to the target. In this study we investigated the underlying neural mechanisms of the motion integration and position processing for this double-drift stimulus by testing possible anatomical constraints on its magnitude. We found that the illusion was reduced at the vertical and horizontal meridians when the perceptual path would cross or be driven toward the meridian, but not at other locations or other motion directions. The disruption of the accumulation of the position error at both the horizontal and vertical meridians suggests a central role of quadrantic areas in the generation of this type of motion-induced position shift. NEW & NOTEWORTHY The remarkably strong double-drift illusion is disrupted at both the vertical and horizontal meridians. We propose that this finding is the behavioral consequence of the anatomical gaps at both meridians, suggesting that neural areas with quadrantic representations (e.g., V2, V3) are the initial locus of this motion-induced position shift. This result rules out V1 as the source of the illusion because it has an anatomical break only at the vertical meridian.

Identification of the ventral occipital visual field maps in the human brain

The location and topography of the first three visual field maps in the human brain, V1-V3, are well agreed upon and routinely measured across most laboratories. The position of 4 ^th visual field map, ‘hV4’, is identified with less consistency in the neuroimaging literature.  Using magnetic resonance imaging data, we describe landmarks to help identify the position and borders of ‘hV4’. The data consist of anatomical images, visualized as cortical meshes to highlight the sulcal and gyral patterns, and functional data obtained from retinotopic mapping experiments, visualized as eccentricity and angle maps on the cortical surface.

Several features of the functional and anatomical data can be found across nearly all subjects and are helpful for identifying the location and extent of the hV4 map. The medial border of hV4 is shared with the posterior, ventral portion of V3, and is marked by a retinotopic representation of the upper vertical meridian. The anterior border of hV4 is shared with the VO-1 map, and falls on a retinotopic representation of the peripheral visual field, usually coincident with the posterior transverse collateral sulcus. The ventro-lateral edge of the map typically falls on the inferior occipital gyrus, where functional MRI artifacts often obscure the retinotopic data. Finally, we demonstrate the continuity of retinotopic parameters between hV4 and its neighbors; hV4 and V3v contain iso-eccentricity lines in register, whereas hV4 and VO-1 contain iso-polar angle lines in register.

Together, the multiple constraints allow for a consistent identification of the hV4 map across most human subjects.

The human visual cortex response to melanopsin-directed stimulation is accompanied by a distinct perceptual experience

The photopigment melanopsin supports reflexive visual functions in people, such as pupil constriction and circadian photoentrainment. What contribution melanopsin makes to conscious visual perception is less studied. We devised a stimulus that targeted melanopsin separately from the cones using pulsed (3-s) spectral modulations around a photopic background. Pupillometry confirmed that the melanopsin stimulus evokes a response different from that produced by cone stimulation. In each of four subjects, a functional MRI response in area V1 was found. This response scaled with melanopic contrast and was not easily explained by imprecision in the silencing of the cones. Twenty additional subjects then observed melanopsin pulses and provided a structured rating of the perceptual experience. Melanopsin stimulation was described as an unpleasant, blurry, minimal brightening that quickly faded. We conclude that isolated stimulation of melanopsin is likely associated with a response within the cortical visual pathway and with an evoked conscious percept.