The Human Connectome Project 7 Tesla retinotopy dataset: Description and population receptive field analysis

Impact of Rod-Dominant Mesopic Conditions on Spatial Summation and Surround Suppression in Early Visual Cortex

Mesopic (dim light) conditions are prevalent in everyday environments, yet most human vision research is conducted under idealized, photopic (bright) conditions. Electrophysiological studies suggest that under mesopic conditions, contrast-encoding retinal ganglion cell receptive fields expand their center width while diminishing surround inhibition. These retinal modifications enhance light capture by increasing the summation area but they limit spatial resolution. However, the impact of mesopic conditions on human cortical spatial integration mechanisms remains unclear. To address this, we investigate how mesopic conditions affect early visuocortical processing, specifically spatial summation and surround suppression. Across two experiments, we acquired fMRI BOLD responses from 11 normally sighted participants of both sexes under photopic and mesopic conditions in visual areas V1-V3. The first experiment estimated population receptive field (pRF) properties while the second experiment assessed cortical surround suppression. Photopic and mesopic psychophysical surround suppression, contrast sensitivity function (CSF), and visual acuity were also measured. At the cortical level, mesopic conditions were associated with smaller pRF sizes, while surround suppression remained robust. At the perceptual level, mesopic conditions led to reduced acuity, lower CSF, and weaker suppression, diverging from the observed cortical effects. Importantly, individual differences linked these findings: participants who exhibited greater mesopic reductions in visual acuity also showed larger decreases in early visuocortical surround suppression, underscoring its role in contrast coding and spatial resolution. Altogether, our fMRI findings contrast with retinal electrophysiology and suggest that early visual cortex may employ distinct, perhaps compensatory, mechanisms in response to reduced retinal input under mesopic conditions.

Myelination selectively modulates BOLD signal in white matter

There is increasing recognition that blood oxygenation level dependent (BOLD) signals are detectable in white matter (WM) and reflect an important, heretofore overlooked functional activity in the brain, but their biophysical origins remain understudied and poorly understood. By integrating several disparate, multimodal data sets, we established the associations of resting state BOLD signals with key microstructural, hemodynamic and metabolic features in WM. In particular, we identified the roles of myelination and fiber type in modulating BOLD effects, and derived relationships between measurements of BOLD signal power and cerebral blood volume, flow, oxygen extraction and metabolic rate of oxygen consumption, which are predicted using a simple theory and then verified empirically. Our findings demonstrate that myelin selectively influences the fractional amplitude of low-frequency fluctuations (fALFF) in BOLD signals, and that differences in myelin content account for variations in their temporal spectra and hemodynamic response functions, but these in turn are qualitatively different in association versus projection fibers. Other determinants of BOLD in WM are further revealed by converging biological, genomic and neurochemical evidence, including measurements of neurite and mitochondrial densities. Moreover, analyses of images of the optic nerve from human subjects confirm that BOLD activations evoked by visual stimuli are preferentially localized to unmyelinated portions, with minimal responses in fully myelinated regions of the same nerve, suggesting a myelin-dependent requirement for BOLD effects in WM.

Towards Large Diameter Transmit Coils for 7-T Head Imaging: A Detailed Comparison of a Set of Transmit Element Design Concepts

Many different transmit (Tx) coil concepts and designs for 7-T magnetic resonance imaging of the head have been proposed. Most of them are placed close to the head and in combination with the receive coils creating a helmet-like structure. This limits the space for additional equipment for external stimuli. A large diameter transmit coil can increase the ease using supplementary measurement devices. Therefore, this study systematically evaluated nine different Tx elements regarding their performance within a large diameter transmit coil with a diameter> $$ > $$  350 mm. Each Tx element was examined regarding its power and specific absorption rate (SAR) efficiencies, its loading dependence, intrinsic decoupling, and its radio frequency (RF) shimming capability. Additionally, an experimental validation of| B 1 + | $$ \mid {B}_1^{+}\mid $$ -maps was performed. The loop-based Tx elements (circular and rectangular loop) provided the highest power and SAR efficiency with at least 15.5% and 21.2% higher efficiencies for a single channel and 22.1% and 18.0% for the eight-channel array, respectively. In terms of voxel-wise power efficiency, the circular loop was the superior Tx element type within most of the head. Looking at the voxel-wise SAR efficiency, the loop-based elements manifest themselves as the most efficient type within most of the central brain. The mutual coupling was lowest for the passively fed dipole (- $$ - $$ 31.23 dB). The highest RF shimming capability in terms of sum of normalized singular values was calculated for the rectangular (4.21) and the circular loop (4.36), whereby the L-curve results showed that the arrays have only minor| B 1 + | $$ \mid {B}_1^{+}\mid $$ shimming performance differences for the transversal slice. For the hippocampus, the meander element provided the highest overall homogeneity with a minimal coefficient of variation (CoV) of 5.1%. This work provides extensive and unique data for single and eight-channel Tx elements applying common performance benchmarks and enables further discourse on multi-channel evaluations towards large diameter Tx coils at 7-T head imaging. On the bases of the provided results, the preferable Tx element type for this specific application is loop-based.

Human V4 size predicts crowding distance

Visual recognition is limited by both object size (acuity) and spacing. The spacing limit, called "crowding", is the failure to recognize an object in the presence of other objects. Here, we take advantage of individual differences in crowding to investigate its biological basis. Crowding distance, the minimum object spacing needed for recognition, varies 2-fold among healthy adults. We test the conjecture that this variation in psychophysical crowding distance is due to variation in cortical map size. To test this, we make paired measurements of brain and behavior in 49 observers. We use psychophysics to measure crowding distance and calculate λ, the number of letters that fit into each observer's visual field without crowding. In the same observers, we use functional magnetic resonance imaging (fMRI) to measure the surface area A of retinotopic maps V1, V2, V3, and V4. Across observers, λ is proportional to the surface area of V4 but is uncorrelated with the surface area of V1 to V3. The proportional relationship of λ to area of V4 indicates conservation of cortical crowding distance across individuals: letters can be recognized if they are spaced by at least 1.4 mm on the V4 map, irrespective of map size and psychophysical crowding distance. We conclude that the size of V4 predicts the spacing limit of visual perception.

When periphery rules: Enhanced sampling weights of the visual periphery in crowding across dimensions

Crowding, our inability to identify a feature or object - the target - due to its proximity to adjacent features or objects - flankers - exhibits a notable inner-outer asymmetry. This asymmetry is characterized by the outer flanker - more peripheral - creating stronger interference than the inner one - closer to the fovea. But crowding is not uniform across different feature dimensions. For example, in the case of orientation, this asymmetry reflects misreport errors: observers are more likely to misidentify the outer flanker as the target than the inner one. However, for spatial frequency (SF), observers tend to average the features of the target and flankers (Yashar et al., 2019). Here, we investigated whether and how the inner-outer asymmetry manifests across various feature dimensions: Gabor orientation and SF, as well as T-shape tilt and color. We reanalyzed continuous estimation reports data published by Yashar et al. (2019), focusing on a previously unanalyzed factor: the relative position of each flanker (inner vs. outer). We fit probabilistic models that assign variable weights to each flanker. Our analysis revealed that observers predominantly misreport the outer flanker as the target with Gabor orientation and T-shape tilt stimuli, and slightly so with color stimuli, whereas with Gabor SF, observers perform a weighted average of all features but also with a bias towards the outer flanker over the inner one. These findings suggest that an increased weighting on the more peripheral items is a general characteristic of crowding in peripheral vision.

Motion-corrected eye tracking (MoCET) improves gaze accuracy during visual fMRI experiments

Human eye movements are essential for understanding cognition, yet achieving high-precision eye tracking in fMRI remains challenging. Even slight head shifts from the initial calibration position can introduce drift in eye tracking data, leading to substantial gaze inaccuracies. To address this, we introduce Motion-Corrected Eye Tracking (MoCET), a novel approach that corrects drift using head motion parameters derived from the preprocessing of fMRI data. MoCET requires no additional hardware and can be applied retrospectively to existing datasets. We show that it outperforms traditional detrending methods with respect to accuracy of gaze estimation and offers higher spatial and temporal precision compared to MR-based eye tracking approaches. By overcoming a key limitation in integrating eye tracking with fMRI, MoCET facilitates investigations of naturalistic vision and cognition in fMRI research.

Mesoscale functional organization and connectivity of color, disparity, and naturalistic texture in human second visual area

Although parallel processing has been extensively studied in the low-level geniculostriate pathway and the high-level dorsal and ventral visual streams, less is known at the intermediate-level visual areas. In this study, we employed high-resolution fMRI at 7T to investigate the columnar and laminar organizations for color, disparity, and naturalistic texture in the human secondary visual cortex (V2), and their informational connectivity with lower- and higher-order visual areas. Although fMRI activations in V2 showed reproducible interdigitated color-selective thin and disparity-selective thick 'stripe' columns, we found no clear evidence of columnar organization for naturalistic textures. Cortical depth-dependent analyses revealed the strongest color-selectivity in the superficial layers of V2, along with both feedforward and feedback informational connectivity with V1 and V4. Disparity selectivity was similar across different cortical depths of V2, which showed significant feedforward and feedback connectivity with V1 and V3ab. Interestingly, the selectivity for naturalistic texture was strongest in the deep layers of V2, with significant feedback connectivity from V4. Thus, while local circuitry within cortical columns is crucial for processing color and disparity information, feedback signals from V4 are involved in generating the selectivity for naturalistic textures in area V2.

Characterizing Human Disparity Tuning Properties Using Population Receptive Field Mapping

Our visual percept of small differences in depth is largely informed by binocular stereopsis, the ability to decode depth from the horizontal offset between the retinal images in each eye. While multiple cortical areas are associated with stereoscopic processing, it is unclear how tuning to specific binocular disparities is organized across the human visual cortex. We used 3 T functional magnetic resonance imaging to generate population receptive fields (pRFs) in response to modulation of binocular disparity to characterize the neural tuning to disparity. We also used psychophysics to measure stereoacuity thresholds compared with backgrounds at different depths (pedestal disparity). Ten human participants (seven females) observed correlated or anticorrelated random-dot stereograms with disparity ranging from -0.3 to 0.3°, and responses were modeled as one-dimensional tuning curves along the depth dimension. First, we demonstrate that lateral and dorsal visual areas show the greatest proportion of vertices selective for binocular disparity. Second, with binocularly correlated stimuli, we show a polynomial relationship between preferred disparity and tuning curve width, with sharply tuned disparity responses at near-zero disparities, and broader disparity tuning profiles at near or far disparities. This relationship held across visual areas and was not present for anticorrelated stimuli. Finally, the individual thresholds for psychophysical stereoacuity at the three different pedestal disparities were broadly related to pRF tuning width in area V1, suggesting a possible limit for fine stereopsis at the earliest level of cortical processing. Together, these findings point to heterogeneity of disparity processing across human visual areas, comparable with nonhuman primates.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.Significance Statement We demonstrate that remembering a visual stimulus evokes responses in visual cortex that differ in spatial extent compared to seeing the same stimulus. Perception evokes tuned responses in early visual areas that increase in size up the visual hierarchy. Prior work showed that feedback inputs associated with long-term memory originate from later visual areas with larger receptive fields resulting in uniformly wide spatial tuning even in primary visual cortex. We replicate these results and show that the same pattern holds when maintaining in working memory a recently viewed stimulus. That trial-to-trial difficulty is reflected in the accuracy and precision of these representations suggests that visual cortex is flexibly used for processing visuospatial information, regardless of where that information originates.

Optimal placement of high-channel visual prostheses in human retinotopic visual cortex

Objective.Recent strides in neurotechnology show potential to restore vision in individuals with visual impairments due to early visual pathway damage. As neuroprostheses mature and become available to a larger population, manual placement and evaluation of electrode designs become costly and impractical. An automatic method to simulate and optimize the implantation process of electrode arrays at large-scale is currently lacking.Approach.Here, we present a comprehensive method to automatically optimize electrode placement for visual prostheses, with the objective of matching predefined phosphene distributions. Our approach makes use of retinotopic predictions combined with individual anatomy data to minimize discrepancies between simulated and target phosphene patterns. While demonstrated with a 1000-channel 3D electrode array in V1, our simulation pipeline is versatile, potentially accommodating any electrode design and allowing for design evaluation.Main results.Notably, our results show that individually optimized placements in 362 brain hemispheres outperform average brain solutions, underscoring the significance of anatomical specificity. We further show how virtual implantation of multiple individual brains highlights the challenges of achieving full visual field coverage owing to single electrode constraints, which may be overcome by introducing multiple arrays of electrodes. Including additional surgical considerations, such as intracranial vasculature, in future iterations could refine the optimization process.Significance.Our open-source software streamlines the refinement of surgical procedures and facilitates simulation studies, offering a realistic exploration of electrode configuration possibilities.

Does the Cortical-Depth Dependence of the Hemodynamic Response Function Differ Between Age Groups?

Functional magnetic resonance imaging (fMRI) is a widely used tool to investigate the functional brain responses in living humans. Valid comparisons of fMRI results depend on consistency of the blood-oxygen-level-dependent (BOLD) hemodynamic response function (HRF). Although common statistical approaches assume a single HRF across the entire brain, the HRF differs across individuals, regions of the brain, and cortical depth. Here, we measure HRF properties in primary visual cortex (V1) using 7 T fMRI with ultra-high spatiotemporal resolution line-scanning (250 μm in laminar direction, sampled every 105 ms). Line-scanning allowed us to investigate age-related HRF changes as a function of cortical depth. Eleven young and eleven middle-aged healthy participants participated in the experiments. We estimated the HRFs using a smooth basis function deconvolution approach. We also compared the results with conventional resolutions. From these HRFs, we extracted properties related to response magnitude and temporal dynamics. The cortical depth dependent HRFs were similar to the HRFs extracted using conventional resolutions validating the cortical depth dependent approach. We found that the properties of the HRF in the two age groups are similar across cortical depth. In other words, the variance between participants is larger than the variance between age groups. This suggests that middle-aged individuals can participate in cortical depth dependent studies free of bias in HRF properties.

Optimal Estimation of Local Motion-in-Depth with Naturalistic Stimuli

Estimating the motion of objects in depth is important for behavior and is strongly supported by binocular visual cues. To understand both how the brain should estimate motion in depth and how natural constraints shape and limit performance in two local 3D motion tasks, we develop image-computable ideal observers from a large number of binocular video clips created from a dataset of natural images. The observers spatiotemporally filter the videos and nonlinearly decode 3D motion from the filter responses. The optimal filters and decoder are dictated by the task-relevant image statistics and are specific to each task. Multiple findings emerge. First, two distinct filter subpopulations are spontaneously learned for each task. For 3D speed estimation, filters emerge for processing either changing disparities over time or interocular velocity differences, cues that are used by humans. For 3D direction estimation, filters emerge for discriminating either left-right or toward-away motion. Second, the filter responses, conditioned on the latent variable, are well-described as jointly Gaussian, and the covariance of the filter responses carries the information about the task-relevant latent variable. Quadratic combination is thus necessary for optimal decoding, which can be implemented by biologically plausible neural computations. Finally, the ideal observer yields nonobvious-and in some cases counterintuitive-patterns of performance like those exhibited by humans. Important characteristics of human 3D motion processing and estimation may therefore result from optimal information processing in the early visual system.

Biases in Volumetric Versus Surface Analyses in Population Receptive Field Mapping

Population receptive field (pRF) mapping is a quantitative functional MRI (fMRI) analysis method that links visual field positions with specific locations in the visual cortex. A common preprocessing step in pRF analyses involves projecting volumetric fMRI data onto the cortical surface, typically leading to upsampling of the data. This process may introduce biases in the resulting pRF parameters. Using publicly available analysis containers, we compared pRF maps generated from the original volumetric with those from upsampled surface data. Our results show substantial increases in pRF coverage in the central visual field of upsampled datasets. These effects were consistent across early visual cortex areas V1-3. Further analysis indicates that this bias is primarily driven by the nonlinear relationship between cortical distance and visual field eccentricity, known as cortical magnification. Our results underscore the importance of understanding and addressing biases introduced by processing steps to ensure accurate interpretation of pRF mapping data, particularly in cross-study comparisons.

qPRF: A system to accelerate population receptive field modeling

BOLD response can be fitted using the population receptive field (PRF) model to reveal how visual input is represented on the cortex (Dumoulin and Wandell, 2008). Fitting the PRF model costs considerable time, often requiring days to analyze BOLD signals for a small cohort of subjects. We introduce the qPRF ("quick PRF"), a system for accelerated PRF modeling that reduced the computation time by a factor >1,000 without losing goodness-of-fit when compared to another widely available PRF modeling package (Kay et al., 2013) on a benchmark of data from the Human Connectome Project (HCP; Van Essen et al. (2013). The system achieves this level of acceleration by pre-computing a tree-like data structure, which it rapidly searches during the fitting step for an optimal parameter combination. We tested the method on a constrained four-parameter version of the PRF model (Strategy 1 herein) and an unconstrained five-parameter PRF model, which the qPRF fitted at comparable speed (Strategy 2). We show how an additional search step can guarantee optimality of qPRF solutions with little additional time cost (Strategy 3). To assess the quality of qPRF solutions, we compared our Strategy 1 solutions to those provided by Benson et al. (2018) who performed a similar four-parameter fit. Both hemispheres of the 181 subjects in the HCP dataset (a total of 10,753,572 vertices, each with a unique BOLD time series of 1800 frames) were analyzed by qPRF in 12.82 h on an ordinary CPU. The absolute difference in R2 achieved by the qPRF compared to Benson et al. (2018) was negligible, with a median of 0.025% (R2 units being between 0% and 100%). In general, the qPRF yielded a slightly better fitting solution, achieving a greater R2 on 70.2% of vertices. We also assess the qPRF method's model-recovery ability using a simulated dataset. The qPRF may facilitate the development and use of more elaborate models based on the PRF framework and may pave the way for novel clinical applications.

An Eccentricity Gradient Reversal across High-Level Visual Cortex

Human visual cortex contains regions selectively involved in perceiving and recognizing ecologically important visual stimuli such as people and places. Located in the ventral temporal lobe, these regions are organized consistently relative to cortical folding, a phenomenon thought to be inherited from how centrally or peripherally these stimuli are viewed with the retina. While this eccentricity theory of visual cortex has been one of the best descriptions of its functional organization, whether or not it accurately describes visual processing in all category-selective regions is not yet clear. Through a combination of behavioral and functional MRI measurements in 27 participants (17 females), we demonstrate that a limb-selective region neighboring well-studied face-selective regions shows tuning for the visual periphery in a cortical region originally thought to be centrally biased. We demonstrate that the spatial computations performed by the limb-selective region are consistent with visual experience and in doing so, make the novel observation that there may in fact be two eccentricity gradients, forming an eccentricity reversal across high-level visual cortex. These data expand the current theory of cortical organization to provide a unifying principle that explains the broad functional features of many visual regions, showing that viewing experience interacts with innate wiring principles to drive the location of cortical specialization.

Improving the reliability and accuracy of population receptive field measures using a logarithmically warped stimulus

The population receptive field (pRF) method, which measures the region in visual space that elicits a blood-oxygen-level-dependent (BOLD) signal in a voxel in retinotopic cortex, is a powerful tool for investigating the functional organization of human visual cortex with fMRI (Dumoulin & Wandell, 2008). However, recent work has shown that pRF estimates for early retinotopic visual areas can be biased and unreliable, especially for voxels representing the fovea. Here, we show that a log-bar stimulus that is logarithmically warped along the eccentricity dimension produces more reliable estimates of pRF size and location than the traditional moving bar stimulus. The log-bar stimulus was better able to identify pRFs near the foveal representation, and pRFs were smaller in size, consistent with simulation estimates of receptive field sizes in the fovea.

The neural link between stimulus duration and spatial location in the human visual hierarchy

Integrating spatial and temporal information is essential for our sensory experience. While psychophysical evidence suggests spatial dependencies in duration perception, few studies have directly tested the neural link between temporal and spatial processing. Using ultra-high-field functional MRI and neuronal-based modeling, we investigated how and where the processing and the representation of a visual stimulus duration is linked to that of its spatial location. Our results show a transition in duration coding: from monotonic and spatially-dependent in early visual cortex to unimodal and spatially-invariant in frontal cortex. Along the dorsal visual stream, particularly in the intraparietal sulcus (IPS), neuronal populations show common selective responses to both spatial and temporal information. In the IPS, spatial and temporal topographic organizations are also linked, although duration maps are smaller, less clustered, and more variable across participants. These findings help identify the mechanisms underlying human perception of visual duration and characterize the functional link between time and space processing, highlighting the importance of their interactions in shaping brain responses.

Asymmetries in foveal vision

Visual perception is characterized by known asymmetries in the visual field; human's visual sensitivity is higher along the horizontal than the vertical meridian, and along the lower than the upper vertical meridian. These asymmetries decrease with decreasing eccentricity from the periphery to the center of gaze, suggesting that they may be absent in the 1-deg foveola, the retinal region used to explore scenes at high-resolution. Using high-precision eyetracking and gaze-contingent display, allowing for accurate control over the stimulated foveolar location despite the continuous eye motion at fixation, we investigated fine visual discrimination at different isoeccentric locations across the foveola and parafovea. Although the tested foveolar locations were only 0.3 deg away from the center of gaze, we show that, similar to more eccentric locations, humans are more sensitive to stimuli presented along the horizontal than the vertical meridian. Whereas the magnitude of this asymmetry is reduced in the foveola, the magnitude of the vertical meridian asymmetry is comparable but, interestingly, reversed: objects presented slightly above the center of gaze are more easily discerned than when presented at the same eccentricity below the center of gaze. Therefore, far from being uniform, as often assumed, foveolar vision is characterized by perceptual asymmetries. Further, these asymmetries differ not only in magnitude but also in direction compared to those present just ~4deg away from the center of gaze, resulting in overall different foveal and extrafoveal perceptual fields.

An fMRI dataset in response to large-scale short natural dynamic facial expression videos

Facial expression is among the most natural methods for human beings to convey their emotional information in daily life. Although the neural mechanisms of facial expression have been extensively studied employing lab-controlled images and a small number of lab-controlled video stimuli, how the human brain processes natural dynamic facial expression videos still needs to be investigated. To our knowledge, this type of data specifically on large-scale natural facial expression videos is currently missing. We describe here the natural Facial Expressions Dataset (NFED), an fMRI dataset including responses to 1,320 short (3-second) natural facial expression video clips. These video clips are annotated with three types of labels: emotion, gender, and ethnicity, along with accompanying metadata. We validate that the dataset has good quality within and across participants and, notably, can capture temporal and spatial stimuli features. NFED provides researchers with fMRI data for understanding of the visual processing of large number of natural facial expression videos.

Principles of intensive human neuroimaging

The rise of large, publicly shared functional magnetic resonance imaging (fMRI) data sets in human neuroscience has focused on acquiring either a few hours of data on many individuals ('wide' fMRI) or many hours of data on a few individuals ('deep' fMRI). In this opinion article, we highlight an emerging approach within deep fMRI, which we refer to as 'intensive' fMRI: one that strives for extensive sampling of cognitive phenomena to support computational modeling and detailed investigation of brain function at the single voxel level. We discuss the fundamental principles, trade-offs, and practical considerations of intensive fMRI. We also emphasize that intensive fMRI does not simply mean collecting more data: it requires careful design of experiments to enable a rich hypothesis space, optimizing data quality, and strategically curating public resources to maximize community impact.

Dynamic estimation of the attentional field from visual cortical activity

Navigating around the world, we must adaptively allocate attention to our surroundings based on anticipated future stimuli and events. This allocation of spatial attention boosts visuocortical representations at attended locations and locally enhances perception. Indeed, spatial attention has often been analogized to a "spotlight" shining on the item of relevance. Although the neural underpinnings of the locus of this attentional spotlight have been relatively well studied, less is known about the size of the spotlight: to what extent can the attentional field be broadened and narrowed in accordance with behavioral demands? In this study, we developed a paradigm for dynamically estimating the locus and spread of covert spatial attention, inferred from visuocortical activity using fMRI in humans. We measured BOLD activity in response to an annulus while participants (4 female, 4 male) used covert visual attention to determine whether more numbers or letters were present in a cued region of the annulus. Importantly, the width of the cued area was systematically varied, calling for different sizes of the attentional spotlight. The deployment of attention was associated with an increase in BOLD activity in corresponding retinotopic regions of visual areas V1-V3. By modeling the visuocortical attentional modulation, we could reliably recover the cued location, as well as a broadening of the attentional enhancement with wider attentional cues. This modeling approach offers a useful window into the dynamics of attention and spatial uncertainty.

Positive and Negative Retinotopic Codes in the Human Hippocampus

The hippocampus is thought to coordinate sensory-mnemonic information streams in the brain, representing both the apex of the visual processing hierarchy and the central hub of mnemonic processing. Yet, the mechanisms underlying sensory-mnemonic interactions in the hippocampus are poorly understood. Recent work in cortex suggests that a retinotopic code - typically thought to be exclusive to visual areas - may help organize internal and external information at the cortical apex via opponent interactions. Here, we leverage high-resolution 7T functional MRI to test whether a bivalent retinotopic code structures activity within the human hippocampus and mediates hippocampal-cortical interactions. In seven densely-sampled individuals, we defined the retinotopic preferences of individual voxels within the hippocampus and cortex during a visual mapping task, as well as their functional connectivity during independent runs of resting-state fixation. Our findings reveal a robust retinotopic code in the hippocampus, characterized by stable population receptive fields (pRFs) with consistent preferred visual field locations across experimental runs. Notably, this retinotopic code is comprised of roughly equal proportions of positive and negative pRFs, aligning with the hypothesized role of negative pRFs in mnemonic processing. Finally, the signed amplitude of hippocampal pRFs predicts functional connectivity between retinotopic hippocampal and cortical voxels. Taken together, these results suggest that retinotopic coding may scaffold internal mnemonic and external sensory information processing within the hippocampus, and across hippocampal-cortical interactions.

qPRF: A system to accelerate population receptive field decoding

Patterns of BOLD response can be decoded using the population receptive field (PRF) model to reveal how visual input is represented on the cortex (Dumoulin and Wandell, 2008). The time cost of evaluating the PRF model is high, often requiring days to decode BOLD signals for a small cohort of subjects. We introduce the qPRF, an efficient method for decoding that reduced the computation time by a factor of 1436 when compared to another widely available PRF decoder (Kay, Winawer, Mezer and Wandell, 2013) on a benchmark of data from the Human Connectome Project (HCP; Van Essen, Smith, Barch, Behrens, Yacoub and Ugurbil, 2013). With a specially designed data structure and an efficient search algorithm, the qPRF optimizes the five PRF model parameters according to a least-squares criterion. To verify the accuracy of the qPRF solutions, we compared them to those provided by Benson, Jamison, Arcaro, Vu, Glasser, Coalson, Van Essen, Yacoub, Ugurbil, Winawer and Kay (2018). Both hemispheres of the 181 subjects in the HCP data set (a total of 10,753,572 vertices, each with a unique BOLD time series of 1800 frames) were decoded by qPRF in 15.2 hours on an ordinary CPU. The absolute difference inR 2 reported by Benson et al. and achieved by the qPRF was negligible, with a median of 0.39% (R 2 units being between 0% and 100%). In general, the qPRF yielded a slightly better fitting solution, achieving a greaterR 2 on 99.7% of vertices. The qPRF may facilitate the development and computation of more elaborate models based on the PRF framework, as well as the exploration of novel clinical applications.

Sub-bundle based analysis reveals the role of human optic radiation in visual working memory

White matter (WM) functional activity has been reliably detected through functional magnetic resonance imaging (fMRI). Previous studies have primarily examined WM bundles as unified entities, thereby obscuring the functional heterogeneity inherent within these bundles. Here, for the first time, we investigate the function of sub-bundles of a prototypical visual WM tract-the optic radiation (OR). We use the 7T retinotopy dataset from the Human Connectome Project (HCP) to reconstruct OR and further subdivide the OR into sub-bundles based on the fiber's termination in the primary visual cortex (V1). The population receptive field (pRF) model is then applied to evaluate the retinotopic properties of these sub-bundles, and the consistency of the pRF properties of sub-bundles with those of V1 subfields is evaluated. Furthermore, we utilize the HCP working memory dataset to evaluate the activations of the foveal and peripheral OR sub-bundles, along with LGN and V1 subfields, during 0-back and 2-back tasks. We then evaluate differences in 2bk-0bk contrast between foveal and peripheral sub-bundles (or subfields), and further examine potential relationships between 2bk-0bk contrast and 2-back task d-prime. The results show that the pRF properties of OR sub-bundles exhibit standard retinotopic properties and are typically similar to the properties of V1 subfields. Notably, activations during the 2-back task consistently surpass those under the 0-back task across foveal and peripheral OR sub-bundles, as well as LGN and V1 subfields. The foveal V1 displays significantly higher 2bk-0bk contrast than peripheral V1. The 2-back task d-prime shows strong correlations with 2bk-0bk contrast for foveal and peripheral OR fibers. These findings demonstrate that the blood oxygen level-dependent (BOLD) signals of OR sub-bundles encode high-fidelity visual information, underscoring the feasibility of assessing WM functional activity at the sub-bundle level. Additionally, the study highlights the role of OR in the top-down processes of visual working memory beyond the bottom-up processes for visual information transmission. Conclusively, this study innovatively proposes a novel paradigm for analyzing WM fiber tracts at the individual sub-bundle level and expands understanding of OR function.

Improving the Reliability and Accuracy of Population Receptive Field Measures Using a Logarithmically Warped Stimulus

The population receptive field method, which measures the region in visual space that elicits a BOLD signal in a voxel in retinotopic cortex, is a powerful tool for investigating the functional organization of human visual cortex with fMRI (Dumoulin & Wandell, 2008). However, recent work has shown that population receptive field (pRF) estimates for early retinotopic visual areas can be biased and unreliable, especially for voxels representing the fovea. Here, we show that a 'log-bar' stimulus that is logarithmically warped along the eccentricity dimension produces more reliable estimates of pRF size and location than the traditional moving bar stimulus. The log-bar stimulus was better able to identify pRFs near the foveal representation, and pRFs were smaller in size, consistent with simulation estimates of receptive field sizes in the fovea.

Attention spotlight in V1-based cortico-cortical interactions in human visual hierarchy

Attention is often viewed as a mental spotlight, which can be scaled like a zoom lens at specific spatial locations and features a center-surround gradient. Here, we demonstrate a neural signature of attention spotlight in signal transmission along the visual hierarchy. fMRI background connectivity analysis was performed between retinotopic V1 and downstream areas to characterize the spatial distribution of inter-areal interaction under two attentional states. We found that, compared to diffused attention, focal attention sharpened the spatial gradient in the strength of the background connectivity. Dynamic causal modeling analysis further revealed the effect of attention in both the feedback and feedforward connectivity between V1 and extrastriate cortex. In a context which induced a strong effect of crowding, the effect of attention in the background connectivity profile diminished. Our findings reveal a context-dependent attention prioritization in information transmission via modulating the recurrent processing across the early stages in human visual cortex.

Temporal Sensitivity for Achromatic and Chromatic Flicker across the Visual Cortex

The retinal ganglion cells (RGCs) receive different combinations of L, M, and S cone inputs and give rise to one achromatic and two chromatic postreceptoral channels. The goal of the current study was to determine temporal sensitivity across the three postreceptoral channels in subcortical and cortical regions involved in human vision. We measured functional magnetic resonance imaging (fMRI) responses at 7 T from three participants (two males, one female) viewing a high-contrast, flickering, spatially uniform wide field (∼140°). Stimulus flicker frequency varied logarithmically between 2 and 64 Hz and targeted the L + M + S, L - M, and S - (L + M) cone combinations. These measurements were used to create temporal sensitivity functions of the primary visual cortex (V1) across eccentricity and spatially averaged responses from the lateral geniculate nucleus (LGN), and the V2/V3, hV4, and V3A/B regions. fMRI responses reflected the known properties of the visual system, including higher peak temporal sensitivity to achromatic versus chromatic stimuli and low-pass filtering between the LGN and V1. Peak temporal sensitivity increased across levels of the cortical visual hierarchy. Unexpectedly, peak temporal sensitivity varied little across eccentricity within area V1. Measures of adaptation and distributed pattern activity revealed a subtle influence of 64 Hz achromatic flicker in area V1, despite this stimulus evoking only a minimal overall response. The comparison of measured cortical responses to a model of the integrated retinal output to our stimuli demonstrates that extensive filtering and amplification are applied to postretinal signals.

Updating the sulcal landscape of the human lateral parieto-occipital junction provides anatomical, functional, and cognitive insights

Recent work has uncovered relationships between evolutionarily new small and shallow cerebral indentations, or sulci, and human behavior. Yet, this relationship remains unexplored in the lateral parietal cortex (LPC) and the lateral parieto-occipital junction (LPOJ). After defining thousands of sulci in a young adult cohort, we revised the previous LPC/LPOJ sulcal landscape to include four previously overlooked, small, shallow, and variable sulci. One of these sulci (ventral supralateral occipital sulcus, slocs-v) is present in nearly every hemisphere and is morphologically, architecturally, and functionally dissociable from neighboring sulci. A data-driven, model-based approach, relating sulcal depth to behavior further revealed that the morphology of only a subset of LPC/LPOJ sulci, including the slocs-v, is related to performance on a spatial orientation task. Our findings build on classic neuroanatomical theories and identify new neuroanatomical targets for future "precision imaging" studies exploring the relationship among brain structure, brain function, and cognitive abilities in individual participants.

Adaptive smoothing of retinotopic maps based on Teichmüller parametrization

Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.

A previously undescribed scene-selective site is the key to encoding ego-motion in naturalistic environments

Current models of scene processing in the human brain include three scene-selective areas: the parahippocampal place area (or the temporal place areas), the restrosplenial cortex (or the medial place area), and the transverse occipital sulcus (or the occipital place area). Here, we challenged this model by showing that at least one other scene-selective site can also be detected within the human posterior intraparietal gyrus. Despite the smaller size of this site compared to the other scene-selective areas, the posterior intraparietal gyrus scene-selective (PIGS) site was detected consistently in a large pool of subjects (n = 59; 33 females). The reproducibility of this finding was tested based on multiple criteria, including comparing the results across sessions, utilizing different scanners (3T and 7T) and stimulus sets. Furthermore, we found that this site (but not the other three scene-selective areas) is significantly sensitive to ego-motion in scenes, thus distinguishing the role of PIGS in scene perception relative to other scene-selective areas. These results highlight the importance of including finer scale scene-selective sites in models of scene processing - a crucial step toward a more comprehensive understanding of how scenes are encoded under dynamic conditions.

Mapping the functional and structural connectivity of the scene network

The recognition and perception of places has been linked to a network of scene-selective regions in the human brain. While previous studies have focussed on functional connectivity between scene-selective regions themselves, less is known about their connectivity with other cortical and subcortical regions in the brain. Here, we determine the functional and structural connectivity profile of the scene network. We used fMRI to examine functional connectivity between scene regions and across the whole brain during rest and movie-watching. Connectivity within the scene network revealed a bias between posterior and anterior scene regions implicated in perceptual and mnemonic aspects of scene perception respectively. Differences between posterior and anterior scene regions were also evident in the connectivity with cortical and subcortical regions across the brain. For example, the Occipital Place Area (OPA) and posterior Parahippocampal Place Area (PPA) showed greater connectivity with visual and dorsal attention networks, while anterior PPA and Retrosplenial Complex showed preferential connectivity with default mode and frontoparietal control networks and the hippocampus. We further measured the structural connectivity of the scene network using diffusion tractography. This indicated both similarities and differences with the functional connectivity, highlighting biases between posterior and anterior regions, but also between ventral and dorsal scene regions. Finally, we quantified the structural connectivity between the scene network and major white matter tracts throughout the brain. These findings provide a map of the functional and structural connectivity of scene-selective regions to each other and the rest of the brain.

Organization of pRF size along the AP axis of the hippocampus and adjacent medial temporal cortex is related to specialization for scenes versus faces

The hippocampus is largely recognized for its integral contributions to memory processing. By contrast, its role in perceptual processing remains less clear. Hippocampal properties vary along the anterior-posterior (AP) axis. Based on past research suggesting a gradient in the scale of features processed along the AP extent of the hippocampus, the representations have been proposed to vary as a function of granularity along this axis. One way to quantify such granularity is with population receptive field (pRF) size measured during visual processing, which has so far received little attention. In this study, we compare the pRF sizes within the hippocampus to its activation for images of scenes versus faces. We also measure these functional properties in surrounding medial temporal lobe (MTL) structures. Consistent with past research, we find pRFs to be larger in the anterior than in the posterior hippocampus. Critically, our analysis of surrounding MTL regions, the perirhinal cortex, entorhinal cortex, and parahippocampal cortex shows a similar correlation between scene sensitivity and larger pRF size. These findings provide conclusive evidence for a tight relationship between the pRF size and the sensitivity to image content in the hippocampus and adjacent medial temporal cortex.

Characterizing Spatiotemporal Population Receptive Fields in Human Visual Cortex with fMRI

The use of fMRI and computational modeling has advanced understanding of spatial characteristics of population receptive fields (pRFs) in human visual cortex. However, we know relatively little about the spatiotemporal characteristics of pRFs because neurons' temporal properties are one to two orders of magnitude faster than fMRI BOLD responses. Here, we developed an image-computable framework to estimate spatiotemporal pRFs from fMRI data. First, we developed a simulation software that predicts fMRI responses to a time-varying visual input given a spatiotemporal pRF model and solves the model parameters. The simulator revealed that ground-truth spatiotemporal parameters can be accurately recovered at the millisecond resolution from synthesized fMRI responses. Then, using fMRI and a novel stimulus paradigm, we mapped spatiotemporal pRFs in individual voxels across human visual cortex in 10 participants (both females and males). We find that a compressive spatiotemporal (CST) pRF model better explains fMRI responses than a conventional spatial pRF model across visual areas spanning the dorsal, lateral, and ventral streams. Further, we find three organizational principles of spatiotemporal pRFs: (1) from early to later areas within a visual stream, spatial and temporal windows of pRFs progressively increase in size and show greater compressive nonlinearities, (2) later visual areas show diverging spatial and temporal windows across streams, and (3) within early visual areas (V1-V3), both spatial and temporal windows systematically increase with eccentricity. Together, this computational framework and empirical results open exciting new possibilities for modeling and measuring fine-grained spatiotemporal dynamics of neural responses using fMRI.

Computational model links normalization to chemoarchitecture in the human visual system

A goal of cognitive neuroscience is to provide computational accounts of brain function. Canonical computations-mathematical operations used by the brain in many contexts-fulfill broad information-processing needs by varying their algorithmic parameters. A key question concerns the identification of biological substrates for these computations and their algorithms. Chemoarchitecture-the spatial distribution of neurotransmitter receptor densities-shapes brain function. Here, we propose that local variations in specific receptor densities implement algorithmic modulations of canonical computations. To test this hypothesis, we combine mathematical modeling of brain responses with chemoarchitecture data. We compare parameters of divisive normalization obtained from 7-tesla functional magnetic resonance imaging with receptor density maps obtained from positron emission tomography. We find evidence that serotonin and γ-aminobutyric acid receptor densities are the biological substrate for algorithmic modulations of divisive normalization in the human visual system. Our model links computational and biological levels of vision, explaining how canonical computations allow the brain to fulfill broad information-processing needs.

Human subcortical pathways automatically detect collision trajectory without attention and awareness

Detecting imminent collisions is essential for survival. Here, we used high-resolution fMRI at 7 Tesla to investigate the role of attention and consciousness for detecting collision trajectory in human subcortical pathways. Healthy participants can precisely discriminate collision from near-miss trajectory of an approaching object, with pupil size change reflecting collision sensitivity. Subcortical pathways from the superior colliculus (SC) to the ventromedial pulvinar (vmPul) and ventral tegmental area (VTA) exhibited collision-sensitive responses even when participants were not paying attention to the looming stimuli. For hemianopic patients with unilateral lesions of the geniculostriate pathway, the ipsilesional SC and VTA showed significant activation to collision stimuli in their scotoma. Furthermore, stronger SC responses predicted better behavioral performance in collision detection even in the absence of awareness. Therefore, human tectofugal pathways could automatically detect collision trajectories without the observers' attention to and awareness of looming stimuli, supporting "blindsight" detection of impending visual threats.

Cortical field maps across human sensory cortex

Cortical processing pathways for sensory information in the mammalian brain tend to be organized into topographical representations that encode various fundamental sensory dimensions. Numerous laboratories have now shown how these representations are organized into numerous cortical field maps (CMFs) across visual and auditory cortex, with each CFM supporting a specialized computation or set of computations that underlie the associated perceptual behaviors. An individual CFM is defined by two orthogonal topographical gradients that reflect two essential aspects of feature space for that sense. Multiple adjacent CFMs are then organized across visual and auditory cortex into macrostructural patterns termed cloverleaf clusters. CFMs within cloverleaf clusters are thought to share properties such as receptive field distribution, cortical magnification, and processing specialization. Recent measurements point to the likely existence of CFMs in the other senses, as well, with topographical representations of at least one sensory dimension demonstrated in somatosensory, gustatory, and possibly olfactory cortical pathways. Here we discuss the evidence for CFM and cloverleaf cluster organization across human sensory cortex as well as approaches used to identify such organizational patterns. Knowledge of how these topographical representations are organized across cortex provides us with insight into how our conscious perceptions are created from our basic sensory inputs. In addition, studying how these representations change during development, trauma, and disease serves as an important tool for developing improvements in clinical therapies and rehabilitation for sensory deficits.

Treating amblyopia using altered reality enhances the fine-scale functional correlations in early visual areas

Amblyopia is a developmental visual disorder that causes substantial visual deficits. Studies using resting-state functional magnetic resonance imaging have disclosed abnormal brain functional connectivity (FC) both across long-range cortical sites and within the visual cortex in amblyopes, which is considered to be related to impaired visual functions. However, little work has examined whether restoring the vision of amblyopes accompanies with an improvement of FC. Here in adult amblyopes and healthy participants, we compared their brain FC before and after an altered-reality adaptation training. Before the training, the voxel-wise FCs of amblyopia patients were substantially weaker than those of healthy control participants both within and across the early visual areas. After the training, visual acuities improved in amblyopes but not in the control participants. The effect kept strengthening in the subsequent month without further adaptation. Importantly, we observed enhanced voxel-wise FC both within and across the early visual areas of amblyopes. Moreover, the enhancement continued for at least 1 month. These results suggest that the effective treatment can improve both the amblyopes' vision and functional connections in the visual cortex.

A selection and targeting framework of cortical locations for line-scanning fMRI

Depth-resolved functional magnetic resonance imaging (fMRI) is an emerging field growing in popularity given the potential of separating signals from different computational processes in cerebral cortex. Conventional acquisition schemes suffer from low spatial and temporal resolutions. Line-scanning methods allow depth-resolved fMRI by sacrificing spatial coverage to sample blood oxygenated level-dependent (BOLD) responses at ultra-high temporal and spatial resolution. For neuroscience applications, it is critical to be able to place the line accurately to (1) sample the right neural population and (2) target that neural population with tailored stimuli or tasks. To this end, we devised a multi-session framework where a target cortical location is selected based on anatomical and functional properties. The line is then positioned according to this information in a separate second session, and we tailor the experiment to focus on the target location. Anatomically, the precision of the line placement was confirmed by projecting a nominal representation of the acquired line back onto the surface. Functional estimates of neural selectivities in the line, as quantified by a visual population-receptive field model, resembled the target selectivities well for most subjects. This functional precision was quantified in detail by estimating the distance between the visual field location of the targeted vertex and the location in visual cortex (V1) that most closely resembled the line-scanning estimates; this distance was on average ~5.5 mm. Given the dimensions of the line, differences in acquisition, session, and stimulus design, this validates that line-scanning can be used to probe local neural sensitivities across sessions. In summary, we present an accurate framework for line-scanning MRI; we believe such a framework is required to harness the full potential of line-scanning and maximize its utility. Furthermore, this approach bridges canonical fMRI experiments with electrophysiological experiments, which in turn allows novel avenues for studying human physiology non-invasively.

Context-dependent attentional spotlight in pulvinar-V1 interaction

Spatial attention is often described as a mental spotlight that enhances information processing at the attended location. Using fMRI, we investigated background connectivity between the pulvinar and V1 in relation to focused versus diffused attention allocation, in weak and strong crowding contexts. Our findings revealed that focused attention led to enhanced correlations between the pulvinar and V1. Notably, this modulation was initiated by the pulvinar, and the strength of the modulation was dependent on the saliency of the target. These findings suggest that the pulvinar initiates information reweighting to V1, which underlies attentional selection in cluttered scenes.

A large-scale fMRI dataset for the visual processing of naturalistic scenes

One ultimate goal of visual neuroscience is to understand how the brain processes visual stimuli encountered in the natural environment. Achieving this goal requires records of brain responses under massive amounts of naturalistic stimuli. Although the scientific community has put a lot of effort into collecting large-scale functional magnetic resonance imaging (fMRI) data under naturalistic stimuli, more naturalistic fMRI datasets are still urgently needed. We present here the Natural Object Dataset (NOD), a large-scale fMRI dataset containing responses to 57,120 naturalistic images from 30 participants. NOD strives for a balance between sampling variation between individuals and sampling variation between stimuli. This enables NOD to be utilized not only for determining whether an observation is generalizable across many individuals, but also for testing whether a response pattern is generalized to a variety of naturalistic stimuli. We anticipate that the NOD together with existing naturalistic neuroimaging datasets will serve as a new impetus for our understanding of the visual processing of naturalistic stimuli.

Variability of visual field maps in human early extrastriate cortex challenges the canonical model of organization of V2 and V3

Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing lower contralateral quadrants, and the ventral halves representing upper contralateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here, we systematically investigate individual variability in the visual field maps of human early visual cortex using the 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability. Visual field representation in the dorsal portions of V2 and V3 was more variable than in their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. In addition, left hemisphere retinotopic maps were more variable than those in the right hemisphere. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern in the left hemisphere. Visual field sign analysis further revealed that in many individuals the area conventionally identified as dorsal V3 shows a discontinuity in the mirror-image representation of the retina, associated with a Y-shaped lower vertical representation. Our findings challenge the current view that inter-individual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.

A novel simulation paradigm utilising MRI-derived phosphene maps for cortical prosthetic vision

Objective.We developed a realistic simulation paradigm for cortical prosthetic vision and investigated whether we can improve visual performance using a novel clustering algorithm.Approach.Cortical visual prostheses have been developed to restore sight by stimulating the visual cortex. To investigate the visual experience, previous studies have used uniform phosphene maps, which may not accurately capture generated phosphene map distributions of implant recipients. The current simulation paradigm was based on the Human Connectome Project retinotopy dataset and the placement of implants on the cortices from magnetic resonance imaging scans. Five unique retinotopic maps were derived using this method. To improve performance on these retinotopic maps, we enabled head scanning and a density-based clustering algorithm was then used to relocate centroids of visual stimuli. The impact of these improvements on visual detection performance was tested. Using spatially evenly distributed maps as a control, we recruited ten subjects and evaluated their performance across five sessions on the Berkeley Rudimentary Visual Acuity test and the object recognition task.Main results.Performance on control maps is significantly better than on retinotopic maps in both tasks. Both head scanning and the clustering algorithm showed the potential of improving visual ability across multiple sessions in the object recognition task.Significance.The current paradigm is the first that simulates the experience of cortical prosthetic vision based on brain scans and implant placement, which captures the spatial distribution of phosphenes more realistically. Utilisation of evenly distributed maps may overestimate the performance that visual prosthetics can restore. This simulation paradigm could be used in clinical practice when making plans for where best to implant cortical visual prostheses.

Utilization of brain scans to create realistic phosphene maps for cortical visual prosthesis simulation studies

It has been shown that we can restore sensations of light by stimulating the visual cortex. Cortical prosthetic vision consists of light perception in the visual field named phosphenes. Phosphenes are like pixels on a monitor which we can control to form the desired perception. However, the locations of phosphenes evoked vary between individuals. One of the biggest challenges is how to utilize phosphenes to present recognizable patterns that represent real-world scenes. Because of the difficulties of recruiting participants, and the risks of neurosurgery, researchers have used computer simulations to investigate the outcome of cortical visual prostheses. Previous simulations used regular phosphene maps, which may overestimate the visual ability cortical visual prosthesis can provide. This study aims to develop a more realistic simulation for cortical visual prostheses. We derived realistic phosphene maps using an existing cortical retinotopy dataset and decided implant placement by considering neurosurgery restrictions. We rendered some visual stimuli to evaluate the usability of those phosphene maps. The results indicate that presenting information on phosphenes maps may be more challenging than previously estimated.

Polar angle asymmetries in visual perception and neural architecture

Human visual performance changes with visual field location. It is best at the center of gaze and declines with eccentricity, and also varies markedly with polar angle. These perceptual polar angle asymmetries are linked to asymmetries in the organization of the visual system. We review and integrate research quantifying how performance changes with visual field location and how this relates to neural organization at multiple stages of the visual system. We first briefly review how performance varies with eccentricity and the neural foundations of this effect. We then focus on perceptual polar angle asymmetries and their neural foundations. Characterizing perceptual and neural variations across and around the visual field contributes to our understanding of how the brain translates visual signals into neural representations which form the basis of visual perception.

A Texture Statistics Encoding Model Reveals Hierarchical Feature Selectivity across Human Visual Cortex

Midlevel features, such as contour and texture, provide a computational link between low- and high-level visual representations. Although the nature of midlevel representations in the brain is not fully understood, past work has suggested a texture statistics model, called the P-S model (Portilla and Simoncelli, 2000), is a candidate for predicting neural responses in areas V1-V4 as well as human behavioral data. However, it is not currently known how well this model accounts for the responses of higher visual cortex to natural scene images. To examine this, we constructed single-voxel encoding models based on P-S statistics and fit the models to fMRI data from human subjects (both sexes) from the Natural Scenes Dataset (Allen et al., 2022). We demonstrate that the texture statistics encoding model can predict the held-out responses of individual voxels in early retinotopic areas and higher-level category-selective areas. The ability of the model to reliably predict signal in higher visual cortex suggests that the representation of texture statistics features is widespread throughout the brain. Furthermore, using variance partitioning analyses, we identify which features are most uniquely predictive of brain responses and show that the contributions of higher-order texture features increase from early areas to higher areas on the ventral and lateral surfaces. We also demonstrate that patterns of sensitivity to texture statistics can be used to recover broad organizational axes within visual cortex, including dimensions that capture semantic image content. These results provide a key step forward in characterizing how midlevel feature representations emerge hierarchically across the visual system.SIGNIFICANCE STATEMENT Intermediate visual features, like texture, play an important role in cortical computations and may contribute to tasks like object and scene recognition. Here, we used a texture model proposed in past work to construct encoding models that predict the responses of neural populations in human visual cortex (measured with fMRI) to natural scene stimuli. We show that responses of neural populations at multiple levels of the visual system can be predicted by this model, and that the model is able to reveal an increase in the complexity of feature representations from early retinotopic cortex to higher areas of ventral and lateral visual cortex. These results support the idea that texture-like representations may play a broad underlying role in visual processing.

The psychosis human connectome project: Design and rationale for studies of visual neurophysiology

Visual perception is abnormal in psychotic disorders such as schizophrenia. In addition to hallucinations, laboratory tests show differences in fundamental visual processes including contrast sensitivity, center-surround interactions, and perceptual organization. A number of hypotheses have been proposed to explain visual dysfunction in psychotic disorders, including an imbalance between excitation and inhibition. However, the precise neural basis of abnormal visual perception in people with psychotic psychopathology (PwPP) remains unknown. Here, we describe the behavioral and 7 tesla MRI methods we used to interrogate visual neurophysiology in PwPP as part of the Psychosis Human Connectome Project (HCP). In addition to PwPP (n = 66) and healthy controls (n = 43), we also recruited first-degree biological relatives (n = 44) in order to examine the role of genetic liability for psychosis in visual perception. Our visual tasks were designed to assess fundamental visual processes in PwPP, whereas MR spectroscopy enabled us to examine neurochemistry, including excitatory and inhibitory markers. We show that it is feasible to collect high-quality data across multiple psychophysical, functional MRI, and MR spectroscopy experiments with a sizable number of participants at a single research site. These data, in addition to those from our previously described 3 tesla experiments, will be made publicly available in order to facilitate further investigations by other research groups. By combining visual neuroscience techniques and HCP brain imaging methods, our experiments offer new opportunities to investigate the neural basis of abnormal visual perception in PwPP.

White matter BOLD signals at 7 Tesla reveal visual field maps in optic radiation and vertical occipital fasciculus

There is growing evidence that blood-oxygen-level-dependent (BOLD) activity in the white matter (WM) can be detected by functional magnetic resonance imaging (fMRI). However, the functional relevance and significance of WM BOLD signals remain controversial. Here we investigated whether 7T BOLD fMRI can reveal fine-scale functional organizations of a WM bundle. Population receptive field (pRF) analyses of the 7T retinotopy dataset from the Human Connectome Project revealed clear contralateral retinotopic organizations of two visual WM bundles: the optic radiation (OR) and the vertical occipital fasciculus (VOF). The retinotopic maps of OR are highly consistent with post-mortem dissections and diffusion tractographies, while the VOF maps are compatible with the dorsal and ventral visual areas connected by the WM. Similar to the grey matter (GM) visual areas, both WM bundles show over-representations of the central visual field and increasing pRF size with eccentricity. Hemodynamic response functions of visual WM were slower and wider compared with those of GM areas. These findings clearly demonstrate that WM BOLD at 7 Tesla is closely coupled with neural activity related to axons, encoding highly specific information that can be used to characterize fine-scale functional organizations of a WM bundle.

A General Framework for Inferring Bayesian Ideal Observer Models from Psychophysical Data

A central question in neuroscience is how sensory inputs are transformed into percepts. At this point, it is clear that this process is strongly influenced by prior knowledge of the sensory environment. Bayesian ideal observer models provide a useful link between data and theory that can help researchers evaluate how prior knowledge is represented and integrated with incoming sensory information. However, the statistical prior employed by a Bayesian observer cannot be measured directly, and must instead be inferred from behavioral measurements. Here, we review the general problem of inferring priors from psychophysical data, and the simple solution that follows from assuming a prior that is a Gaussian probability distribution. As our understanding of sensory processing advances, however, there is an increasing need for methods to flexibly recover the shape of Bayesian priors that are not well approximated by elementary functions. To address this issue, we describe a novel approach that applies to arbitrary prior shapes, which we parameterize using mixtures of Gaussian distributions. After incorporating a simple approximation, this method produces an analytical solution for psychophysical quantities that can be numerically optimized to recover the shapes of Bayesian priors. This approach offers advantages in flexibility, while still providing an analytical framework for many scenarios. We provide a MATLAB toolbox implementing key computations described herein.

Variability of the Surface Area of the V1, V2, and V3 Maps in a Large Sample of Human Observers

How variable is the functionally defined structure of early visual areas in human cortex and how much variability is shared between twins? Here we quantify individual differences in the best understood functionally defined regions of cortex: V1, V2, V3. The Human Connectome Project 7T Retinotopy Dataset includes retinotopic measurements from 181 subjects (109 female, 72 male), including many twins. We trained four "anatomists" to manually define V1-V3 using retinotopic features. These definitions were more accurate than automated anatomical templates and showed that surface areas for these maps varied more than threefold across individuals. This threefold variation was little changed when normalizing visual area size by the surface area of the entire cerebral cortex. In addition to varying in size, we find that visual areas vary in how they sample the visual field. Specifically, the cortical magnification function differed substantially among individuals, with the relative amount of cortex devoted to central vision varying by more than a factor of 2. To complement the variability analysis, we examined the similarity of visual area size and structure across twins. Whereas the twin sample sizes are too small to make precise heritability estimates (50 monozygotic pairs, 34 dizygotic pairs), they nonetheless reveal high correlations, consistent with strong effects of the combination of shared genes and environment on visual area size. Collectively, these results provide the most comprehensive account of individual variability in visual area structure to date, and provide a robust population benchmark against which new individuals and developmental and clinical populations can be compared.SIGNIFICANCE STATEMENT Areas V1, V2, and V3 are among the best studied functionally defined regions in human cortex. Using the largest retinotopy dataset to date, we characterized the variability of these regions across individuals and the similarity between twin pairs. We find that the size of visual areas varies dramatically (up to 3.5×) across healthy young adults, far more than the variability of the cerebral cortex size as a whole. Much of this variability appears to arise from inherited factors, as we find very high correlations in visual area size between monozygotic twin pairs, and lower but still substantial correlations between dizygotic twin pairs. These results provide the most comprehensive assessment of how functionally defined visual cortex varies across the population to date.

A modeling framework for determining modulation of neural-level tuning from non-invasive human fMRI data

Many neuroscience theories assume that tuning modulation of individual neurons underlies changes in human cognition. However, non-invasive fMRI lacks sufficient resolution to visualize this modulation. To address this limitation, we developed an analysis framework called Inferring Neural Tuning Modulation (INTM) for "peering inside" voxels. Precise specification of neural tuning from the BOLD signal is not possible. Instead, INTM compares theoretical alternatives for the form of neural tuning modulation that might underlie changes in BOLD across experimental conditions. The most likely form is identified via formal model comparison, with assumed parametric Normal tuning functions, followed by a non-parametric check of conclusions. We validated the framework by successfully identifying a well-established form of modulation: visual contrast-induced multiplicative gain for orientation tuned neurons. INTM can be applied to any experimental paradigm testing several points along a continuous feature dimension (e.g., direction of motion, isoluminant hue) across two conditions (e.g., with/without attention, before/after learning).