Imaging retinotopic maps in the human brain

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.Significance Statement We demonstrate that remembering a visual stimulus evokes responses in visual cortex that differ in spatial extent compared to seeing the same stimulus. Perception evokes tuned responses in early visual areas that increase in size up the visual hierarchy. Prior work showed that feedback inputs associated with long-term memory originate from later visual areas with larger receptive fields resulting in uniformly wide spatial tuning even in primary visual cortex. We replicate these results and show that the same pattern holds when maintaining in working memory a recently viewed stimulus. That trial-to-trial difficulty is reflected in the accuracy and precision of these representations suggests that visual cortex is flexibly used for processing visuospatial information, regardless of where that information originates.

A core set of neural states underlying naturalistic memory reactivation in the posterior medial cortex

In the posterior midline default mode network, spatial activity patterns similar to those during the initial experience are reactivated during the successful recall of past events. Prior studies have shown that these event-specific activity patterns are consistent across individuals recalling a shared experience, suggesting that common functional responses underlying episodic recall do exist. However, the spatial organization of function during episodic encoding and subsequent recall, especially in the absence of external stimuli, remains poorly understood. To address this, we leverage fMRI data collected during the encoding and recall of naturalistic movies to identify a core set of neural states in the posterior medial cortex. These states are stimulus-locked, reactivated during recall, and have a shared spatial organization across brains (i.e., individuals). We show that a surprisingly small number of these states (16 states across hemispheres) is sufficient to achieve the same levels of reactivation in the posterior medial cortex as when using the standard methods of the field. Additionally, these states are linked to actions and social-affective features of events in the movies. Our findings elucidate the properties of a common, spatially organized code within the posterior default mode network which appears during natural recollection of memories.

Using precision approaches to improve brain-behavior prediction

Predicting individual behavioral traits from brain idiosyncrasies has broad practical implications, yet predictions vary widely. This constraint may be driven by a combination of signal and noise in both brain and behavioral variables. Here, we expand on this idea, highlighting the potential of extended sampling 'precision' studies. First, we discuss their relevance to improving the reliability of individualized estimates by minimizing measurement noise. Second, we review how targeted within-subject experiments, when combined with individualized analysis or modeling frameworks, can maximize signal. These improvements in signal-to-noise facilitated by precision designs can help boost prediction studies. We close by discussing the integration of precision approaches with large-sample consortia studies to leverage the advantages of both.

An Eccentricity Gradient Reversal across High-Level Visual Cortex

Human visual cortex contains regions selectively involved in perceiving and recognizing ecologically important visual stimuli such as people and places. Located in the ventral temporal lobe, these regions are organized consistently relative to cortical folding, a phenomenon thought to be inherited from how centrally or peripherally these stimuli are viewed with the retina. While this eccentricity theory of visual cortex has been one of the best descriptions of its functional organization, whether or not it accurately describes visual processing in all category-selective regions is not yet clear. Through a combination of behavioral and functional MRI measurements in 27 participants (17 females), we demonstrate that a limb-selective region neighboring well-studied face-selective regions shows tuning for the visual periphery in a cortical region originally thought to be centrally biased. We demonstrate that the spatial computations performed by the limb-selective region are consistent with visual experience and in doing so, make the novel observation that there may in fact be two eccentricity gradients, forming an eccentricity reversal across high-level visual cortex. These data expand the current theory of cortical organization to provide a unifying principle that explains the broad functional features of many visual regions, showing that viewing experience interacts with innate wiring principles to drive the location of cortical specialization.

Feedback scales the spatial tuning of cortical responses during both visual working memory and long-term memory

Perception, working memory, and long-term memory each evoke neural responses in visual cortex. While previous neuroimaging research on the role of visual cortex in memory has largely emphasized similarities between perception and memory, we hypothesized that responses in visual cortex would differ depending on the origins of the inputs. Using fMRI, we quantified spatial tuning in visual cortex while participants (both sexes) viewed, maintained in working memory, or retrieved from long-term memory a peripheral target. In each condition, BOLD responses were spatially tuned and aligned with the target's polar angle in all measured visual field maps including V1. As expected given the increasing sizes of receptive fields, polar angle tuning during perception increased in width up the visual hierarchy from V1 to V2, V3, hV4, and beyond. In stark contrast, the tuned responses were broad across the visual hierarchy during long-term memory (replicating a prior result) and during working memory. This pattern is consistent with the idea that mnemonic responses in V1 stem from top-down sources, even when the stimulus was recently viewed and is held in working memory. Moreover, in long-term memory, trial-to-trial biases in these tuned responses (clockwise or counterclockwise of target), predicted matched biases in memory, suggesting that the reinstated cortical responses influence memory guided behavior. We conclude that feedback widens spatial tuning in visual cortex during memory, where earlier visual maps inherit broader tuning from later maps thereby impacting the precision of memory.

A data-driven analysis of the perceptual and neural responses to natural objects reveals organising principles of human visual cognition

A key challenge in understanding the functional organisation of visual cortex stems from the fact that only a small proportion of the objects experienced during natural viewing can be presented in a typical experiment. This constraint often leads to experimental designs that compare responses to objects from experimenter-defined stimulus conditions, potentially limiting the interpretation of the data. To overcome this issue, we used images from the THINGS initiative, which provides a systematic sampling of natural objects. A data-driven analysis was then applied to reveal the functional organisation of the visual brain, incorporating both perceptual and neural responses to these objects. Perceptual properties of the objects were taken from an analysis of similarity judgements, and neural properties were taken from whole brain fMRI responses to the same objects. Partial least squares regression (PLSR) was then used to predict neural responses across the brain from the perceptual properties while simultaneously applying dimensionality reduction. The PLSR model accurately predicted neural responses across visual cortex using only a small number of components. These components revealed smooth, graded neural topographies, which were similar in both hemispheres, and captured a variety of object properties including animacy, real-world size, and object category. However, they did not accord in any simple way with previous theoretical perspectives on object perception. Instead, our findings suggest that visual cortex encodes information in a statistically efficient manner, reflecting natural variability among objects.Significance statement The ability to recognise objects is fundamental to how we interact with our environment, yet the organising principles underlying neural representations of visual objects remain contentious. In this study, we sought to address this question by analysing perceptual and neural responses to a large, unbiased sample of objects. Using a data-driven approach, we leveraged perceptual properties of objects to predict neural responses using a small number of components. This model predicted neural responses with a high degree of accuracy across visual cortex. The components did not directly align with previous explanations of object perception. Instead, our findings suggest the organisation of the visual brain is based on the statistical properties of objects in the natural world.

Evaluation of Retinal Structure and Visual Function in Blue Cone Monochromacy to Develop Clinical Endpoints for L-opsin Gene Therapy

L-cone opsin expression by gene therapy is a promising treatment for blue cone monochromacy (BCM) caused by congenital lack of long- and middle-wavelength-sensitive (L/M) cone function. Eight patients with BCM and confirmed pathogenic variants at the OPN1LW/OPN1MW gene cluster participated. Optical coherence tomography (OCT), chromatic perimetry, chromatic microperimetry, chromatic visual acuity (VA), and chromaticity thresholds were performed with unmodified commercial equipment and/or methods available in the public domain. Adaptive optics scanning laser ophthalmoscope (AOSLO) imaging was performed in a subset of patients. Outer retinal changes were detectable by OCT with an age-related effect on the foveal disease stage. Rod and short-wavelength-sensitive (S) cone functions were relatively retained by perimetry, although likely impacted by age-related increases in the pre-retinal absorption of short-wavelength lights. The central macula showed a large loss of red sensitivity on dark-adapted microperimetry. Chromatic VAs with high-contrast red gratings on a blue background were not detectable. Color vision was severely deficient. AOSLO imaging showed reduced total cone density with majority of the population being non-waveguiding. This study developed and evaluated specialized outcomes that will be needed for the determination of efficacy and safety in human clinical trials. Dark-adapted microperimetry with a red stimulus sampling the central macula would be a key endpoint to evaluate the light sensitivity improvements. VA changes specific to L-opsin can be measured with red gratings on a bright blue background and should also be considered as outcome measures in future interventional trials.

Distributed network flows generate localized category selectivity in human visual cortex

A central goal of neuroscience is to understand how function-relevant brain activations are generated. Here we test the hypothesis that function-relevant brain activations are generated primarily by distributed network flows. We focused on visual processing in human cortex, given the long-standing literature supporting the functional relevance of brain activations in visual cortex regions exhibiting visual category selectivity. We began by using fMRI data from N = 352 human participants to identify category-specific responses in visual cortex for images of faces, places, body parts, and tools. We then systematically tested the hypothesis that distributed network flows can generate these localized visual category selective responses. This was accomplished using a recently developed approach for simulating - in a highly empirically constrained manner - the generation of task-evoked brain activations by modeling activity flowing over intrinsic brain connections. We next tested refinements to our hypothesis, focusing on how stimulus-driven network interactions initialized in V1 generate downstream visual category selectivity. We found evidence that network flows directly from V1 were sufficient for generating visual category selectivity, but that additional, globally distributed (whole-cortex) network flows increased category selectivity further. Using null network architectures we also found that each region's unique intrinsic "connectivity fingerprint" was key to the generation of category selectivity. These results generalized across regions associated with all four visual categories tested (bodies, faces, places, and tools), and provide evidence that the human brain's intrinsic network organization plays a prominent role in the generation of functionally relevant, localized responses.

Assessment of objective visual function following idebenone administration in patients with leber hereditary optic neuropathy

PURPOSE

To objectively assess visual function in Leber's Hereditary Optic Neuropathy (LHON) patients; this study evaluated pre- and post-idebenone treatment changes in primary visual cortical (V1) responses using functional magnetic resonance imaging (fMRI), given the challenges in subjective testing due to central retinal ganglion cell damage.

STUDY DESIGN

A descriptive study involving four confirmed LHON patients.

METHODS

Four patients received 900 mg/day of oral idebenone for 24 weeks. Baseline and post-treatment visual acuity, visual fields, and BOLD fMRI responses while passively viewed drifting contrast pattern visual stimuli were compared with self-reported symptoms.

RESULTS

Post-idebenone, one patient showed positive trends across subjective tests, reported symptoms, and fMRI. Two patients had stable symptoms and fMRI responses; one improved on subjective tests, and another worsened slightly. Another patient improved in visual field tests despite worsening symptoms and fMRI trends.

CONCLUSION

fMRI may offer a valuable objective measure of visual functions in LHON and appears to be more relevant in assessing symptoms. Further research with more participants is needed to ascertain fMRI's role in developing objective visual assessments and treatment evaluation.

An In-depth Exploration of the Interplay between fMRI Methods and Theory in Cognitive Neuroscience

Functional magnetic resonance imaging (fMRI) has been a cornerstone of cognitive neuroscience since its invention in the 1990s. The methods that we use for fMRI data analysis allow us to test different theories of the brain, thus different analyses can lead us to different conclusions about how the brain produces cognition. There has been a centuries-long debate about the nature of neural processing, with some theories arguing for functional specialization or localization (e.g., face and scene processing) while other theories suggest that cognition is implemented in distributed representations across many neurons and brain regions. Importantly, these theories have received support via different types of analyses; therefore, having students implement hands-on data analysis to explore the results of different fMRI analyses can allow them to take a firsthand approach to thinking about highly influential theories in cognitive neuroscience. Moreover, these explorations allow students to see that there are not clearcut "right" or "wrong" answers in cognitive neuroscience, rather we effectively instantiate assumptions within our analytical approaches that can lead us to different conclusions. Here, I provide Python code that uses freely available software and data to teach students how to analyze fMRI data using traditional activation analysis and machine-learning-based multivariate pattern analysis (MVPA). Altogether, these resources help teach students about the paramount importance of methodology in shaping our theories of the brain, and I believe they will be helpful for introductory undergraduate courses, graduate-level courses, and as a first analysis for people working in labs that use fMRI.

Tractometry of Human Visual White Matter Pathways in Health and Disease

Diffusion-weighted MRI (dMRI) provides a unique non-invasive view of human brain tissue properties. The present review article focuses on tractometry analysis methods that use dMRI to assess the properties of brain tissue within the long-range connections comprising brain networks. We focus specifically on the major white matter tracts that convey visual information. These connections are particularly important because vision provides rich information from the environment that supports a large range of daily life activities. Many of the diseases of the visual system are associated with advanced aging, and tractometry of the visual system is particularly important in the modern aging society. We provide an overview of the tractometry analysis pipeline, which includes a primer on dMRI data acquisition, voxelwise model fitting, tractography, recognition of white matter tracts, and calculation of tract tissue property profiles. We then review dMRI-based methods for analyzing visual white matter tracts: the optic nerve, optic tract, optic radiation, forceps major, and vertical occipital fasciculus. For each tract, we review background anatomical knowledge together with recent findings in tractometry studies on these tracts and their properties in relation to visual function and disease. Overall, we find that measurements of the brain's visual white matter are sensitive to a range of disorders and correlate with perceptual abilities. We highlight new and promising analysis methods, as well as some of the current barriers to progress toward integration of these methods into clinical practice. These barriers, such as variability in measurements between protocols and instruments, are targets for future development.

Organization of the human cerebral cortex estimated within individuals: networks, global topography, and function

The cerebral cortex is populated by specialized regions that are organized into networks. Here we estimated networks from functional MRI (fMRI) data in intensively sampled participants. The procedure was developed in two participants (scanned 31 times) and then prospectively applied to 15 participants (scanned 8-11 times). Analysis of the networks revealed a global organization. Locally organized first-order sensory and motor networks were surrounded by spatially adjacent second-order networks that linked to distant regions. Third-order networks possessed regions distributed widely throughout association cortex. Regions of distinct third-order networks displayed side-by-side juxtapositions with a pattern that repeated across multiple cortical zones. We refer to these as supra-areal association megaclusters (SAAMs). Within each SAAM, two candidate control regions were adjacent to three separate domain-specialized regions. Response properties were explored with task data. The somatomotor and visual networks responded to body movements and visual stimulation, respectively. Second-order networks responded to transients in an oddball detection task, consistent with a role in orienting to salient events. The third-order networks, including distinct regions within each SAAM, showed two levels of functional specialization. Regions linked to candidate control networks responded to working memory load across multiple stimulus domains. The remaining regions dissociated across language, social, and spatial/episodic processing domains. These results suggest that progressively higher-order networks nest outward from primary sensory and motor cortices. Within the apex zones of association cortex, there is specialization that repeatedly divides domain-flexible from domain-specialized regions. We discuss implications of these findings, including how repeating organizational motifs may emerge during development.NEW & NOTEWORTHY The organization of cerebral networks was estimated within individuals with intensive, repeat sampling of fMRI data. A hierarchical organization emerged in each individual that delineated first-, second-, and third-order cortical networks. Regions of distinct third-order association networks consistently exhibited side-by-side juxtapositions that repeated across multiple cortical zones, with clear and robust functional specialization among the embedded regions.

Modulation of the neuronal response in human primary visual cortex by re-entrant projections during retinal input processing as manifest in the visual evoked potential

Initial deflections in the visual evoked potential (VEP) reflect the neuronal process of extracting features from the retinal input; a process not modulated by re-entrant projections. Later deflections in the VEP reflect the neuronal process of combining features into an object, a process referred to as 'object closure' and modulated by re-entrant projections. Our earlier work indicated that the VEP reflects independent neuronal responses processing temporal - and spatial luminance contrast and that these responses arise from an interaction between forward and re-entrant input. In this earlier work, changing the temporal luminance contrast property of a stimulus altered its spatial luminance contrast property. We recorded the VEP in 12 volunteers viewing image pairs of a windmill, regular dartboard or an RMS dartboard rotated by either Π/4, Π/2, 3Π/4 or Π radians with respect to each other. The windmill and regular dartboard had identical white to black ratio, while the two dartboards identical contrast edges per unit area. Rotation varied temporal luminance contrast of a stimulus without affecting its spatial luminance contrast. N75, P100, N135 and P240 amplitude and latency were compared and a source localisation and temporal frequency analysis performed. P100 amplitude signals a neuronal response processing temporal luminance contrast that is modulated by re-entrant projections with fast axonal conduction velocities. N135 and P240 signal the neuronal response processing spatial luminance contrast and is modulated by re-entrant projections with slow axonal conduction velocities. The dorsal stream is interconnected by fast axonal conduction velocities, the ventral stream by slow axonal conduction velocities.

Adaptive smoothing of retinotopic maps based on Teichmüller parametrization

Retinotopic mapping, the mapping between visual inputs on the retina and neural responses on the cortical surface, is one of the fundamental topics in visual neuroscience. In human studies, retinotopic maps are conventionally constructed and processed by decoding blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) responses to designed visual stimuli on the cortical surface. However, these methods frequently generate retinotopic maps that do not preserve topology, contradicting a fundamental property of retinotopic maps observed in neurophysiology. To address this problem, we propose an integrated approach to simultaneously refine the flattening from the 3D cortical surface to the 2D parametric space and adaptively smooth retinotopic perception centers in the visual space to make the retinotopic maps topological. One key element of the approach is the enhanced error tolerant Teichmüller mapping, which refines the parametrization by minimizing angle distortions and maximizing alignment to noisy landmarks. We validated our overall approach with synthetic and real retinotopic mapping datasets and applied it to compute cortical magnification factor (CMF). The results showed that the proposed approach was superior to other conventional retinotopic mapping methods in predicting BOLD fMRI time series and preserving topology.

Naturalistic Object Representations Depend on Distance and Size Cues

Egocentric distance and real-world size are important cues for object perception and action. Nevertheless, most studies of human vision rely on two-dimensional pictorial stimuli that convey ambiguous distance and size information. Here, we use fMRI to test whether pictures are represented differently in the human brain from real, tangible objects that convey unambiguous distance and size cues. Participants directly viewed stimuli in two display formats (real objects and matched printed pictures of those objects) presented at different egocentric distances (near and far). We measured the effects of format and distance on fMRI response amplitudes and response patterns. We found that fMRI response amplitudes in the lateral occipital and posterior parietal cortices were stronger overall for real objects than for pictures. In these areas and many others, including regions involved in action guidance, responses to real objects were stronger for near vs. far stimuli, whereas distance had little effect on responses to pictures-suggesting that distance determines relevance to action for real objects, but not for pictures. Although stimulus distance especially influenced response patterns in dorsal areas that operate in the service of visually guided action, distance also modulated representations in ventral cortex, where object responses are thought to remain invariant across contextual changes. We observed object size representations for both stimulus formats in ventral cortex but predominantly only for real objects in dorsal cortex. Together, these results demonstrate that whether brain responses reflect physical object characteristics depends on whether the experimental stimuli convey unambiguous information about those characteristics.

Significance Statement

Classic frameworks of vision attribute perception of inherent object characteristics, such as size, to the ventral visual pathway, and processing of spatial characteristics relevant to action, such as distance, to the dorsal visual pathway. However, these frameworks are based on studies that used projected images of objects whose actual size and distance from the observer were ambiguous. Here, we find that when object size and distance information in the stimulus is less ambiguous, these characteristics are widely represented in both visual pathways. Our results provide valuable new insights into the brain representations of objects and their various physical attributes in the context of naturalistic vision.

Sulcal variability in anterior lateral prefrontal cortex contributes to variability in reasoning performance among young adults

Identifying structure-function correspondences is a major goal among biologists, cognitive neuroscientists, and brain mappers. Recent studies have identified relationships between performance on cognitive tasks and the presence or absence of small, shallow indentations, or sulci, of the human brain. Building on the previous finding that the presence of the ventral para-intermediate frontal sulcus (pimfs-v) in the left anterior lateral prefrontal cortex (aLPFC) was related to reasoning task performance in children and adolescents, we tested whether this relationship extended to a different sample, age group, and reasoning task. As predicted, the presence of this aLPFC sulcus was also associated with higher reasoning scores in young adults (ages 22-36). These findings have not only direct developmental, but also evolutionary relevance-as recent work shows that the pimfs-v is exceedingly rare in chimpanzees. Thus, the pimfs-v is a key developmental, cognitive, and evolutionarily relevant feature that should be considered in future studies examining how the complex relationships among multiscale anatomical and functional features of the brain give rise to abstract thought.

Perceptual Cycles Travel Across Retinotopic Space

Visual perception waxes and wanes periodically over time at low frequencies (theta: 4-7 Hz; alpha: 8-13 Hz), creating "perceptual cycles." These perceptual cycles can be induced when stimulating the brain with a flickering visual stimulus at the theta or alpha frequency. Here, we took advantage of the well-known organization of the visual system into retinotopic maps (topographic correspondence between visual and cortical spaces) to assess the spatial organization of induced perceptual cycles. Specifically, we tested the hypothesis that they can propagate across the retinotopic space. A disk oscillating in luminance (inducer) at 4, 6, 8, or 10 Hz was presented in the periphery of the visual field to induce perceptual cycles at specific frequencies. EEG recordings verified that the brain responded at the corresponding inducer frequencies and their first harmonics. Perceptual cycles were assessed with a concurrent detection task-target stimuli were displayed at threshold contrast (50% detection) at random times during the inducer. Behavioral results confirmed that perceptual performance was modulated periodically by the inducer at each frequency. We additionally manipulated the distance between the target and the inducer (three possible positions) and showed that the optimal phase, that is, moment of highest target detection, shifted across target distance to the inducer, specifically when its flicker frequency was in the alpha range (8 and 10 Hz). These results demonstrate that induced alpha perceptual cycles travel across the retinotopic space in humans at a propagation speed of 0.3-0.5 m/sec, consistent with the speed of unmyelinated horizontal connections in the visual cortex.

Normalization by orientation-tuned surround in human V1-V3

An influential account of neuronal responses in primary visual cortex is the normalized energy model. This model is often implemented as a multi-stage computation. The first stage is linear filtering. The second stage is the extraction of contrast energy, whereby a complex cell computes the squared and summed outputs of a pair of the linear filters in quadrature phase. The third stage is normalization, in which a local population of complex cells mutually inhibit one another. Because the population includes cells tuned to a range of orientations and spatial frequencies, the result is that the responses are effectively normalized by the local stimulus contrast. Here, using evidence from human functional MRI, we show that the classical model fails to account for the relative responses to two classes of stimuli: straight, parallel, band-passed contours (gratings), and curved, band-passed contours (snakes). The snakes elicit fMRI responses that are about twice as large as the gratings, yet a traditional divisive normalization model predicts responses that are about the same. Motivated by these observations and others from the literature, we implement a divisive normalization model in which cells matched in orientation tuning ("tuned normalization") preferentially inhibit each other. We first show that this model accounts for differential responses to these two classes of stimuli. We then show that the model successfully generalizes to other band-pass textures, both in V1 and in extrastriate cortex (V2 and V3). We conclude that even in primary visual cortex, complex features of images such as the degree of heterogeneity, can have large effects on neural responses.

Longitudinal stability of individual brain plasticity patterns in blindness

The primary visual cortex (V1) in individuals born blind is engaged in a wide spectrum of tasks and sensory modalities, including audition, touch, language, and memory. This widespread involvement raises questions regarding the constancy of its role and whether it might exhibit flexibility in its function over time, connecting to diverse network functions in response to task-specific demands. This would suggest that reorganized V1 takes on a role similar to cognitive multiple-demand system regions. Alternatively, it is possible that the varying patterns of plasticity observed in the blind V1 can be attributed to individual factors, whereby different blind individuals recruit V1 for different functions, highlighting the immense idiosyncrasy of plasticity. In support of this second account, we have recently shown that V1 functional connectivity varies greatly across blind individuals. But do these represent stable individual patterns of plasticity or merely instantaneous changes, for a multiple-demand system now inhabiting V1? Here we tested if individual connectivity patterns from the visual cortex of blind individuals are stable over time. We show that over two years, fMRI functional connectivity from the primary visual cortex is unique and highly stable in a small sample of repeatedly sampled congenitally blind individuals. Further, using multivoxel pattern analysis, we demonstrate that the unique reorganization patterns of these individuals allow decoding of participant identity. Together with recent evidence for substantial individual differences in visual cortex connectivity, this indicates there may be a consistent role for the visual cortex in blindness, which may differ for each individual. Further, it suggests that the variability in visual reorganization in blindness across individuals could be used to seek stable neuromarkers for sight rehabilitation and assistive approaches.

Sulcal variability in anterior lateral prefrontal cortex contributes to variability in reasoning performance among young adults

Identifying structure-function correspondences is a major goal among biologists, cognitive neuroscientists, and brain mappers. Recent studies have identified relationships between performance on cognitive tasks and the presence or absence of small, shallow indentations, or sulci, of the human brain. Building on the previous finding that the presence of one such sulcus in the left anterior lateral prefrontal cortex (aLPFC) was related to reasoning task performance in children and adolescents, we tested whether this relationship extended to a different sample, age group, and reasoning task. As predicted, the presence of this aLPFC sulcus-the ventral para-intermediate frontal sulcus-was also associated with higher reasoning scores in young adults (ages 22-36). These findings have not only direct developmental, but also evolutionary relevance-as recent work shows that the pimfs-v is exceedingly rare in chimpanzees. Thus, the pimfs-v is a novel developmental, cognitive, and evolutionarily relevant feature that should be considered in future studies examining how the complex relationships among multiscale anatomical and functional features of the brain give rise to abstract thought.

Variability of visual field maps in human early extrastriate cortex challenges the canonical model of organization of V2 and V3

Visual field maps in human early extrastriate areas (V2 and V3) are traditionally thought to form mirror-image representations which surround the primary visual cortex (V1). According to this scheme, V2 and V3 form nearly symmetrical halves with respect to the calcarine sulcus, with the dorsal halves representing lower contralateral quadrants, and the ventral halves representing upper contralateral quadrants. This arrangement is considered to be consistent across individuals, and thus predictable with reasonable accuracy using templates. However, data that deviate from this expected pattern have been observed, but mainly treated as artifactual. Here, we systematically investigate individual variability in the visual field maps of human early visual cortex using the 7T Human Connectome Project (HCP) retinotopy dataset. Our results demonstrate substantial and principled inter-individual variability. Visual field representation in the dorsal portions of V2 and V3 was more variable than in their ventral counterparts, including substantial departures from the expected mirror-symmetrical patterns. In addition, left hemisphere retinotopic maps were more variable than those in the right hemisphere. Surprisingly, only one-third of individuals had maps that conformed to the expected pattern in the left hemisphere. Visual field sign analysis further revealed that in many individuals the area conventionally identified as dorsal V3 shows a discontinuity in the mirror-image representation of the retina, associated with a Y-shaped lower vertical representation. Our findings challenge the current view that inter-individual variability in early extrastriate cortex is negligible, and that the dorsal portions of V2 and V3 are roughly mirror images of their ventral counterparts.

Spoken language processing activates the primary visual cortex

Primary visual cortex (V1) is generally thought of as a low-level sensory area that primarily processes basic visual features. Although there is evidence for multisensory effects on its activity, these are typically found for the processing of simple sounds and their properties, for example spatially or temporally-congruent simple sounds. However, in congenitally blind individuals, V1 is involved in language processing, with no evidence of major changes in anatomical connectivity that could explain this seemingly drastic functional change. This is at odds with current accounts of neural plasticity, which emphasize the role of connectivity and conserved function in determining a neural tissue's role even after atypical early experiences. To reconcile what appears to be unprecedented functional reorganization with known accounts of plasticity limitations, we tested whether V1's multisensory roles include responses to spoken language in sighted individuals. Using fMRI, we found that V1 in normally sighted individuals was indeed activated by comprehensible spoken sentences as compared to an incomprehensible reversed speech control condition, and more strongly so in the left compared to the right hemisphere. Activation in V1 for language was also significant and comparable for abstract and concrete words, suggesting it was not driven by visual imagery. Last, this activation did not stem from increased attention to the auditory onset of words, nor was it correlated with attentional arousal ratings, making general attention accounts an unlikely explanation. Together these findings suggest that V1 responds to spoken language even in sighted individuals, reflecting the binding of multisensory high-level signals, potentially to predict visual input. This capability might be the basis for the strong V1 language activation observed in people born blind, re-affirming the notion that plasticity is guided by pre-existing connectivity and abilities in the typically developed brain.

Within-Individual Organization of the Human Cerebral Cortex: Networks, Global Topography, and Function

The human cerebral cortex is populated by specialized regions that are organized into networks. Here we estimated networks using a Multi-Session Hierarchical Bayesian Model (MS-HBM) applied to intensively sampled within-individual functional MRI (fMRI) data. The network estimation procedure was initially developed and tested in two participants (each scanned 31 times) and then prospectively applied to 15 new participants (each scanned 8 to 11 times). Detailed analysis of the networks revealed a global organization. Locally organized first-order sensory and motor networks were surrounded by spatially adjacent second-order networks that also linked to distant regions. Third-order networks each possessed regions distributed widely throughout association cortex. Moreover, regions of distinct third-order networks displayed side-by-side juxtapositions with a pattern that repeated similarly across multiple cortical zones. We refer to these as Supra-Areal Association Megaclusters (SAAMs). Within each SAAM, two candidate control regions were typically adjacent to three separate domain-specialized regions. Independent task data were analyzed to explore functional response properties. The somatomotor and visual first-order networks responded to body movements and visual stimulation, respectively. A subset of the second-order networks responded to transients in an oddball detection task, consistent with a role in orienting to salient or novel events. The third-order networks, including distinct regions within each SAAM, showed two levels of functional specialization. Regions linked to candidate control networks responded to working memory load across multiple stimulus domains. The remaining regions within each SAAM did not track working memory load but rather dissociated across language, social, and spatial / episodic processing domains. These results support a model of the cerebral cortex in which progressively higher-order networks nest outwards from primary sensory and motor cortices. Within the apex zones of association cortex there is specialization of large-scale networks that divides domain-flexible from domain-specialized regions repeatedly across parietal, temporal, and prefrontal cortices. We discuss implications of these findings including how repeating organizational motifs may emerge during development.

Neurobehavioral measures of coincidence anticipation timing

Coincidence anticipation (CA) refers to the ability to coordinate responses to the arrival of a moving object. This study investigates the neurobehavioral processes that underlie CA through the measurement of electroencephalography (EEG) recorded during a CA task on a 17-foot plastic rail with evenly spaced LED lights. Participants responded at the anticipated moment a sequence of successively lit LEDs coincided with a stationary target. Healthy young adult participants (Mage = 21) performed six blocks with movement at 20, 30, or 40 mph and the direction either inbound or outbound relative to the participant. Behavioral results demonstrated a main effect of speed and an interaction between speed and direction, with outbound motion producing early responses and inbound motion producing delayed responses that increased at greater speeds. EEG demonstrated characteristic P1, N2, and P3-like visual evoked potentials (VEPs). VEP amplitudes revealed a significant direction by channel interaction for the P1, indicative of more medial responses for inbound motion. Significant laterality differences were present in the N2, whereas the P3 component produced significant main effects and interactions of speed and direction. This novel combination of three-dimensional CA with EEG demonstrates systematic brain responses that are tuned for motion speed and sensitive to different egocentric motion patterns thereby shedding new light on the mechanism of human visual-motor control.

Shape, perspective, and what is and is not perceived: Comment on Morales, Bax, and Firestone (2020)

Psychology and philosophy have long reflected on the role of perspective in vision. Since the dawn of modern vision science-roughly, since Helmholtz in the late 1800s-scientific explanations in vision have focused on understanding the computations that transform the sensed retinal image into percepts of the three-dimensional environment. The standard view in the science is that distal properties-viewpoint-independent properties of the environment (object shape) and viewpoint-dependent relational properties (3D orientation relative to the viewer)-are perceptually represented and that properties of the proximal stimulus (in vision, the retinal image) are not. This view is woven into the nature of scientific explanation in perceptual psychology, and has guided impressive advances over the past 150 years. A recently published article suggests that in shape perception, the standard view must be revised. It argues, on the basis of new empirical data, that a new entity-perspectival shape-should be introduced into scientific explanations of shape perception. Specifically, the article's centrally advertised claim is that, in addition to distal shape, perspectival shape is perceived. We argue that this claim rests on a series of mistakes. Problems in experimental design entail that the article provides no empirical support for any claims regarding either perspective or the perception of shape. There are further problems in scientific reasoning and conceptual development. Detailing these criticisms and explaining how science treats these issues are meant to clarify method and theory, and to improve exchanges between the science and philosophy of perception. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Dynamic Visualization of Gyral and Sulcal Stereoelectroencephalographic Contacts in Humans

Stereoelectroencephalography (SEEG) is a neurosurgical method to survey electrophysiological activity within the brain to treat disorders such as Epilepsy. In this stereotactic approach, leads are implanted through straight trajectories to survey both cortical and sub-cortical activity.Visualizing the recorded locations covering sulcal and gyral activity while staying true to the cortical architecture is challenging due to the folded, three-dimensional nature of the human cortex.To overcome this challenge, we developed a novel visualization concept, allowing investigators to dynamically morph between the subjects' cortical reconstruction and an inflated cortex representation. This inflated view, in which gyri and sulci are viewed on a smooth surface, allows better visualization of electrodes buried within the sulcus while staying true to the underlying cortical architecture.Clinical relevance- These visualization techniques might also help guide clinical decision-making when defining seizure onset zones or resections for patients undergoing SEEG monitoring for intractable epilepsy.

Connectopic mapping techniques do not reflect functional gradients in the brain

Functional gradients, in which response properties change gradually across a brain region, have been proposed as a key organising principle of the brain. Recent studies using both resting-state and natural viewing paradigms have indicated that these gradients may be reconstructed from functional connectivity patterns via "connectopic mapping" analyses. However, local connectivity patterns may be confounded by spatial autocorrelations artificially introduced during data analysis, for instance by spatial smoothing or interpolation between coordinate spaces. Here, we investigate whether such confounds can produce illusory connectopic gradients. We generated datasets comprising random white noise in subjects' functional volume spaces, then optionally applied spatial smoothing and/or interpolated the data to a different volume or surface space. Both smoothing and interpolation induced spatial autocorrelations sufficient for connectopic mapping to produce both volume- and surface-based local gradients in numerous brain regions. Furthermore, these gradients appeared highly similar to those obtained from real natural viewing data, although gradients generated from real and random data were statistically different in certain scenarios. We also reconstructed global gradients across the whole-brain - while these appeared less susceptible to artificial spatial autocorrelations, the ability to reproduce previously reported gradients was closely linked to specific features of the analysis pipeline. These results indicate that previously reported gradients identified by connectopic mapping techniques may be confounded by artificial spatial autocorrelations introduced during the analysis, and in some cases may reproduce poorly across different analysis pipelines. These findings imply that connectopic gradients need to be interpreted with caution.

Optic radiations representing different eccentricities age differently

The neural pathways that carry information from the foveal, macular, and peripheral visual fields have distinct biological properties. The optic radiations (OR) carry foveal and peripheral information from the thalamus to the primary visual cortex (V1) through adjacent but separate pathways in the white matter. Here, we perform white matter tractometry using pyAFQ on a large sample of diffusion MRI (dMRI) data from subjects with healthy vision in the U.K. Biobank dataset (UKBB; N = 5382; age 45-81). We use pyAFQ to characterize white matter tissue properties in parts of the OR that transmit information about the foveal, macular, and peripheral visual fields, and to characterize the changes in these tissue properties with age. We find that (1) independent of age there is higher fractional anisotropy, lower mean diffusivity, and higher mean kurtosis in the foveal and macular OR than in peripheral OR, consistent with denser, more organized nerve fiber populations in foveal/parafoveal pathways, and (2) age is associated with increased diffusivity and decreased anisotropy and kurtosis, consistent with decreased density and tissue organization with aging. However, anisotropy in foveal OR decreases faster with age than in peripheral OR, while diffusivity increases faster in peripheral OR, suggesting foveal/peri-foveal OR and peripheral OR differ in how they age.

Interaction between spatial perception and temporal perception enables preservation of cause-effect relationship: Visual psychophysics and neuronal dynamics

INTRODUCTION

Visual perception of moving objects is integral to our day-to-day life, integrating visual spatial and temporal perception. Most research studies have focused on finding the brain regions activated during motion perception. However, an empirically validated general mathematical model is required to understand the modulation of the motion perception. Here, we develop a mathematical formulation of the modulation of the perception of a moving object due to a change in speed, under the formulation of the invariance of causality.

METHODS

We formulated the perception of a moving object as the coordinate transformation from a retinotopic space onto perceptual space and derived a quantitative relationship between spatiotemporal coordinates. To validate our model, we undertook the analysis of two experiments: (i) the perceived length of the moving arc, and (ii) the perceived time while observing moving stimuli. We performed a magnetic resonance imaging (MRI) tractography investigation of subjects to demarcate the anatomical correlation of the modulation of the perception of moving objects.

RESULTS

Our theoretical model shows that the interaction between visual-spatial and temporal perception, during the perception of moving object is described by coupled linear equations; and experimental observations validate our model. We observed that cerebral area V5 may be an anatomical correlate for this interaction. The physiological basis of interaction is shown by a Lotka-Volterra system delineating interplay between acetylcholine and dopamine neurotransmitters, whose concentrations vary periodically with the orthogonal phase shift between them, occurring at the axodendritic synapse of complex cells at area V5.

CONCLUSION

Under the invariance of causality in the representation of events in retinotopic space and perceptual space, the speed modulates the perception of a moving object. This modulation may be due to variations of the tuning properties of complex cells at area V5 due to the dynamic interaction between acetylcholine and dopamine. Our analysis is the first significant study, to our knowledge, that establishes a mathematical linkage between motion perception and causality invariance.

White matter connections of high-level visual areas predict cytoarchitecture better than category-selectivity in childhood, but not adulthood

Ventral temporal cortex (VTC) consists of high-level visual regions that are arranged in consistent anatomical locations across individuals. This consistency has led to several hypotheses about the factors that constrain the functional organization of VTC. A prevailing theory is that white matter connections influence the organization of VTC, however, the nature of this constraint is unclear. Here, we test 2 hypotheses: (1) white matter tracts are specific for each category or (2) white matter tracts are specific to cytoarchitectonic areas of VTC. To test these hypotheses, we used diffusion magnetic resonance imaging to identify white matter tracts and functional magnetic resonance imaging to identify category-selective regions in VTC in children and adults. We find that in childhood, white matter connections are linked to cytoarchitecture rather than category-selectivity. In adulthood, however, white matter connections are linked to both cytoarchitecture and category-selectivity. These results suggest a rethinking of the view that category-selective regions in VTC have category-specific white matter connections early in development. Instead, these findings suggest that the neural hardware underlying the processing of categorical stimuli may be more domain-general than previously thought, particularly in childhood.

Dynamic Visualization of Gyral and Sulcal Stereoelectroencephalographic contacts in Humans

Stereoelectroencephalography (SEEG) is a neurosurgical method to survey electrophysiological activity within the brain to treat disorders such as Epilepsy. In this stereotactic approach, leads are implanted through straight trajectories to survey both cortical and sub-cortical activity. Visualizing the recorded locations covering sulcal and gyral activity while staying true to the cortical architecture is challenging due to the folded, three-dimensional nature of the human cortex. To overcome this challenge, we developed a novel visualization concept, allowing investigators to dynamically morph between the subjects' cortical reconstruction and an inflated cortex representation. This inflated view, in which gyri and sulci are viewed on a smooth surface, allows better visualization of electrodes buried within the sulcus while staying true to the underlying cortical architecture.

Clinical relevance—

These visualization techniques might also help guide clinical decision-making when defining seizure onset zones or resections for patients undergoing SEEG monitoring for intractable epilepsy.

Signal denoising through topographic modularity of neural circuits

Information from the sensory periphery is conveyed to the cortex via structured projection pathways that spatially segregate stimulus features, providing a robust and efficient encoding strategy. Beyond sensory encoding, this prominent anatomical feature extends throughout the neocortex. However, the extent to which it influences cortical processing is unclear. In this study, we combine cortical circuit modeling with network theory to demonstrate that the sharpness of topographic projections acts as a bifurcation parameter, controlling the macroscopic dynamics and representational precision across a modular network. By shifting the balance of excitation and inhibition, topographic modularity gradually increases task performance and improves the signal-to-noise ratio across the system. We demonstrate that in biologically constrained networks, such a denoising behavior is contingent on recurrent inhibition. We show that this is a robust and generic structural feature that enables a broad range of behaviorally relevant operating regimes, and provide an in-depth theoretical analysis unraveling the dynamical principles underlying the mechanism.

Estimating neural activity from visual areas using functionally defined EEG templates

Electroencephalography (EEG) is a common and inexpensive method to record neural activity in humans. However, it lacks spatial resolution making it difficult to determine which areas of the brain are responsible for the observed EEG response. Here we present a new easy-to-use method that relies on EEG topographical templates. Using MRI and fMRI scans of 50 participants, we simulated how the activity in each visual area appears on the scalp and averaged this signal to produce functionally defined EEG templates. Once created, these templates can be used to estimate how much each visual area contributes to the observed EEG activity. We tested this method on extensive simulations and on real data. The proposed procedure is as good as bespoke individual source localization methods, robust to a wide range of factors, and has several strengths. First, because it does not rely on individual brain scans, it is inexpensive and can be used on any EEG data set, past or present. Second, the results are readily interpretable in terms of functional brain regions and can be compared across neuroimaging techniques. Finally, this method is easy to understand, simple to use and expandable to other brain sources.

Activity-dependent Organization of Topographic Neural Circuits

Sensory information in the brain is organized into spatial representations, including retinotopic, somatotopic, and tonotopic maps, as well as ocular dominance columns. The spatial representation of sensory inputs is thought to be a fundamental organizational principle that is important for information processing. Topographic maps are plastic throughout an animal's life, reflecting changes in development and aging of brain circuitry, changes in the periphery and sensory input, and changes in circuitry, for instance in response to experience and learning. Here, we review mechanisms underlying the role of activity in the development, stability and plasticity of topographic maps, focusing on recent work suggesting that the spatial information in the visual field, and the resulting spatiotemporal patterns of activity, provide instructive cues that organize visual projections.

Macromolecular tissue volume mapping of lateral geniculate nucleus subdivisions in living human brains

The lateral geniculate nucleus (LGN) is a key thalamic nucleus in the visual system, which has an important function in relaying retinal visual input to the visual cortex. The human LGN is composed mainly of magnocellular (M) and parvocellular (P) subdivisions, each of which has different stimulus selectivity in neural response properties. Previous studies have discussed the potential relationship between LGN subdivisions and visual disorders based on psychophysical data on specific types of visual stimuli. However, these relationships remain speculative because non-invasive measurements of these subdivisions are difficult due to the small size of the LGN. Here we propose a method to identify these subdivisions by combining two structural MR measures: high-resolution proton-density weighted images and macromolecular tissue volume (MTV) maps. We defined the M and P subdivisions based on MTV fraction data and tested the validity of the definition by (1) comparing the data with that from human histological studies, (2) comparing the data with functional magnetic resonance imaging measurements on stimulus selectivity, and (3) analyzing the test-retest reliability. The findings demonstrated that the spatial organization of the M and P subdivisions was consistent across subjects and in line with LGN subdivisions observed in human histological data. Moreover, the difference in stimulus selectivity between the subdivisions identified using MTV was consistent with previous physiology literature. The definition of the subdivisions based on MTV was shown to be robust over measurements taken on different days. These results suggest that MTV mapping is a promising approach for evaluating the tissue properties of LGN subdivisions in living humans. This method potentially will enable neuroscientific and clinical hypotheses about the human LGN subdivisions to be tested.

Restored vision-augmented vision: arguments for a cybernetic vision

In this paper, we present some thoughts about the recent developments, made possible by technological advances and miniaturisation of connected visual prostheses, linked to the visual system, operating at different level of this one, on the retina as well as in the visual cortex. While these objects represent a great hope for people with impaired vision to recover partial vision, we show how this technology could also act on the functional vision of well sighted persons to improve or increase their visual performance. In addition to the impact on our cognitive and attentional mechanisms, such an operation when it originates outside the natural real visual field (e.g. cybernetics) raises a number of questions about the development and use of such implants or prostheses in the future.

Bayesian connective field modeling using a Markov Chain Monte Carlo approach

The majority of neurons in the human brain process signals from neurons elsewhere in the brain. Connective Field (CF) modelling is a biologically-grounded method to describe this essential aspect of the brain's circuitry. It allows characterizing the response of a population of neurons in terms of the activity in another part of the brain. CF modelling translates the concept of the receptive field (RF) into the domain of connectivity by assessing, at the voxel level, the spatial dependency between signals in distinct cortical visual field areas. Thus, the approach enables to characterize the functional cortical circuitry of the human cortex. While already very useful, the present CF modelling approach has some intrinsic limitations due to the fact that it only estimates the model's explained variance and not the probability distribution associated with the estimated parameters. If we could resolve this, CF modelling would lend itself much better for statistical comparisons at the level of single voxels and individuals. This is important when trying to gain a detailed understanding of the neurobiology and pathophysiology of the visual cortex, notably in rare cases. To enable this, we present a Bayesian approach to CF modeling (bCF). Using a Markov Chain Monte Carlo (MCMC) procedure, it estimates the posterior probability distribution underlying the CF parameters. Based on this, bCF quantifies, at the voxel level, the uncertainty associated with each parameter estimate. This information can be used in various ways to increase confidence in the CF model predictions. We applied bCF to BOLD responses recorded in the early human visual cortex using 3T fMRI. We estimated both the CF parameters and their associated uncertainties and show they are only weakly correlated. Moreover, we show how bCF facilitates the use of effect size (beta) as a data-driven parameter that can be used to select the most reliable voxels for further analysis. Finally, to further illustrate the functionality gained by bCF, we apply it to perform a voxel-level comparison of a single, circular symmetric, Gaussian versus a Difference-of-Gaussian model. We conclude that our bCF framework provides a comprehensive tool to study human functional cortical circuitry in health and disease.

Variability of the Surface Area of the V1, V2, and V3 Maps in a Large Sample of Human Observers

How variable is the functionally defined structure of early visual areas in human cortex and how much variability is shared between twins? Here we quantify individual differences in the best understood functionally defined regions of cortex: V1, V2, V3. The Human Connectome Project 7T Retinotopy Dataset includes retinotopic measurements from 181 subjects (109 female, 72 male), including many twins. We trained four "anatomists" to manually define V1-V3 using retinotopic features. These definitions were more accurate than automated anatomical templates and showed that surface areas for these maps varied more than threefold across individuals. This threefold variation was little changed when normalizing visual area size by the surface area of the entire cerebral cortex. In addition to varying in size, we find that visual areas vary in how they sample the visual field. Specifically, the cortical magnification function differed substantially among individuals, with the relative amount of cortex devoted to central vision varying by more than a factor of 2. To complement the variability analysis, we examined the similarity of visual area size and structure across twins. Whereas the twin sample sizes are too small to make precise heritability estimates (50 monozygotic pairs, 34 dizygotic pairs), they nonetheless reveal high correlations, consistent with strong effects of the combination of shared genes and environment on visual area size. Collectively, these results provide the most comprehensive account of individual variability in visual area structure to date, and provide a robust population benchmark against which new individuals and developmental and clinical populations can be compared.SIGNIFICANCE STATEMENT Areas V1, V2, and V3 are among the best studied functionally defined regions in human cortex. Using the largest retinotopy dataset to date, we characterized the variability of these regions across individuals and the similarity between twin pairs. We find that the size of visual areas varies dramatically (up to 3.5×) across healthy young adults, far more than the variability of the cerebral cortex size as a whole. Much of this variability appears to arise from inherited factors, as we find very high correlations in visual area size between monozygotic twin pairs, and lower but still substantial correlations between dizygotic twin pairs. These results provide the most comprehensive assessment of how functionally defined visual cortex varies across the population to date.

Micro-scale functional modules in the human temporal lobe

The sensory cortices of many mammals are often organized into modules in the form of cortical columns, yet whether modular organization at this spatial scale is a general property of the human neocortex is unknown. The strongest evidence for modularity arises when measures of connectivity, structure, and function converge. Here we use microelectrode recordings in humans to examine functional connectivity and neuronal spiking responses in order to assess modularity in submillimeter scale networks. We find that the human temporal lobe consists of temporally persistent spatially compact modules approximately 1.3mm in diameter. Functionally, the information coded by single neurons during an image categorization task is more similar for neurons belonging to the same module than for neurons from different modules. The geometry, connectivity, and spiking responses of these local cortical networks provide converging evidence that the human temporal lobe is organized into functional modules at the micro scale.

Adaptive processing and perceptual learning in visual cortical areas V1 and V4

Neurons in visual cortical areas primary visual cortex (V1) and V4 are adaptive processors, influenced by perceptual task. This is reflected in their ability to segment the visual scene into task-relevant and task-irrelevant stimulus components and by changing their tuning to task-relevant stimulus properties according to the current top-down instruction. Differences between the information represented in each area were seen. While V1 represented detailed stimulus characteristics, V4 filtered the input from V1 to carry the binary information required for the two-alternative judgement task. Neurons in V1 were activated at locations where the behaviorally relevant stimulus was placed well outside the grating-mapped receptive field. By systematically following the development of the task-dependent signals over the course of perceptual learning, we found that neuronal selectivity for task-relevant information was initially seen in V4 and, over a period of weeks, subsequently in V1. Once the learned information was represented in V1, on any given trial, task-relevant information appeared initially in V1 responses, followed by a 12-ms delay in V4. We propose that the shifting representation of learned information constitutes a mechanism for systems consolidation of memory.

The spatial properties of adaptation-induced distance compression

Exposure to a dynamic texture reduces the perceived separation between objects, altering the mapping between physical relations in the environment and their neural representations. Here we investigated the spatial tuning and spatial frame of reference of this aftereffect to understand the stage(s) of processing where adaptation-induced changes occur. In Experiment 1, we measured apparent separation at different positions relative to the adapted area, revealing a strong but tightly tuned compression effect. We next tested the spatial frame of reference of the effect, either by introducing a gaze shift between adaptation and test phase (Experiment 2) or by decoupling the spatial selectivity of adaptation in retinotopic and world-centered coordinates (Experiment 3). Results across the two experiments indicated that both retinotopic and world-centered adaptation effects can occur independently. Spatial attention to the location of the adaptor alone could not account for the world-centered transfer we observed, and retinotopic adaptation did not transfer to world-centered coordinates after a saccade (Experiment 4). Finally, we found that aftereffects in different reference frames have a similar, narrow spatial tuning profile (Experiment 5). Together, our results suggest that the neural representation of local separation resides early in the visual cortex, but it can also be modulated by activity in higher visual areas.

An evaluation of how connectopic mapping reveals visual field maps in V1

Abstract

Functional gradients, in which response properties change gradually across the cortical surface, have been proposed as a key organising principle of the brain. However, the presence of these gradients remains undetermined in many brain regions. Resting-state neuroimaging studies have suggested these gradients can be reconstructed from patterns of functional connectivity. Here we investigate the accuracy of these reconstructions and establish whether it is connectivity or the functional properties within a region that determine these “connectopic maps”. Different manifold learning techniques were used to recover visual field maps while participants were at rest or engaged in natural viewing. We benchmarked these reconstructions against maps measured by traditional visual field mapping. We report an initial exploratory experiment of a publicly available naturalistic imaging dataset, followed by a preregistered replication using larger resting-state and naturalistic imaging datasets from the Human Connectome Project. Connectopic mapping accurately predicted visual field maps in primary visual cortex, with better predictions for eccentricity than polar angle maps. Non-linear manifold learning methods outperformed simpler linear embeddings. We also found more accurate predictions during natural viewing compared to resting-state. Varying the source of the connectivity estimates had minimal impact on the connectopic maps, suggesting the key factor is the functional topography within a brain region. The application of these standardised methods for connectopic mapping will allow the discovery of functional gradients across the brain.

Protocol registration

The stage 1 protocol for this Registered Report was accepted in principle on 19 April 2022. The protocol, as accepted by the journal, can be found at 10.6084/m9.figshare.19771717.

Neural correlates of lateral modulation and perceptual filling-in in center-surround radial sinusoidal gratings: an fMRI study

We investigated lateral modulation effects with functional magnetic resonance imaging. We presented radial sinusoidal gratings in random sequence: a scotoma grating with two arc-shaped blank regions (scotomata) in the periphery, one in the left and one in the right visual field, a center grating containing pattern only in the scotoma regions, and a full-field grating where the pattern occupied the whole screen. On each trial, one of the three gratings flickered in counterphase for 10 s, followed by a blank period. Observers were instructed to perform a fixation task and report whether filling-in was experienced during the scotoma condition. The results showed that the blood-oxygen-level-dependent signal was reduced in areas corresponding to the scotoma regions in the full-field compared to the center condition in V1 to V3 areas, indicating a lateral inhibition effect when the surround was added to the center pattern. The univariate analysis results showed no difference between the filling-in and no-filling-in trials. However, multivariate pattern analysis results showed that classifiers trained on activation pattern in V1 to V3 could differentiate between filling-in and no-filling-in trials, suggesting that the neural activation pattern in visual cortex correlated with the subjective percept.

Uncovering a tripartite landmark in posterior cingulate cortex

Understanding brain structure-function relationships, and their development and evolution, is central to neuroscience research. Here, we show that morphological differences in posterior cingulate cortex (PCC), a hub of functional brain networks, predict individual differences in macroanatomical, microstructural, and functional features of PCC. Manually labeling 4511 sulci in 572 hemispheres, we found a shallow cortical indentation (termed the inframarginal sulcus; ifrms) within PCC that is absent from neuroanatomical atlases yet colocalized with a focal, functional region of the lateral frontoparietal network implicated in cognitive control. This structural-functional coupling generalized to meta-analyses consisting of hundreds of studies and thousands of participants. Additional morphological analyses showed that unique properties of the ifrms differ across the life span and between hominoid species. These findings support a classic theory that shallow, tertiary sulci serve as landmarks in association cortices. They also beg the question: How many other cortical indentations have we missed?

Structural Covariance and Heritability of the Optic Tract and Primary Visual Cortex in Living Human Brains

Individual differences among human brains exist at many scales, spanning gene expression, white matter tissue properties, and the size and shape of cortical areas. One notable example is an approximately 3-fold range in the size of human primary visual cortex (V1), a much larger range than is found in overall brain size. A previous study (Andrews et al., 1997) reported a correlation between optic tract (OT) cross-section area and V1 size in postmortem human brains, suggesting that there may be a common developmental mechanism for multiple components of the visual pathways. We evaluated the relationship between properties of the OT and V1 in a much larger sample of living human brains by analyzing the Human Connectome Project (HCP) 7 Tesla Retinotopy Dataset (including 107 females and 71 males). This dataset includes retinotopic maps measured with functional MRI (fMRI) and fiber tract data measured with diffusion MRI (dMRI). We found a negative correlation between OT fractional anisotropy (FA) and V1 surface area (r = -0.19). This correlation, although small, was consistent across multiple dMRI datasets differing in acquisition parameters. Further, we found that both V1 surface area and OT properties were correlated among twins, with higher correlations for monozygotic (MZ) than dizygotic (DZ) twins, indicating a high degree of heritability for both properties. Together, these results demonstrate covariation across individuals in properties of the retina (OT) and cortex (V1) and show that each is influenced by genetic factors.SIGNIFICANCE STATEMENT The size of human primary visual cortex (V1) has large interindividual differences. These differences do not scale with overall brain size. A previous postmortem study reported a correlation between the size of the human optic tract (OT) and V1. In this study, we evaluated the relationship between the OT and V1 in living humans by analyzing a neuroimaging dataset that included functional MRI (fMRI) and diffusion MRI (dMRI) data. We found a small, but robust correlation between OT tissue properties and V1 size, supporting the existence of structural covariance between the OT and V1 in living humans. The results suggest that characteristics of retinal ganglion cells (RGCs), reflected in OT measurements, are correlated with individual differences in human V1.

Decoding the temporal dynamics of affective scene processing

Natural images containing affective scenes are used extensively to investigate the neural mechanisms of visual emotion processing. Functional fMRI studies have shown that these images activate a large-scale distributed brain network that encompasses areas in visual, temporal, and frontal cortices. The underlying spatial and temporal dynamics, however, remain to be better characterized. We recorded simultaneous EEG-fMRI data while participants passively viewed affective images from the International Affective Picture System (IAPS). Applying multivariate pattern analysis to decode EEG data, and representational similarity analysis to fuse EEG data with simultaneously recorded fMRI data, we found that: (1) ∼80 ms after picture onset, perceptual processing of complex visual scenes began in early visual cortex, proceeding to ventral visual cortex at ∼100 ms, (2) between ∼200 and ∼300 ms (pleasant pictures: ∼200 ms; unpleasant pictures: ∼260 ms), affect-specific neural representations began to form, supported mainly by areas in occipital and temporal cortices, and (3) affect-specific neural representations were stable, lasting up to ∼2 s, and exhibited temporally generalizable activity patterns. These results suggest that affective scene representations in the brain are formed temporally in a valence-dependent manner and may be sustained by recurrent neural interactions among distributed brain areas.

The Role of Visual Experience in Individual Differences of Brain Connectivity

Visual cortex organization is highly consistent across individuals. But to what degree does this consistency depend on life experience, in particular sensory experience? In this study, we asked whether visual cortex reorganization in congenital blindness results in connectivity patterns that are particularly variable across individuals, focusing on resting-state functional connectivity (RSFC) patterns from the primary visual cortex. We show that the absence of shared visual experience results in more variable RSFC patterns across blind individuals than sighted controls. Increased variability is specifically found in areas that show a group difference between the blind and sighted in their RSFC. These findings reveal a relationship between brain plasticity and individual variability; reorganization manifests variably across individuals. We further investigated the different patterns of reorganization in the blind, showing that the connectivity to frontal regions, proposed to have a role in the reorganization of the visual cortex of the blind toward higher cognitive roles, is highly variable. Further, we link some of the variability in visual-to-frontal connectivity to another environmental factor-duration of formal education. Together, these findings show a role of postnatal sensory and socioeconomic experience in imposing consistency on brain organization. By revealing the idiosyncratic nature of neural reorganization, these findings highlight the importance of considering individual differences in fitting sensory aids and restoration approaches for vision loss.SIGNIFICANCE STATEMENT The typical visual system is highly consistent across individuals. What are the origins of this consistency? Comparing the consistency of visual cortex connectivity between people born blind and sighted people, we showed that blindness results in higher variability, suggesting a key impact of postnatal individual experience on brain organization. Further, connectivity patterns that changed following blindness were particularly variable, resulting in diverse patterns of brain reorganization. Individual differences in reorganization were also directly affected by nonvisual experiences in the blind (years of formal education). Together, these findings show a role of sensory and socioeconomic experiences in creating individual differences in brain organization and endorse the use of individual profiles for rehabilitation and restoration of vision loss.

Intra-Areal Visual Topography in Primate Brains Mapped with Probabilistic Tractography of Diffusion-Weighted Imaging

Noninvasive diffusion-weighted magnetic resonance imaging (dMRI) can be used to map the neural connectivity between distinct areas in the intact brain, but the standard resolution achieved fundamentally limits the sensitivity of such maps. We investigated the sensitivity and specificity of high-resolution postmortem dMRI and probabilistic tractography in rhesus macaque brains to produce retinotopic maps of the lateral geniculate nucleus (LGN) and extrastriate cortical visual area V5/MT based on their topographic connections with the previously established functional retinotopic map of primary visual cortex (V1). We also replicated the differential connectivity of magnocellular and parvocellular LGN compartments with V1 across visual field positions. Predicted topographic maps based on dMRI data largely matched the established retinotopy of both LGN and V5/MT. Furthermore, tractography based on in vivo dMRI data from the same macaque brains acquired at standard field strength (3T) yielded comparable topographic maps in many cases. We conclude that tractography based on dMRI is sensitive enough to reveal the intrinsic organization of ordered connections between topographically organized neural structures and their resultant functional organization.