A cross-validated cytoarchitectonic atlas of the human ventral visual stream

Identification of abnormal closed-loop pathways in patients with MRI-negative pharmacoresistant epilepsy

Epilepsy is a disorder of brain networks, that is usually combined with cognitive and emotional impairment. However, most of the current research on closed-loop pathways in epilepsy is limited to the neuronal level or has focused only on known closed-loop pathways, and studies on abnormalities in closed-loop pathways in epilepsy at the whole-brain network level are lacking. A total of 26 patients with magnetic resonance imaging-negative pharmacoresistant epilepsy (MRIneg-PRE) and 26 healthy controls (HCs) were included in this study. Causal brain networks and temporal-lag brain networks were constructed from resting-state functional MRI data, and the Johnson algorithm was used to identify stable closed-loop pathways. Abnormal closed-loop pathways in the MRIneg-PRE cohort compared with the HC group were identified, and the associations of these pathways with indicators of cognitive and emotional impairments were examined via Pearson correlation analysis. The results revealed that the abnormal stable closed-loop pathways were distributed across the frontal, parietal, and occipital lobes and included altered functional connectivity values both within and between cerebral hemispheres. Four abnormal closed-loop pathways in the occipital lobe were associated with emotional and cognitive impairments. These abnormal pathways may serve as biomarkers for the diagnosis and guidance of individualized treatments for MRIneg-PRE patients.

Distributed representations of behaviorally-relevant object dimensions in the human visual system

Object vision is commonly thought to involve a hierarchy of brain regions processing increasingly complex image features, with high-level visual cortex supporting object recognition and categorization. However, object vision supports diverse behavioral goals, suggesting basic limitations of this category-centric framework. To address these limitations, we mapped a series of behaviorally-relevant dimensions derived from a large-scale analysis of human similarity judgments directly onto the brain. Our results reveal broadly distributed representations of behaviorally-relevant information, demonstrating selectivity to a wide variety of novel dimensions while capturing known selectivities for visual features and categories. Behaviorally-relevant dimensions were superior to categories at predicting brain responses, yielding mixed selectivity in much of visual cortex and sparse selectivity in category-selective clusters. This framework reconciles seemingly disparate findings regarding regional specialization, explaining category selectivity as a special case of sparse response profiles among representational dimensions, suggesting a more expansive view on visual processing in the human brain.

Visual word processing engages a hierarchical, distributed, and bilateral cortical network

Although the Visual Word Form Area (VWFA) in left temporal cortex is considered the pre-eminent region in visual word processing, other regions are also implicated. We examined the entire text-selective circuit, using functional MRI. Ten regions of interest (ROIs) per hemisphere were defined, which, based on clustering, grouped into early vision, high-level vision, and language clusters. We analyzed the responses of the ROIs and clusters to words, inverted words, and consonant strings using univariate, multivariate, and functional connectivity measures. Bilateral modulation by stimulus condition was evident, with a stronger effect in left hemisphere regions. Last, using graph theory, we observed that the VWFA was equivalently connected with early visual and language clusters in both hemispheres, reflecting its role as a mediator in the circuit. Although the individual ROIs and clusters bilaterally were flexibly altered by the nature of the input, stability held at the level of global circuit connectivity, reflecting the complex hierarchical distributed system serving visual text perception.

Sound-encoded faces activate the left fusiform face area in the early blind

Face perception in humans and nonhuman primates is accomplished by a patchwork of specialized cortical regions. How these regions develop has remained controversial. In sighted individuals, facial information is primarily conveyed via the visual modality. Early blind individuals, on the other hand, can recognize shapes using auditory and tactile cues. Here we demonstrate that such individuals can learn to distinguish faces from houses and other shapes by using a sensory substitution device (SSD) presenting schematic faces as sound-encoded stimuli in the auditory modality. Using functional MRI, we then asked whether a face-selective brain region like the fusiform face area (FFA) shows selectivity for faces in the same subjects, and indeed, we found evidence for preferential activation of the left FFA by sound-encoded faces. These results imply that FFA development does not depend on experience with visual faces per se but may instead depend on exposure to the geometry of facial configurations.

Pneumatic tactile stimulus delivery system for studying brain responses evoked by active finger touch with fMRI

BACKGROUND

Primates use their hands to actively touch objects and collect information. To study tactile information processing, it is important for participants to experience tactile stimuli through active touch while monitoring brain activities.

NEW METHOD

Here, we developed a pneumatic tactile stimulus delivery system (pTDS) that delivers various tactile stimuli on a programmed schedule and allows voluntary finger touches during MRI scanning. The pTDS uses a pneumatic actuator to move tactile stimuli and place them in a finger hole. A photosensor detects the time when an index finger touches a tactile stimulus, enabling the analysis of the touch-elicited brain responses.

RESULTS

We examined brain responses while the participants actively touched braille objects presented by the pTDS. BOLD responses during tactile perception were significantly stronger in a finger touch area of the contralateral somatosensory cortex compared with that of visual perception.

CONCLUSION

The pTDS enables MR studies of brain mechanisms for tactile processes through natural finger touch.

White matter connections of high-level visual areas predict cytoarchitecture better than category-selectivity in childhood, but not adulthood

Ventral temporal cortex (VTC) consists of high-level visual regions that are arranged in consistent anatomical locations across individuals. This consistency has led to several hypotheses about the factors that constrain the functional organization of VTC. A prevailing theory is that white matter connections influence the organization of VTC, however, the nature of this constraint is unclear. Here, we test 2 hypotheses: (1) white matter tracts are specific for each category or (2) white matter tracts are specific to cytoarchitectonic areas of VTC. To test these hypotheses, we used diffusion magnetic resonance imaging to identify white matter tracts and functional magnetic resonance imaging to identify category-selective regions in VTC in children and adults. We find that in childhood, white matter connections are linked to cytoarchitecture rather than category-selectivity. In adulthood, however, white matter connections are linked to both cytoarchitecture and category-selectivity. These results suggest a rethinking of the view that category-selective regions in VTC have category-specific white matter connections early in development. Instead, these findings suggest that the neural hardware underlying the processing of categorical stimuli may be more domain-general than previously thought, particularly in childhood.

Classification of multiple sclerosis clinical profiles using machine learning and grey matter connectome

Purpose: The main goal of this study is to investigate the discrimination power of Grey Matter (GM) thickness connectome data between Multiple Sclerosis (MS) clinical profiles using statistical and Machine Learning (ML) methods.

Materials and Methods: A dataset composed of 90 MS patients acquired at the MS clinic of Lyon Neurological Hospital was used for the analysis. Four MS profiles were considered, corresponding to Clinical Isolated Syndrome (CIS), Relapsing-Remitting MS (RRMS), Secondary Progressive MS (SPMS), and Primary Progressive MS (PPMS). Each patient was classified in one of these profiles by our neurologist and underwent longitudinal MRI examinations including T1-weighted image acquisition at each examination, from which the GM tissue was segmented and the cortical GM thickness measured. Following the GM parcellation using two different atlases (FSAverage and Glasser 2016), the morphological connectome was built and six global metrics (Betweenness Centrality (BC), Assortativity (r), Transitivity (T), Efficiency (E_g), Modularity (Q) and Density (D)) were extracted. Based on their connectivity metrics, MS profiles were first statistically compared and second, classified using four different learning machines (Logistic Regression, Random Forest, Support Vector Machine and AdaBoost), combined in a higher level ensemble model by majority voting. Finally, the impact of the GM spatial resolution on the MS clinical profiles classification was analyzed.

Results: Using binary comparisons between the four MS clinical profiles, statistical differences and classification performances higher than 0.7 were observed. Good performances were obtained when comparing the two early clinical forms, RRMS and PPMS (F1 score of 0.86), and the two neurodegenerative profiles, PPMS and SPMS (F1 score of 0.72). When comparing the two atlases, slightly better performances were obtained with the Glasser 2016 atlas, especially between RRMS with PPMS (F1 score of 0.83), compared to the FSAverage atlas (F1 score of 0.69). Also, the thresholding value for graph binarization was investigated suggesting more informative graph properties in the percentile range between 0.6 and 0.8.

Conclusion: An automated pipeline was proposed for the classification of MS clinical profiles using six global graph metrics extracted from the GM morphological connectome of MS patients. This work demonstrated that GM morphological connectivity data could provide good classification performances by combining four simple ML models, without the cost of long and complex MR techniques, such as MR diffusion, and/or deep learning architectures.

Evaluating Head Models for Cortical Source Localization of the Face-Sensitive N290 Component in Infants

Accurate cortical source localization of event-related potentials (ERPs) requires using realistic head models constructed from the participant's structural magnetic resonance imaging (MRI). A challenge in developmental studies is the limited accessibility of participant-specific MRIs. The present study compared source localization of infants' N290 ERP activities estimated using participant-specific head models with a series of substitute head models. The N290 responses to faces relative to toys were measured in 36 infants aged at 4.5, 7.5, 9, and 12 months. The substitutes were individual-based head models constructed from age-matched MRIs with closely matched ("close") or different ("far") head measures with the participants, age-appropriate average template, and age-inappropriate average templates. The greater source responses to faces than toys at the middle fusiform gyrus (mFG) estimated using participant-specific head models were preserved in individual-based head models, but not average templates. The "close" head models yielded the best fit with the participant-specific head models in source activities at the mFG and across face-processing-related regions of interest (ROIs). The age-appropriate average template showed mixed results, not supporting the stimulus effect but showed topographical distributions across the ROIs like the participant-specific head models. The "close" head models are the most optimal substitute for participant-specific MRIs.

Anatomy of the temporal lobe: From macro to micro

The temporal cortex encompasses a large number of different areas ranging from the six-layered isocortex to the allocortex. The areas support auditory, visual, and language processing, as well as emotions and memory. The primary auditory cortex is found at the Heschl gyri, which develop early in ontogeny with the Sylvian fissure, a deep and characteristic fissure that separates the temporal lobe from the parietal and frontal lobes. Gyri and sulci as well as brain areas vary between brains and between hemispheres, partly linked to the functional organization of language and lateralization. Interindividual variability in anatomy makes a direct comparison between different brains in structure-functional analysis often challenging, but can be addressed by applying cytoarchitectonic probability maps of the Julich-Brain atlas. We review the macroanatomy of the temporal lobe, its variability and asymmetry at the macro- and the microlevel, discuss the relationship to brain areas and their microstructure, and emphasize the advantage of a multimodal approach to address temporal lobe organization. We review recent data on combined cytoarchitectonic and molecular architectonic studies of temporal areas, and provide links to their function.

BOLD signal response in primary visual cortex to flickering checkerboard increases with stimulus temporal frequency in older adults

Many older adults have difficulty seeing brief visual stimuli which younger adults can easily recognize. The primary visual cortex (V1) may induce this difficulty. However, in neuroimaging studies, the V1 response change to the increase of temporal frequency of visual stimulus in older adults was unclear. Here we investigated the association between the temporal frequency of flickering stimuli and the BOLD activity within V1 in older adults, using surface-based fMRI analysis. The fMRI data from 29 healthy older participants stimulated by contrast-reversing checkerboard at temporal flicker frequencies of 2, 4, and 8 Hz were obtained. The participants also performed a useful field of view (UFOV) test. The slope coefficient of BOLD activity regarding the temporal frequency of the visual stimulus averaged within V1 regions of interest was positive and significantly different from zero. Group analysis in the V1 showed significant clusters with positive slope and no significant clusters with a negative slope. The correlation coefficient between the slope coefficient and UFOV performance was not significant. The results indicated that V1 BOLD response to a flickering visual stimulus increases as the stimulus temporal frequency increases from 2 to 8 Hz in older adults.

Is Developmental Dyslexia Due to a Visual and Not a Phonological Impairment?

It is a widely held belief that developmental dyslexia (DD) is a phonological disorder in which readers have difficulty associating graphemes with their corresponding phonemes. In contrast, the magnocellular theory of dyslexia assumes that DD is a visual disorder caused by dysfunctional magnocellular neural pathways. The review explores arguments for and against these theories. Recent results have shown that DD is caused by (1) a reduced ability to simultaneously recognize sequences of letters that make up words, (2) longer fixation times required to simultaneously recognize strings of letters, and (3) amplitudes of saccades that do not match the number of simultaneously recognized letters. It was shown that pseudowords that could not be recognized simultaneously were recognized almost without errors when the fixation time was extended. However, there is an individual maximum number of letters that each reader with DD can recognize simultaneously. Findings on the neurobiological basis of temporal summation have shown that a necessary prolongation of fixation times is due to impaired processing mechanisms of the visual system, presumably involving magnocells and parvocells. An area in the mid-fusiform gyrus also appears to play a significant role in the ability to simultaneously recognize words and pseudowords. The results also contradict the assumption that DD is due to a lack of eye movement control. The present research does not support the assumption that DD is caused by a phonological disorder but shows that DD is due to a visual processing dysfunction.

Cortical and subcortical signatures of conscious object recognition

The neural mechanisms underlying conscious recognition remain unclear, particularly the roles played by the prefrontal cortex, deactivated brain areas and subcortical regions. We investigated neural activity during conscious object recognition using 7 Tesla fMRI while human participants viewed object images presented at liminal contrasts. Here, we show both recognized and unrecognized images recruit widely distributed cortical and subcortical regions; however, recognized images elicit enhanced activation of visual, frontoparietal, and subcortical networks and stronger deactivation of the default-mode network. For recognized images, object category information can be decoded from all of the involved cortical networks but not from subcortical regions. Phase-scrambled images trigger strong involvement of inferior frontal junction, anterior cingulate cortex and default-mode network, implicating these regions in inferential processing under increased uncertainty. Our results indicate that content-specific activity in both activated and deactivated cortical networks and non-content-specific subcortical activity support conscious recognition.

Cortical and subcortical neural activity supporting conscious object recognition has not yet been well defined. Here, the authors describe these networks and show recognition-related category information can be decoded from widespread cortical activity but not subcortical activity.

Correlated structure of neuronal firing in macaque visual cortex limits information for binocular depth discrimination

Variability in cortical neural activity potentially limits sensory discriminations. Theoretical work shows that information required to discriminate two similar stimuli is limited by the correlation structure of cortical variability. We investigated these information-limiting correlations by recording simultaneously from visual cortical areas primary visual cortex (V1) and extrastriate area V4 in macaque monkeys performing a binocular, stereo depth discrimination task. Within both areas, noise correlations on a rapid temporal scale (20–30 ms) were stronger for neuron pairs with similar selectivity for binocular depth, meaning that these correlations potentially limit information for making the discrimination. Between-area correlations (V1 to V4) were different, being weaker for neuron pairs with similar tuning and having a slower temporal scale (100+ ms). Fluctuations in these information-limiting correlations just prior to the detection event were associated with changes in behavioral accuracy. Although these correlations limit the recovery of information about sensory targets, their impact may be curtailed by integrative processing of signals across multiple brain areas.

NEW & NOTEWORTHY Correlated noise reduces the stimulus information in visual cortical neurons during experimental performance of binocular depth discriminations. The temporal scale of these correlations is important. Rapid (20–30 ms) correlations reduce information within and between areas V1 and V4, whereas slow (>100 ms) correlations between areas do not. Separate cortical areas appear to act together to maintain signal fidelity. Rapid correlations reduce the neuronal signal difference between stimuli and adversely affect perceptual discrimination.

Interocular Grouping in Perceptual Rivalry Localized with fMRI

Bistable perception refers to a broad class of dynamically alternating visual illusions that result from ambiguous images. These illusions provide a powerful method to study the mechanisms that determine how visual input is integrated over space and time. Binocular rivalry occurs when subjects view different images in each eye, and a similar experience called stimulus rivalry occurs even when the left and right images are exchanged at a fast rate. Many previous studies have identified with fMRI a network of cortical regions that are recruited during binocular rivalry, relative to non-rivalrous control conditions (termed replay) that use physically changing stimuli to mimic rivalry. However, we show here for the first time that additional cortical areas are activated when subjects experience rivalry with interocular grouping. When interocular grouping occurs, activation levels broadly increase, with a slight shift towards right hemisphere lateralization. Moreover, direct comparison of binocular rivalry with and without grouping highlights strong focused activity in the intraparietal sulcus and lateral occipital areas, such as right-sided retinotopic visual areas LO1 and IP2, as well as activity in left-sided visual areas LO1, and IP0-IP2. The equivalent analyses for comparable stimulus (eye-swap) rivalry showed very similar results; the main difference is greater recruitment of the right superior parietal cortex for binocular rivalry, as previously reported. Thus, we found minimal interaction between the novel networks isolated here for interocular grouping, and those previously attributed to stimulus and binocular rivalry. We conclude that spatial integration (i.e,. image grouping/segmentation) is a key function of lateral occipital/intraparietal cortex that acts similarly on competing binocular stimulus representations, regardless of fast monocular changes.

Guiding functional near-infrared spectroscopy optode-layout design using individual (f)MRI data: effects on signal strength

Significance: Designing optode layouts is an essential step for functional near-infrared spectroscopy (fNIRS) experiments as the quality of the measured signal and the sensitivity to cortical regions-of-interest depend on how optodes are arranged on the scalp. This becomes particularly relevant for fNIRS-based brain-computer interfaces (BCIs), where developing robust systems with few optodes is crucial for clinical applications. Aim: Available resources often dictate the approach researchers use for optode-layout design. We investigated whether guiding optode layout design using different amounts of subject-specific magnetic resonance imaging (MRI) data affects the fNIRS signal quality and sensitivity to brain activation when healthy participants perform mental-imagery tasks typically used in fNIRS-BCI experiments. Approach: We compared four approaches that incrementally incorporated subject-specific MRI information while participants performed mental-calculation, mental-rotation, and inner-speech tasks. The literature-based approach (LIT) used a literature review to guide the optode layout design. The probabilistic approach (PROB) employed individual anatomical data and probabilistic maps of functional MRI (fMRI)-activation from an independent dataset. The individual fMRI (iFMRI) approach used individual anatomical and fMRI data, and the fourth approach used individual anatomical, functional, and vascular information of the same subject (fVASC). Results: The four approaches resulted in different optode layouts and the more informed approaches outperformed the minimally informed approach (LIT) in terms of signal quality and sensitivity. Further, PROB, iFMRI, and fVASC approaches resulted in a similar outcome. Conclusions: We conclude that additional individual MRI data lead to a better outcome, but that not all the modalities tested here are required to achieve a robust setup. Finally, we give preliminary advice to efficiently using resources for developing robust optode layouts for BCI and neurofeedback applications.

Dynamic Stimulation of Visual Cortex Produces Form Vision in Sighted and Blind Humans

A visual cortical prosthesis (VCP) has long been proposed as a strategy for restoring useful vision to the blind, under the assumption that visual percepts of small spots of light produced with electrical stimulation of visual cortex (phosphenes) will combine into coherent percepts of visual forms, like pixels on a video screen. We tested an alternative strategy in which shapes were traced on the surface of visual cortex by stimulating electrodes in dynamic sequence. In both sighted and blind participants, dynamic stimulation enabled accurate recognition of letter shapes predicted by the brain's spatial map of the visual world. Forms were presented and recognized rapidly by blind participants, up to 86 forms per minute. These findings demonstrate that a brain prosthetic can produce coherent percepts of visual forms.

Allocentric representation in the human amygdala and ventral visual stream

The hippocampus and the entorhinal cortex are considered the main brain structures for allocentric representation of the external environment. Here, we show that the amygdala and the ventral visual stream are involved in allocentric representation. Thirty-one young men explored 35 virtual environments during high-resolution functional magnetic resonance imaging (fMRI) of the medial temporal lobe (MTL) and were subsequently tested on recall of the allocentric pattern of the objects in each environment-in other words, the positions of the objects relative to each other and to the outer perimeter. We find increasingly unique brain activation patterns associated with increasing allocentric accuracy in distinct neural populations in the perirhinal cortex, parahippocampal cortex, fusiform cortex, amygdala, hippocampus, and entorhinal cortex. In contrast to the traditional view of a hierarchical MTL network with the hippocampus at the top, we demonstrate, using recently developed graph analyses, a hierarchical allocentric MTL network without a main connector hub.

A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex

Human visual cortex contains many retinotopic and category-specific regions. These brain regions have been the focus of a large body of functional magnetic resonance imaging research, significantly expanding our understanding of visual processing. As studying these regions requires accurate localization of their cortical location, researchers perform functional localizer scans to identify these regions in each individual. However, it is not always possible to conduct these localizer scans. Here, we developed and validated a functional region of interest (ROI) atlas of early visual and category-selective regions in human ventral and lateral occipito-temporal cortex. Results show that for the majority of functionally defined ROIs, cortex-based alignment results in lower between-subject variability compared to nonlinear volumetric alignment. Furthermore, we demonstrate that 1) the atlas accurately predicts the location of an independent dataset of ventral temporal cortex ROIs and other atlases of place selectivity, motion selectivity, and retinotopy. Next, 2) we show that the majority of voxel within our atlas is responding mostly to the labeled category in a left-out subject cross-validation, demonstrating the utility of this atlas. The functional atlas is publicly available (download.brainvoyager.com/data/visfAtlas.zip) and can help identify the location of these regions in healthy subjects as well as populations (e.g., blind people, infants) in which functional localizers cannot be run.

Data-Driven Parcellation Approaches Based on Functional Connectivity of Visual Cortices in Primary Open-Angle Glaucoma

Purpose

Functional changes have been observed between diseased and healthy subjects, and functional brain atlases derived from healthy populations may fail to reflect functional characteristic of the diseased brain. Therefore the aim of this study was to generate a visual atlas based on functional connectivity from primary open-angle glaucoma (POAG) patients and to prove the applicability of the visual atlas in functional connectivity and network analysis.

Methods

Functional magnetic resonance images were acquired from 36 POAG patients and 20 healthy controls. Two data-driven approaches, K-means and Ward clustering algorithms, were adopted for visual cortices parcellation. Dice coefficient and adjusted Rand index were used to assess reproducibility of the two approaches. Homogeneity index, silhouette coefficient, and network properties were adopted to assess functional validity for the data-driven approaches and frequently used brain atlas. Graph theoretical analysis was adopted to investigate altered network patterns in POAG patients based on data-driven visual atlas.

Results

Parcellation results demonstrated asymmetric patterns between left and right hemispheres in POAG patients compared with healthy controls. In terms of evaluating metrics, K-means performed better than Ward clustering in reproducibility. Data-driven parcellations outperformed frequently used brain atlases in terms of functional homogeneity and network properties. Graph theoretical analysis revealed that atlases generated by data-driven approaches were more conducive in detecting network alterations between POAG patients and healthy controls.

Conclusions

Our findings suggested that POAG patients experienced functional alterations in the visual cortices. Results also highlighted the necessity of data-driven atlases for functional connectivity and functional network analysis of POAG brain.

Cortical gradients of functional connectivity are robust to state-dependent changes following sleep deprivation

Sleep deprivation leads to significant impairments in cognitive performance and changes to the interactions between large scale cortical networks, yet the hierarchical organization of cortical activity across states is still being explored. We used functional magnetic resonance imaging to assess activations and connectivity during cognitive tasks in 20 healthy young adults, during three states: (i) following a normal night of sleep, (ii) following 24hr of total sleep deprivation, and (iii) after a morning recovery nap. Situating cortical activity during cognitive tasks along hierarchical organizing gradients based upon similarity of functional connectivity patterns, we found that regional variations in task-activations were captured by an axis differentiating areas involved in executive control from default mode regions and paralimbic cortex. After global signal regression, the range of functional differentiation along this axis at baseline was significantly related to decline in working memory performance (2-back task) following sleep deprivation, as well as the extent of recovery in performance following a nap. The relative positions of cortical regions within gradients did not significantly change across states, except for a lesser differentiation of the visual system and increased coupling of the posterior cingulate cortex with executive control areas after sleep deprivation. This was despite a widespread increase in the magnitude of functional connectivity across the cortex following sleep deprivation. Cortical gradients of functional differentiation thus appear relatively insensitive to state-dependent changes following sleep deprivation and recovery, suggesting that there are no large-scale changes in cortical functional organization across vigilance states. Certain features of particular gradient axes may be informative for the extent of decline in performance on more complex tasks following sleep deprivation, and could be beneficial over traditional voxel- or parcel-based approaches in identifying realtionships between state-dependent brain activity and behavior.

Sulcal morphology of ventral temporal cortex is shared between humans and other hominoids

Hominoid-specific brain structures are of particular importance in understanding the evolution of human brain structure and function, as they are absent in mammals that are widely studied in the extended neuroscience field. Recent research indicates that the human fusiform gyrus (FG), which is a hominoid-specific structure critical for complex object recognition, contains a tertiary, longitudinal sulcus (mid-fusiform sulcus, MFS) that bisects the FG into lateral and medial parallel gyri. The MFS is a functional and architectonic landmark in the human brain. Here, we tested if the MFS is specific to the human FG or if the MFS is also identifiable in other hominoids. Using magnetic resonance imaging and cortical surface reconstructions in 30 chimpanzees and 30 humans, we show that the MFS is also present in chimpanzees. The MFS is relatively deeper and cortically thinner in chimpanzees compared to humans. Additional histological analyses reveal that the MFS is not only present in humans and chimpanzees, but also in bonobos, gorillas, orangutans, and gibbons. Taken together, these results reveal that the MFS is a sulcal landmark that is shared between humans and other hominoids. These results require a reconsideration of the sulcal patterning in ventral temporal cortex across hominoids, as well as revise the compensation theory of cortical folding.

Attention control processes that prioritise task execution may come at the expense of incidental memory encoding

Attention underpins episodic memory encoding by gating information processing. However, it is unclear how different forms of attention affect encoding. Using fMRI, we implemented a novel task that separates top-down and bottom-up attention (TDA; BUA) to test how these forms of attention influence encoding. Twenty-seven subjects carried out a scanned incidental encoding task that required semantic categorisation of stimuli. Trials either required visual search (TDA) to locate a target, or the target blinked and captured attention (BUA). After a retention period, subjects performed a surprise recognition test. Univariate analyses showed that ventral visual regions and right hippocampus indexed encoding success. Psychophysiological interaction analyses showed that, during TDA, there was increased coupling between dorsal parietal cortex and fusiform gyrus with encoding failure, and between lateral occipital cortex and fusiform gyrus with encoding success. No significant connectivity modulations were observed during BUA. We propose that increased TDA to objects in space is mediated by parietal cortex and negatively impacts encoding. Also, increases in connectivity within ventral visual cortex index the integration of stimulus features, promoting encoding. Finally, the influences of attention on encoding likely depend on task demands: as cognitive control increases, task execution is emphasised at the expense of memory encoding.

Improving a probabilistic cytoarchitectonic atlas of auditory cortex using a novel method for inter-individual alignment

The human superior temporal plane, the site of the auditory cortex, displays high inter-individual macro-anatomical variation. This questions the validity of curvature-based alignment (CBA) methods for in vivo imaging data. Here, we have addressed this issue by developing CBA+, which is a cortical surface registration method that uses prior macro-anatomical knowledge. We validate this method by using cytoarchitectonic areas on 10 individual brains (which we make publicly available). Compared to volumetric and standard surface registration, CBA+ results in a more accurate cytoarchitectonic auditory atlas. The improved correspondence of micro-anatomy following the improved alignment of macro-anatomy validates the superiority of CBA+ compared to CBA. In addition, we use CBA+ to align in vivo and postmortem data. This allows projection of functional and anatomical information collected in vivo onto the cytoarchitectonic areas, which has the potential to contribute to the ongoing debate on the parcellation of the human auditory cortex.

Julich-Brain: A 3D probabilistic atlas of the human brain’s cytoarchitecture

Cytoarchitecture is a basic principle of microstructural brain parcellation. We introduce Julich-Brain, a three-dimensional atlas containing cytoarchitectonic maps of cortical areas and subcortical nuclei. The atlas is probabilistic, which enables it to account for variations between individual brains. Building such an atlas was highly data- and labor-intensive and required the development of nested, interdependent workflows for detecting borders between brain areas, data processing, provenance tracking, and flexible execution of processing chains to handle large amounts of data at different spatial scales. Full cortical coverage was achieved by the inclusion of gap maps to complement cortical maps. The atlas is dynamic and will be adapted as mapping progresses; it is openly available to support neuroimaging studies as well as modeling and simulation; and it is interoperable, enabling connection to other atlases and resources.

Combined Neural Tuning in Human Ventral Temporal Cortex Resolves the Perceptual Ambiguity of Morphed 2D Images

We have an amazing ability to categorize objects in the world around us. Nevertheless, how cortical regions in human ventral temporal cortex (VTC), which is critical for categorization, support this behavioral ability, is largely unknown. Here, we examined the relationship between neural responses and behavioral performance during the categorization of morphed silhouettes of faces and hands, which are animate categories processed in cortically adjacent regions in VTC. Our results reveal that the combination of neural responses from VTC face- and body-selective regions more accurately explains behavioral categorization than neural responses from either region alone. Furthermore, we built a model that predicts a person's behavioral performance using estimated parameters of brain-behavior relationships from a different group of people. Moreover, we show that this brain-behavior model generalizes to adjacent face- and body-selective regions in lateral occipitotemporal cortex. Thus, while face- and body-selective regions are located within functionally distinct domain-specific networks, cortically adjacent regions from both networks likely integrate neural responses to resolve competing and perceptually ambiguous information from both categories.

Face-sensitive brain responses in the first year of life

Cortical areas in the ventral visual pathway become selectively tuned towards the processing of faces compared to non-face stimuli beginning around 3 months of age and continuing over the first year. Studies using event-related potentials in the EEG (ERPs) have found an ERP component, the N290, that displays specificity for human faces. Other components, such as the P1, P400, and Nc have been studied to a lesser degree in their responsiveness to human faces. However, little is known about the systematic changes in the neural responses to faces during the first year of life, and the localization of these responses in infants' brain. We examined ERP responses to pictures of faces and objects in infants from 4.5 months through 12 months in a cross-sectional study. We investigated the activity of all the components reported to be involved in infant face processing, with particular interest to their amplitude variation and cortical localization. We identified neural regions responsible for the component through the application of cortical source localization methods. We found larger P1 and N290 responses to faces than objects, and these components were localized in the lingual and middle/posterior fusiform gyri, respectively. The amplitude of the P400 was not differentially sensitive to faces over objects. The Nc component was different for faces and objects, was influenced by the infant's attentional state, and localized in medial-anterior brain areas. The implications of these results are discussed in the identification of developmental ERP precursors to face processing.

Ultra-high-resolution fMRI of Human Ventral Temporal Cortex Reveals Differential Representation of Categories and Domains

Human ventral temporal cortex (VTC) is critical for visual recognition. It is thought that this ability is supported by large-scale patterns of activity across VTC that contain information about visual categories. However, it is unknown how category representations in VTC are organized at the submillimeter scale and across cortical depths. To fill this gap in knowledge, we measured BOLD responses in medial and lateral VTC to images spanning 10 categories from five domains (written characters, bodies, faces, places, and objects) at an ultra-high spatial resolution of 0.8 mm using 7 Tesla fMRI in both male and female participants. Representations in lateral VTC were organized most strongly at the general level of domains (e.g., places), whereas medial VTC was also organized at the level of specific categories (e.g., corridors and houses within the domain of places). In both lateral and medial VTC, domain-level and category-level structure decreased with cortical depth, and downsampling our data to standard resolution (2.4 mm) did not reverse differences in representations between lateral and medial VTC. The functional diversity of representations across VTC partitions may allow downstream regions to read out information in a flexible manner according to task demands. These results bridge an important gap between electrophysiological recordings in single neurons at the micron scale in nonhuman primates and standard-resolution fMRI in humans by elucidating distributed responses at the submillimeter scale with ultra-high-resolution fMRI in humans.SIGNIFICANCE STATEMENT Visual recognition is a fundamental ability supported by human ventral temporal cortex (VTC). However, the nature of fine-scale, submillimeter distributed representations in VTC is unknown. Using ultra-high-resolution fMRI of human VTC, we found differential distributed visual representations across lateral and medial VTC. Domain representations (e.g., faces, bodies, places, characters) were most salient in lateral VTC, whereas category representations (e.g., corridors/houses within the domain of places) were equally salient in medial VTC. These results bridge an important gap between electrophysiological recordings in single neurons at a micron scale and fMRI measurements at a millimeter scale.

Effects of Optic Neuritis, T2 Lesions, and Microstructural Diffusion Integrity in the Visual Pathway on Cortical Thickness in Pediatric-Onset Multiple Sclerosis

BACKGROUND AND PURPOSE

Pediatric-onset multiple sclerosis (POMS) is associated with focal inflammatory lesions and the loss of cortical and deep gray matter. Optic neuritis (ON) and white matter (WM) lesions in the visual pathway can directly contribute to visual cortical mantle thinning. We determine the relative contributions of MS insult on anterior and posterior visual pathway integrity.

METHODS

High- and low-contrast visual acuity, optical coherence tomography (OCT), and 3T MRI scans were obtained from 20 POMS patients (10 with remote ON) and 22 age- and sex-matched healthy controls. Cortical mantle thickness was measured using FreeSurfer. Fractional anisotropy (FA) and mean diffusivity were calculated for postchiasmal optic radiations (with and without WM lesions). Groups were compared using Student's t-test (adjusted for multiple comparisons), and simple linear regression was used to investigate interrelationships between measures.

RESULTS

Mean cortical thickness of the whole brain was reduced in patients (2.49 mm) versus controls (2.58 mm, P = .0432) and in the visual cortex (2.07 mm vs. 2.17 mm, P = .0059), although the foveal confluence was spared. Mean FA of the optic radiations was reduced in POMS (.40) versus controls (.43, P = .0042) and correlated with visual cortical mantle thickness in POMS (P = .017). Visual acuity, OCT measures, and lesion volumes in the optic radiations were not associated with cortical mantle thickness.

CONCLUSIONS

POMS negatively impacts the integrity of the anterior visual pathway, but it is the loss of WM integrity that drives anterograde loss of the cortical mantle. Preserved visual acuity and foveal sparing imply some degree of functional and structural resilience.

Functionally Distinct Gamma Range Activity Revealed by Stimulus Tuning in Human Visual Cortex

Neocortical gamma activity has long been hypothesized as a mechanism for synchronizing brain regions to support visual perception and cognition more broadly. Although early studies focused on narrowband gamma oscillations (∼20-60 Hz), recent work has emphasized a more broadband "high-gamma" response (∼70-150+ Hz). These responses are often conceptually or analytically treated as synonymous markers of gamma activity. Using high-density intracranial recordings from the human visual cortex, we challenge this view by showing distinct spectral, temporal, and functional properties of narrow and broadband gamma. Across four experiments, narrowband gamma was strongly selective for gratings and long-wavelength colors, displaying a delayed response onset, sustained temporal profile, and contrast-dependent peak frequency. In addition, induced narrowband gamma oscillations lacked phase consistency across stimulus repetitions and displayed highly focal inter-site synchronization. In contrast, broadband gamma was consistently observed for all presented stimuli, displaying a rapid response onset, transient temporal profile, and invariant spectral properties. We exploited stimulus tuning to highlight the functional dissociation of these distinct signals, reconciling prior inconsistencies across species and stimuli regarding the ubiquity of visual gamma oscillations during natural vision. The occurrence of visual narrowband gamma oscillations, unlike broadband high gamma, appears contingent on specific structural and chromatic stimulus attributes intersecting with the receptive field. Together, these findings have important implications for the study, analysis, and functional interpretation of neocortical gamma-range activity.

Human visual cortex is organized along two genetically opposed hierarchical gradients with unique developmental and evolutionary origins

Human visual cortex is organized with striking consistency across individuals. While recent findings demonstrate an unexpected coupling between functional and cytoarchitectonic regions relative to the folding of human visual cortex, a unifying principle linking these anatomical and functional features of the cortex remains elusive. To fill this gap in knowledge, we combined independent and ground truth measurements of cytoarchitectonic regions and genetic tissue characterization within human occipitotemporal cortex. Using a data-driven approach, we examined whether differential gene expression among cytoarchitectonic areas could contribute to the arealization of occipitotemporal cortex into a hierarchy based on transcriptomics. This approach revealed two opposing gene expression gradients: one that contains a series of genes with expression magnitudes that ascend from posterior (e.g., areas human occipital [hOc]1, hOc2, hOc3, etc.) to anterior cytoarchitectonic areas (e.g., areas fusiform gyrus [FG]1–FG4) and another that contains a separate series of genes that show a descending gradient from posterior to anterior areas. Using data from the living human brain, we show that each of these gradients correlates strongly with variations in measures related to either thickness or myelination of cortex, respectively. We further reveal that these genetic gradients emerge along unique trajectories in human development: the ascending gradient is present at 10–12 gestational weeks, while the descending gradient emerges later (19–24 gestational weeks). Interestingly, it is not until early childhood (before 5 years of age) that the two expression gradients achieve their adult-like mean expression values. Additional analyses in nonhuman primates (NHPs) reveal that homologous genes do not generate the same ascending and descending expression gradients as in humans. We discuss these findings relative to previously proposed hierarchies based on functional and cytoarchitectonic features of visual cortex. Altogether, these findings bridge macroscopic features of human cytoarchitectonic areas in visual cortex with microscopic features of cellular organization and genetic expression, which, despite the complexity of this multiscale correspondence, can be described by a sparse subset (approximately 200) of genes. These findings help pinpoint the genes contributing to healthy cortical development and explicate the cortical biology distinguishing humans from other primates, as well as establishing essential groundwork for understanding future work linking genetic mutations with the function and development of the human brain.

The expression of a sparse subset of human genes forms two opposed gradients that capture the processing hierarchy of visual cortex; these transcription gradients emerge at different points during human development and distinguish human from nonhuman primates.

The neural sources of N170: Understanding timing of activation in face-selective areas

The N170 ERP component has been widely identified as a face-sensitive neural marker. Despite extensive investigations conducted to examine the neural sources of N170, there are two issues in prior literature: (a) few studies used individualized anatomy as head model for the cortical source analysis of the N170, and (b) the relationship between the N170 and face-selective regions from fMRI studies is unclear. Here, we addressed these questions by presenting pictures of faces and houses to the same group of healthy adults and recording structural MRI, fMRI, and high-density ERPs in separate sessions. Source analysis based on the participant's anatomy showed that the middle and posterior fusiform gyri were the primary neural sources for the face-sensitive aspects of the N170. Source analysis based on regions of interest from the fMRI revealed that the fMRI-defined fusiform face area was the major contributor to the N170. The current study suggests that the fusiform gyrus is a major neural contributor to the N170 ERP component and provides further insights about the spatiotemporal characteristics of face processing.

Extensive childhood experience with Pokémon suggests eccentricity drives organization of visual cortex

The functional organization of human high-level visual cortex, such as the face- and place-selective regions, is strikingly consistent across individuals. An unanswered question in neuroscience concerns which dimensions of visual information constrain the development and topography of this shared brain organization. To answer this question, we used functional magnetic resonance imaging to scan a unique group of adults who, as children, had extensive visual experience with Pokémon. These animal-like, pixelated characters are dissimilar from other ecological categories, such as faces and places, along critical dimensions (foveal bias, rectilinearity, size, animacy). We show not only that adults who have Pokémon experience demonstrate distinct distributed cortical responses to Pokémon, but also that the experienced retinal eccentricity during childhood can predict the locus of Pokémon responses in adulthood. These data demonstrate that inherent functional representations in the visual cortex-retinal eccentricity-combined with consistent viewing behaviour of particular stimuli during childhood result in a shared functional topography in adulthood.

Properties of face localizer activations and their application in functional magnetic resonance imaging (fMRI) fingerprinting

Functional localizers are particularly prevalent in functional magnetic resonance imaging (fMRI) studies concerning face processing. In this study, we extend the knowledge on face localizers regarding four important aspects: First, activation differences in occipital and fusiform face areas (OFA/FFA) and amygdala are characterized by increased activation while precuneus and medial prefrontal cortex show decreased deactivation to faces versus control stimuli. The face-selective posterior superior temporal sulcus is a hybrid area exhibiting increased activation within its inferior and decreased deactivation within its superior part. Second, the employed control stimuli can impact on whether a region is classified in group analyses as face-selective or not. We specifically investigated this for recently described cytoarchitectonic subregions of the fusiform cortex (FG-2/FG-4). Averaged activity across voxels in FG-4 was stronger for faces than objects, houses, or landscapes. In FG-2, averaged activity was only significantly stronger in comparison with landscapes, but small peaks within this area were detected for comparison versus objects and houses. Third, reproducibility of individual peak activations is excellent for right FFA and quite good for right OFA, whereas within all other areas it was too low to provide valid information on time-invariant individual peaks. Finally, the fine-grained spatial activation patterns in right OFA and FFA are both time-invariant within each individual and sufficiently different between individuals to enable identification of individual participants with near-perfect precision (fMRI fingerprinting).

Toward a Common Terminology for the Gyri and Sulci of the Human Cerebral Cortex

The gyri and sulci of the human brain were defined by pioneers such as Louis-Pierre Gratiolet and Alexander Ecker, and extensified by, among others, Dejerine (1895) and von Economo and Koskinas (1925). Extensive discussions of the cerebral sulci and their variations were presented by Ono et al. (1990), Duvernoy (1992), Tamraz and Comair (2000), and Rhoton (2007). An anatomical parcellation of the spatially normalized single high resolution T1 volume provided by the Montreal Neurological Institute (MNI; Collins, 1994; Collins et al., 1998) was used for the macroscopical labeling of functional studies (Tzourio-Mazoyer et al., 2002; Rolls et al., 2015). In the standard atlas of the human brain by Mai et al. (2016), the terminology from Mai and Paxinos (2012) is used. It contains an extensively analyzed individual brain hemisphere in the MNI-space. A recent revision of the terminology on the central nervous system in the Terminologia Anatomica (TA, 1998) was made by the Working Group Neuroanatomy of the Federative International Programme for Anatomical Terminology (FIPAT) of the International Federation of Associations of Anatomists (IFAA), and posted online as the Terminologia Neuroanatomica (TNA, 2017: http://FIPAT.library.dal.ca) as the official FIPAT terminology. This review deals with the various terminologies for the cerebral gyri and sulci, aiming for a common terminology.

Converging evidence for functional and structural segregation within the left ventral occipitotemporal cortex in reading

The ventral occipitotemporal cortex (vOTC) is crucial for recognizing visual patterns, and previous evidence suggests that there may be different subregions within the vOTC involved in the rapid identification of word forms. Here, we characterize vOTC reading circuitry using a multimodal approach combining functional, structural, and quantitative MRI and behavioral data. Two main word-responsive vOTC areas emerged: a posterior area involved in visual feature extraction, structurally connected to the intraparietal sulcus via the vertical occipital fasciculus; and an anterior area involved in integrating information with other regions of the language network, structurally connected to the angular gyrus via the posterior arcuate fasciculus. Furthermore, functional activation in these vOTC regions predicted reading behavior outside of the scanner. Differences in the microarchitectonic properties of gray-matter cells in these segregated areas were also observed, in line with earlier cytoarchitectonic evidence. These findings advance our understanding of the vOTC circuitry by linking functional responses to anatomical structure, revealing the pathways of distinct reading-related processes.

The functional neuroanatomy of face perception: from brain measurements to deep neural networks

A central goal in neuroscience is to understand how processing within the ventral visual stream enables rapid and robust perception and recognition. Recent neuroscientific discoveries have significantly advanced understanding of the function, structure and computations along the ventral visual stream that serve as the infrastructure supporting this behaviour. In parallel, significant advances in computational models, such as hierarchical deep neural networks (DNNs), have brought machine performance to a level that is commensurate with human performance. Here, we propose a new framework using the ventral face network as a model system to illustrate how increasing the neural accuracy of present DNNs may allow researchers to test the computational benefits of the functional architecture of the human brain. Thus, the review (i) considers specific neural implementational features of the ventral face network, (ii) describes similarities and differences between the functional architecture of the brain and DNNs, and (iii) provides a hypothesis for the computational value of implementational features within the brain that may improve DNN performance. Importantly, this new framework promotes the incorporation of neuroscientific findings into DNNs in order to test the computational benefits of fundamental organizational features of the visual system.

Visual brain plasticity induced by central and peripheral visual field loss

Disorders that specifically affect central and peripheral vision constitute invaluable models to study how the human brain adapts to visual deafferentation. We explored cortical changes after the loss of central or peripheral vision. Cortical thickness (CoTks) and resting-state cortical entropy (rs-CoEn), as a surrogate for neural and synaptic complexity, were extracted in 12 Stargardt macular dystrophy, 12 retinitis pigmentosa (tunnel vision stage), and 14 normally sighted subjects. When compared to controls, both groups with visual loss exhibited decreased CoTks in dorsal area V3d. Peripheral visual field loss also showed a specific CoTks decrease in early visual cortex and ventral area V4, while central visual field loss in dorsal area V3A. Only central visual field loss exhibited increased CoEn in LO-2 area and FG1. Current results revealed biomarkers of brain plasticity within the dorsal and the ventral visual streams following central and peripheral visual field defects.

The Functional Neuroanatomy of Human Face Perception

Face perception is critical for normal social functioning and is mediated by a network of regions in the ventral visual stream. In this review, we describe recent neuroimaging findings regarding the macro- and microscopic anatomical features of the ventral face network, the characteristics of white matter connections, and basic computations performed by population receptive fields within face-selective regions composing this network. We emphasize the importance of the neural tissue properties and white matter connections of each region, as these anatomical properties may be tightly linked to the functional characteristics of the ventral face network. We end by considering how empirical investigations of the neural architecture of the face network may inform the development of computational models and shed light on how computations in the face network enable efficient face perception.

Data on a cytoarchitectonic brain atlas: effects of brain template and a comparison to a multimodal atlas

The data presented here are related to the research article: “A cross-validated cytoarchitectonic atlas of the human ventral visual stream” in which we developed a cytoarchitectonic atlas of ventral visual cortex. Here, we provide two additional quantifications of this cytoarchitectonic atlas: First, we quantify the effect of brain template on cross-validation performance. The data show a comparison between cortex-based alignment to two templates: the postmortem average brain and the FreeSurfer average brain. Second, we quantify the relationship between this cytoarchitectonic atlas and a recently published multimodal atlas of the human brain (Glasser et al., 2016).