Aberrant White Matter Development in Cerebral Visual Impairment: A Proposed Mechanism for Visual Dysfunction Following Early Brain Injury

BACKGROUND

Cerebral visual impairment (CVI) is a common sequala of early brain injury, damage, or malformation and is one of the leading individual causes of visual dysfunction in pediatric populations worldwide. Although patients with CVI are heterogeneous both in terms of underlying etiology and visual behavioural manifestations, there may be underlying similarities in terms of which white matter pathways are potentially altered. This exploratory study used diffusion tractography to examine potential differences in volume, quantitative anisotropy (QA), as well as mean, axial, and radial diffusivities (mean diffusivity (MD), axial diffusivity (AD) and radial diffusivity (RD), respectively) focusing on the dorsal and ventral visual stream pathways in a cohort of young adults with CVI compared to typically sighted and developing controls.

METHODS

High angular resolution diffusion imaging (HARDI) data were acquired in a sample of 10 individuals with a diagnosis of CVI (mean age = 17.3 years, 2.97 standard deviation (SD), range 14-22 years) and 17 controls (mean age = 19.82 years, 3.34 SD, range 15-25 years). The inferior longitudinal fasciculus (ILF), inferior fronto-occipital fasciculus (IFOF), vertical occipital fasciculus (VOF), and the three divisions of the superior longitudinal fasciculus (SLF I, II, and III) were virtually reconstructed and average tract volume (adjusted for intracranial volume), MD, AD, and RD were compared between CVI and control groups. As a secondary analysis, an analysis of variance (ANOVA) was carried out to investigate potential differences based on etiology (i.e., CVI due to periventricular leukomalacia (CVI-PVL) and CVI due to other causes (CVI-nonPVL)).

RESULTS

We observed a large degree of variation within the CVI group, which minimized the overall group differences in tractography outcomes when examining the CVI sample as a unitary group. In our secondary analysis, we observed significant reductions in tract volume in the CVI-PVL group compared to both controls and individuals with CVI due to other causes. We also observed widespread significant increases in QA, MD, and AD in CVI-PVL compared to the control group, with mixed effects in the CVI-nonPVL group.

CONCLUSIONS

These data provide preliminary evidence for aberrant development of key white matter fasciculi implicated in visual perceptual processing skills, which are often impaired to varying degrees in individuals with CVI. The results also indicate that the severity and extent of the white matter changes may be due in part to the underlying cause of the cerebral visual impairments. Additional analyses will need to be done in a larger sample alongside behavioural testing to fully appreciate the relationships between white matter integrity, visual dysfunction, and associated causes in individuals with CVI.

Perception and Memory in the Ventral Visual Stream and Medial Temporal Lobe

Perception and memory are traditionally thought of as separate cognitive functions, supported by distinct brain regions. The canonical perspective is that perceptual processing of visual information is supported by the ventral visual stream, whereas long-term declarative memory is supported by the medial temporal lobe. However, this modular framework cannot account for the increasingly large body of evidence that reveals a role for early visual areas in long-term recognition memory and a role for medial temporal lobe structures in high-level perceptual processing. In this article, we review relevant research conducted in humans, nonhuman primates, and rodents. We conclude that the evidence is largely inconsistent with theoretical proposals that draw sharp functional boundaries between perceptual and memory systems in the brain. Instead, the weight of the empirical findings is best captured by a representational-hierarchical model that emphasizes differences in content, rather than in cognitive processes within the ventral visual stream and medial temporal lobe.

Visual recognition in rhesus monkeys requires area TE but not TEO

The primate visual system is often described as a hierarchical feature-conjunction pathway, whereby each level represents an increasingly complex combination of image elements, culminating in the representation of whole coherent images in anterior inferior temporal cortex. Although many models of the ventral visual stream emphasize serial feedforward processing ((Poggio T, Mutch J, Leibo J, Rosasco L, Tacchetti A. The computationalmagic of the ventral stream: sketch of a theory (and why some deep architectures work). TechRep MIT-CSAIL-TR-2012-035. MIT CSAIL, Cambridge, MA. 2012); (Yamins DLK, DiCarlo JJ. Eight open questions in the computational modeling of higher sensory cortex. Curr Opin Neurobiol. 2016:37:114-120.)), anatomical studies show connections that bypass intermediate areas and that feedback to preceding areas ((Distler C, Boussaoud D, Desimone R, Ungerleider LG. Cortical connections of inferior temporal area TEO in macaque monkeys. J Comp Neurol. 1993:334(1):125-150.); (Kravitz DJ, Saleem KS, Baker CI, Mishkin M. A new neural framework for visuospatial processing. Nat Rev Neurosci. 2011:12(4):217-230.)). Prior studies on visual discrimination and object transforms also provide evidence against a strictly feed-forward serial transfer of information between adjacent areas ((Kikuchi R, Iwai E. The locus of the posterior subdivision of the inferotemporal visual learning area in the monkey. Brain Res. 1980:198(2):347-360.); (Weiskrantz L, Saunders RC. Impairments of visual object transforms in monkeys. Brain. 1984:107(4):1033-1072.); (Kar K, DiCarlo JJ. Fast recurrent processing via ventrolateral prefrontal cortex is needed by the primate ventral stream for robust Core visual object recognition. Neuron. 2021:109(1):164-176.e5.)). Thus, we sought to investigate whether behaviorally relevant propagation of visual information is as strictly sequential as sometimes supposed. We compared the accuracy of visual recognition after selective removal of specific subregions of inferior temporal cortex-area TEO, area TE, or both areas combined. Removal of TEO alone had no detectable effect on recognition memory, whereas removal of TE alone produced a large and significant impairment. Combined removal of both areas created no additional deficit relative to removal of TE alone. Thus, area TE is critical for rapid visual object recognition, and detailed image-level visual information can reach area TE via a route other than through TEO.

Hemispheric Patterns of Recruitment of Object Processing Regions in Early Alzheimer's Disease: A Study Along the Entire Ventral Stream

BACKGROUND

Investigation of neural response patterns along the entire network of functionally defined object recognition ventral stream regions in Alzheimer's disease (AD) is surprisingly lacking.

OBJECTIVE

We aimed to investigate putative functional reorganization along a wide-ranging network of known regions in the ventral visual stream in mild AD.

METHODS

Overall we investigated 6 regions of interest (5 of which were not investigated before), in 19 AD patients and 19 controls, in both hemispheres along the ventral visual stream: Fusiform Face Area, Fusiform Body Area, Extrastriate Body Area, Lateral Occipital Cortex, Parahippocampal Place Area, and Visual Word Form Area, while assessing object recognition performance.

RESULTS

We found group differences in dprime measures for all object categories, corroborating generalized deficits in object recognition. Concerning neural responses, we found region dependent group differences respecting a priori expected Hemispheric asymmetries. Patients showed significantly decreased BOLD responses in the right hemisphere-biased Fusiform Body Area, and lower left hemisphere responses in the Visual Word Form Area (with a priori known left hemispheric bias), consistent with deficits in body shape and word/pseudoword processing deficits. This hemispheric dominance related effects were preserved when controlling for performance differences. Whole brain analysis during the recognition task showed enhanced activity in AD group of left dorsolateral prefrontal cortex, left cingulate gyrus, and in the posterior cingulate cortex- a hotspot of amyloid-β accumulation.

CONCLUSION

These findings demonstrate region dependent respecting hemispheric dominance patterns activation changes in independently localized selective regions in mild AD, accompanied by putative compensatory activity of frontal and cingular networks.

Tackling the challenges of group network inference from intracranial EEG data

INTRODUCTION

Intracranial EEG (iEEG) data is a powerful way to map brain function, characterized by high temporal and spatial resolution, allowing the study of interactions among neuronal populations that orchestrate cognitive processing. However, the statistical inference and analysis of brain networks using iEEG data faces many challenges related to its sparse brain coverage, and its inhomogeneity across patients.

METHODS

We review these challenges and develop a methodological pipeline for estimation of network structure not obtainable from any single patient, illustrated on the inference of the interaction among visual streams using a dataset of 27 human iEEG recordings from a visual experiment employing visual scene stimuli. 100 ms sliding window and multiple band-pass filtered signals are used to provide temporal and spectral resolution. For the connectivity analysis we showcase two connectivity measures reflecting different types of interaction between regions of interest (ROI): Phase Locking Value as a symmetric measure of synchrony, and Directed Transfer Function-asymmetric measure describing causal interaction. For each two channels, initial uncorrected significance testing at p < 0.05 for every time-frequency point is carried out by comparison of the data-derived connectivity to a baseline surrogate-based null distribution, providing a binary time-frequency connectivity map. For each ROI pair, a connectivity density map is obtained by averaging across all pairs of channels spanning them, effectively agglomerating data across relevant channels and subjects. Finally, the difference of the mean map value after and before the stimulation is compared to the same statistic in surrogate data to assess link significance.

RESULTS

The analysis confirmed the function of the parieto-medial temporal pathway, mediating visuospatial information between dorsal and ventral visual streams during visual scene analysis. Moreover, we observed the anterior hippocampal connectivity with more posterior areas in the medial temporal lobe, and found the reciprocal information flow between early processing areas and medial place area.

DISCUSSION

To summarize, we developed an approach for estimating network connectivity, dealing with the challenge of sparse individual coverage of intracranial EEG electrodes. Its application provided new insights into the interaction between the dorsal and ventral visual streams, one of the iconic dualities in human cognition.

Neural representational geometry underlies few-shot concept learning

Understanding the neural basis of the remarkable human cognitive capacity to learn novel concepts from just one or a few sensory experiences constitutes a fundamental problem. We propose a simple, biologically plausible, mathematically tractable, and computationally powerful neural mechanism for few-shot learning of naturalistic concepts. We posit that the concepts that can be learned from few examples are defined by tightly circumscribed manifolds in the neural firing-rate space of higher-order sensory areas. We further posit that a single plastic downstream readout neuron learns to discriminate new concepts based on few examples using a simple plasticity rule. We demonstrate the computational power of our proposal by showing that it can achieve high few-shot learning accuracy on natural visual concepts using both macaque inferotemporal cortex representations and deep neural network (DNN) models of these representations and can even learn novel visual concepts specified only through linguistic descriptors. Moreover, we develop a mathematical theory of few-shot learning that links neurophysiology to predictions about behavioral outcomes by delineating several fundamental and measurable geometric properties of neural representations that can accurately predict the few-shot learning performance of naturalistic concepts across all our numerical simulations. This theory reveals, for instance, that high-dimensional manifolds enhance the ability to learn new concepts from few examples. Intriguingly, we observe striking mismatches between the geometry of manifolds in the primate visual pathway and in trained DNNs. We discuss testable predictions of our theory for psychophysics and neurophysiological experiments.

Texture-like representation of objects in human visual cortex

Humans are exquisitely sensitive to the spatial arrangement of visual features in objects and scenes, but not in visual textures. Category-selective regions in the visual cortex are widely believed to underlie object perception, suggesting such regions should distinguish natural images of objects from synthesized images containing similar visual features in scrambled arrangements. Contrarily, we demonstrate that representations in category-selective cortex do not discriminate natural images from feature-matched scrambles but can discriminate images of different categories, suggesting a texture-like encoding. We find similar insensitivity to feature arrangement in Imagenet-trained deep convolutional neural networks. This suggests the need to reconceptualize the role of category-selective cortex as representing a basis set of complex texture-like features, useful for a myriad of behaviors.

The human visual ability to recognize objects and scenes is widely thought to rely on representations in category-selective regions of the visual cortex. These representations could support object vision by specifically representing objects, or, more simply, by representing complex visual features regardless of the particular spatial arrangement needed to constitute real-world objects, that is, by representing visual textures. To discriminate between these hypotheses, we leveraged an image synthesis approach that, unlike previous methods, provides independent control over the complexity and spatial arrangement of visual features. We found that human observers could easily detect a natural object among synthetic images with similar complex features that were spatially scrambled. However, observer models built from BOLD responses from category-selective regions, as well as a model of macaque inferotemporal cortex and Imagenet-trained deep convolutional neural networks, were all unable to identify the real object. This inability was not due to a lack of signal to noise, as all observer models could predict human performance in image categorization tasks. How then might these texture-like representations in category-selective regions support object perception? An image-specific readout from category-selective cortex yielded a representation that was more selective for natural feature arrangement, showing that the information necessary for natural object discrimination is available. Thus, our results suggest that the role of the human category-selective visual cortex is not to explicitly encode objects but rather to provide a basis set of texture-like features that can be infinitely reconfigured to flexibly learn and identify new object categories.

The Effective Connectivity of the Human Hippocampal Memory System

Effective connectivity measurements in the human hippocampal memory system based on the resting-state blood oxygenation-level dependent signal were made in 172 participants in the Human Connectome Project to reveal the directionality and strength of the connectivity. A ventral "what" hippocampal stream involves the temporal lobe cortex, perirhinal and parahippocampal TF cortex, and entorhinal cortex. A dorsal "where" hippocampal stream connects parietal cortex with posterior and retrosplenial cingulate cortex, and with parahippocampal TH cortex, which, in turn, project to the presubiculum, which connects to the hippocampus. A third stream involves the orbitofrontal and ventromedial-prefrontal cortex with effective connectivity with the hippocampal, entorhinal, and perirhinal cortex. There is generally stronger forward connectivity to the hippocampus than backward. Thus separate "what," "where," and "reward" streams can converge in the hippocampus, from which back projections return to the sources. However, unlike the simple dual stream hippocampal model, there is a third stream related to reward value; there is some cross-connectivity between these systems before the hippocampus is reached; and the hippocampus has some effective connectivity with earlier stages of processing than the entorhinal cortex and presubiculum. These findings complement diffusion tractography and provide a foundation for new concepts on the operation of the human hippocampal memory system.

Single-Unit Recordings Reveal the Selectivity of a Human Face Area

The exquisite capacity of primates to detect and recognize faces is crucial for social interactions. Although disentangling the neural basis of human face recognition remains a key goal in neuroscience, direct evidence at the single-neuron level is limited. We recorded from face-selective neurons in human visual cortex in a region characterized by functional magnetic resonance imaging (fMRI) activations for faces compared with objects. The majority of visually responsive neurons in this fMRI activation showed strong selectivity at short latencies for faces compared with objects. Feature-scrambled faces and face-like objects could also drive these neurons, suggesting that this region is not tightly tuned to the visual attributes that typically define whole human faces. These single-cell recordings within the human face processing system provide vital experimental evidence linking previous imaging studies in humans and invasive studies in animal models.SIGNIFICANCE STATEMENT We present the first recordings of face-selective neurons in or near an fMRI-defined patch in human visual cortex. Our unbiased multielectrode array recordings (i.e., no selection of neurons based on a search strategy) confirmed the validity of the BOLD contrast (faces-objects) in humans, a finding with implications for all human imaging studies. By presenting faces, feature-scrambled faces, and face-pareidolia (perceiving faces in inanimate objects) stimuli, we demonstrate that neurons at this level of the visual hierarchy are broadly tuned to the features of a face, independent of spatial configuration and low-level visual attributes.

When the ventral visual stream is not enough: A deep learning account of medial temporal lobe involvement in perception

The medial temporal lobe (MTL) supports a constellation of memory-related behaviors. Its involvement in perceptual processing, however, has been subject to enduring debate. This debate centers on perirhinal cortex (PRC), an MTL structure at the apex of the ventral visual stream (VVS). Here we leverage a deep learning framework that approximates visual behaviors supported by the VVS (i.e., lacking PRC). We first apply this approach retroactively, modeling 30 published visual discrimination experiments: excluding non-diagnostic stimulus sets, there is a striking correspondence between VVS-modeled and PRC-lesioned behavior, while each is outperformed by PRC-intact participants. We corroborate and extend these results with a novel experiment, directly comparing PRC-intact human performance to electrophysiological recordings from the macaque VVS: PRC-intact participants outperform a linear readout of high-level visual cortex. By situating lesion, electrophysiological, and behavioral results within a shared computational framework, this work resolves decades of seemingly inconsistent findings surrounding PRC involvement in perception.

Unsupervised neural network models of the ventral visual stream

Deep neural networks currently provide the best quantitative models of the response patterns of neurons throughout the primate ventral visual stream. However, such networks have remained implausible as a model of the development of the ventral stream, in part because they are trained with supervised methods requiring many more labels than are accessible to infants during development. Here, we report that recent rapid progress in unsupervised learning has largely closed this gap. We find that neural network models learned with deep unsupervised contrastive embedding methods achieve neural prediction accuracy in multiple ventral visual cortical areas that equals or exceeds that of models derived using today's best supervised methods and that the mapping of these neural network models' hidden layers is neuroanatomically consistent across the ventral stream. Strikingly, we find that these methods produce brain-like representations even when trained solely with real human child developmental data collected from head-mounted cameras, despite the fact that these datasets are noisy and limited. We also find that semisupervised deep contrastive embeddings can leverage small numbers of labeled examples to produce representations with substantially improved error-pattern consistency to human behavior. Taken together, these results illustrate a use of unsupervised learning to provide a quantitative model of a multiarea cortical brain system and present a strong candidate for a biologically plausible computational theory of primate sensory learning.

Perceptual processing in the ventral visual stream requires area TE but not rhinal cortex

There is an on-going debate over whether area TE, or the anatomically adjacent rhinal cortex, is the final stage of visual object processing. Both regions have been implicated in visual perception, but their involvement in non-perceptual functions, such as short-term memory, hinders clear-cut interpretation. Here, using a two-interval forced choice task without a short-term memory demand, we find that after bilateral removal of area TE, monkeys trained to categorize images based on perceptual similarity (morphs between dogs and cats), are, on the initial viewing, badly impaired when given a new set of images. They improve markedly with a small amount of practice but nonetheless remain moderately impaired indefinitely. The monkeys with bilateral removal of rhinal cortex are, under all conditions, indistinguishable from unoperated controls. We conclude that the final stage of the integration of visual perceptual information into object percepts in the ventral visual stream occurs in area TE.

Integrative and distinctive coding of visual and conceptual object features in the ventral visual stream

A significant body of research in cognitive neuroscience is aimed at understanding how object concepts are represented in the human brain. However, it remains unknown whether and where the visual and abstract conceptual features that define an object concept are integrated. We addressed this issue by comparing the neural pattern similarities among object-evoked fMRI responses with behavior-based models that independently captured the visual and conceptual similarities among these stimuli. Our results revealed evidence for distinctive coding of visual features in lateral occipital cortex, and conceptual features in the temporal pole and parahippocampal cortex. By contrast, we found evidence for integrative coding of visual and conceptual object features in perirhinal cortex. The neuroanatomical specificity of this effect was highlighted by results from a searchlight analysis. Taken together, our findings suggest that perirhinal cortex uniquely supports the representation of fully specified object concepts through the integration of their visual and conceptual features.

Blindsight and Unconscious Vision: What They Teach Us about the Human Visual System

Damage to the primary visual cortex removes the major input from the eyes to the brain, causing significant visual loss as patients are unable to perceive the side of the world contralateral to the damage. Some patients, however, retain the ability to detect visual information within this blind region; this is known as blindsight. By studying the visual pathways that underlie this residual vision in patients, we can uncover additional aspects of the human visual system that likely contribute to normal visual function but cannot be revealed under physiological conditions. In this review, we discuss the residual abilities and neural activity that have been described in blindsight and the implications of these findings for understanding the intact system.

Cortical Neural Synchronization Underlies Primary Visual Consciousness of Qualia: Evidence from Event-Related Potentials

This article reviews three experiments on event-related potentials (ERPs) testing the hypothesis that primary visual consciousness (stimulus self-report) is related to enhanced cortical neural synchronization as a function of stimulus features. ERP peak latency and sources were compared between "seen" trials and "not seen" trials, respectively related and unrelated to the primary visual consciousness. Three salient features of visual stimuli were considered (visuospatial, emotional face expression, and written words). Results showed the typical visual ERP components in both "seen" and "not seen" trials. There was no statistical difference in the ERP peak latencies between the "seen" and "not seen" trials, suggesting a similar timing of the cortical neural synchronization regardless the primary visual consciousness. In contrast, ERP sources showed differences between "seen" and "not seen" trials. For the visuospatial stimuli, the primary consciousness was related to higher activity in dorsal occipital and parietal sources at about 400 ms post-stimulus. For the emotional face expressions, there was greater activity in parietal and frontal sources at about 180 ms post-stimulus. For the written letters, there was higher activity in occipital, parietal and temporal sources at about 230 ms post-stimulus. These results hint that primary visual consciousness is associated with an enhanced cortical neural synchronization having entirely different spatiotemporal characteristics as a function of the features of the visual stimuli and possibly, the relative qualia (i.e., visuospatial, face expression, and words). In this framework, the dorsal visual stream may be synchronized in association with the primary consciousness of visuospatial and emotional face contents. Analogously, both dorsal and ventral visual streams may be synchronized in association with the primary consciousness of linguistic contents. In this line of reasoning, the ensemble of the cortical neural networks underpinning the single visual features would constitute a sort of multi-dimensional palette of colors, shapes, regions of the visual field, movements, emotional face expressions, and words. The synchronization of one or more of these cortical neural networks, each with its peculiar timing, would produce the primary consciousness of one or more of the visual features of the scene.

The neural representation of Arabic digits in visual cortex

In this study, we investigated how Arabic digits are represented in the visual cortex, and how their representation changes throughout the ventral visual processing stream, compared to the representation of letters. We probed these questions with two functional magnetic resonance imaging (fMRI) experiments. In Experiment 1, we explored whether we could find brain regions that were more activated for digits than for number words in a subtraction task. One such region was detected in lateral occipital cortex. However, the activity in this region might have been confounded by string length—number words contain more characters than digits. We therefore conducted a second experiment in which string length was systematically controlled. Experiment 2 revealed that the findings of the first experiment were task dependent (as it was only observed in a task in which numerosity was relevant) or stimulus dependent (as it was only observed when the number of characters of a stimulus was not controlled). We further explored the characteristics of the activation patterns for digit and letter strings across the ventral visual processing stream through multi-voxel pattern analyses. We found an alteration in representations throughout the ventral processing stream from clustering based on amount of visual information in primary visual cortex (V1) towards clustering based on symbolic stimulus category higher in the visual hierarchy. The present findings converge to the conclusion that in the ventral visual system, as far as can be detected with fMRI, the distinction between Arabic digits and letter strings is represented in terms of distributed patterns rather than separate regions.

Rapid shape detection signals in area V4

Vision in foveate animals is an active process that requires rapid and constant decision-making. For example, when a new object appears in the visual field, we can quickly decide to inspect it by directing our eyes to the object's location. We studied the contribution of primate area V4 to these types of rapid foveation decisions. Animals performed a reaction time task that required them to report when any shape appeared within a peripherally-located noisy stimulus by making a saccade to the stimulus location. We found that about half of the randomly sampled V4 neurons not only rapidly and precisely represented the appearance of this shape, but they were also predictive of the animal's saccades. A neuron's ability to predict the animal's saccades was not related to the specificity with which the cell represented a single type of shape but rather to its ability to signal whether any shape was present. This relationship between sensory sensitivity and behavioral predictiveness was not due to global effects such as alertness, as it was equally likely to be observed for cells with increases and decreases in firing rate. Careful analysis of the timescales of reliability in these neurons implies that they reflect both feedforward and feedback shape detecting processes. In approximately 7% of our recorded sample, individual neurons were able to predict both the delay and precision of the animal's shape detection performance. This suggests that a subset of V4 neurons may have been directly and causally contributing to task performance and that area V4 likely plays a critical role in guiding rapid, form-based foveation decisions.

The Impact of Density and Ratio on Object-Ensemble Representation in Human Anterior-Medial Ventral Visual Cortex

Behavioral research has demonstrated that observers can extract summary statistics from ensembles of multiple objects. We recently showed that a region of anterior-medial ventral visual cortex, overlapping largely with the scene-sensitive parahippocampal place area (PPA), participates in object-ensemble representation. Here we investigated the encoding of ensemble density in this brain region using fMRI-adaptation. In Experiment 1, we varied density by changing the spacing between objects and found no sensitivity in PPA to such density changes. Thus, density may not be encoded in PPA, possibly because object spacing is not perceived as an intrinsic ensemble property. In Experiment 2, we varied relative density by changing the ratio of 2 types of objects comprising an ensemble, and observed significant sensitivity in PPA to such ratio change. Although colorful ensembles were shown in Experiment 2, Experiment 3 demonstrated that sensitivity to object ratio change was not driven mainly by a change in the ratio of colors. Thus, while anterior-medial ventral visual cortex is insensitive to density (object spacing) changes, it does code relative density (object ratio) within an ensemble. Object-ensemble processing in this region may thus depend on high-level visual information, such as object ratio, rather than low-level information, such as spacing/spatial frequency.

Where is human V4? Predicting the location of hV4 and VO1 from cortical folding

A strong relationship between cortical folding and the location of primary sensory areas in the human brain is well established. However, it is unknown if coupling between functional responses and gross anatomy is found at higher stages of sensory processing. We examined the relationship between cortical folding and the location of the retinotopic maps hV4 and VO1, which are intermediate stages in the human ventral visual processing stream. Our data show a consistent arrangement of the eccentricity maps within hV4 and VO1 with respect to anatomy, with the consequence that the hV4/VO1 boundary is found consistently in the posterior transverse collateral sulcus (ptCoS) despite individual variability in map size and cortical folding. Understanding this relationship allowed us to predict the location of visual areas hV4 and VO1 in a separate set of individuals, using only their anatomies, with >85% accuracy. These findings have important implications for understanding the relation between cortical folding and functional maps as well as for defining visual areas from anatomical landmarks alone.

Activity patterns in the category-selective occipitotemporal cortex predict upcoming motor actions

Converging lines of evidence point to the occipitotemporal cortex (OTC) as a critical structure in visual perception. For instance, human functional magnetic resonance imaging (fMRI) has revealed a modular organisation of object-selective, face-selective, body-selective and scene-selective visual areas in the OTC, and disruptions to the processing within these regions, either in neuropsychological patients or through transcranial magnetic stimulation, can produce category-specific deficits in visual recognition. Here we show, using fMRI and pattern classification methods, that the activity in the OTC also represents how stimuli will be interacted with by the body--a level of processing more traditionally associated with the preparatory activity in sensorimotor circuits of the brain. Combining functional mapping of different OTC areas with a real object-directed delayed movement task, we found that the pre-movement spatial activity patterns across the OTC could be used to predict both the action of an upcoming hand movement (grasping vs. reaching) and the effector (left hand vs. right hand) to be used. Interestingly, we were able to extract this wide range of predictive movement information even though nearly all OTC areas showed either baseline-level or below baseline-level activity prior to action onset. Our characterisation of different OTC areas according to the features of upcoming movements that they could predict also revealed a general gradient of effector-to-action-dependent movement representations along the posterior-anterior OTC axis. These findings suggest that the ventral visual pathway, which is well known to be involved in object recognition and perceptual processing, plays a larger than previously expected role in preparing object-directed hand actions.

Higher level visual cortex represents retinotopic, not spatiotopic, object location

The crux of vision is to identify objects and determine their locations in the environment. Although initial visual representations are necessarily retinotopic (eye centered), interaction with the real world requires spatiotopic (absolute) location information. We asked whether higher level human visual cortex-important for stable object recognition and action-contains information about retinotopic and/or spatiotopic object position. Using functional magnetic resonance imaging multivariate pattern analysis techniques, we found information about both object category and object location in each of the ventral, dorsal, and early visual regions tested, replicating previous reports. By manipulating fixation position and stimulus position, we then tested whether these location representations were retinotopic or spatiotopic. Crucially, all location information was purely retinotopic. This pattern persisted when location information was irrelevant to the task, and even when spatiotopic (not retinotopic) stimulus position was explicitly emphasized. We also conducted a "searchlight" analysis across our entire scanned volume to explore additional cortex but again found predominantly retinotopic representations. The lack of explicit spatiotopic representations suggests that spatiotopic object position may instead be computed indirectly and continually reconstructed with each eye movement. Thus, despite our subjective impression that visual information is spatiotopic, even in higher level visual cortex, object location continues to be represented in retinotopic coordinates.

Nonlinear relationships between anxiety and visual processing of own and others' faces in body dysmorphic disorder

Individuals with body dysmorphic disorder (BDD) often experience anxiety, as well as perceptual distortions of appearance. Anxiety has previously been found to impact visual processing. This study therefore tested the relationship between anxiety and visual processing of faces in BDD. Medication-free participants with BDD (N=17) and healthy controls (N=16) viewed photographs of their face and a familiar face during functional magnetic resonance imaging. Blood-oxygen-level dependent signal changes in regions involved in anxiety (amygdala) and detailed visual processing (ventral visual stream-VVS) were regressed on anxiety scores. Significant linear relationships between activity in the amygdala and VVS were found in both healthy controls and individuals with BDD. There was a trend of a quadratic relationship between anxiety and activity in the right VVS and a linear relationship between anxiety and activity in the left VVS for the BDD sample, and this was stronger for own-face stimuli versus familiar-face. Results suggest that anxiety symptoms in BDD may be associated with activity in systems responsible for detailed visual processing. This may have clinical implications related to heightened perceptual distortions associated with anxiety.

Dissociation of sensitivity to spatial frequency in word and face preferential areas of the fusiform gyrus

Different cortical regions within the ventral occipitotemporal junction have been reported to show preferential responses to particular objects. Thus, it is argued that there is evidence for a left-lateralized visual word form area and a right-lateralized fusiform face area, but the unique specialization of these areas remains controversial. Words are characterized by greater power in the high spatial frequency (SF) range, whereas faces comprise a broader range of high and low frequencies. We investigated how these high-order visual association areas respond to simple sine-wave gratings that varied in SF. Using functional magnetic resonance imaging, we demonstrated lateralization of activity that was concordant with the low-level visual property of words and faces; left occipitotemporal cortex is more strongly activated by high than by low SF gratings, whereas the right occipitotemporal cortex responded more to low than high spatial frequencies. Therefore, the SF of a visual stimulus may bias the lateralization of processing irrespective of its higher order properties.

Unsupervised natural visual experience rapidly reshapes size-invariant object representation in inferior temporal cortex

We easily recognize objects and faces across a myriad of retinal images produced by each object. One hypothesis is that this tolerance (a.k.a. "invariance") is learned by relying on the fact that object identities are temporally stable. While we previously found neuronal evidence supporting this idea at the top of the nonhuman primate ventral visual stream (inferior temporal cortex, or IT), we here test if this is a general tolerance learning mechanism. First, we found that the same type of unsupervised experience that reshaped IT position tolerance also predictably reshaped IT size tolerance, and the magnitude of reshaping was quantitatively similar. Second, this tolerance reshaping can be induced under naturally occurring dynamic visual experience, even without eye movements. Third, unsupervised temporal contiguous experience can build new neuronal tolerance. These results suggest that the ventral visual stream uses a general unsupervised tolerance learning algorithm to build its invariant object representation.

Schizophrenia patients show deficits in shifts of attention to different levels of global-local stimuli: evidence for magnocellular dysfunction

Abnormalities of attention and visual perception are well documented in schizophrenia. The global-local task is a measure of attention and perceptual organization that utilizes visual stimuli comprised of large letters (global level) made up of smaller letters (local level). Subjects identify target letters appearing at either the global or local level of the stimulus. In this study, we used a version of the global-local task specifically designed to examine lateralized hemispheric processing and attention shifting in 30 schizophrenia patients and 24 normal controls. Global-local stimuli were presented in couplets (consecutive pairs). Reaction time for the second target in a couplet was compared under conditions in which the target remained at the same level (global-global, local-local) and when the target changed levels (global-local, local-global). Level-specific priming (ie, global to global and local to local) and the local-to-global level shift were similar in both groups. Schizophrenia patients were significantly slower, however, shifting attention from the global to the local level. These results implicate an impairment in shifting attentional resources from predominantly right lateralized magnocellular/dorsal stream processing of global targets to predominantly left lateralized parvocellular/ventral stream processing of local targets. Local interference effects in global processing provide further support for impaired magnocellular processing in schizophrenia patients.

Gender differences in the functional and structural neuroanatomy of mathematical cognition

Despite ongoing debate about the nature of gender differences in mathematics achievement, little is known about gender similarities and differences in mathematical cognition at the neural level. We used fMRI to compare brain responses in 25 females and 24 males during a mental arithmetic task involving 3-operand addition and subtraction. We also used voxel-based morphometry (VBM) to examine gender differences in brain structure. Although females and males did not differ in accuracy or response times (effect size d<0.3), significant gender differences in functional brain activation were observed in the right dorsal and ventral visuospatial information processing streams (d>1.1). Males showed greater dorsal stream activation in the right intra-parietal sulcus areas important for numerical cognition, and angular gyrus regions of the default mode network that are typically deactivated during complex cognitive tasks, as well as greater ventral stream activation in the right lingual and parahippocampal gyri. VBM revealed an opposite pattern of gender differences-compared to males, females had greater regional density and greater regional volume in dorsal and ventral stream regions where males showed greater fMRI activation. There were no brain areas where females showed greater functional activation than males, and no brain areas where males showed greater structural density or volume than females. Our findings provide evidence for gender differences in the functional and structural organization of the right hemisphere brain areas involved in mathematical cognition. Together with the lack of behavioral differences, our results point to more efficient use of neural processing resources in females.

Modulation of the parieto-occipital alpha rhythm during object detection

Changes in the human neuromagnetic alpha rhythm were monitored during an object detection task to study the effects of visual shape processing on the parieto-occipital activity. Pictures of coherent meaningful objects, which the observers had to detect, and of disorganized meaningless non-objects were presented briefly between masks. The non-objects were systematically followed by a higher level of alpha than the objects, the difference emerging on average 400 msec after the stimulus, with a median delay of 130 msec after evoked response onsets in the occipital, temporal, and parietal cortices. Without attention to visual shape, the alpha levels did not differ between objects and non-objects. The alpha level was higher after non-objects than missed objects, and higher after missed than correctly detected objects, suggesting that the alpha level is inversely related to saliency or familiarity of the object and does not directly reflect visual awareness. The reactive alpha rhythm was generated in the parieto-occipital sulcus, which in several primate species includes areas belonging to the dorsal visual pathway. According to current views, the parietal cortex produces attentional signals that filter out irrelevant information in the ventral visual stream. Our results reinforce the idea of bidirectional interaction: information derived from visual shape can rapidly modify activity in the parieto-occipital region. The synchronized alpha oscillations may reflect attenuation of occipito-parietal information transfer and disengagement of parietal cortex from object selection.