Distributed circuits, not circumscribed centers, mediate visual recognition

Decoding face recognition abilities in the human brain

Why are some individuals better at recognizing faces? Uncovering the neural mechanisms supporting face recognition ability has proven elusive. To tackle this challenge, we used a multimodal data-driven approach combining neuroimaging, computational modeling, and behavioral tests. We recorded the high-density electroencephalographic brain activity of individuals with extraordinary face recognition abilities-super-recognizers-and typical recognizers in response to diverse visual stimuli. Using multivariate pattern analyses, we decoded face recognition abilities from 1 s of brain activity with up to 80% accuracy. To better understand the mechanisms subtending this decoding, we compared representations in the brains of our participants with those in artificial neural network models of vision and semantics, as well as with those involved in human judgments of shape and meaning similarity. Compared to typical recognizers, we found stronger associations between early brain representations of super-recognizers and midlevel representations of vision models as well as shape similarity judgments. Moreover, we found stronger associations between late brain representations of super-recognizers and representations of the artificial semantic model as well as meaning similarity judgments. Overall, these results indicate that important individual variations in brain processing, including neural computations extending beyond purely visual processes, support differences in face recognition abilities. They provide the first empirical evidence for an association between semantic computations and face recognition abilities. We believe that such multimodal data-driven approaches will likely play a critical role in further revealing the complex nature of idiosyncratic face recognition in the human brain.

Language-universal and script-specific factors in the recognition of letters in visual crowding: The effects of lexicality, hemifield, and transitional probabilities in a right-to-left script

Peripheral letter recognition is fundamentally limited not by the visibility of letters but by the spacing between them, i.e., 'crowding'. Crowding imposes a significant constraint on reading, however, the interplay between crowding and reading is not fully understood. Using a letter recognition task in varying display conditions, we investigated the effects of lexicality (words versus pseudowords), visual hemifield, and transitional letter probability (bigram/trigram frequency) among skilled readers (N = 14. and N = 13) in Hebrew - a script read from right to left. We observed two language-universal effects: a lexicality effect and a right hemifield (left hemisphere) advantage, as well as a strong language-specific effect - a left bigram advantage stemming from the right-to-left reading direction of Hebrew. The latter finding suggests that transitional probabilities are essential for parafoveal letter recognition. The results reveal that script-specific contextual information such as letter combination probabilities is used to accurately identify crowded letters.

From Perugino to Picasso revisited: Electrophysiological responses to faces in paintings from different art styles

Behavioral research (Ventura, et al., 2023) suggested that pictorial representations of faces varying along a realism-distortion spectrum elicit holistic processing as natural faces. Whether holistic face neural responses are engaged similarly remains, however, underexplored. In the present study, we evaluated the neural correlates of naturalist and artistic face processing, by exploring electrophysiological responses to faces in photographs versus in four major painting styles. The N170 response to faces in photographs was indistinguishable from that elicited by faces in the renaissance art style (depicting the most realistic faces), whilst both categories elicited larger N170 than faces in other art styles (post-impressionism, expressionism, and cubism), with a gradation in brain activity. The present evidence suggest that visual processing may become finer grained the more the realistic nature of the face. Despite behavioral equivalence, the neural mechanisms for holistic processing of natural faces and faces in diverse art styles are not equivalent.

Neglect dyslexia: whole-word and within-word errors with parafoveal and foveal viewing

Patients with left-sided neglect dyslexia often omit whole words positioned on the left, termed whole-word errors, or commit errors on the left-sided letters of words, termed unilateral paralexias. In addition, the errors have been shown to be exacerbated by simultaneously presented distractors, which has been interpreted as a failure of selective attention. In two experiments, we examined the dependency of these error types on parafoveal versus foveal viewing. The first experiment used a paradigm with parafoveal targets and distractors; the second a paradigm with foveal targets and parafoveal distractors. This enabled a separate evaluation of the influences of stimulus position within an egocentric frame, a two-word allocentric frame, and a within-word allocentric frame. First, regarding whole-word errors, we found the expected spatial and distractor effects with parafoveal targets and distractors. With foveal targets and parafoveal distractors, however, the spatial effect was effectively eliminated. Surprisingly, intrusions from the distractor word were common in distractor conditions. This is consistent with an egocentric account and not a two-word allocentric account. Second, we found that unilateral paralexias remained largely consistent regardless of spatial position or the presence of a distractor. Thus, there is a contrast in spatial and distractor effects between whole-word errors and unilateral paralexias. These results are consistent with three distinct deficits: an egocentric deficit across space resulting in whole-word errors, a failure of selective attention that results in whole-word intrusion errors, and a within-word allocentric deficit resulting in unilateral paralexias.

A new approach to diagnosing and researching developmental prosopagnosia: Excluded cases are impaired too

Developmental prosopagnosia is characterized by severe, lifelong difficulties when recognizing facial identity. Unfortunately, the most common diagnostic assessment (Cambridge Face Memory Test) misses 50-65% of individuals who believe that they have this condition. This results in such excluded cases' absence from scientific knowledge, effect sizes of impairment potentially overestimated, treatment efficacy underrated, and may elicit in them a negative experience of research. To estimate their symptomology and group-level impairments in face processing, we recruited a large cohort who believes that they have prosopagnosia. Matching prior reports, 56% did not meet criteria on the Cambridge Face Memory Test. However, the severity of their prosopagnosia symptoms and holistic perception deficits were comparable to those who did meet criteria. Excluded cases also exhibited face perception and memory impairments that were roughly one standard deviation below neurotypical norms, indicating the presence of objective problems. As the prosopagnosia index correctly classified virtually every case, we propose it should be the primary method for providing a diagnosis, prior to subtype categorization. We present researchers with a plan on how they can analyze these excluded prosopagnosia cases in their future work without negatively impacting their traditional findings. We anticipate such inclusion will enhance scientific knowledge, more accurately estimate effect sizes of impairments and treatments, and identify commonalities and distinctions between these different forms of prosopagnosia. Owing to their atypicalities in visual perception, we recommend that the prosopagnosia index should be used to screen out potential prosopagnosia cases from broader vision research.

Novel approaches to functional lateralization: Assessing information in activity patterns across hemispheres and more accurately identifying structural homologues

Functional lateralization is typically measured by comparing activation levels across the right and left hemispheres of the brain. Significant additional information, however, exists within distributed multi-voxel patterns of activity - a format not detectable by traditional activation-based analysis of functional magnetic resonance imaging (fMRI) data. We introduce and test two methods -one anatomical, one functional- that allow hemispheric information asymmetries to be detected. We first introduce and apply a novel tool that draws on brain 'surface fingerprints' to pair every location in one hemisphere with its hemispheric homologue. We use anatomical data to show that this approach is more accurate than the common distance-from-midline method for comparing bilateral regions. Next, we introduce a complementary analysis method that quantifies multivariate laterality in functional data. This new 'multivariate Laterality Index' (mLI) reflects both quantitative and qualitative information-differences across homologous activity patterns. We apply the technique here to functional data collected as participants viewed faces and non-faces. Using the previously generated surface fingerprints to pair-up homologous searchlights in each hemisphere, we use the novel multivariate laterality technique to identify face-information asymmetries across right and left counterparts of the fusiform gyrus, inferior temporal gyrus, superior parietal lobule, and early visual areas. The typical location of the fusiform face area has greater information asymmetry for faces than for shapes. More generally, we argue that the field should consider an information-based approach to lateralization.

Using representational similarity analysis to reveal category and process specificity in visual object recognition

Cross-condition comparisons on neurodevelopmental conditions are central in neurodiversity research. In the realm of visual perception, the performance of participants with different category-specific disorders such as developmental prosopagnosia (problems with faces) and dyslexia (problems with words) have contributed to understanding of perceptual processes involved in word and face recognition. Alterations in face and word recognition are present in several neurodiverse populations, and improved knowledge about their relationship may increase our understanding of this variability of impairment. The present study investigates organizing principles of visual object processing and their implications for developmental disorders of recognition. Some accounts suggest that distinct mechanisms are responsible for recognizing objects of different categories, while others propose that categories share or even compete for cortical resources. We took an individual differences approach to estimate the relationship between abilities in recognition. Neurotypical participants (N = 97 after outlier exclusion) performed a match-to-sample task with faces, houses, and pseudowords. Either individual features or feature configurations were manipulated. To estimate the separability of visual recognition mechanisms, we used representational similarity analysis (RSA) where correlational matrices for accuracy were compared to predicted data patterns. Recognition abilities separated into face recognition on one hand and house/pseudoword recognition on the other, indicating that face recognition may rely on relatively selective mechanisms in neurotypicals. We also found evidence for a general visual object recognition mechanism, while some combinations of category (faces, houses, words) and processing type (featural, configural) likely rely on additional mechanisms. Developmental conditions may therefore reflect combinations of impaired and intact aspects of specific and general visual object recognition mechanisms, where featural and configural processes for one object category separate from the featural or configural processing of another. More generally, RSA is a promising approach for advancing understanding of neurodiversity, including shared aspects and distinctions between neurodevelopmental conditions of visual recognition.

The words that little by little revealed everything: Neural response to lexical-semantic content during narrative comprehension

The ease with which narratives are understood belies the complexity of the information being conveyed and the cognitive processes that support comprehension. The meanings of the words must be rapidly accessed and integrated with the reader's mental representation of the overarching, unfolding scenario. A broad, bilateral brain network is engaged by this process, but it is not clear how words that vary on specific semantic dimensions, such as ambiguity, emotion, or socialness, engage the semantic, semantic control, or social cognition systems. In the present study, data from 48 participants who listened to The Little Prince audiobook during MRI scanning were selected from the Le Petit Prince dataset. The lexical and semantic content within the narrative was quantified from the transcript words with factor scores capturing Word Length, Semantic Flexibility, Emotional Strength, and Social Impact. These scores, along with word quantity variables, were used to investigate where these predictors co-vary with activation across the brain. In contrast to studies of isolated word processing, large networks were found to co-vary with the lexical and semantic content within the narrative. An increase in semantic content engaged the ventral portion of ventrolateral ATL, consistent with its role as a semantic hub. Decreased semantic content engaged temporal pole and inferior parietal lobule, which may reflect semantic integration. The semantic control network was engaged by words with low Semantic Flexibility, perhaps due to the demand required to process infrequent, less semantically diverse language. Activation in ATL co-varied with an increase in Social Impact, which is consistent with the claim that social knowledge is housed within the neural architecture of the semantic system. These results suggest that current models of language processing may present an impoverished estimate of the neural systems that coordinate to support narrative comprehension, and, by extension, real-world language processing.

Cortical topographic motifs emerge in a self-organized map of object space

The human ventral visual stream has a highly systematic organization of object information, but the causal pressures driving these topographic motifs are highly debated. Here, we use self-organizing principles to learn a topographic representation of the data manifold of a deep neural network representational space. We find that a smooth mapping of this representational space showed many brain-like motifs, with a large-scale organization by animacy and real-world object size, supported by mid-level feature tuning, with naturally emerging face- and scene-selective regions. While some theories of the object-selective cortex posit that these differently tuned regions of the brain reflect a collection of distinctly specified functional modules, the present work provides computational support for an alternate hypothesis that the tuning and topography of the object-selective cortex reflect a smooth mapping of a unified representational space.

Associative white matter tracts selectively predict sensorimotor learning

Human learning is a complex phenomenon that varies greatly among individuals and is related to the microstructure of major white matter tracts in several learning domains, yet the impact of the existing myelination of white matter tracts on future learning outcomes remains unclear. We employed a machine-learning model selection framework to evaluate whether existing microstructure might predict individual differences in the potential for learning a sensorimotor task, and further, if the mapping between the microstructure of major white matter tracts and learning was selective for learning outcomes. We used diffusion tractography to measure the mean fractional anisotropy (FA) of white matter tracts in 60 adult participants who then underwent training and subsequent testing to evaluate learning. During training, participants practiced drawing a set of 40 novel symbols repeatedly using a digital writing tablet. We measured drawing learning as the slope of draw duration over the practice session and visual recognition learning as the performance accuracy in an old/new 2-AFC recognition task. Results demonstrated that the microstructure of major white matter tracts selectively predicted learning outcomes, with left hemisphere pArc and SLF 3 tracts predicting drawing learning and the left hemisphere MDLFspl predicting visual recognition learning. These results were replicated in a repeat, held-out data set and supported with complementary analyses. Overall, results suggest that individual differences in the microstructure of human white matter tracts may be selectively related to future learning outcomes and open avenues of inquiry concerning the impact of existing tract myelination in the potential for learning.

Significance statement

A selective mapping between tract microstructure and future learning has been demonstrated in the murine model and, to our knowledge, has not yet been demonstrated in humans. We employed a data-driven approach that identified only two tracts, the two most posterior segments of the arcuate fasciculus in the left hemisphere, to predict learning a sensorimotor task (drawing symbols) and this prediction model did not transfer to other learning outcomes (visual symbol recognition). Results suggest that individual differences in learning may be selectively related to the tissue properties of major white matter tracts in the human brain.

Faces, English words and Chinese characters: a study of dual-task interference in mono-and bilingual speakers

The many-to-many hypothesis suggests that face and visual-word processing tasks share neural resources in the brain, even though they show opposing hemispheric asymmetries in neuroimaging and neuropsychologic studies. Recently it has been suggested that both stimulus and task effects need to be incorporated into the hypothesis. A recent study found dual-task interference between face and text functions that lateralized to the same hemisphere, but not when they lateralized to different hemispheres. However, it is not clear whether a lack of interference between word and face recognition would occur for other languages, particularly those with a morpho-syllabic script, like Chinese, for which there is some evidence of greater right hemispheric involvement. Here, we used the same technique to probe for dual-task interference between English text, Chinese characters and face recognition. We tested 20 subjects monolingual for English and 20 subjects bilingual for Chinese and English. We replicated the prior result for English text and showed similar results for Chinese text with no evidence of interference with faces. We also did not find interference between Chinese and English text. The results support a view in which reading English words, reading Chinese characters and face identification have minimal sharing of neural resources.

Dysfunctions associated with the intraparietal sulcus and a distributed network in individuals with math learning difficulties: An ALE meta-analysis

Math learning difficulty (MLD) is a learning disorder characterized by persistent impairments in the understanding and application of numbers independent of intelligence or schooling. The current study aims to review existing neuroimaging studies to characterize the neurobiological basis in MLD for their quantity and arithmetic dysfunctions. We identified a total of 24 studies with 728 participants through the literature. Using the activation likelihood estimate (ALE) method, we found that the most consistent neurobiological dysfunction in MLD was observed in the right intraparietal sulcus (IPS) with distinct patterns of the anterior and posterior aspects. Meanwhile, neurobiological dysfunctions were also observed in a distributed network including the fusiform gyrus, inferior temporal gyrus, insula, prefrontal cortex, anterior cingulate cortex, and claustrum. Our results suggest a core dysfunction in the right anterior IPS and left fusiform gyrus with atypically upregulated functions in brain regions for attention, working memory, visual processing, and motivation, serving as the neurobiological basis of MLD.

Hemispheric Asymmetries of Individual Differences in Functional Connectivity

Resting-state fMRI studies have revealed that individuals exhibit stable, functionally meaningful divergences in large-scale network organization. The locations with strongest deviations (called network "variants") have a characteristic spatial distribution, with qualitative evidence from prior reports suggesting that this distribution differs across hemispheres. Hemispheric asymmetries can inform us on constraints guiding the development of these idiosyncratic regions. Here, we used data from the Human Connectome Project to systematically investigate hemispheric differences in network variants. Variants were significantly larger in the right hemisphere, particularly along the frontal operculum and medial frontal cortex. Variants in the left hemisphere appeared most commonly around the TPJ. We investigated how variant asymmetries vary by functional network and how they compare with typical network distributions. For some networks, variants seemingly increase group-average network asymmetries (e.g., the group-average language network is slightly bigger in the left hemisphere and variants also appeared more frequently in that hemisphere). For other networks, variants counter the group-average network asymmetries (e.g., the default mode network is slightly bigger in the left hemisphere, but variants were more frequent in the right hemisphere). Intriguingly, left- and right-handers differed in their network variant asymmetries for the cingulo-opercular and frontoparietal networks, suggesting that variant asymmetries are connected to lateralized traits. These findings demonstrate that idiosyncratic aspects of brain organization differ systematically across the hemispheres. We discuss how these asymmetries in brain organization may inform us on developmental constraints of network variants and how they may relate to functions differentially linked to the two hemispheres.

Intact reading ability despite lacking a canonical visual word form area in an individual born without the left superior temporal lobe

The visual word form area (VWFA), a region canonically located within left ventral temporal cortex (VTC), is specialized for orthography in literate adults presumbly due to its connectivity with frontotemporal language regions. But is a typical, left-lateralized language network critical for the VWFA's emergence? We investigated this question in an individual (EG) born without the left superior temporal lobe but who has normal reading ability. EG showed canonical typical face-selectivity bilateraly but no wordselectivity either in right VWFA or in the spared left VWFA. Moreover, in contrast with the idea that the VWFA is simply part of the language network, no part of EG's VTC showed selectivity to higher-level linguistic processing. Interestingly, EG's VWFA showed reliable multivariate patterns that distinguished words from other categories. These results suggest that a typical left-hemisphere language network is necessary for acanonical VWFA, and that orthographic processing can otherwise be supported by a distributed neural code.

Exploring pattern recognition: what is the relationship between the recognition of words, faces and other objects?

Debate surrounds processes of visual recognition, with no consensus as to whether recognition of distinct object categories (faces, bodies, cars, and words) is domain specific or subserved by domain-general visual recognition mechanisms. Here, we investigated correlations between the performance of 74 participants on recognition tasks for words, faces and other object categories. Participants completed a counter-balanced test battery of the Cambridge Face, Car and Body Parts Memory tests, as well as a standard four category lexical decision task, with response time and recognition accuracy as dependent variables. Results revealed significant correlations across domains for both recognition accuracy and response time, providing some support for domain-general pattern recognition. Further exploration of the data using principal component analysis (PCA) revealed a two-component model for both the response time and accuracy data. However, how the various word and object recognition tasks fitted these components varied considerably but did hint at familiarity/expertise as a common factor. In sum, we argue a complex relationship exists between domain-specific processing and domain-general processing, but that this is shaped by expertise. To further our understanding of pattern recognition, research investigating the recognition of words, faces and other objects in dyslexic individuals is recommended, as is research exploiting neuroimaging methodologies, with excellent temporal resolution, to chart the temporal specifics of different forms of visual pattern recognition.

Functionally and structurally distinct fusiform face area(s) in over 1000 participants

The fusiform face area (FFA) is a widely studied region causally involved in face perception. Even though cognitive neuroscientists have been studying the FFA for over two decades, answers to foundational questions regarding the function, architecture, and connectivity of the FFA from a large (N>1000) group of participants are still lacking. To fill this gap in knowledge, we quantified these multimodal features of fusiform face-selective regions in 1053 participants in the Human Connectome Project. After manually defining over 4,000 fusiform face-selective regions, we report five main findings. First, 68.76% of hemispheres have two cortically separate regions (pFus-faces/FFA-1 and mFus-faces/FFA-2). Second, in 26.69% of hemispheres, pFus-faces/FFA-1 and mFus-faces/FFA-2 are spatially contiguous, yet are distinct based on functional, architectural, and connectivity metrics. Third, pFus-faces/FFA-1 is more face-selective than mFus-faces/FFA-2, and the two regions have distinct functional connectivity fingerprints. Fourth, pFus-faces/FFA-1 is cortically thinner and more heavily myelinated than mFus-faces/FFA-2. Fifth, face-selective patterns and functional connectivity fingerprints of each region are more similar in monozygotic than dizygotic twins and more so than architectural gradients. As we share our areal definitions with the field, future studies can explore how structural and functional features of these regions will inform theories regarding how visual categories are represented in the brain.

Functionally and structurally distinct fusiform face area(s) in over 1000 participants

The fusiform face area (FFA) is a widely studied region causally involved in face perception. Even though cognitive neuroscientists have been studying the FFA for over two decades, answers to foundational questions regarding the function, architecture, and connectivity of the FFA from a large (N>1000) group of participants are still lacking. To fill this gap in knowledge, we quantified these multimodal features of fusiform face-selective regions in 1053 participants in the Human Connectome Project. After manually defining over 4,000 fusiform face-selective regions, we report five main findings. First, 68.76% of hemispheres have two cortically separate regions (pFus-faces/FFA-1 and mFus-faces/FFA-2). Second, in 26.69% of hemispheres, pFus-faces/FFA-1 and mFus-faces/FFA-2 are spatially contiguous, yet are distinct based on functional, architectural, and connectivity metrics. Third, pFus-faces/FFA-1 is more face-selective than mFus-faces/FFA-2, and the two regions have distinct functional connectivity fingerprints. Fourth, pFus-faces/FFA-1 is cortically thinner and more heavily myelinated than mFus-faces/FFA-2. Fifth, face-selective patterns and functional connectivity fingerprints of each region are more similar in monozygotic than dizygotic twins and more so than architectural gradients. As we share our areal definitions with the field, future studies can explore how structural and functional features of these regions will inform theories regarding how visual categories are represented in the brain.

Contrasting domain-general and domain-specific accounts in cognitive neuropsychology: An outline of a new approach with developmental prosopagnosia as a case

The backbone of cognitive neuropsychology is the observation of (double) dissociations in performance between patients, suggesting some degree of independence between cognitive processes (domain specificity). In comparison, observations of associations between disorders/deficits have been deemed less evidential in neuropsychological theorizing about cognitive architecture. The reason is that associations can reflect damage to independent cognitive processes that happen to be mediated by structures commonly affected by the same brain disorder rather than damage to a shared (domain-general) mechanism. Here we demonstrate that it is in principle possible to discriminate between these alternatives by means of a procedure involving large unbiased samples. We exemplify the procedure in the context of developmental prosopagnosia (DP), but the procedure is in principle applicable to all neuropsychological deficits/disorders. A simulation of the procedure on a dataset yields estimates of dissociations/associations that are well in line with existing DP-studies, and also suggests that seemingly selective disorders can reflect damage to both domain-general and domain-specific cognitive processes. However, the simulation also highlights some limitations that should be considered if the procedure is to be applied prospectively. The main advantage of the procedure is that allows for examination of both associations and dissociations in the same sample. Hence, it may help even the balance in the use of associations and dissociations as grounds for neuropsychological theorizing.

The mechanisms supporting holistic perception of words and faces are not independent

The question of whether word and face recognition rely on overlapping or dissociable neural and cognitive mechanisms received considerable attention in the literature. In the present work, we presented words (aligned or misaligned) superimposed on faces (aligned or misaligned) and tested the interference from the unattended stimulus category on holistic processing of the attended category. In Experiment 1, we found that holistic face processing is reduced when a face was overlaid with an unattended, aligned word (processed holistically). In Experiment 2, we found a similar reduction of holistic processing for words when a word was superimposed on an unattended, aligned face (processed holistically). This reciprocal interference effect indicates a trade-off in holistic processing of the two stimuli, consistent with the idea that word and face recognition may rely on non-independent, overlapping mechanisms.

With childhood hemispherectomy, one hemisphere can support—but is suboptimal for—word and face recognition

The right and left cerebral hemispheres are important for face and word recognition, respectively—a specialization that emerges over human development. The question is whether this bilateral distribution is necessary or whether a single hemisphere, be it left or right, can support both face and word recognition. Here, face and word recognition accuracy in patients (median age 16.7 y) with a single hemisphere following childhood hemispherectomy was compared against matched typical controls. In experiment 1, participants viewed stimuli in central vision. Across both face and word tasks, accuracy of both left and right hemispherectomy patients, while significantly lower than controls' accuracy, averaged above 80% and did not differ from each other. To compare patients' single hemisphere more directly to one hemisphere of controls, in experiment 2, participants viewed stimuli in one visual field to constrain initial processing chiefly to a single (contralateral) hemisphere. Whereas controls had higher word accuracy when words were presented to the right than to the left visual field, there was no field/hemispheric difference for faces. In contrast, left and right hemispherectomy patients, again, showed comparable performance to one another on both face and word recognition, albeit significantly lower than controls. Altogether, the findings indicate that a single developing hemisphere, either left or right, may be sufficiently plastic for comparable representation of faces and words. However, perhaps due to increased competition or “neural crowding,” constraining cortical representations to one hemisphere may collectively hamper face and word recognition, relative to that observed in typical development with two hemispheres.

General object-based features account for letter perception

After years of experience, humans become experts at perceiving letters. Is this visual capacity attained by learning specialized letter features, or by reusing general visual features previously learned in service of object categorization? To explore this question, we first measured the perceptual similarity of letters in two behavioral tasks, visual search and letter categorization. Then, we trained deep convolutional neural networks on either 26-way letter categorization or 1000-way object categorization, as a way to operationalize possible specialized letter features and general object-based features, respectively. We found that the general object-based features more robustly correlated with the perceptual similarity of letters. We then operationalized additional forms of experience-dependent letter specialization by altering object-trained networks with varied forms of letter training; however, none of these forms of letter specialization improved the match to human behavior. Thus, our findings reveal that it is not necessary to appeal to specialized letter representations to account for perceptual similarity of letters. Instead, we argue that it is more likely that the perception of letters depends on domain-general visual features.

For over a century, scientists have conducted behavioral experiments to investigate how the visual system recognizes letters, but it has proven difficult to propose a model of the feature space underlying this capacity. Here we leveraged recent advances in machine learning to model a wide variety of features ranging from specialized letter features to general object-based features. Across two large-scale behavioral experiments we find that general object-based features account well for letter perception, and that adding letter specialization did not improve the correspondence to human behavior. It is plausible that the ability to recognize letters largely relies on general visual features unaltered by letter learning.

Distinct response properties between the FFA to faces and the PPA to houses

INTRODUCTION

The object recognition system involves both selectivity to specific object category and invariance to changes in low-level visual features. Mounting neuroimaging evidence supports that brain areas in the ventral temporal cortex, such as the FFA and PPA, respond preferentially to faces and houses, respectively. However, how regions in human ventral temporal cortex partitioned and functionally organized to selectively and invariantly respond to different object categories remains unclear. What are the changes of response properties at the intersection of adjacent but distinctively-selective regions?

METHOD

Here, we conducted an fMRI study and three-pronged analyses to compare the brain mapping relationships between the FFA to faces and the PPA to houses. Specifically, we examined: 1) the response properties of object selectivity to the preferred category; 2) the response properties of invariance to contrast and a concurrently presented non-preferred category; 3) whether there are asymmetrical changes of response properties across the boundary from the FFA to PPA versus from the PPA to FFA.

RESULTS

We found that the response properties of FFA are highly selective and reliably invariant, whereas the responses of PPA vary with the image contrast and concurrently presented face. Moreover, the response properties across the boundary between the FFA and PPA are asymmetrical from face-selective to house-selective relative to from house-selective to face-selective.

CONCLUSIONS

These results convergently revealed distinct response properties between the FFA to faces and the PPA to houses, implying a combination of spatially discrete domain-specific and relatively distributed domain-general organization mapping in human ventral temporal cortex.

Shallow or deep? The impact of orthographic depth on visual processing impairments in developmental dyslexia

The extent to which impaired visual and phonological mechanisms may contribute to the manifestation of developmental dyslexia across orthographies of varying depth has yet to be fully established. By adopting a cross-linguistic approach, the current study aimed to explore the nature of visual and phonological processing in developmental dyslexic readers of shallow (Italian) and deep (English) orthographies, and specifically the characterisation of visual processing deficits in relation to orthographic depth. To achieve this aim, we administered a battery of non-reading visual and phonological tasks. Developmental dyslexics performed worse than typically developing readers on all visual and phonological tasks. Critically, readers of the shallow orthography were disproportionately impaired on visual processing tasks. Our results suggest that the impaired reading and associated deficits observed in developmental dyslexia are anchored by dual impairments to visual and phonological mechanisms that underpin reading, with the magnitude of the visual deficit varying according to orthographic depth.

Lateralization of word and face processing in developmental dyslexia and developmental prosopagnosia

In right-handed adults, face processing is lateralized to the right hemisphere and visual word processing to the left hemisphere. According to the many-to-many account (MTMA) of functional cerebral organization this lateralization pattern is partly dependent on the acquisition of literacy. Hence, the MTMA predicts that: (i) processing of both words and faces should show no or at least less lateralization in individuals with developmental dyslexia compared with controls, and (ii) lateralization in word processing should be normal in individuals with developmental prosopagnosia whereas lateralization in face processing should be absent. To test these hypotheses, 21 right-handed adults with developmental dyslexia and 21 right-handed adults with developmental prosopagnosia performed a divided visual field paradigm with delayed matching of faces, words and cars. Contrary to the predictions, we find that lateralization effects in face processing are within the normal range for both developmental dyslexics and prosopagnosics. Moreover, the group with developmental dyslexia showed right hemisphere lateralization for word processing. We argue that these findings are incompatible with the specific predictions of the MTMA.

Electrophysiological correlates of perceptual prediction error are attenuated in dyslexia

A perceptual adaptation deficit often accompanies reading difficulty in dyslexia, manifesting in poor perceptual learning of consistent stimuli and reduced neurophysiological adaptation to stimulus repetition. However, it is not known how adaptation deficits relate to differences in feedforward or feedback processes in the brain. Here we used electroencephalography (EEG) to interrogate the feedforward and feedback contributions to neural adaptation as adults with and without dyslexia viewed pairs of faces and words in a paradigm that manipulated whether there was a high probability of stimulus repetition versus a high probability of stimulus change. We measured three neural dependent variables: expectation (the difference between prestimulus EEG power with and without the expectation of stimulus repetition), feedforward repetition (the difference between event-related potentials (ERPs) evoked by an expected change and an unexpected repetition), and feedback-mediated prediction error (the difference between ERPs evoked by an unexpected change and an expected repetition). Expectation significantly modulated prestimulus theta- and alpha-band EEG in both groups. Unexpected repetitions of words, but not faces, also led to significant feedforward repetition effects in the ERPs of both groups. However, neural prediction error when an unexpected change occurred instead of an expected repetition was significantly weaker in dyslexia than the control group for both faces and words. These results suggest that the neural and perceptual adaptation deficits observed in dyslexia reflect the failure to effectively integrate perceptual predictions with feedforward sensory processing. In addition to reducing perceptual efficiency, the attenuation of neural prediction error signals would also be deleterious to the wide range of perceptual and procedural learning abilities that are critical for developing accurate and fluent reading skills.

A connectivity-constrained computational account of topographic organization in primate high-level visual cortex

Inferotemporal (IT) cortex in humans and other primates is topographically organized, containing multiple hierarchically organized areas selective for particular domains, such as faces and scenes. This organization is commonly viewed in terms of evolved domain-specific visual mechanisms. Here, we develop an alternative, domain-general and developmental account of IT cortical organization. The account is instantiated in interactive topographic networks (ITNs), a class of computational models in which a hierarchy of model IT areas, subject to biologically plausible connectivity-based constraints, learns high-level visual representations optimized for multiple domains. We find that minimizing a wiring cost on spatially organized feedforward and lateral connections, alongside realistic constraints on the sign of neuronal connectivity within model IT, results in a hierarchical, topographic organization. This organization replicates a number of key properties of primate IT cortex, including the presence of domain-selective spatial clusters preferentially involved in the representation of faces, objects, and scenes; columnar responses across separate excitatory and inhibitory units; and generic spatial organization whereby the response correlation of pairs of units falls off with their distance. We thus argue that topographic domain selectivity is an emergent property of a visual system optimized to maximize behavioral performance under generic connectivity-based constraints.

The effects of stimulus inversion on the neural representations of Chinese character and face recognition

This study investigates whether stimulus inversion influences neural responses of Chinese character recognition similarly to its effect on face recognition in category-selective and object-related brain areas using functional magnetic resonance imaging. Participants performed a one-back matching task for simple (one radical) and compound (two radicals) Chinese characters and faces with upright and inverted orientations. Inverted stimuli produced slower response times with stronger activity within the fusiform gyrus (FG) than upright stimuli for faces and Chinese characters. While common inversion-related activation was identified in the left FG among stimulus types, we observed a significant inter-regional correlation between the left FG and the intraparietal sulcus for face inversion. Importantly, analyses of region-of-interest (ROI) multivariate pattern classification showed that classifiers trained on face inversion can decode the representations of character inversion in the character-selective ROI. However, this was not true for face inversion in face-selective ROIs when the classifiers were trained on characters. Similar activity patterns for character and face inversion were observed in the object-related ROIs. We also showed higher decoding accuracy for upright stimuli in the face-selective ROI than in the character-selective ROI but this was not true for inverted ones or when patterns were examined in the object-related ROIs. Together, our results support shared and distinct configural representations for character and face recognition in category-selective and object-related brain areas.

Face processing in the temporal lobe

Face perception is a socially important but complex process with many stages and many facets. There is substantial evidence from many sources that it involves a large extent of the temporal lobe, from the ventral occipitotemporal cortex and superior temporal sulci to anterior temporal regions. While early human neuroimaging work suggested a core face network consisting of the occipital face area, fusiform face area, and posterior superior temporal sulcus, studies in both humans and monkeys show a system of face patches stretching from posterior to anterior in both the superior temporal sulcus and inferotemporal cortex. Sophisticated techniques such as fMRI adaptation have shown that these face-activated regions show responses that have many of the attributes of human face processing. Lesions of some of these regions in humans lead to variants of prosopagnosia, the inability to recognize the identity of a face. Lesion, imaging, and electrophysiologic data all suggest that there is a segregation between identity and expression processing, though some suggest this may be better characterized as a distinction between static and dynamic facial information.

From Action to Cognition: Neural Reuse, Network Theory and the Emergence of Higher Cognitive Functions

The aim of this article is to discuss the logic and assumptions behind the concept of neural reuse, to explore its biological advantages and to discuss the implications for the cognition of a brain that reuses existing circuits and resources. We first address the requirements that must be fulfilled for neural reuse to be a biologically plausible mechanism. Neural reuse theories generally take a developmental approach and model the brain as a dynamic system composed of highly flexible neural networks. They often argue against domain-specificity and for a distributed, embodied representation of knowledge, which sets them apart from modular theories of mental processes. We provide an example of reuse by proposing how a phylogenetically more modern mental capacity (mental rotation) may appear through the reuse and recombination of existing resources from an older capacity (motor planning). We conclude by putting arguments into context regarding functional modularity, embodied representation, and the current ontology of mental processes.

Dissociated face- and word-selective intracerebral responses in the human ventral occipito-temporal cortex

The extent to which faces and written words share neural circuitry in the human brain is actively debated. Here, we compare face-selective and word-selective responses in a large group of patients (N = 37) implanted with intracerebral electrodes in the ventral occipito-temporal cortex (VOTC). Both face-selective (i.e., significantly different responses to faces vs. non-face visual objects) and word-selective (i.e., significantly different responses to words vs. pseudofonts) neural activity is isolated with frequency-tagging. Critically, this sensitive approach allows to objectively quantify category-selective neural responses and disentangle them from general visual responses. About 70% of significant electrode contacts show either face-selectivity or word-selectivity only, with the expected right and left hemispheric dominance, respectively. Spatial dissociations are also found within core regions of face and word processing, with a medio-lateral dissociation in the fusiform gyrus (FG) and surrounding sulci, respectively. In the 30% of overlapping face- and word-selective contacts across the VOTC or in the FG and surrounding sulci, between-category-selective amplitudes (faces vs. words) show no-to-weak correlations, despite strong correlations in both the within-category-selective amplitudes (face-face, word-word) and the general visual responses to words and faces. Overall, these observations support the view that category-selective circuitry for faces and written words is largely dissociated in the human adult VOTC.

Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia

Faces and words are traditionally assumed to be independently processed. Dyslexia is also traditionally thought to be a non-visual deficit. Counter to both ideas, face perception deficits in dyslexia have been reported. Others report no such deficits. We sought to resolve this discrepancy. 60 adults participated in the study (24 dyslexic, 36 typical readers). Feature-based processing and configural or global form processing of faces was measured with a face matching task. Opposite laterality effects in these tasks, dependent on left-right orientation of faces, supported that they tapped into separable visual mechanisms. Dyslexic readers tended to be poorer than typical readers at feature-based face matching while no differences were found for global form face matching. We conclude that word and face perception are associated when the latter requires the processing of visual features of a face, while processing the global form of faces apparently shares minimal-if any-resources with visual word processing. The current results indicate that visual word and face processing are both associated and dissociated-but this depends on what visual mechanisms are task-relevant. We suggest that reading deficits could stem from multiple factors, and that one such factor is a problem with feature-based processing of visual objects.

Featural and configural processing of faces and houses in matched dyslexic and typical readers

While dyslexia is typically described as a phonological deficit, recent evidence suggests that ventral stream regions, important for visual categorization and object recognition, are hypoactive in dyslexic readers who might accordingly show visual recognition deficits. By manipulating featural and configural information of faces and houses, we investigated whether dyslexic readers are disadvantaged at recognizing certain object classes or using particular visual processing mechanisms. Dyslexic readers found it harder to recognize objects (houses), suggesting that visual problems in dyslexia are not completely domain-specific. Face recognition accuracy was equivalent in the two groups. Lower recognition accuracy for houses was also related to reading difficulties even when accuracy for faces was kept constant, which could indicate a specific relationship between visual word processing and visual processing of non-face objects. Representational similarity analyses (RSA) revealed that featural and configural processes were clearly separable in typical readers, which was not the case for dyslexic readers who appear to rely on a single process. This was not restricted to particular visual categories, occurring for both faces and houses. We speculate that reading deficits in some dyslexic readers reflect their reliance on a single process for object recognition.

Face processing predicts reading ability: Evidence from prosopagnosia

There is considerable interest in whether face and word processing are reliant upon shared or dissociable processes. Developmental prosopagnosia is associated with lifelong face processing deficits, with these cases providing strong support for a dissociation between face and word recognition in three recent papers (Burns et al., 2017; Rubino et al., 2016; Starrfelt et al., 2018). However, the sample sizes in each of these studies may have been too small to detect significant effects. We therefore combined their data to increase power and reassessed their results. While only a non-significant trend for reading impairments was found in prosopagnosia using a one-sample t-test, poorer face memory performance was correlated with slower reading speeds across prosopagnosia and control participants. Surprisingly, poorer face perception skills in prosopagnosia were associated with smaller word length effects. This suggests that while mild reading impairments exist in developmental prosopagnosia, there may be a trade-off between their residual face perception abilities and reading skill. A reanalysis of Hills and colleagues' (2015) acquired prosopagnosia data also revealed a positive relationship between words and faces: severe impairments in face recognition were related to poorer word processing. In summary, the developmental and acquired prosopagnosia literature supports models of visual perception that posit face and word processing are reliant upon broadly shared processes.

Whole-object effects in visual word processing: Parallels with and differences from face recognition

Visual words and faces differ in their structural properties, but both are objects of high expertise. Holistic processing is said to characterize expert face recognition, but the extent to which whole-word processes contribute to word recognition is unclear, particularly as word recognition is thought to proceed by a component-based process. We review the evidence for experimental effects in word recognition that parallel those used to support holistic face processing, namely inversion effects, the part-whole task, and composite effects, as well as the status of whole-word processing in pure alexia and developmental dyslexia, contrasts between familiar and unfamiliar languages, and the differences between handwriting and typeset font. The observations support some parallels in whole-object influences between face and visual word recognition, but do not necessarily imply similar expert mechanisms. It remains to be determined whether and how the relative balance between part-based and whole-object processing differs for visual words and faces.

Untangling the Animacy Organization of Occipitotemporal Cortex

Some of the most impressive functional specializations in the human brain are found in the occipitotemporal cortex (OTC), where several areas exhibit selectivity for a small number of visual categories, such as faces and bodies, and spatially cluster based on stimulus animacy. Previous studies suggest this animacy organization reflects the representation of an intuitive taxonomic hierarchy, distinct from the presence of face- and body-selective areas in OTC. Using human functional magnetic resonance imaging, we investigated the independent contribution of these two factors-the face-body division and taxonomic hierarchy-in accounting for the animacy organization of OTC and whether they might also be reflected in the architecture of several deep neural networks that have not been explicitly trained to differentiate taxonomic relations. We found that graded visual selectivity, based on animal resemblance to human faces and bodies, masquerades as an apparent animacy continuum, which suggests that taxonomy is not a separate factor underlying the organization of the ventral visual pathway.SIGNIFICANCE STATEMENT Portions of the visual cortex are specialized to determine whether types of objects are animate in the sense of being capable of self-movement. Two factors have been proposed as accounting for this animacy organization: representations of faces and bodies and an intuitive taxonomic continuum of humans and animals. We performed an experiment to assess the independent contribution of both of these factors. We found that graded visual representations, based on animal resemblance to human faces and bodies, masquerade as an apparent animacy continuum, suggesting that taxonomy is not a separate factor underlying the organization of areas in the visual cortex.

Structural impairments in hippocampal and occipitotemporal networks specifically contribute to decline in place and face category processing but not to other visual object categories in healthy aging

BACKGROUND

Functional neuroimaging studies have identified a set of nodes in the occipital-temporal cortex that preferentially respond to faces in comparison with other visual objects. By contrast, the processing of places seems to rely on parahippocampal cortex and structures heavily implicated in memory (e.g., the hippocampus). It has been suggested that human aging leads to decreased neural specialization of core face and place processing areas and impairments in face and place perception.

METHODS

Using mediation analysis, we tested the potential contribution of micro- and macrostructure within the hippocampal and occipitotemporal systems to age-associated effects in face and place category processing (as measured by 1-back working memory tasks) in 55 healthy adults (age range 23-79 years). To test for specific contributions of the studied structures to face/place processing, we also studied a distinct tract (i.e., the anterior thalamic radiation [ATR]) and cognitive performance for other visual object categories (objects, bodies, and verbal material). Constrained spherical deconvolution-based tractography was used to reconstruct the fornix, the inferior longitudinal fasciculus (ILF), and the ATR. Hippocampal volumetric measures were segmented from FSL-FIRST toolbox.

RESULTS

It was found that age associates with (a) decreases in fractional anisotropy (FA) in the fornix, in right ILF (but not left ILF), and in the ATR (b) reduced volume in the right and left hippocampus and (c) decline in visual object category processing. Importantly, mediation analysis showed that micro- and macrostructural impairments in the fornix and right hippocampus, respectively, associated with age-dependent decline in place processing. Alternatively, microstructural impairments in right hemispheric ILF associated with age-dependent decline in face processing. There were no other mediator effects of micro- and macrostructural variables on age-cognition relationships.

CONCLUSION

Together, the findings support specific contributions of the fornix and right hippocampus in visuospatial scene processing and of the long-range right hemispheric occipitotemporal network in face category processing.

Multiple Adjoining Word- and Face-Selective Regions in Ventral Temporal Cortex Exhibit Distinct Dynamics

The map of category-selectivity in human ventral temporal cortex (VTC) provides organizational constraints to models of object recognition. One important principle is lateral-medial response biases to stimuli that are typically viewed in the center or periphery of the visual field. However, little is known about the relative temporal dynamics and location of regions that respond preferentially to stimulus classes that are centrally viewed, such as the face- and word-processing networks. Here, word- and face-selective regions within VTC were mapped using intracranial recordings from 36 patients. Partially overlapping, but also anatomically dissociable patches of face- and word-selectivity, were found in VTC. In addition to canonical word-selective regions along the left posterior occipitotemporal sulcus, selectivity was also located medial and anterior to face-selective regions on the fusiform gyrus at the group level and within individual male and female subjects. These regions were replicated using 7 Tesla fMRI in healthy subjects. Left hemisphere word-selective regions preceded right hemisphere responses by 125 ms, potentially reflecting the left hemisphere bias for language, with no hemispheric difference in face-selective response latency. Word-selective regions along the posterior fusiform responded first, then spread medially and laterally, then anteriorally. Face-selective responses were first seen in posterior fusiform regions bilaterally, then proceeded anteriorally from there. For both words and faces, the relative delay between regions was longer than would be predicted by purely feedforward models of visual processing. The distinct time courses of responses across these regions, and between hemispheres, suggest that a complex and dynamic functional circuit supports face and word perception.SIGNIFICANCE STATEMENT Representations of visual objects in the human brain have been shown to be organized by several principles, including whether those objects tend to be viewed centrally or peripherally in the visual field. However, it remains unclear how regions that process objects that are viewed centrally, such as words and faces, are organized relative to one another. Here, invasive and noninvasive neuroimaging suggests that there is a mosaic of regions in ventral temporal cortex that respond selectively to either words or faces. These regions display differences in the strength and timing of their responses, both within and between brain hemispheres, suggesting that they play different roles in perception. These results illuminate extended, bilateral, and dynamic brain pathways that support face perception and reading.

Does face-selective cortex show a left visual field bias for centrally-viewed faces?

The left half of a centrally-viewed face contributes more strongly to recognition performance than the right. This left visual field (LVF) advantage is typically attributed to an untested assumption that face-selective cortex in the right hemisphere (RH) exhibits a contralateral bias, even for centrally-viewed faces. We tested the validity of this assumption using a behavioral measure of the LVF advantage and an fMRI experiment that measured laterality of face-selective cortex and neural contralateral bias. In the behavioral experiment, participants performed a chimeric face-matching task (Harrison and Strother, 2019). In the fMRI experiment, participants viewed chimeric faces comprised of face halves that either repeated or changed simultaneously in both hemifields, or repeated in one hemifield and changed in the other. This enabled us to measure lateralization of fMRI face-repetition suppression and hemifield-specific half-face sensitivity in face-selective cortex. We found that LVF bias in the fusiform face area (FFA) and right-lateralization of the FFA for changing versus repeated faces were both positively correlated with a behavioral measure of the LVF advantage for upright (but not inverted) faces. Results from regression analyses showed that LVF bias in the right FFA and FFA laterality make separable contributions to the prediction of our behavioral measure of the LVF bias for upright faces. Our results confirm a ubiquitous but previously untested assumption that RH superiority combined with contralateral bias in face-selective cortex explains the LVF advantage in face recognition. Specifically, our results show that neural LVF bias in the right FFA is sufficient to explain the relationship between FFA laterality and the perceptual LVF bias for centrally-viewed faces.

Neural processing of vision and language in kindergarten is associated with prereading skills and predicts future literacy

The main objective of this longitudinal study was to investigate the neural predictors of reading acquisition. For this purpose, we followed a sample of 54 children from the end of kindergarten to the end of second grade. Preliterate children were tested for visual symbol (checkerboards, houses, faces, written words) and auditory language processing (spoken words) using a passive functional magnetic resonance imaging paradigm. To examine brain-behavior relationships, we also tested cognitive-linguistic prereading skills at kindergarten age and reading performance of 48 of the same children 2 years later. Face-selective response in the bilateral fusiform gyrus was positively associated with rapid automatized naming (RAN). Response to both spoken and written words at preliterate age was negatively associated with RAN in the dorsal temporo-parietal language system. Longitudinally, neural response to faces in the ventral stream predicted future reading fluency. Here, stronger neural activity in inferior and middle temporal gyri at kindergarten age was associated with higher reading performance. Our results suggest that interindividual differences in the neural system of language and reading affect literacy acquisition and thus might serve as a marker for successful reading acquisition in preliterate children.

Complementary deficits in perceptual classification in pure alexia and acquired prosopagnosia - New insights from two classic cases

Pure alexia and prosopagnosia traditionally have been seen as prime examples of dissociated, category-specific agnosias affecting reading and face recognition, respectively. More recent accounts have moved towards domain-independent explanations that postulate potential cross-links between different types of visual agnosia. According to one proposal, abnormal crowding, i.e. the impairment of recognition when features of adjacent objects are positioned too closely to each other, might provide a unified account for the perceptual deficits experienced by an agnosic patient. An alternative approach is based on the notion of complementary visual subsystems favouring the processing of abstract categories and specific exemplars, respectively. To test predictions of these two approaches with regard to pure alexia and prosopagnosia, we present previously unpublished data on digit recognition and visual crowding from two in the neuropsychological literature extensively studied patients, KD and MT (e.g., Campbell et al., 1986; Landis and Regard, 1988; Rentschler et al., 1994). Patient MT, diagnosed with pure alexia, showed pronounced abnormal foveal crowding, whereas KD, diagnosed with prosopagnosia, did not. These results form a distinct double dissociation with the performance of the two patients in other perceptual classification tasks involving Gabor micropatterns and textures, as well as Glass patterns, which revealed a significantly greater impairment in KD relative to MT. Based on an analysis of the specific task demands we argue that prosopagnosia and pure alexia may involve complementary deficits in instantiation and abstraction, respectively, during perceptual classification, beyond any category specificity. Such an explanation appears in line with previous distinctions between a predominantly left-hemispheric, abstract-category and a predominantly right-hemispheric, specific-exemplar subsystem underlying object recognition.

Neural Oscillatory Abnormalities During Gaze Processing in Schizophrenia: Evidence of Reduced Theta Phase Consistency and Inter-areal Theta-Gamma Coupling

BACKGROUND

Abnormal gaze discrimination in schizophrenia (SZ) is associated with impairment in social functioning, but the neural mechanisms remain unclear. Evidence suggests that local neural oscillations and inter-areal communication through neural synchronization are critical physiological mechanisms supporting basic and complex cognitive processes. The roles of these mechanisms in abnormal gaze processing in SZ have not been investigated. The present study examined local neural oscillations and connectivity between anterior and bilateral posterior brain areas during gaze processing.

METHODS

During electroencephalography recording, 28 participants with SZ and 34 healthy control participants completed a gaze discrimination task. Time-frequency decomposition of electroencephalography data was used to examine neural oscillatory power and intertrial phase consistency at bilateral posterior and midline anterior scalp sites. In addition, connectivity between these anterior and posterior sites, in terms of cross-frequency coupling between theta phase and gamma amplitude, was examined using the Kullback-Leibler Modulation Index.

RESULTS

Participants with SZ showed reduced total power of theta-band activity relative to healthy control participants at all sites examined. This group difference could be accounted for by reduced intertrial phase consistency of theta activity in SZ participants, which was related to reduced gaze discrimination accuracy in SZ. In addition, SZ participants exhibited reduced Kullback-Leibler indexing, both feedforward and feedback connectivity, between the posterior and anterior sites.

CONCLUSIONS

These findings suggest that abnormal theta phase consistency and dysconnection between posterior face processing and anterior areas may underlie gaze processing deficits in SZ.

Category-selective deficits are the exception and not the rule: Evidence from a case-series of 64 patients with ventral occipito-temporal cortex damage

The organisational principles of the visual ventral stream are still highly debated, particularly the relative association/dissociation between word and face recognition and the degree of lateralisation of the underlying processes. Reports of dissociations between word and face recognition stem from single case-studies of category selective impairments, and neuroimaging investigations of healthy participants. Despite the historical reliance on single case-studies, more recent group studies have highlighted a greater commonality between word and face recognition. Studying individual patients with rare selective deficits misses (a) important variability between patients, (b) systematic associations between task performance, and (c) patients with mild, severe and/or non-selective impairments; meaning that the full spectrum of deficits is unknown. The Back of the Brain project assessed the range and specificity of visual perceptual impairment in 64 patients with posterior cerebral artery stroke recruited based on lesion localization and not behavioural performance. Word, object, and face processing were measured with comparable tests across different levels of processing to investigate associations and dissociations across domains. We present two complementary analyses of the extensive behavioural battery: (1) a data-driven analysis of the whole patient group, and (2) a single-subject case-series analysis testing for deficits and dissociations in each individual patient. In both analyses, the general organisational principle was of associations between words, objects, and faces even following unilateral lesions. The majority of patients either showed deficits across all domains or in no domain, suggesting a spectrum of visuo-perceptual deficits post stroke. Dissociations were observed, but they were the exception and not the rule: Category-selective impairments were found in only a minority of patients, all of whom showed disproportionate deficits for words. Interestingly, such selective word impairments were found following both left and right hemisphere lesions. This large-scale investigation of posterior cerebral artery stroke patients highlights the bilateral representation of visual perceptual function.

Event-related network changes unfold the dynamics of cortical integration during face processing

Face perception arises from a collective activation of brain regions in the occipital, parietal and temporal cortices. Despite the wide acknowledgment that these regions act in an intertwined network, the network behavior itself is poorly understood. Here we present a study in which time-varying connectivity estimated from EEG activity elicited by facial expressions presentation was characterized using graph-theoretical measures of node centrality and global network topology. Results revealed that face perception results from a dynamic reshaping of the network architecture, characterized by the emergence of hubs located in the occipital and temporal regions of the scalp. The importance of these nodes can be observed from the early stages of visual processing and reaches a climax in the same time-window in which the face-sensitive N170 is observed. Furthermore, using Granger causality, we found that the time-evolving centrality of these nodes is associated with ERP amplitude, providing a direct link between the network state and local neural response. Additionally, investigating global network topology by means of small-worldness and modularity, we found that face processing requires a functional network with a strong small-world organization that maximizes integration, at the cost of segregated subdivisions. Interestingly, we found that this architecture is not static, but instead, it is implemented by the network from stimulus onset to ~200 ms. Altogether, this study reveals the event-related changes underlying face processing at the network level, suggesting that a distributed processing mechanism operates through dynamically weighting the contribution of the cortical regions involved.

Basal Ganglia and Thalamic Contributions to Language Function: Insights from A Parallel Distributed Processing Perspective

Cerebral representations are encoded as patterns of activity involving billions of neurons. Parallel distributed processing (PDP) across these neuronal populations provides the basis for a number of emergent properties: 1) processing occurs and knowledge (long term memories) is stored (as synaptic connection strengths) in exactly the same networks; 2) networks have the capacity for setting into stable attractor states corresponding to concepts, symbols, implicit rules, or data transformations; 3) networks provide the scaffold for the acquisition of knowledge but knowledge is acquired through experience; 4) PDP networks are adept at incorporating the statistical regularities of experience as well as frequency and age of acquisition effects; 5) networks enable content-addressable memory; 6) because knowledge is distributed throughout networks, they exhibit the property of graceful degradation; 7) networks intrinsically provide the capacity for inference. This paper details the features of the basal ganglia and thalamic systems (recurrent and distributed connectivity) that support PDP. The PDP lens and an understanding of the attractor trench dynamics of the basal ganglia provide a natural explanation for the peculiar dysfunctions of Parkinson's disease and the mechanisms by which dopamine deficiency is causal. The PDP lens, coupled with the fact that the basal ganglia of humans bears strong homology to the basal ganglia of lampreys and the central complex of arthropods, reveals that the fundamental function of the basal ganglia is computational and involves the reduction of the vast dimensionality of a complex multi-dimensional array of sensorimotor input into the optimal choice from a small repertoire of behavioral options - the essence of reactive intention (automatic responses to sensory input). There is strong evidence that the sensorimotor basal ganglia make no contributions to cognitive or motor function in humans but can cause serious dysfunction when pathological. It appears that humans, through the course of evolution, have developed cortical capacities (working memory and volitional and reactive attention) for managing sensory input, however complex, that obviate the need for the basal ganglia. The functions of the dorsal tier thalamus, however, even viewed with an understanding of the properties of population encoded representations, remain somewhat more obscure. Possibilities include the enabling of attractor state constellations that optimize function by taking advantage of simultaneous input from multiple cortical areas; selective engagement of cortical representations; and support of the gamma frequency synchrony that enables binding of the multiple network representations that comprise a full concept representation.

Patterns of perceptual performance in developmental prosopagnosia: An in-depth case series

Developmental prosopagnosia (DP) is a syndrome characterized by lifelong impairment in face recognition in the absence of brain damage. A key question regarding DP concerns which process(es) might be affected to selectively/disproportionally impair face recognition. We present evidence from a group of DPs, combining an overview of previous results with additional analyses important for understanding their pattern of preserved and impaired perceptual abilities. We argue that for most of these individuals, the common denominator is a deficit in (rapid) processing of global shape information. We conclude that the deficit in this group of DPs is not face-selective, but that it may appear so because faces are more visually similar-and recognized at a more fine-grained level-than objects. Indeed, when the demand on perceptual differentiation and visual similarity are held constant for faces and objects, we find no evidence for a disproportionate deficit for faces in this group of DPs.