Properties of face localizer activations and their application in functional magnetic resonance imaging (fMRI) fingerprinting

Perception and Memory Reinstatement Engage Overlapping Face-Selective Regions within Human Ventral Temporal Cortex

Humans have the remarkable ability to vividly retrieve sensory details of past events. According to the theory of sensory reinstatement, during remembering, brain regions specialized for processing specific sensory stimuli are reactivated to support content-specific retrieval. Recently, several studies have emphasized transformations in the spatial organization of these reinstated activity patterns. Specifically, studies of scene stimuli suggest a clear anterior shift in the location of retrieval activations compared with the activity observed during perception. However, it is not clear that such transformations occur universally, with inconsistent evidence for other important stimulus categories, particularly faces. One challenge in addressing this question is the careful delineation of face-selective cortices, which are interdigitated with other selective regions, in configurations that spatially differ across individuals. Therefore, we conducted a multisession neuroimaging study to first carefully map individual participants' (nine males and seven females) face-selective regions within ventral temporal cortex (VTC), followed by a second session to examine the activity patterns within these regions during face memory encoding and retrieval. While face-selective regions were expectedly engaged during face perception at encoding, memory retrieval engagement exhibited a more selective and constricted reinstatement pattern within these regions, but did not show any consistent direction of spatial transformation (e.g., anteriorization). We also report on unique human intracranial recordings from VTC under the same experimental conditions. These findings highlight the importance of considering the complex configuration of category-selective cortex in elucidating principles shaping the neural transformations that occur from perception to memory.

Investigating the Influence of Autism Spectrum Traits on Face Processing Mechanisms in Developmental Prosopagnosia

Autism traits are common exclusionary criteria in developmental prosopagnosia (DP) studies. We investigated whether autism traits produce qualitatively different face processing in 43 DPs with high vs. low autism quotient (AQ) scores. Compared to controls (n = 27), face memory and perception were similarly deficient in the high- and low-AQ DPs, with the high-AQ DP group additionally showing deficient face emotion recognition. Task-based fMRI revealed reduced occipito-temporal face selectivity in both groups, with high-AQ DPs additionally demonstrating decreased posterior superior temporal sulcus selectivity. Resting-state fMRI showed similar reduced face-selective network connectivity in both DP groups compared with controls. Together, this demonstrates that high- and low-AQ DP groups have very similar face processing deficits, with additional facial emotion deficits in high-AQ DPs.

Individual-specific memory reinstatement patterns within human face-selective cortex

Humans have the remarkable ability to vividly retrieve sensory details of past events. According to the theory of sensory reinstatement, during remembering, brain regions involved in the sensory processing of prior events are reactivated to support this perception of the past. Recently, several studies have emphasized potential transformations in the spatial organization of reinstated activity patterns. In particular, studies of scene stimuli suggest a clear anterior shift in the location of retrieval activations compared with those during perception. However, it is not clear that such transformations occur universally, with evidence lacking for other important stimulus categories, particularly faces. Critical to addressing these questions, and to studies of reinstatement more broadly, is the growing importance of considering meaningful variations in the organization of sensory systems across individuals. Therefore, we conducted a multi-session neuroimaging study to first carefully map individual participants face-selective regions within ventral temporal cortex (VTC), followed by a second session to examine the correspondence of activity patterns during face memory encoding and retrieval. Our results showed distinct configurations of face-selective regions within the VTC across individuals. While a significant degree of overlap was observed between face perception and memory encoding, memory retrieval engagement exhibited a more selective and constricted reinstatement pattern within these regions. Importantly, these activity patterns were consistently tied to individual-specific neural substrates, but did not show any consistent direction of spatial transformation (e.g., anteriorization). To provide further insight to these findings, we also report on unique human intracranial recordings from VTC under the same experimental conditions. Our findings highlight the importance of considering individual variations in functional neuroanatomy in the context of assessing the nature of cortical reinstatement. Consideration of such factors will be important for establishing general principles shaping the neural transformations that occur from perception to memory.

Imitation encourages empathic capacity toward other individuals with physical disabilities

Many people have difficulty empathizing with others who have dissimilar characteristics, such as physical disabilities. We hypothesized that people with no disabilities imitating the movements of individuals with disabilities could improve the empathic capacity toward their difficulties. To evaluate this hypothesis, we used functional magnetic resonance imaging to measure the neural activity patterns of 26 healthy participants while they felt the difficulties of individuals with hemiplegia by adopting their perspective. The participants initially either imitated or observed hemiplegic hand movements shown in video clips. Subsequently, the videos were rewatched and their difficulties were rated. Analysis of the subjective rating scores indicated that after imitating the hemiplegic movements, the participants felt into the difficulties of hemiplegia better than if they simply observed them. The cross-validation approach of multivoxel pattern analyses demonstrated that the information regarding the effect of imitation on empathizing with the difficulties was represented in specific activation patterns of brain regions involved in the mirror neuron system and cognitive empathy by comparing to other conditions that did not contain the information. The cross-classification approach detected distinct activation patterns in the brain regions involved in affective and cognitive empathy, commonly while imitating the hemiplegic movements and subsequently feeling them. This indicated that the common representation related to these two types of empathy existed between imitating and feeling the hemiplegic movements. Furthermore, representational similarity analysis revealed that activity patterns in the anterior cingulate cortex linked to affective empathy tuned to the subjective assessment of hemiplegic movements. Our findings indicate that imitating the movements of individuals with hemiplegia triggered the affective empathic response and improved the cognitive empathic response toward them. The affective empathic response also linked the subjective assessment to the difficulties of hemiplegia, which was especially modulated by the experience of imitation. Imitating the movements of individuals with disabilities likely encourages empathic capacity from both affective and cognitive aspects, resulting in people with no disabilities precisely feeling what they are feeling.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

Correlates of individual voice and face preferential responses during resting state

Human nonverbal social signals are transmitted to a large extent by vocal and facial cues. The prominent importance of these cues is reflected in specialized cerebral regions which preferentially respond to these stimuli, e.g. the temporal voice area (TVA) for human voices and the fusiform face area (FFA) for human faces. But it remained up to date unknown whether there are respective specializations during resting state, i.e. in the absence of any cues, and if so, whether these representations share neural substrates across sensory modalities. In the present study, resting state functional connectivity (RSFC) as well as voice- and face-preferential activations were analysed from functional magnetic resonance imaging (fMRI) data sets of 60 healthy individuals. Data analysis comprised seed-based analyses using the TVA and FFA as regions of interest (ROIs) as well as multi voxel pattern analyses (MVPA). Using the face- and voice-preferential responses of the FFA and TVA as regressors, we identified several correlating clusters during resting state spread across frontal, temporal, parietal and occipital regions. Using these regions as seeds, characteristic and distinct network patterns were apparent with a predominantly convergent pattern for the bilateral TVAs whereas a largely divergent pattern was observed for the bilateral FFAs. One region in the anterior medial frontal cortex displayed a maximum of supramodal convergence of informative connectivity patterns reflecting voice- and face-preferential responses of both TVAs and the right FFA, pointing to shared neural resources in supramodal voice and face processing. The association of individual voice- and face-preferential neural activity with resting state connectivity patterns may support the perspective of a network function of the brain beyond an activation of specialized regions.

A Genuine Interindividual Variability in Number and Anatomical Localization of Face-Selective Regions in the Human Brain

Neuroimaging studies have reported regions with more neural activation to face than nonface stimuli in the human occipitotemporal cortex for three decades. Here we used a highly sensitive and reliable frequency-tagging functional magnetic resonance imaging paradigm measuring high-level face-selective neural activity to assess interindividual variability in the localization and number of face-selective clusters. Although the majority of these clusters are located in the same cortical gyri and sulci across 25 adult brains, a volume-based analysis of unsmoothed data reveals a large amount of interindividual variability in their spatial distribution and number, particularly in the ventral occipitotemporal cortex. In contrast to the widely held assumption, these face-selective clusters cannot be objectively related on a one-to-one basis across individual brains, do not correspond to a single cytoarchitectonic region, and are not clearly demarcated by estimated posteroanterior cytoarchitectonic borders. Interindividual variability in localization and number of cortical face-selective clusters does not appear to be due to the measurement noise but seems to be genuine, casting doubt on definite labeling and interindividual correspondence of face-selective "areas" and questioning their a priori definition based on cytoarchitectony or probabilistic atlases of independent datasets. These observations challenge conventional models of human face recognition based on a fixed number of discrete neurofunctional information processing stages.

Multi-modal Mapping of the Face Selective Ventral Temporal Cortex-A Group Study With Clinical Implications for ECS, ECoG, and fMRI

Face recognition is impaired in patients with prosopagnosia, which may occur as a side effect of neurosurgical procedures. Face selective regions on the ventral temporal cortex have been localized with electrical cortical stimulation (ECS), electrocorticography (ECoG), and functional magnetic resonance imagining (fMRI). This is the first group study using within-patient comparisons to validate face selective regions mapping, utilizing the aforementioned modalities. Five patients underwent surgical treatment of intractable epilepsy and joined the study. Subdural grid electrodes were implanted on their ventral temporal cortices to localize seizure foci and face selective regions as part of the functional mapping protocol. Face selective regions were identified in all patients with fMRI, four patients with ECoG, and two patients with ECS. From 177 tested electrode locations in the region of interest (ROI), which is defined by the fusiform gyrus and the inferior temporal gyrus, 54 face locations were identified by at least one modality in all patients. fMRI mapping showed the highest detection rate, revealing 70.4% for face selective locations, whereas ECoG and ECS identified 64.8 and 31.5%, respectively. Thus, 28 face locations were co-localized by at least two modalities, with detection rates of 89.3% for fMRI, 85.7% for ECoG and 53.6 % for ECS. All five patients had no face recognition deficits after surgery, even though five of the face selective locations, one obtained by ECoG and the other four by fMRI, were within 10 mm to the resected volumes. Moreover, fMRI included a quite large volume artifact on the ventral temporal cortex in the ROI from the anatomical structures of the temporal base. In conclusion, ECS was not sensitive in several patients, whereas ECoG and fMRI even showed activation within 10 mm to the resected volumes. Considering the potential signal drop-out in fMRI makes ECoG the most reliable tool to identify face selective locations in this study. A multimodal approach can improve the specificity of ECoG and fMRI, while simultaneously minimizing the number of required ECS sessions. Hence, all modalities should be considered in a clinical mapping protocol entailing combined results of co-localized face selective locations.