Effective connectivities of cortical regions for top-down face processing: a dynamic causal modeling study

Resting-state degree centrality and Granger causality analysis in relation to facial working memory in patients with first-episode schizophrenia

BACKGROUND

This study focused on the relationship between facial working memory and resting-state brain function abnormalities in patients with schizophrenia.

METHODS

Resting-state functional magnetic resonance imaging (rs-fMRI) data were collected from 28 first-episode schizophrenia (FSZ) patients and 33 healthy controls (HCs). Degree centrality (DC) and Granger causality analysis (GCA) were used to assess brain region connectivity. A delayed matching-to-sample task was used to examine visual working memory for faces and houses. Correlations between DC and facial working memory accuracy were analysed. Brain regions were selected as regions of interest (ROIs) and subjected to further GCA. MRI signals of the DC or GCA were extracted and analysed for correlation with clinical symptom scores.

RESULT

The results revealed that FSZ patients presented facial working memory impairments at high loads (t = 2.21, P = 0.03). DC values of the right middle frontal gyrus (MFG) were linked to facial working memory accuracy (P < 0.05, false discovery rate (FDR) correction). GCA indicated inhibited connectivity from the right MFG to the right inferior frontal gyrus (IFG) and right thalamus and from the right postcentral gyrus to the right MFG in FSZ patients (P < 0.05, FDR correction). The DC values of the right thalamus were correlated with negative symptom scores (r = -0.44, P = 0.02) and affective symptom scores (r = -0.57, P < 0.01).

CONCLUSIONS

Our findings suggest that FSZ patients may have impaired facial working memory ability, which may be associated with altered functions in multiple brain regions. Some of these functions are associated with clinical symptoms, which may provide insight into the underlying neural mechanisms of schizophrenia.

A longitudinal study on the impact of high-altitude hypoxia on perceptual processes

This study aimed to explore the neural mechanisms underlying high-altitude (HA) adaptation and deadaptation in perceptual processes in lowlanders. Eighteen healthy lowlanders were administered a facial S1-S2 matching task that included incomplete face (S1) and complete face (S2) photographs combined with ERP technology. Participants were tested at four time points: shortly before they departed the HA (Test 1), twenty-five days after entering the HA (Test 2), and one week (Test 3) and one month (Test 4) after returning to the lowlands. Compared with those at sea level (SL), shorter reaction times (RTs), shorter latencies of P1 and N170, and larger amplitudes of complete face N170 were found in HAs. After returning to SL, compared with that of HA, the amplitude of the incomplete face P1 was smaller after one week, and the complete face was smaller after one month. The right hemisphere N170 amplitude was greater after entering HA and one week after returning to SL than at baseline, but it returned to baseline after one month. Taken together, the current findings suggest that HA adaptation increases visual cortex excitation to accelerate perceptual processing. More mental resources are recruited during the configural encoding stage of complete faces after HA exposure. The perceptual processes affected by HA exposure are reversible after returning to SL, but the low-level processing stage differs between incomplete and complete faces due to neural compensation mechanisms. The configural encoding stage in the right hemisphere is affected by HA exposure and requires more than one week but less than one month to recover to baseline.

Combining electrodermal activity analysis and dynamic causal modeling to investigate the visual-odor multimodal integration during face perception

Objective. This study presents a novel methodological approach for incorporating information related to the peripheral sympathetic response into the investigation of neural dynamics. Particularly, we explore how hedonic contextual olfactory stimuli influence the processing of neutral faces in terms of sympathetic response, event-related potentials and effective connectivity analysis. The objective is to investigate how the emotional valence of odors influences the cortical connectivity underlying face processing and the role of face-induced sympathetic arousal in this visual-olfactory multimodal integration.Approach. To this aim, we combine electrodermal activity (EDA) analysis and dynamic causal modeling to examine changes in cortico-cortical interactions.Results. The results reveal that stimuli arising sympathetic EDA responses are associated with a more negative N170 amplitude, which may be a marker of heightened arousal in response to faces. Hedonic odors, on the other hand, lead to a more negative N1 component and a reduced the vertex positive potential when they are unpleasant or pleasant. Concerning connectivity, unpleasant odors strengthen the forward connection from the inferior temporal gyrus (ITG) to the middle temporal gyrus, which is involved in processing changeable facial features. Conversely, the occurrence of sympathetic responses after a stimulus is correlated with an inhibition of this same connection and an enhancement of the backward connection from ITG to the fusiform face gyrus.Significance. These findings suggest that unpleasant odors may enhance the interpretation of emotional expressions and mental states, while faces capable of eliciting sympathetic arousal prioritize identity processing.

Twenty years of investigation with the case of prosopagnosia PS to understand human face identity recognition. Part II: Neural basis

Patient PS sustained her dramatic brain injury in 1992, the same year as the first report of a neuroimaging study of human face recognition. The present paper complements the review on the functional nature of PS's prosopagnosia (part I), illustrating how her case study directly, i.e., through neuroimaging investigations of her brain structure and activity, but also indirectly, through neural studies performed on other clinical cases and neurotypical individuals, inspired and constrained neural models of human face recognition. In the dominant right hemisphere for face recognition in humans, PS's main lesion concerns (inputs to) the inferior occipital gyrus (IOG), in a region where face-selective activity is typically found in normal individuals ('Occipital Face Area', OFA). Her case study initially supported the criticality of this region for face identity recognition (FIR) and provided the impetus for transcranial magnetic stimulation (TMS), intracerebral electrical stimulation, and cortical surgery studies that have generally supported this view. Despite PS's right IOG lesion, typical face-selectivity is found anteriorly in the middle portion of the fusiform gyrus, a hominoid structure (termed the right 'Fusiform Face Area', FFA) that is widely considered to be the most important region for human face recognition. This finding led to the original proposal of direct anatomico-functional connections from early visual cortices to the FFA, bypassing the IOG/OFA (lulu), a hypothesis supported by further neuroimaging studies of PS, other neurological cases and neuro-typical individuals with original visual stimulation paradigms, data recordings and analyses. The proposal of a lack of sensitivity to face identity in PS's right FFA due to defective reentrant inputs from the IOG/FFA has also been supported by other cases, functional connectivity and cortical surgery studies. Overall, neural studies of, and based on, the case of prosopagnosia PS strongly question the hierarchical organization of the human neural face recognition system, supporting a more flexible and dynamic view of this key social brain function.

"I Spy with my Little Eye, Something that is a Face…": A Brain Network for Illusory Face Detection

The most basic aspect of face perception is simply detecting the presence of a face, which requires the extraction of features that it has in common with other faces. Putatively, it is caused by matching high-dimensional sensory input with internal face templates, achieved through a top-down mediated coupling between prefrontal regions and brain areas in the occipito-temporal cortex ("core system of face perception"). Illusory face detection tasks can be used to study these top-down influences. In the present functional magnetic resonance imaging study, we showed that illusory face perception activated just as real faces the core system, albeit with atypical left-lateralization of the occipital face area. The core system was coupled with two distinct brain regions in the lateral prefrontal (inferior frontal gyrus, IFG) and orbitofrontal cortex (OFC). A dynamic causal modeling (DCM) analysis revealed that activity in the core system during illusory face detection was upregulated by a modulatory face-specific influence of the IFG, not as previously assumed by the OFC. Based on these findings, we were able to develop the most comprehensive neuroanatomical framework of illusory face detection until now.

Anomalous visual experience is linked to perceptual uncertainty and visual imagery vividness

An imbalance between top-down and bottom-up processing on perception (specifically, over-reliance on top-down processing) can lead to anomalous perception, such as illusions. One factor that may be involved in anomalous perception is visual mental imagery, which is the experience of "seeing" with the mind's eye. There are vast individual differences in self-reported imagery vividness, and more vivid imagery is linked to a more sensory-like experience. We, therefore, hypothesized that susceptibility to anomalous perception is linked to individual imagery vividness. To investigate this, we adopted a paradigm that is known to elicit the perception of faces in pure visual noise (pareidolia). In four experiments, we explored how imagery vividness contributes to this experience under different response instructions and environments. We found strong evidence that people with more vivid imagery were more likely to see faces in the noise, although removing suggestive instructions weakened this relationship. Analyses from the first two experiments led us to explore confidence as another factor in pareidolia proneness. We, therefore, modulated environment noise and added a confidence rating in a novel design. We found strong evidence that pareidolia proneness is correlated with uncertainty about real percepts. Decreasing perceptual ambiguity abolished the relationship between pareidolia proneness and both imagery vividness and confidence. The results cannot be explained by incidental face-like patterns in the noise, individual variations in response bias, perceptual sensitivity, subjective perceptual thresholds, viewing distance, testing environments, motivation, gender, or prosopagnosia. This indicates a critical role of mental imagery vividness and perceptual uncertainty in anomalous perceptual experience.

Separate and Shared Neural Basis of Face Memory and Face Perception in Developmental Prosopagnosia

Developmental prosopagnosia (DP), also known as face blindness, is a cognitive disorder with a severe deficit in recognizing faces. However, the heterogeneous nature of DP leads to a longstanding debate on which stages the deficit occurs, face perception (e.g., matching two consecutively presented faces) or face memory (e.g., matching a face to memorized faces). Here, we used the individual difference approach with functional magnetic resonance imaging to explore the neural substrates of DPs' face perception and face memory that may illuminate DPs' heterogeneity. Specifically, we measured the behavioral performance of face perception and face memory in a large sample of individuals suffering DP (N = 64) and then associated the behavioral performance with their face-selective neural responses in the core face network (CFN) and the extended face network (EFN), respectively. Behaviorally, we found that DP individuals were impaired in both face perception and face memory; however, there was only a weak correlation between the performances of two tasks. Consistent with this observation, the neural correlate of DPs' performance in face memory task was localized in the bilateral fusiform face area, whereas DPs' performance in face perception task was correlated with the face selectivity in the right posterior superior temporal sulcus, suggesting that the neural substrates in the CFN for face memory and face perception were separate in DP. In contrast, shared neural substrates of deficits in face perception and face memory tasks were identified in the EFN, including the right precuneus and the right orbitofrontal cortex. In summary, our study provides one of the first empirical evidence that the separate and shared neural substrates of face perception and face memory were identified in the CFN and EFN, respectively, which may help illuminating DP's heterogeneous nature.

Differential Modulation of Effective Connectivity in the Brain's Extended Face Processing System by Fearful and Sad Facial Expressions

The processing of emotional facial expressions is underpinned by the integration of information from a distributed network of brain regions. Despite investigations into how different emotional expressions alter the functional relationships within this network, there remains limited research examining which regions drive these interactions. This study investigated effective connectivity during the processing of sad and fearful facial expressions to better understand how these stimuli differentially modulate emotional face processing circuitry. Ninety-eight healthy human adolescents and young adults, aged between 15 and 25 years, underwent an implicit emotional face processing fMRI task. Using dynamic causal modeling (DCM), we examined five brain regions implicated in face processing. These were restricted to the right hemisphere and included the occipital and fusiform face areas, amygdala, and dorsolateral prefrontal cortex (dlPFC) and ventromedial prefrontal cortex (vmPFC). Processing sad and fearful facial expressions were associated with greater positive connectivity from the amygdala to dlPFC. Only the processing of fearful facial expressions was associated with greater negative connectivity from the vmPFC to amygdala. Compared with processing sad faces, processing fearful faces was associated with significantly greater connectivity from the amygdala to dlPFC. No difference was found between the processing of these expressions and the connectivity from the vmPFC to amygdala. Overall, our findings indicate that connectivity from the amygdala and dlPFC appears to be responding to dimensional features which differ between these expressions, likely those relating to arousal. Further research is necessary to examine whether this relationship is also observable for positively valenced emotions.

Illusory face detection in pure noise images: The role of interindividual variability in fMRI activation patterns

Illusory face detection tasks can be used to study the neural correlates of top-down influences on face perception. In a typical functional magnetic resonance imaging (fMRI) study design, subjects are presented with pure noise images, but are told that half of the stimuli contain a face. The illusory face perception network is assessed by comparing blood oxygenation level dependent (BOLD) responses to images in which a face has been detected against BOLD activity related to images in which no face has been detected. In the present study, we highlight the existence of strong interindividual differences of BOLD activation patterns associated with illusory face perception. In the core system of face perception, 4 of 9 subjects had highly significant (p<0.05, corrected for multiple comparisons) activity in the bilateral occipital face area (OFA) and fusiform face area (FFA). In contrast, 5 of 9 subjects did not show any activity in these regions, even at statistical thresholds as liberal as p = 0.05, uncorrected. At the group level, this variability is reflected by non-significant activity in all regions of the core system. We argue that these differences might be related to individual differences in task execution: only some participants really detected faces in the noise images, while the other subjects simply responded in the desired way. This has several implications for future studies on illusory face detection. First, future studies should not only analyze results at the group level, but also for single subjects. Second, subjects should be explicitly queried after the fMRI experiment about whether they really detected faces or not. Third, if possible, not only the overt response of the subject, but also additional parameters that might indicate the perception of a noise stimulus as face should be collected (e.g., behavioral classification images).

Neural mechanisms underlying visual pareidolia processing: An fMRI study

Objectives

Pareidolia is the interpretation of previously unseen and unrelated objects as familiar due to previous learning. The present study aimed to determine the specific brain areas that exhibited activation during real-face and face-pareidolia processing.

Methods

Functional Magnetic Resonance Imaging (fMRI) scans were performed on 20 healthy subjects under real-face and face-pareidolia conditions in National Magnetic Resonance Research Center (UMRAM), Ankara, Turkey from April 2016 to January 2017. FSL software was used to conduct a FEAT higher level (group) analysis to identify the brain areas activated during real-face and face-pareidolia processing.

Results

Under both the real-face and face-pareidolia conditions, activation was observed in the Prefrontal Cortex (PFCX), occipital cortex V1, occipital cortex V2, and inferior temporal regions. Also under both conditions, the same degree of activation was observed in the right Fusiform Face Area (FFA) and the right PFCX. On the other hand, PFCX activation was not evident under the real-face versus face scrambled or face-pareidolia versus pareidolia scrambled conditions.

Conclusions

The present findings suggest that, as in real-face perception, face-pareidolia requires interaction between top-down and bottom-up brain regions including the FFA and frontal and occipitotemporal areas. Additionally, whole-brain analyses revealed that the right PFCX played an important role in processing real faces and in face pareidolia (illusory face perception), as did the FFA.

Peripheral Nervous System Reconstruction Reroutes Cortical Motor Output-Brain Reorganization Uncovered by Effective Connectivity

Cortical reorganization in response to peripheral nervous system damage is only poorly understood. In patients with complete brachial plexus avulsion and subsequent reconnection of the end of the musculocutaneous nerve to the side of a phrenic nerve, reorganization leads to a doubled arm representation in the primary motor cortex. Despite, homuncular organization being one of the most fundamental principles of the human brain, movements of the affected arm now activate 2 loci: the completely denervated arm representation and the diaphragm representation. Here, we investigate the details behind this peripherally triggered reorganization, which happens in healthy brains. fMRI effective connectivity changes within the motor network were compared between a group of patients and age matched healthy controls at 7 Tesla (6 patients and 12 healthy controls). Results show the establishment of a driving input of the denervated arm area to the diaphragm area which is now responsible for arm movements. The findings extend current knowledge about neuroplasticity in primary motor cortex: a denervated motor area may drive an auxilliary area to reroute its motor output.

Mental imagery of face enhances face-sensitive event-related potentials to ambiguous visual stimuli

Visual mental imagery forms mental representations of visual objects when correspondent stimuli are absent and shares some characters with visual perception. Both the vertex-positive-potential (VPP) and N170 components of event-related potentials (ERPs) to visual stimuli have a remarkable preference to faces. This study investigated whether visual mental imagery modulates the face-sensitive VPP and/or N170 components. The results showed that with significantly larger amplitudes under the face-imagery condition than the house-imagery condition, the VPP and P2 responses, but not the N170 component, were elicited by phase-randomized ambiguous stimuli. Thus, the brain substrates underlying VPP are not completely identical to those underlying N170, and the VPP/P2 manifestation of the category selectivity in imagery probably reflects an integration of top-down mental imagery signals (from the prefrontal cortex) and bottom-up perception signals (from the early visual cortex) in the occipito-temporal cortex where VPP and P2 originate.

Dominance of the Unaffected Hemisphere Motor Network and Its Role in the Behavior of Chronic Stroke Survivors

Balance of motor network activity between the two brain hemispheres after stroke is crucial for functional recovery. Several studies have extensively studied the role of the affected brain hemisphere to better understand changes in motor network activity following stroke. Very few studies have examined the role of the unaffected brain hemisphere and confirmed the test-retest reliability of connectivity measures on unaffected hemisphere. We recorded blood oxygenation level dependent functional magnetic resonance imaging (fMRI) signals from nine stroke survivors with hemiparesis of the left or right hand. Participants performed a motor execution task with affected hand, unaffected hand, and both hands simultaneously. Participants returned for a repeat fMRI scan 1 week later. Using dynamic causal modeling (DCM), we evaluated effective connectivity among three motor areas: the primary motor area (M1), the premotor cortex (PMC) and the supplementary motor area for the affected and unaffected hemispheres separately. Five participants' manual motor ability was assessed by Fugl-Meyer Motor Assessment scores and root-mean square error of participants' tracking ability during a robot-assisted game. We found (i) that the task performance with the affected hand resulted in strengthening of the connectivity pattern for unaffected hemisphere, (ii) an identical network of the unaffected hemisphere when participants performed the task with their unaffected hand, and (iii) the pattern of directional connectivity observed in the affected hemisphere was identical for tasks using the affected hand only or both hands. Furthermore, paired t-test comparison found no significant differences in connectivity strength for any path when compared with one-week follow-up. Brain-behavior linear correlation analysis showed that the connectivity patterns in the unaffected hemisphere more accurately reflected the behavioral conditions than the connectivity patterns in the affected hemisphere. Above findings enrich our knowledge of unaffected brain hemisphere following stroke, which further strengthens our neurobiological understanding of stroke-affected brain and can help to effectively identify and apply stroke-treatments.

Structural attributes of the temporal lobe predict face recognition ability in youth

The face recognition ability varies across individuals. However, it remains elusive how brain anatomical structure is related to the face recognition ability in healthy subjects. In this study, we adopted voxel-based morphometry analysis and machine learning approach to investigate the neural basis of individual face recognition ability using anatomical magnetic resonance imaging. We demonstrated that the gray matter volume (GMV) of the right ventral anterior temporal lobe (vATL), an area sensitive to face identity, is significant positively correlated with the subject's face recognition ability which was measured by the Cambridge face memory test (CFMT) score. Furthermore, the predictive model established by the balanced cross-validation combined with linear regression method revealed that the right vATL GMV can predict subjects' face ability. However, the subjects' Cambridge face memory test scores cannot be predicted by the GMV of the face processing network core brain regions including the right occipital face area (OFA) and the right face fusion area (FFA). Our results suggest that the right vATL may play an important role in face recognition and might provide insight into the neural mechanisms underlying face recognition deficits in patients with pathophysiological conditions such as prosopagnosia.

Brain effective connectivity during motor-imagery and execution following stroke and rehabilitation

Brain areas within the motor system interact directly or indirectly during motor-imagery and motor-execution tasks. These interactions and their functionality can change following stroke and recovery. How brain network interactions reorganize and recover their functionality during recovery and treatment following stroke are not well understood. To contribute to answering these questions, we recorded blood oxygenation-level dependent (BOLD) functional magnetic resonance imaging (fMRI) signals from 10 stroke survivors and evaluated dynamical causal modeling (DCM)-based effective connectivity among three motor areas: primary motor cortex (M1), pre-motor cortex (PMC) and supplementary motor area (SMA), during motor-imagery and motor-execution tasks. We compared the connectivity between affected and unaffected hemispheres before and after mental practice and combined mental practice and physical therapy as treatments. The treatment (intervention) period varied in length between 14 to 51 days but all patients received the same dose of 60 h of treatment. Using Bayesian model selection (BMS) approach in the DCM approach, we found that, after intervention, the same network dominated during motor-imagery and motor-execution tasks but modulatory parameters suggested a suppressive influence of SM A on M1 during the motor-imagery task whereas the influence of SM A on M1 was unrestricted during the motor-execution task. We found that the intervention caused a reorganization of the network during both tasks for unaffected as well as for the affected hemisphere. Using Bayesian model averaging (BMA) approach, we found that the intervention improved the regional connectivity among the motor areas during both the tasks. The connectivity between PMC and M1 was stronger in motor-imagery tasks whereas the connectivity from PMC to M1, SM A to M1 dominated in motor-execution tasks. There was significant behavioral improvement (p = 0.001) in sensation and motor movements because of the intervention as reflected by behavioral Fugl-Meyer (FMA) measures, which were significantly correlated (p = 0.05) with a subset of connectivity. These findings suggest that PMC and M1 play a crucial role during motor-imagery as well as during motor-execution task. In addition, M1 causes more exchange of causal information among motor areas during a motor-execution task than during a motor-imagery task due to its interaction with SM A. This study expands our understanding of motor network involved during two different tasks, which are commonly used during rehabilitation following stroke. A clear understanding of the effective connectivity networks leads to a better treatment in helping stroke survivors regain motor ability.

•

Brain motor effective connectivity can change due to stroke and during recovery.

•

Rehabilitative treatments caused significant changes in motor and sensation scores.

•

Behavioral improvements were accompanied by specific changes in brain connectivity.

•

SMA exerted a suppressive driving to M1 during motor imagery.

•

SMA-to-M1connectivity was positively modulated during actual motor execution.

Structural and effective connectivity reveals potential network-based influences on category-sensitive visual areas

Visual category perception is thought to depend on brain areas that respond specifically when certain categories are viewed. These category-sensitive areas are often assumed to be “modules” (with some degree of processing autonomy) and to act predominantly on feedforward visual input. This modular view can be complemented by a view that treats brain areas as elements within more complex networks and as influenced by network properties. This network-oriented viewpoint is emerging from studies using either diffusion tensor imaging to map structural connections or effective connectivity analyses to measure how their functional responses influence each other. This literature motivates several hypotheses that predict category-sensitive activity based on network properties. Large, long-range fiber bundles such as inferior fronto-occipital, arcuate and inferior longitudinal fasciculi are associated with behavioral recognition and could play crucial roles in conveying backward influences on visual cortex from anterior temporal and frontal areas. Such backward influences could support top-down functions such as visual search and emotion-based visual modulation. Within visual cortex itself, areas sensitive to different categories appear well-connected (e.g., face areas connect to object- and motion sensitive areas) and their responses can be predicted by backward modulation. Evidence supporting these propositions remains incomplete and underscores the need for better integration of DTI and functional imaging.

Face recognition in schizophrenia disorder: A comprehensive review of behavioral, neuroimaging and neurophysiological studies

Facial emotion processing has been extensively studied in schizophrenia patients while general face processing has received less attention. The already published reviews do not address the current scientific literature in a complete manner. Therefore, here we tried to answer some questions that remain to be clarified, particularly: are the non-emotional aspects of facial processing in fact impaired in schizophrenia patients? At the behavioral level, our key conclusions are that visual perception deficit in schizophrenia patients: are not specific to faces; are most often present when the cognitive (e.g. attention) and perceptual demands of the tasks are important; and seems to worsen with the illness chronification. Although, currently evidence suggests impaired second order configural processing, more studies are necessary to determine whether or not holistic processing is impaired in schizophrenia patients. Neural and neurophysiological evidence suggests impaired earlier levels of visual processing, which might involve the deficits in interaction of the magnocellular and parvocellular pathways impacting on further processing. These deficits seem to be present even before the disorder out-set. Although evidence suggests that this deficit may be not specific to faces, further evidence on this question is necessary, in particularly more ecological studies including context and body processing.

The resilience of object predictions: early recognition across viewpoints and exemplars

Recognition of everyday objects can be facilitated by top-down predictions. We have proposed that these predictions are derived from rudimentary image information, or gist, extracted rapidly from the low spatial frequencies (LSFs) (Bar Journal of Cognitive Neuroscience 15: 600–609, 2003). Because of the coarse nature of LSF representations, we hypothesized here that such predictions can accommodate changes in viewpoint as well as facilitate the recognition of visually similar objects. In a repetition-priming task, we indeed observed significant facilitation of target recognition that was primed by LSF objects across moderate viewpoint changes, as well as across visually similar exemplars. These results suggest that the LSF representations are specific enough to activate accurate predictions, yet flexible enough to overcome small changes in visual appearance. Such gist representations facilitate object recognition by accommodating changes in visual appearance due to viewing conditions, and help generalize from familiar to novel exemplars.

Task preparation and neural activation in stimulus-specific brain regions: an fMRI study with the cued task-switching paradigm

To investigate the role of posterior brain regions related to task-relevant stimulus processing in task preparation, we used a cued task-switching paradigm in which a pre-cue informed participants about the upcoming task on a trial: face discrimination or number comparison. Employing an event-related fMRI design, we examined for changes of activity in face- and number-related posterior brain regions (right fusiform face area (FFA) and right intraparietal sulcus (IPSnum), respectively), and explored the functional connectivity of these areas with other brain regions, during the (preparation) interval between cue onset and onset of the (to-be-responded) target stimulus. The results revealed task-relevant posterior brain regions to be modulated during this period: activation in task-relevant stimulus-specific regions was selectively enhanced and their functional connectivity to task-relevant anterior brain regions strengthened (right FFA - face task, right IPSnum - number task) while participants prepared for the cued task. Additionally, activity in task-relevant posterior brain regions was influenced by residual activation from the preceding trial in the right FFA and the right IPSnum, respectively. These findings indicate that, during task preparation, the activation pattern in currently task-relevant posterior brain regions is shaped by residual activation as well as preparatory modulation prior to the onset of the critical stimulus, even without participants being instructed to imagine the stimulus.

Amygdala mediated connectivity in perceptual decision-making of emotional facial expressions

Recognizing emotional facial expressions is a part of perceptual decision-making processes in the brain. Arriving at a decision for the brain becomes more difficult when available sensory information is limited or ambiguous. We used clear and noisy pictures with happy and angry emotional expressions and asked 32 participants to categorize these pictures based on emotions. There were significant differences in behavioral accuracy and reaction time between the decisions of clear and noisy images. The functional magnetic resonance imaging activations showed that the inferior occipital gyrus (IOG), fusiform gyrus (FG), amygdala (AMG) and ventrolateral prefrontal cortex (VPFC) along with other regions were active during the perceptual decision-making process. Using dynamic causal modeling analysis, we obtained three important results. First, from Bayesian model selection (BMS) approach, we found that the feed-forward network activity was enhanced during the processing of clear and noisy happy faces more than during the processing of clear angry faces. The AMG mediated this feed-forward connectivity in processing of clear and noisy happy faces, whereas the AMG mediation was absent in case of clear angry faces. However, this network activity was enhanced in case of noisy angry faces. Second, connectivity parameters obtained from Bayesian model averaging (BMA) suggested that the forward connectivity dominated over the backward connectivity during such processes. Third, based on the BMA parameters, we found that the easier tasks modulated effective connectivity from IOG to FG, AMG, and VPFC more than the difficult tasks did. These findings suggest that both parallel and hierarchical brain processes are at work during perceptual decision-making of negative, positive, unambiguous and ambiguous emotional expressions, but the AMG-mediated feed-forward network plays a dominant role in such decisions.

Early visual deprivation from congenital cataracts disrupts activity and functional connectivity in the face network

The development of the face-processing network has been examined with functional neuroimaging, but the effect of visual deprivation early in life on this network is not known. We examined this question in a group of young adults who had been born with dense, central cataracts in both eyes that blocked all visual input to the retina until the cataracts were removed during infancy. We used functional magnetic resonance imaging to examine regions in the "core" and "extended" face networks as participants viewed faces and other objects, and performed a face discrimination task. This task required matching faces on the basis of facial features or on the spacing between the facial features. The Cataract group (a) had reduced discrimination performance on the Spacing task relative to Controls; (b) used the same brain regions as Controls when passively viewing faces or making judgments about faces, but showed reduced activation during passive viewing of faces, especially in extended face-network regions; and (c) unlike Controls, showed activation in face-network regions for objects. In addition, the functional connections of the fusiform gyri with the rest of the face network were altered, and these brain changes were related to Cataract participants' performance on the face discrimination task. These results provide evidence that early visual input is necessary to set up or preserve activity and functional connectivity in the face-processing network that will later mediate expert face processing.

Neural correlates of own- and other-race face recognition in children: a functional near-infrared spectroscopy study

The present study used the functional Near-infrared Spectroscopy (fNIRS) methodology to investigate the neural correlates of elementary school children's own- and other-race face processing. An old-new paradigm was used to assess children's recognition ability of own- and other-race faces. FNIRS data revealed that other-race faces elicited significantly greater [oxy-Hb] changes than own-race faces in the right middle frontal gyrus and inferior frontal gyrus regions (BA9) and the left cuneus (BA18). With increased age, the [oxy-Hb] activity differences between own- and other-race faces, or the neural other-race effect (NORE), underwent significant changes in these two cortical areas: at younger ages, the neural response to the other-race faces was modestly greater than that to the own-race faces, but with increased age, the neural response to the own-race faces became increasingly greater than that to the other-race faces. Moreover, these areas had strong regional functional connectivity with a swath of the cortical regions in terms of the neural other-race effect that also changed with increased age. We also found significant and positive correlations between the behavioral other-race effect (reaction time) and the neural other-race effect in the right middle frontal gyrus and inferior frontal gyrus regions (BA9). These results taken together suggest that children, like adults, devote different amounts of neural resources to processing own- and other-race faces, but the size and direction of the neural other-race effect and associated functional regional connectivity change with increased age.

The superior temporal sulcus and the N170 during face processing: single trial analysis of concurrent EEG-fMRI

Face-selective neural signals have been reliably identified using both EEG and fMRI studies. These consist of the N170 component, a neural response peaking approximately 170ms after a face is presented, and face-selective activations in the fusiform face area (FFA), the occipital face area (OFA), and the superior temporal sulcus (STS). As most neuroimaging studies examine these face-selective processes separately, the relationship between the N170 neural response and activation in the fusiform gyrus is still debated. In this study, we concurrently measured EEG and fMRI responses to upright faces, inverted faces, and objects to examine this association. We introduce a method for single-trial estimation of N170 amplitudes and correlation of the trial-by-trial variation in N170 neural responses with fMRI BOLD responses. For upright faces, BOLD responses in the right STS were negatively correlated with N170 amplitudes, showing greater activation on trials in which N170 amplitudes were larger (more negative). For inverted faces, a medial region of the fusiform gyrus (mFG) was positively correlated with N170 amplitudes, showing greater activation on trials in which N170 amplitudes were smaller (less negative). This result points to the STS as a crucial region for generating the N170 associated with face perception, and suggests that the mFG is additionally recruited for processing inverted faces, particularly on trials in which N170 is small. Despite the different time resolution of fMRI and EEG signals, our single-trial estimation and EEG-fMRI correlation method can reveal associations between activation in face-selective brain regions and neural processes at 170ms associated with face perception.

Ranking fluctuating asymmetry in a dot figure and the significant impact of imagining a face

Fluctuating asymmetry and averageness is correlated with our perception of beauty in human faces. Yet, whether deviations of centrality in the positioning of the eyes, the nose, and the mouth have different effects on our perception of asymmetry in a holistic human face, is still uncertain. In this study we aimed to test the relative effect of decentralising the horizontal position of three sets of paired dots representing eyes, nostrils, or mouth from the vertical midline of ambiguous dot figures, vaguely resembling a face. The figures were ranked according to perceived asymmetry by human observers. When associating the figures with non-facial objects (eg a butterfly), none of the figures' rank distribution differed from each other. However, when observers imagined the figures to represent a human face, the figure with the decentralised pair of dots representing the nostrils was significantly ranked as more asymmetric than the other figures. This result provides indications that the brain may deal with information about facial asymmetry and averageness heavily depending on the centrality of the nasal region.

Fusing concurrent EEG-fMRI with dynamic causal modeling: application to effective connectivity during face perception

Despite the wealth of research on face perception, the interactions between core regions in the face-sensitive network of the visual cortex are not well understood. In particular, the link between neural activity in face-sensitive brain regions measured by fMRI and EEG markers of face-selective processing in the N170 component is not well established. In this study, we used dynamic causal modeling (DCM) as a data fusion approach to integrate concurrently acquired EEG and fMRI data during the perception of upright compared with inverted faces. Data features derived from single-trial EEG variability were used as contextual modulators on fMRI-derived estimates of effective connectivity between key regions of the face perception network. The overall construction of our model space was highly constrained by the effects of task and ERP parameters on our fMRI data. Bayesian model selection suggested that the occipital face area (OFA) acted as a central gatekeeper directing visual information to the superior temporal sulcus (STS), the fusiform face area (FFA), and to a medial region of the fusiform gyrus (mFG). The connection from the OFA to the STS was strengthened on trials in which N170 amplitudes to upright faces were large. In contrast, the connection from the OFA to the mFG, an area known to be involved in object processing, was enhanced for inverted faces particularly on trials in which N170 amplitudes were small. Our results suggest that trial-by-trial variation in neural activity at around 170 ms, reflected in the N170 component, reflects the relative engagement of the OFA to STS/FFA network over the OFA to mFG object processing network for face perception. Importantly, the DCMs predicted the observed data significantly better by including the modulators derived from the N170, highlighting the value of incorporating EEG-derived information to explain interactions between regions as a multi-modal data fusion method for combined EEG-fMRI.

Is a neutral expression also a neutral stimulus? A study with functional magnetic resonance

Although neutral faces do not initially convey an explicit emotional message, it has been found that individuals tend to assign them an affective content. Moreover, previous research has shown that affective judgments are mediated by the task they have to perform. Using functional magnetic resonance imaging in 21 healthy participants, we focus this study on the cerebral activity patterns triggered by neutral and emotional faces in two different tasks (social or gender judgments). Results obtained, using conjunction analyses, indicated that viewing both emotional and neutral faces evokes activity in several similar brain areas indicating a common neural substrate. Moreover, neutral faces specifically elicit activation of cerebellum, frontal and temporal areas, while emotional faces involve the cuneus, anterior cingulated gyrus, medial orbitofrontal cortex, posterior superior temporal gyrus, precentral/postcentral gyrus and insula. The task selected was also found to influence brain activity, in that the social task recruited frontal areas while the gender task involved the posterior cingulated, inferior parietal lobule and middle temporal gyrus to a greater extent. Specifically, in the social task viewing neutral faces was associated with longer reaction times and increased activity of left dorsolateral frontal cortex compared with viewing facial expressions of emotions. In contrast, in the same task emotional expressions distinctively activated the left amygdale. The results are discussed taking into consideration the fact that, like other facial expressions, neutral expressions are usually assigned some emotional significance. However, neutral faces evoke a greater activation of circuits probably involved in more elaborate cognitive processing.

Different neural mechanisms within occipitotemporal cortex underlie repetition suppression across same and different-size faces

Repetition suppression (RS) (or functional magnetic resonance imaging adaptation) refers to the reduction in blood oxygen level-dependent signal following repeated presentation of a stimulus. RS is frequently used to investigate the role of face-selective regions in human visual cortex and is commonly thought to be a "localized" effect, reflecting fatigue of a neuronal population representing a given stimulus. In contrast, predictive coding theories characterize RS as a consequence of "top-down" changes in between-region modulation. Differentiating between these accounts is crucial for the correct interpretation of RS effects in the face-processing network. Here, dynamic causal modeling revealed that different mechanisms underlie different forms of RS to faces in occipitotemporal cortex. For both familiar and unfamiliar faces, repetition of identical face images (same size) was associated with changes in "forward" connectivity between the occipital face area (OFA) and the fusiform face area (FFA) (OFA-to-FFA). In contrast, RS across image size was characterized by altered "backward" connectivity (FFA-to-OFA). In addition, evidence was higher for models in which information projected directly into both OFA and FFA, challenging the role of OFA as the input stage of the face-processing network. These findings suggest "size-invariant" RS to faces is a consequence of interactions between regions rather than being a localized effect.

Intra- and interhemispheric connectivity between face-selective regions in the human brain

Neuroimaging studies have revealed a number of regions in the human brain that respond to faces. However, the way these regions interact is a matter of current debate. The aim of this study was to use functional MRI to define face-selective regions in the human brain and then determine how these regions interact in a large population of subjects (n = 72). We found consistent face selectivity in the core face regions of the occipital and temporal lobes: the fusiform face area (FFA), occipital face area (OFA), and superior temporal sulcus (STS). Face selectivity extended into the intraparietal sulcus (IPS), precuneus (PCu), superior colliculus (SC), amygdala (AMG), and inferior frontal gyrus (IFG). We found evidence for significant functional connectivity between the core face-selective regions, particularly between the OFA and FFA. However, we found that the covariation in activity between corresponding face regions in different hemispheres (e.g., right and left FFA) was higher than between different face regions in the same hemisphere (e.g., right OFA and right FFA). Although functional connectivity was evident between regions in the core and extended network, there were significant differences in the magnitude of the connectivity between regions. Activity in the OFA and FFA were most correlated with the IPS, PCu, and SC. In contrast, activity in the STS was most correlated with the AMG and IFG. Correlations between the extended regions suggest strong functional connectivity between the IPS, PCu, and SC. In contrast, the IFG was only correlated with the AMG. This study reveals that interhemispheric as well as intrahemispheric connections play an important role in face perception.

The lateral occipital cortex in the face perception network: an effective connectivity study

The perception of faces involves a large network of cortical areas of the human brain. While several studies tested this network recently, its relationship to the lateral occipital (LO) cortex known to be involved in visual object perception remains largely unknown. We used functional magnetic resonance imaging and dynamic causal modeling (DCM) to test the effective connectivity among the major areas of the face-processing core network and LO. Specifically, we tested how LO is connected to the fusiform face area (FFA) and occipital face area (OFA) and which area provides the major face/object input to the network. We found that LO is connected via significant bidirectional connections to both OFA and FFA, suggesting the existence of a triangular network. In addition, our results also suggest that face- and object-related stimulus inputs are not entirely segregated at these lower level stages of face-processing and enter the network via the LO. These results support the role of LO in face perception, at least at the level of face/non-face stimulus discrimination.

Face Processing Changes in Normal Aging Revealed by fMRI Adaptation

We investigated the neural correlates of facial processing changes in healthy aging using fMRI and an adaptation paradigm. In the scanner, participants were successively presented with faces that varied in identity, viewpoint, both, or neither and performed a head size detection task independent of identity or viewpoint. In right fusiform face area (FFA), older adults failed to show adaptation to the same face repeatedly presented in the same view, which elicited the most adaptation in young adults. We also performed a multivariate analysis to examine correlations between whole-brain activation patterns and behavioral performance in a face-matching task tested outside the scanner. Despite poor neural adaptation in right FFA, high-performing older adults engaged the same face-processing network as high-performing young adults across conditions, except the one presenting a same facial identity across different viewpoints. Low-performing older adults used this network to a lesser extent. Additionally, high-performing older adults uniquely recruited a set of areas related to better performance across all conditions, indicating age-specific involvement of this added network. This network did not include the core ventral face-processing areas but involved the left inferior occipital gyrus, frontal, and parietal regions. Although our adaptation results show that the neuronal representations of the core face-preferring areas become less selective with age, our multivariate analysis indicates that older adults utilize a distinct network of regions associated with better face matching performance, suggesting that engaging this network may compensate for deficiencies in ventral face processing regions.

The other face of the other-race effect: an fMRI investigation of the other-race face categorization advantage

The present study was the first to use the functional magnetic resonance imaging (fMRI) methodology to investigate the neural correlates of race categorization of own- and other-race faces. We found that Chinese participants categorized the race of Caucasian faces more accurately and faster than that of Chinese faces, replicating the robust effect of the other-race categorization advantage. Regions of interest (ROI) analyses revealed greater neural activations when participants were categorizing own-race faces than other-race faces in the bilateral ventral occipito-temporal cortex (VOT) such as the fusiform face areas (FFAs) and the occipital face areas (OFAs). Within the left FFA, there was also a significant negative correlation between the behavioral difference of own- and other-race face categorization accuracy and the activation difference between categorizing own- and other-race faces. Whole brain analyses showed that categorizing own-race faces induced greater activations in the right medial frontal cortex (MFC) and right inferior frontal gyrus (IFG) than categorizing other-race faces. Psychophysiological interaction (PPI) analyses revealed that the frontal cortical regions interacted more strongly with the posterior VOT during the categorization of own-race faces than that of other-race faces. Overall, our findings suggest that relative to the categorization of other-race faces, more cortical resources are engaged during the categorization of own-race faces with which we have a higher level of processing expertise. This increased involvement of cortical neural sources perhaps serves to provide more in-depth processing of own-race faces (such as individuation), which in turn paradoxically results in the behavioral other-race categorization advantage.

Faces in the mist: illusory face and letter detection

We report three behavioral experiments on the spatial characteristics evoking illusory face and letter detection. False detections made to pure noise images were analyzed using a modified reverse correlation method in which hundreds of observers rated a modest number of noise images (480) during a single session. This method was originally developed for brain imaging research, and has been used in a number of fMRI publications, but this is the first report of the behavioral classification images. In Experiment 1 illusory face detection occurred in response to scattered dark patches throughout the images, with a bias to the left visual field. This occurred despite the use of a fixation cross and expectations that faces would be centered. In contrast, illusory letter detection (Experiment 2) occurred in response to centrally positioned dark patches. Experiment 3 included an oval in all displays to spatially constrain illusory face detection. With the addition of this oval the classification image revealed an eyes/nose/mouth pattern. These results suggest that face detection is triggered by a minimal face-like pattern even when these features are not centered in visual focus.

Division of labor between lateral and ventral extrastriate representations of faces, bodies, and objects

The occipito-temporal cortex is strongly implicated in carrying out the high-level computations associated with vision. In human neuroimaging studies, focal regions are consistently found within this broad region that respond strongly and selectively to faces, bodies, or objects. A notable feature of these selective regions is that they are found in pairs. In the posterior-lateral occipito-temporal cortex, focal selectivity is found for faces (occipital face area), bodies (extrastriate body area), and objects (lateral occipital). These three areas are found bilaterally and at close quarters to each other. Likewise, in the ventro-medial occipito-temporal cortex, three similar category-selective regions are found, also in proximity to each other: for faces (fusiform face area), bodies (fusiform body area), and objects (posterior fusiform). Here we review some of the extensive evidence on the functional properties of these areas with two aims. First, we seek to identify principles that distinguish the posterior-lateral and ventro-medial clusters of selective regions but that apply generally within each cluster across the three stimulus kinds. Our review identifies and elaborates several principles by which these relationships hold. In brief, the posterior-lateral representations are more primitive, local, and stimulus-driven relative to the ventro-medial representations, which in contrast are more invariant to visual features, global, and linked to the subjective percept. Second, because the evidence base of studies that compare both posterior-lateral and ventro-medial representations of faces, bodies, and objects is still relatively small, we seek to provoke more cross-talk among the research strands that are traditionally separate. We identify several promising approaches for such future work.

A dynamic causal modeling analysis of the effective connectivities underlying top-down letter processing

The present study employed dynamic causal modeling to investigate the effective functional connectivity between regions of the neural network involved in top-down letter processing. We used an illusory letter detection paradigm in which participants detected letters while viewing pure noise images. When participants detected letters, the response of the right middle occipital gyrus (MOG) in the visual cortex was enhanced by increased feed-backward connectivity from the left inferior frontal gyrus (IFG). In addition, illusory letter detection increased feed-forward connectivity from the right MOG to the left inferior parietal lobules. Originating in the left IFG, this top-down letter processing network may facilitate the detection of letters by activating letter processing areas within the visual cortex. This activation in turns may highlight the visual features of letters and send letter information to activate the associated phonological representations in the identified parietal region.

Identifying abnormal connectivity in patients using dynamic causal modeling of FMRI responses

Functional imaging studies of brain damaged patients offer a unique opportunity to understand how sensorimotor and cognitive tasks can be carried out when parts of the neural system that support normal performance are no longer available. In addition to knowing which regions a patient activates, we also need to know how these regions interact with one another, and how these inter-regional interactions deviate from normal. Dynamic causal modeling (DCM) offers the opportunity to assess task-dependent interactions within a set of regions. Here we review its use in patients when the question of interest concerns the characterization of abnormal connectivity for a given pathology. We describe the currently available implementations of DCM for fMRI responses, varying from the deterministic bilinear models with one-state equation to the stochastic non-linear models with two-state equations. We also highlight the importance of the new Bayesian model selection and averaging tools that allow different plausible models to be compared at the single subject and group level. These procedures allow inferences to be made at different levels of model selection, from features (model families) to connectivity parameters. Following a critical review of previous DCM studies that investigated abnormal connectivity we propose a systematic procedure that will ensure more flexibility and efficiency when using DCM in patients. Finally, some practical and methodological issues crucial for interpreting or generalizing DCM findings in patients are discussed.