Neural correlates of personally familiar faces: parents, partner and own faces

Prediction error processing and sharpening of expected information across the face-processing hierarchy

The perception and neural processing of sensory information are strongly influenced by prior expectations. The integration of prior and sensory information can manifest through distinct underlying mechanisms: focusing on unexpected input, denoted as prediction error (PE) processing, or amplifying anticipated information via sharpened representation. In this study, we employed computational modeling using deep neural networks combined with representational similarity analyses of fMRI data to investigate these two processes during face perception. Participants were cued to see face images, some generated by morphing two faces, leading to ambiguity in face identity. We show that expected faces were identified faster and perception of ambiguous faces was shifted towards priors. Multivariate analyses uncovered evidence for PE processing across and beyond the face-processing hierarchy from the occipital face area (OFA), via the fusiform face area, to the anterior temporal lobe, and suggest sharpened representations in the OFA. Our findings support the proposition that the brain represents faces grounded in prior expectations.

Decoding visual fatigue in a visual search task selectively manipulated via myopia-correcting lenses

Introduction

Visual fatigue resulting from sustained, high-workload visual activities can significantly impact task performance and general wellbeing. So far, however, little is known about the underlying brain networks of visual fatigue. This study aimed to identify such potential networks using a unique paradigm involving myopia-correcting lenses known to directly modulate subjectively-perceived fatigue levels.

Methods

A sample of N = 31 myopia participants [right eye-SE: -3.77D (SD: 2.46); left eye-SE: -3.75D (SD: 2.45)] performed a demanding visual search task with varying difficulty levels, both with and without the lenses, while undergoing fMRI scanning. There were a total of 20 trials, after each of which participants rated the perceived difficulty and their subjective visual fatigue level. We used representational similarity analysis to decode brain regions associated with fatigue and difficulty, analyzing their individual and joint decoding pattern.

Results and discussion

Behavioral results showed correlations between fatigue and difficulty ratings and above all a significant reduction in fatigue levels when wearing the lenses. Imaging results implicated the cuneus, lingual gyrus, middle occipital gyrus (MOG), and declive for joint fatigue and difficulty decoding. Parts of the lingual gyrus were able to selectively decode perceived difficulty. Importantly, a broader network of visual and higher-level association areas showed exclusive decodability of fatigue (culmen, middle temporal gyrus (MTG), parahippocampal gyrus, precentral gyrus, and precuneus). Our findings enhance our understanding of processing within the context of visual search, attention, and mental workload and for the first time demonstrate that it is possible to decode subjectively-perceived visual fatigue during a challenging task from imaging data. Furthermore, the study underscores the potential of myopia-correcting lenses in investigating and modulating fatigue.

The extended neural architecture of human attachment: An fMRI coordinate-based meta-analysis of affiliative studies

Functional imaging studies and clinical evidence indicate that cortical areas relevant to social cognition are closely integrated with evolutionarily conserved basal forebrain structures and neighboring regions, enabling human attachment and affiliative emotions. The neural circuitry of human affiliation is continually being unraveled as functional magnetic resonance imaging (fMRI) becomes increasingly prevalent, with studies examining human brain responses to various attachment figures. However, previous fMRI meta-analyses on affiliative stimuli have encountered challenges, such as low statistical power and the absence of robustness measures. To address these issues, we conducted an exhaustive coordinate-based meta-analysis of 79 fMRI studies, focusing on personalized affiliative stimuli, including one's infants, family, romantic partners, and friends. We employed complementary coordinate-based analyses (Activation Likelihood Estimation and Signed Differential Mapping) and conducted a robustness analysis of the results. Findings revealed cluster convergence in cortical and subcortical structures related to reward and motivation, salience detection, social bonding, and cognition. Our study thoroughly explores the neural correlates underpinning affiliative responses, effectively overcoming the limitations noted in previous meta-analyses. It provides an extensive view of the neural substrates associated with affiliative stimuli, illuminating the intricate interaction between cortical and subcortical regions. Our findings significantly contribute to understanding the neurobiology of human affiliation, expanding the known human attachment circuitry beyond the traditional basal forebrain regions observed in other mammals to include uniquely human isocortical structures.

Neural responses underlying extraordinary altruists' generosity for socially distant others

Most people are much less generous toward strangers than close others, a bias termed social discounting. But people who engage in extraordinary real-world altruism, like altruistic kidney donors, show dramatically reduced social discounting. Why they do so is unclear. Some prior research suggests reduced social discounting requires effortfully overcoming selfishness via recruitment of the temporoparietal junction. Alternatively, reduced social discounting may reflect genuinely valuing strangers' welfare more due to how the subjective value of their outcomes is encoded in regions such as rostral anterior cingulate cortex (ACC) and amygdala. We tested both hypotheses in this pre-registered study. We also tested the hypothesis that a loving-kindness meditation (LKM) training intervention would cause typical adults' neural and behavioral patterns to resemble altruists. Altruists and matched controls (N = 77) completed a social discounting task during functional magnetic resonance imaging; 25 controls were randomized to complete LKM training. Neither behavioral nor imaging analyses supported the hypothesis that altruists' reduced social discounting reflects effortfully overcoming selfishness. Instead, group differences emerged in social value encoding regions, including rostral ACC and amygdala. Activation in these regions corresponded to the subjective valuation of others' welfare predicted by the social discounting model. LKM training did not result in more generous behavioral or neural patterns, but only greater perceived difficulty during social discounting. Our results indicate extraordinary altruists' generosity results from the way regions involved in social decision-making encode the subjective value of others' welfare. Interventions aimed at promoting generosity may thus succeed to the degree they can increase the subjective valuation of others' welfare.

Laterality and hemispheric specialization of self-face recognition

Inspired by the pioneering work of Eran Zaidel beginning in the early 1970's on the role of the two cerebral hemispheres of the human brain in self-related cognition, we review research on self-face recognition from a laterality perspective. The self-face is an important proxy of the self, and self-face recognition has been used as an indicator of self-awareness more broadly. Over the last half century, behavioral and neurological data, along with over two decades of neuroimaging research evidence have accumulated on this topic, generally concluding a right-hemisphere dominance for self-face recognition. In this review, we briefly revisit the pioneering roots of this work by Sperry, Zaidel & Zaidel, and focus on the important body of neuroimaging literature on self-face recognition it has inspired. We conclude with a brief discussion of current models of self-related processing and future directions for research in this area.

Value-based neural representations predict social decision preferences

Social decision-making is omnipresent in everyday life, carrying the potential for both positive and negative consequences for the decision-maker and those closest to them. While evidence suggests that decision-makers use value-based heuristics to guide choice behavior, very little is known about how decision-makers' representations of other agents influence social choice behavior. We used multivariate pattern expression analyses on fMRI data to understand how value-based processes shape neural representations of those affected by one's social decisions and whether value-based encoding is associated with social decision preferences. We found that stronger value-based encoding of a given close other (e.g. parent) relative to a second close other (e.g. friend) was associated with a greater propensity to favor the former during subsequent social decision-making. These results are the first to our knowledge to explicitly show that value-based processes affect decision behavior via representations of close others.

Familiarity Facilitates Detection of Angry Expressions

Personal familiarity facilitates rapid and optimized detection of faces. In this study, we investigated whether familiarity associated with faces can also facilitate the detection of facial expressions. Models of face processing propose that face identity and face expression detection are mediated by distinct pathways. We used a visual search paradigm to assess if facial expressions of emotion (anger and happiness) were detected more rapidly when produced by familiar as compared to unfamiliar faces. We found that participants detected an angry expression 11% more accurately and 135 ms faster when produced by familiar as compared to unfamiliar faces while happy expressions were detected with equivalent accuracies and at equivalent speeds for familiar and unfamiliar faces. These results suggest that detectors in the visual system dedicated to processing features of angry expressions are optimized for familiar faces.

Neural and Affective Responses to Prolonged Eye Contact with One's Own Adolescent Child and Unfamiliar Others

Eye contact is crucial for the formation and maintenance of social relationships, and plays a key role in facilitating a strong parent-child bond. However, the precise neural and affective mechanisms through which eye contact impacts on parent-child relationships remain elusive. We introduce a task to assess parents' neural and affective responses to prolonged direct and averted gaze coming from their own child, and an unfamiliar child and adult. While in the scanner, 79 parents (n = 44 mothers and n = 35 fathers) were presented with prolonged (16-38 s) videos of their own child, an unfamiliar child, an unfamiliar adult, and themselves (i.e., targets), facing the camera with a direct or an averted gaze. We measured BOLD-responses, tracked parents' eye movements during the videos, and asked them to report on their mood and feelings of connectedness with the targets after each video. Parents reported improved mood and increased feelings of connectedness after prolonged exposure to direct versus averted gaze and these effects were amplified for unfamiliar targets compared to their own child, due to high affect and connectedness ratings after videos of their own child. Neuroimaging results showed that the sight of one's own child was associated with increased activity in middle occipital gyrus, fusiform gyrus and inferior frontal gyrus relative to seeing an unfamiliar child or adult. While we found no robust evidence of specific neural correlates of eye contact (i.e., contrast direct > averted gaze), an exploratory parametric analysis showed that dorsomedial prefrontal cortex (dmPFC) activity increased linearly with duration of eye contact (collapsed across all "other" targets). Eye contact-related dmPFC activity correlated positively with increases in feelings of connectedness, suggesting that this region may drive feelings of connectedness during prolonged eye contact with others. These results underline the importance of prolonged eye contact for affiliative processes and provide first insights into its neural correlates. This may pave the way for new research in individuals or pairs in whom affiliative processes are disrupted.

Neural substrates of brand equity: applying a quantitative meta-analytical method for neuroimage studies

Although the concept of brand equity has been investigated using various approaches, a comprehensive neural basis for brand equity remains unclear. The default mode network (DMN) as a mental process might influence brand equity related consumers' decision-making, as reported in the marketing literature. While studies on the overlapping regions between the DMN and value-based decision-making related brain regions have been reported in neuroscience literature, relationships between the DMN and a neural mechanism of brand equity have not been clarified. The aim of our study is to identify neural substrates of brand equity and examine brand equity-related mental processes by comparing them to the DMN. To determine the neural substrates of brand equity, we first carried out the activation likelihood estimation (ALE) meta-analysis. We examined 26 studies using branded objects as experimental stimuli for the ALE. Next, we set the output regions from ALE as the region of interest for meta-analytic connectivity modeling (MACM). Further, we compared the brand equity-related brain network (BE-RBN) revealed by the MACM with the DMN. We confirmed that the BE-RBN brain regions overlap with the medial temporal lobule (MTL) sub-system, a module composed of the DMN but excluding the retrosplenial cortex. Further, we discovered that several brain regions apart from the DMN are also distinctive BE-RBN brain regions (i.e., the insula, the inferior frontal gyrus, amygdala, ventral striatum, parietal region). We decoded the BE-RBN brain regions using the BrandMap module. The decoded results revealed that the brand equity-related mental processes are complex constructs integrated via multiple mental processes such as self-referential, reward, emotional, memory, and sensorimotor processing. Our study demonstrated that the DMN alone is insufficient to engage in brand equity-related mental processes. Therefore, marketers are required to make strategic plans to integrate the five consumer's multiple mental processes while building brand equity.

The upside-down self: One's own face recognition is affected by inversion

One's own face is recognized more efficiently than any other face, although the neural mechanisms underlying this phenomenon remain poorly understood. Considering the extensive visual experience that we have with our own face, some authors have proposed that self-face recognition involves a more analytical perceptual strategy (i.e., based on face features) than other familiar faces, which are commonly processed holistically (i.e., as a whole). However, this hypothesis has not yet been tested with brain activity data. In the present study, we employed an inversion paradigm combined with event-related potential (ERP) recordings to investigate whether the self-face is processed more analytically. Sixteen healthy participants were asked to identify their own face and a familiar face regardless of its orientation, which could either be upright or inverted. ERP analysis revealed an enhanced amplitude and a delayed latency for the N170 component when faces were presented in an inverted orientation. Critically, both the self and a familiar face were equally vulnerable to the inversion effect, suggesting that the self-face is not processed more analytically than a familiar face. In addition, we replicated the recent finding that the attention-related P200 component is a specific neural index of self-face recognition. Overall, our results suggest that the advantage for self-face processing might be better explained by the engagement of self-related attentional mechanisms than by the use of a more analytical visuoperceptual strategy.

The Early Start Denver Model Intervention and Mu Rhythm Attenuation in Autism Spectrum Disorders

We examined the relationship between the Early start Denver model (ESDM) intervention and mu rhythm attenuation, an EEG paradigm reflecting neural processes associated with action perception and social information processing. Children were assigned to either receive comprehensive ESDM intervention for two years, or were encouraged to pursue resources in the community. Two years after intervention, EEG was collected during the execution and observation of grasping actions performed by familiar and unfamiliar agents. The ESDM group showed significantly greater attenuation when viewing a parent or caregiver executing a grasping action, compared with an unfamiliar individual executing the same action. Our findings suggest that the ESDM may have a unique impact on neural circuitry underlying social cognition and familiarity.

Perceptual difficulty modulates the direction of information flow in familiar face recognition

Humans are fast and accurate when they recognize familiar faces. Previous neurophysiological studies have shown enhanced representations for the dichotomy of familiar vs. unfamiliar faces. As familiarity is a spectrum, however, any neural correlate should reflect graded representations for more vs. less familiar faces along the spectrum. By systematically varying familiarity across stimuli, we show a neural familiarity spectrum using electroencephalography. We then evaluated the spatiotemporal dynamics of familiar face recognition across the brain. Specifically, we developed a novel informational connectivity method to test whether peri-frontal brain areas contribute to familiar face recognition. Results showed that feed-forward flow dominates for the most familiar faces and top-down flow was only dominant when sensory evidence was insufficient to support face recognition. These results demonstrate that perceptual difficulty and the level of familiarity influence the neural representation of familiar faces and the degree to which peri-frontal neural networks contribute to familiar face recognition.

Neural representations of own-voice in the human auditory cortex

We have a keen sensitivity when it comes to the perception of our own voices. We can detect not only the differences between ourselves and others, but also slight modifications of our own voices. Here, we examined the neural correlates underlying such sensitive perception of one's own voice. In the experiments, we modified the subjects' own voices by using five types of filters. The subjects rated the similarity of the presented voices to their own. We compared BOLD (Blood Oxygen Level Dependent) signals between the voices that subjects rated as least similar to their own voice and those they rated as most similar. The contrast revealed that the bilateral superior temporal gyrus exhibited greater activities while listening to the voice least similar to their own voice and lesser activation while listening to the voice most similar to their own. Our results suggest that the superior temporal gyrus is involved in neural sharpening for the own-voice. The lesser degree of activations observed by the voices that were similar to the own-voice indicates that these areas not only respond to the differences between self and others, but also respond to the finer details of own-voices.

Getting to Know Someone: Familiarity, Person Recognition, and Identification in the Human Brain

In our everyday life, we continuously get to know people, dominantly through their faces. Several neuroscientific experiments showed that familiarization changes the behavioral processing and underlying neural representation of faces of others. Here, we propose a model of the process of how we actually get to know someone. First, the purely visual familiarization of unfamiliar faces occurs. Second, the accumulation of associated, nonsensory information refines person representation, and finally, one reaches a stage where the effortless identification of very well-known persons occurs. We offer here an overview of neuroimaging studies, first evaluating how and in what ways the processing of unfamiliar and familiar faces differs and, second, by analyzing the fMRI adaptation and multivariate pattern analysis results we estimate where identity-specific representation is found in the brain. The available neuroimaging data suggest that different aspects of the information emerge gradually as one gets more and more familiar with a person within the same network. We propose a novel model of familiarity and identity processing, where the differential activation of long-term memory and emotion processing areas is essential for correct identification.

Recognizing Your Hand and That of Your Romantic Partner

Although the hand is an important organ in interpersonal interactions, focusing on this body part explicitly is less common in daily life compared with the face. We investigated (i) whether a person's recognition of their own hand is different from their recognition of another person's hand (i.e., self hand vs. other's hand) and (ii) whether a close social relationship affects hand recognition (i.e., a partner's hand vs. an unknown person's hand). For this aim, we ran an experiment in which participants took part in one of two discrimination tasks: (i) a self-others discrimination task or (ii) a partner/unknown opposite-sex person discrimination task. In these tasks, participants were presented with a hand image and asked to select one of two responses, self (partner) or other (unknown persons), as quickly and accurately as possible. We manipulated hand ownership (self (partner)/other(unknown person)), hand image laterality (right/left), and visual perspective of hand image (upright/upside-down). A main effect of hand ownership in both tasks (i.e., self vs. other and partner vs. unknown person) was found, indicating longer reaction times for self and partner images. The results suggest that close social relationships modulate hand recognition-namely, "self-expansion" to a romantic partner could occur at explicit visual hand recognition.

Predicting Interpersonal Outcomes From Information Processing Tasks Using Personally Relevant and Generic Stimuli: A Methodology Study

Despite evidence of differential processing of personally relevant stimuli (PR), most studies investigating attentional biases in processing emotional content use generic stimuli. We sought to examine differences in the processing of PR, relative to generic, stimuli across information processing tasks and to validate their use in predicting concurrent interpersonal functioning. Fifty participants (25 female) viewed generic and PR (i.e., their intimate partner’s face) emotional stimuli during tasks assessing selective attention (using a modified version of the Spatial Cueing Task) and inhibition (using the Negative Affective Priming task) of emotional content. Ratings of relationship quality were also collected. Evidence of increased selective attention during controlled and greater avoidance during automatic stages of processing emerged when viewing PR, relative to generic, emotional faces. We also found greater inhibition of PR sad faces. Finally, male, but not female, participants who displayed greater difficulty disengaging from the sad face of their partner reported more conflict in their relationships. Taken together, findings from information processing studies using generic emotional stimuli may not be representative of how we process PR stimuli in naturalistic settings.

Reinforcement-Sensitive Personality Traits Associated With Passion in Heterosexual Intimate Relationships: An fNIRS Investigation

According to the triangular theory of love, passion is an indispensable component of romantic love. Some brain imaging studies have shown that passionate arousal in intimate relationships is associated with the reward circuits in the brain. We hypothesized that the individual reward sensitivity trait is also related to passion in intimate relationships, and two separate studies were conducted in the present research. In the first study, 558 college students who were currently in love were selected as participants. The correlation between intimacy and reinforcement sensitivity in individuals identifying as heterosexual was explored using the Sensitivity to Punishment and Sensitivity to Reward Questionnaire, the Passionate Love Scale, and the Triangular Love Scale. In the second study, participants were 42 college students who were also currently in love. Functional near-infrared spectroscopy (fNIRS) was adopted to explore the neurophysiological interaction between reward sensitivity and emotional arousal induced in participants when presented a photograph of their partner, a friend, or a stranger. The results showed that reward sensitivity was positively correlated with passion, and punishment sensitivity was negatively correlated with intimacy and commitment. Significant interactions between reward sensitivity and photograph type were found, and the triangular part of the inferior frontal gyrus showed a particular relevance to the reward-sensitive personality trait toward partners. Overall, the findings support reinforcement sensitivity theory and suggest that reinforcement-sensitive personality traits (personality traits of reward and punishment sensitivity) are associated with all three components of love, with only reward sensitivity being related to passion.

Catching the imposter in the brain: The case of Capgras delusion

Here we describe a rare case of Capgras delusion - a misidentification syndrome characterized by the belief that a person has been replaced by an imposter - in a patient without evident neurological or psychiatric symptoms. Intriguingly, delusional belief was selective for both person and modality, as the patient believed that his son - not his daughter or other relatives - was substituted with an imposter only while being in presence of him and looking at his face, but not when merely listening to his voice. A neuroanatomical reconstruction obtained integrating morphological and functional patient's neuroimaging data highlighted two main peculiarities: a compression of the rostral portion of right temporal lobe due to a large arachnoid cyst, and a bilaterally reduced metabolism of frontal areas. Autonomic data obtained from thermal infra-red camera and skin conductance recordings showed that a higher sympathetic activation was evoked by the observation of daughter's face, relative to the observation of the son's face as well as of not-familiar faces; conversely, daughter and son voices elicited a similar sympathetic activation, higher relative to not-familiar voices, indicating a modality-dependent dissociation consistent with the delusional behavior. Our case supports the "two-hit hypothesis" about Capgras delusion etiopathogenesis: here, the first hit is represented by the right-temporal lesion impairing the association between familiar faces and emotional values, the second one is the frontal bilateral hypometabolism favoring delusional behavior. The selective occurrence of "imposter" delusion for a particular subject and for a specific perceptual modality suggests the involvement of modality-specific interactions in the retrieval of affective properties during familiar people recognition.

Seeing your own or someone else's hand moving in accordance with your action: The neural interaction of agency and hand identity

Forward models can predict sensory consequences of self-action, which is reflected by less neural processing for actively than passively generated sensory inputs (BOLD suppression effect). However, it remains open whether forward models take the identity of a moving body part into account when predicting the sensory consequences of an action. In the current study, fMRI was used to investigate the neural correlates of active and passive hand movements during which participants saw either an on-line display of their own hand or someone else's hand moving in accordance with their movement. Participants had to detect delays (0-417 ms) between their movement and the displays. Analyses revealed reduced activation in sensory areas and higher delay detection thresholds for active versus passive movements. Furthermore, there was increased activation in the hippocampus, the amygdala, and the middle temporal gyrus when someone else's hand was seen. Most importantly, in posterior parietal (angular gyrus and precuneus), frontal (middle, superior, and medial frontal gyrus), and temporal (middle temporal gyrus) regions, suppression for actively versus passively generated feedback was stronger when participants were viewing their own compared to someone else's hand. Our results suggest that forward models can take hand identity into account when predicting sensory action consequences.

The 'Narcissus Effect': Top-down alpha-beta band modulation of face-related brain areas during self-face processing

Self-related information, such as one's own face, is prioritized by our cognitive system. Whilst recent theoretical developments suggest that this is achieved by an interplay between bottom-up and top-down attentional mechanisms, their underlying neural dynamics are still poorly understood. Furthermore, it is still matter of discussion as to whether these attentional mechanisms are truly self-specific or instead driven by face familiarity. To address these questions, we used EEG to record the brain activity of twenty-five healthy participants whilst identifying their own face, a friend's face and a stranger's face. Time-frequency analysis revealed a greater sustained power decrease in the alpha and beta frequency bands for the self-face, which emerged at late latencies and was maintained even when the face was no longer present. Critically, source analysis showed that this activity was generated in key brain regions for self-face recognition, such as the fusiform gyrus. As in the Myth of Narcissus, our results indicate that one's own face might have the potential to hijack attention. We suggest that this effect is specific to the self and driven by a top-down attentional control mechanism, which might facilitate further processing of personally relevant events.

Poor inhibition of personally-relevant facial expressions of sadness and anger predicts an elevated cortisol response following awakening six months later

Failure to inhibit interference from distracting emotional stimuli may obstruct an individual's ability to regulate their behavioural and emotional responses to environmental stressors. Few studies have examined the longitudinal association between cognitive inhibition and regulation of the hypothalamic-pituitary-adrenal axis (HPA) in the natural environment. Seventy-nine healthy adults underwent two assessments 6 months apart. Participants' ability to suppress interference from distracting emotional stimuli was assessed using a negative affective priming task that included both generic and personally-relevant (i.e., participants' intimate partners) facial expressions of emotion. Poorer inhibition of personally-relevant sad and angry faces, but not generic stimuli, significantly predicted an increased cortisol awakening response (CAR) six months later. Moreover, poor inhibition of personally-relevant sad faces mediated the relation between chronic stress and an elevated CAR. Difficulties inhibiting personally-relevant emotional information may represent a key mechanism in understanding how environmental stress influences HPA functioning.

Anatomical connections underlying personally-familiar face processing

Familiar face processing involves face specific regions (the core face system) as well as other non-specific areas related to processing of person-related information (the extended face system). The connections between core and extended face system areas must be critical for face recognition. Some studies have explored the connectivity pattern of unfamiliar face responding area, but none have explored those areas related to face familiarity processing in the extended system. To study these connections, diffusion weighted imaging with probabilistic tractography was used to estimate the white-matter pathways between core and extended system regions, which were defined from functional magnetic resonance imaging responses to personally-familiar faces. Strong white matter connections were found between occipitotemporal face areas (OFA/FFA) with superior temporal sulcus and insula suggesting the possible existence of direct anatomical connections from face-specific areas to frontal nodes that could underlay the processing of emotional information associated to familiar faces.

Memory across a short-delay: Systematic biases in memory for faces

From geometric figures to human faces, many visual stimuli vary along a continuum in featural space, anchored at one end by a highly distinctive constellation of features, at the other by a neutral set. Here we used a continuum of morphed faces to test whether errors in visual short-term memory are symmetric in feature space around the target or systematically biased toward one or the other end of the continuum. Participants were shown a face for 1 s. After a brief delay, participants were asked to choose the face they had been shown among three face options, which consisted of the target face, one face that was slightly more distinctive, and one face that was slightly more neutral. Continuums of morphed faces ranged from an average, neutral face to different distinctive celebrity faces two experiments, or from neutral facial expressions to highly emotional expressions a third experiment. Results showed that when participants made an incorrect response, they were more likely to incorrectly identify the more distinctive face than the more neutral or average face as the target face. This bias toward more extreme faces, however, was not observed for unfamiliar (non-celebrity) faces that were emotionally neutral. These findings suggest that visual memory encodes distinctive features of stimuli that lead to biases in later recognition.

Idiosyncratic, Retinotopic Bias in Face Identification Modulated by Familiarity

The perception of gender and age of unfamiliar faces is reported to vary idiosyncratically across retinal locations such that, for example, the same androgynous face may appear to be male at one location but female at another. Here, we test spatial heterogeneity for the recognition of the identity of personally familiar faces in human participants. We found idiosyncratic biases that were stable within participants and that varied more across locations for low as compared to high familiar faces. These data suggest that like face gender and age, face identity is processed, in part, by independent populations of neurons monitoring restricted spatial regions and that the recognition responses vary for the same face across these different locations. Moreover, repeated and varied social interactions appear to lead to adjustments of these independent face recognition neurons so that the same familiar face is eventually more likely to elicit the same recognition response across widely separated visual field locations. We provide a mechanistic account of this reduced retinotopic bias based on computational simulations.

Gaming-addicted teens identify more with their cyber-self than their own self: Neural evidence

According to existing neuroimaging studies of social cognition, individuals use knowledge about themselves to infer the mental states of others and to mentalize in a different way when the other is perceived to be similar versus dissimilar to oneself. In this study, we examined whether adolescent boys make mental state inferences for their online game characters and whether adolescents who were diagnosed as addicted to the internet game perceived their personal game character to be similar to themselves. Twelve internet-addicted adolescents and fifteen adolescents without addiction reported whether short phrases described themselves, a well-known historical person, or their own game character while undergoing a functional magnetic resonance imaging (fMRI). Different patterns of activity emerged for adolescents with internet game addiction compared to healthy adolescents when they were thinking about themselves, another person, and their game characters. Specifically, when addicted adolescents were thinking about their own game characters, more global and significant medial prefrontal (MPFC) and anterior cingulate (ACC) activations were observed, than even when compared to thinking about themselves. The ACC activation was correlated with the symptom severity. The activation patterns demonstrated that addicted adolescents were most attached to their game characters and equated their game characters to human.

Brain Responses to Dynamic Facial Expressions: A Normative Meta-Analysis

Identifying facial expressions is crucial for social interactions. Functional neuroimaging studies show that a set of brain areas, such as the fusiform gyrus and amygdala, become active when viewing emotional facial expressions. The majority of functional magnetic resonance imaging (fMRI) studies investigating face perception typically employ static images of faces. However, studies that use dynamic facial expressions (e.g., videos) are accumulating and suggest that a dynamic presentation may be more sensitive and ecologically valid for investigating faces. By using quantitative fMRI meta-analysis the present study examined concordance of brain regions associated with viewing dynamic facial expressions. We analyzed data from 216 participants that participated in 14 studies, which reported coordinates for 28 experiments. Our analysis revealed bilateral fusiform and middle temporal gyri, left amygdala, left declive of the cerebellum and the right inferior frontal gyrus. These regions are discussed in terms of their relation to models of face processing.

Understanding Activation Patterns in Shared Circuits: Toward a Value Driven Model

Over the past decade many studies indicate that we utilize our own motor system to understand the actions of other people. This mirror neuron system (MNS) has been proposed to be involved in social cognition and motor learning. However, conflicting findings regarding the underlying mechanisms that drive these shared circuits make it difficult to decipher a common model of their function. Here we propose adapting a “value-driven” model to explain discrepancies in the human mirror system literature and to incorporate this model with existing models. We will use this model to explain discrepant activation patterns in multiple shared circuits in the human data, such that a unified model may explain reported activation patterns from previous studies as a function of value.

Early Adverse Caregiving Experiences and Preschoolers' Current Attachment Affect Brain Responses during Facial Familiarity Processing: An ERP Study

When being placed into more benign environments like foster care, children from adverse rearing backgrounds are capable of forming attachment relationships to new caregivers within the first year of placement, while certain problematic social behaviors appear to be more persistent. Assuming that early averse experiences shape neural circuits underlying social behavior, neurophysiological studies on individual differences in early social-information processing have great informative value. More precisely, ERP studies have repeatedly shown face processing to be sensitive to experience especially regarding the caregiving background. However, studies on effects of early adverse caregiving experiences are restricted to children with a history of institutionalization. Also, no study has investigated effects of attachment security as a marker of the quality of the caregiver-child relationship. Thus, the current study asks how adverse caregiving experiences and attachment security to (new) caregivers affect early- and mid-latency ERPs sensitive to facial familiarity processing. Therefore, pre-school aged foster children during their second year within the foster home were compared to an age matched control group. Attachment was assessed using the AQS and neurophysiological data was collected during a passive viewing task presenting (foster) mother and stranger faces. Foster children were comparable to the control group with regard to attachment security. On a neurophysiological level, however, the foster group showed dampened N170 amplitudes for both face types. In both foster and control children, dampened N170 amplitudes were also found for stranger as compared to (foster) mother faces, and, for insecurely attached children as compared to securely attached children. This neural pattern may be viewed as a result of poorer social interactions earlier in life. Still, there was no effect on P1 amplitudes. Indicating heightened attentional processing, Nc amplitude responses to stranger faces were found to be enhanced in foster as compared to control children. Also, insecurely attached children allocated more attentional resources for the neural processing of mother faces. The study further confirms that early brain development is highly sensitive to the quality of caregiving. The findings are also relevant from a developmental perspective as miswiring of neural circuits may possibly play a critical role in children's psycho-social adjustment.

The neural representation of personally familiar and unfamiliar faces in the distributed system for face perception

Personally familiar faces are processed more robustly and efficiently than unfamiliar faces. The human face processing system comprises a core system that analyzes the visual appearance of faces and an extended system for the retrieval of person-knowledge and other nonvisual information. We applied multivariate pattern analysis to fMRI data to investigate aspects of familiarity that are shared by all familiar identities and information that distinguishes specific face identities from each other. Both identity-independent familiarity information and face identity could be decoded in an overlapping set of areas in the core and extended systems. Representational similarity analysis revealed a clear distinction between the two systems and a subdivision of the core system into ventral, dorsal and anterior components. This study provides evidence that activity in the extended system carries information about both individual identities and personal familiarity, while clarifying and extending the organization of the core system for face perception.

You Fill My Heart: Looking at One's Partner Increases Interoceptive Accuracy

The integration of external and internal bodily signals provides a coherent, multisensory experience of one’s own body. The ability to accurately detect internal bodily sensations is referred to as interoceptive accuracy (IAcc). Previous studies found that IAcc can be increased when people with low IAcc engage in self-processing such as when looking in the mirror or at a photograph of one’s own face. However, the way the self is represented changes depending on the context. Specifically, in social situations, the self is experienced in relation to significant others and not as an isolated individual. Intriguingly, in a relational context romantic partners can be used as social mirrors for one’s self. We here investigated whether directing one’s attention to romantic partners would enhance one’s IAcc, similar to the effect of self-face observation when the self is processed in isolation. During a heartbeat counting task, both concurrent self-face and partner-face observation improved accuracy in those with initially low IAcc; however, this improvement was significantly greater for the partner’s face. These results suggest that significant others may play an important role in determining the quality of one’s self-awareness. Given that high interoceptive awareness is linked to better emotion regulation, increased IAcc during partner observation is likely to have an adaptive role in maintaining stable and secure romantic relationships through greater emotion regulation.

Masking the Identities of Celebrities and Personally Familiar Individuals: Effects on Visual and Auditory Recognition Performance

The current study compared the effectiveness of masking on recognition performance for faces and voices of celebrities and personally familiar individuals. On the basis of the theory suggesting stronger memory representations for personally familiar individuals, we expected masking to be more effective for celebrities than for personally familiar stimulus persons. Furthermore, we sought to replicate the face recognition advantage with masked stimuli. Face pixelation and electronic changes of the voice pitch were applied as masking techniques, using four masking levels for each stimulus. Thirty-one undergraduate students were presented with the masked faces and voices of 10 celebrities and 10 personally familiar fellow students. As expected, more correct recognitions occurred for faces than for voices, suggesting that masking does not counteract the mechanisms causing the face recognition advantage. Unexpectedly, masking effectiveness did not differ between celebrities and personally familiar individuals. This may be due to the type of personally familiar individuals used. Within personally familiar stimuli, increased familiarity did not predict the effectiveness of masking. Whereas the highest masking level eliminated speaker recognition, masking did not fully eliminate face recognition. From a practical perspective, the findings especially question the suitability of pixelation as a means for identity concealment.

Adolescents' Socio-Motivational Relationships With Teachers, Amygdala Response to Teacher's Negative Facial Expressions, and Test Anxiety

The amygdala is essential for processing emotions, including the processing of aversive faces. The aim of this multimethodological study was to relate the amygdala reactivity of students (N = 88) toward teachers' fearful and angry faces, to students' relationship with their teachers. Furthermore, students' neural responses during the perception of teachers' faces were tested as predictors of test anxiety (controlling for neuroticism as a potential trait anxiety effect). Multiple regression analysis revealed that students reporting high-quality teacher-student relationships showed stronger amygdala activity toward fearful faces, which was related to worry. Furthermore, students with high levels of neuroticism tended to perceive their teachers as motivators and showed higher amygdala activity toward angry faces, which was related to the measures of emotionality.

Am I seeing myself, my friend or a stranger? The role of personal familiarity in visual distinction of body identities in the human brain

Several brain regions appear to play a role in representing different body identities. The specific contribution of each of these regions is still unclear, however. Here we investigated which brain areas enable the visual distinction between self and other bodies of different familiarity, and between familiar and unfamiliar other individuals, and moreover, where identity-specific information on the three individuals was encoded. Participants were confronted with standardized headless human body stimuli either showing the participant's own, a personally familiar or an unfamiliar other body, while performing a luminance discrimination task. Employing multivariate pattern analysis, we were able to identify areas that allowed for the distinction of self from personal familiar other bodies within the medial prefrontal cortex (mPFC) and posterior cingulate cortex/precuneus. Successful distinction of self from unfamiliar others was possible in the left middle frontal gyrus, the right inferior frontal gyrus, the left pre-supplementary motor area and the right putamen. Personally familiar others could be distinguished from unfamiliar others in the right temporoparietal junction (TPJ). An analysis of identity-specific information revealed a spatial gradient ranging from inferior posterior to superior anterior portions of the mPFC that was associated with encoding identity-related information for self via familiar to unfamiliar other bodies, respectively. Furthermore, several midline and frontal regions encoded information on more than one identity. The TPJ's role in deviance detection was underlined, as only identity-specific information on unfamiliar others was encoded here. Together, our findings suggest substantial spatial overlap in neural correlates of self and other body representation and thus, support the hypothesis of a socially-related representation of the self.

Neural Processing of Familiar and Unfamiliar Children's Faces: Effects of Experienced Love Withdrawal, but No Effects of Neutral and Threatening Priming

In the face of a potential threat to his or her child, a parent's caregiving system becomes activated, motivating the parent to protect and care for the child. However, the neural correlates of these responses are not yet well understood. The current study was a pilot study to investigate the processing of subliminally presented threatening primes and their effects on neural responses to familiar and unfamiliar children's faces. In addition, we studied potential moderating effects of empathy and childhood experiences of love-withdrawal. A total of 45 students participated in an fMRI experiment in which they were shown pictures of familiar children (pictures morphed to resemble the participant like an own child would) and unfamiliar children preceded by neutral and threatening primes. Participants completed a modified version of the Children's Report of Parental Behavior Inventory to measure parental love withdrawal, and the Empathic Concern scale of the Interpersonal Reactivity Index to measure affective empathy. Contrary to our expectations, we did not find evidence for subliminal priming effects. However, we did find enhanced activity in the right inferior frontal gyrus (IFG; involved in self-referential processing) and in face processing areas (infero-lateral occipital cortex and fusiform areas) in response to the familiar child, indicating preferential processing of these faces. Effects of familiarity in face processing areas were larger for participants reporting more love withdrawal, suggesting enhanced attention to and processing of these highly attachment relevant stimuli. Unfamiliar faces elicited enhanced activity in bilateral superior temporal gyrus (STG) and other regions associated with theory of mind (ToM), which may indicate more effortful ToM processing of these faces. We discuss the potential difference between a familiarity and a caregiving effect triggered by the morphed faces, and emphasize the need for replication in parents with pictures of their "real" own child.

The Role of Familiarity on Viewpoint Adaptation for Self-Face and Other-Face Images

An adaptation method was used to investigate whether self-face processing is dissociable from general face processing. We explored the viewpoint aftereffect with face images having different degrees of familiarity (never-before-seen faces, recently familiarized faces, personally familiar faces, and the participant’s own face). A face viewpoint aftereffect occurs after prolonged viewing of a face viewed from one side, with the result that the perceived viewing direction of a subsequently presented face image shown near the frontal view is biased in a direction which is the opposite of the adapting orientation. We found that (1) the magnitude of the viewpoint aftereffect depends on the level of familiarity of the adapting and test faces, (2) a cross-identity transfer of the viewpoint aftereffect is found between all categories of faces, but not between an unfamiliar adaptor face and the self-face test, and (3) learning affects the processing of the self-face in greater measure than any other category of faces. These results highlight the importance of familiarity on the face aftereffects, but they also suggest the possibility of separate representations for the self-face, on the one side, and for highly familiar faces, on the other.

Language modulates brain activity underlying representation of kinship terms

Kinship terms have been found to be highly diverse across languages. Here we investigated the brain representation of kinship terms in two distinct populations, native Chinese and Caucasian English speakers, with a five-element kinship identification (FEKI) task. The neuroimaging results showed a common extensive frontal and parietal lobe brain activation pattern for different kinship levels for both Chinese and Caucasian English speakers. Furthermore, Chinese speakers had longer reaction times and elicited more fronto-parietal brain networks activation compared to English speakers in level three (e.g., uncle and nephew) and four (e.g., cousin), including an association between the middle frontal gyrus and superior parietal lobe, which might be associated with higher working memory, attention control, and social distance representation load in Chinese kinship system processing. These results contribute to our understanding of the representation of kinship terms in the two languages.

ACC and IPL networks in the perception of the faces of parents during selective tasks

The perception of the faces of parents is different from that of other faces. Mother's face perception is associated with childbearing and parenting and has specific cognitive processing properties. Yet, the underlying mechanism remains unknown. We investigated the neural network that is involved in the perception of parent's face based upon parental face selective tasks that were completed by 23 normal adults. Resting state functional magnetic resonance imaging (fMRI) and a task block design with fixation cross sign control fMRI were used. The faces activated the right inferior frontal gyrus, the left and right middle frontal gyri, and the left and right inferior parietal lobule. In addition, the parental faces task resulted in more activation than the control tasks in the left and right anterior cingulate, left middle (superior) temporal gyrus, right and left inferior frontal gyrus. The anterior cingulate cortex (ACC) and the inferior parietal lobe (IPL) are central nodes of the brain network, while the parental face perception network includes the anterior cingulate cortex and superior temporal gyrus (ACC-STG)/parahippocampal network as well as the inferior frontal and inferior parietal lobule (IFG-IPL) network. The network of father's face perception involves the left inferior parietal lobule and left middle frontal gyrus/right middle frontal gyrus/right inferior frontal gyrus, while mother's face perception involves the right inferior parietal lobe and frontal network (MFG.L/IFG.R). The experiments showed that the ACC-STG/parahippocampal network and IFG-IPL network are neural networks used in parental face perception, and the ACC and IPL are central nodes in the network. The neural pathway of parental face perception is similar to the perception of a stranger's face, as both include the STG, but is different in that the perception of the stranger's face involves a connected STG and IPL as a specific neural pathway.

Neural mechanisms tracking popularity in real-world social networks

Differences in popularity are a key aspect of status in virtually all human groups and shape social interactions within them. Little is known, however, about how we track and neurally represent others' popularity. We addressed this question in two real-world social networks using sociometric methods to quantify popularity. Each group member (perceiver) viewed faces of every other group member (target) while whole-brain functional MRI data were collected. Independent functional localizer tasks were used to identify brain systems supporting affective valuation (ventromedial prefrontal cortex, ventral striatum, amygdala) and social cognition (dorsomedial prefrontal cortex, precuneus, temporoparietal junction), respectively. During the face-viewing task, activity in both types of neural systems tracked targets' sociometric popularity, even when controlling for potential confounds. The target popularity-social cognition system relationship was mediated by valuation system activity, suggesting that observing popular individuals elicits value signals that facilitate understanding their mental states. The target popularity-valuation system relationship was strongest for popular perceivers, suggesting enhanced sensitivity to differences among other group members' popularity. Popular group members also demonstrated greater interpersonal sensitivity by more accurately predicting how their own personalities were perceived by other individuals in the social network. These data offer insights into the mechanisms by which status guides social behavior.

Neural microgenesis of personally familiar face recognition

Despite a wealth of information provided by neuroimaging research, the neural basis of familiar face recognition in humans remains largely unknown. Here, we isolated the discriminative neural responses to unfamiliar and familiar faces by slowly increasing visual information (i.e., high-spatial frequencies) to progressively reveal faces of unfamiliar or personally familiar individuals. Activation in ventral occipitotemporal face-preferential regions increased with visual information, independently of long-term face familiarity. In contrast, medial temporal lobe structures (perirhinal cortex, amygdala, hippocampus) and anterior inferior temporal cortex responded abruptly when sufficient information for familiar face recognition was accumulated. These observations suggest that following detailed analysis of individual faces in core posterior areas of the face-processing network, familiar face recognition emerges categorically in medial temporal and anterior regions of the extended cortical face network.

Familiar Face Detection in 180 ms

The visual system is tuned for rapid detection of faces, with the fastest choice saccade to a face at 100 ms. Familiar faces have a more robust representation than do unfamiliar faces, and are detected faster in the absence of awareness and with reduced attentional resources. Faces of family and close friends become familiar over a protracted period involving learning the unique visual appearance, including a view-invariant representation, as well as person knowledge. We investigated the effect of personal familiarity on the earliest stages of face processing by using a saccadic-choice task to measure how fast familiar face detection can happen. Subjects made correct and reliable saccades to familiar faces when unfamiliar faces were distractors at 180 ms--very rapid saccades that are 30 to 70 ms earlier than the earliest evoked potential modulated by familiarity. By contrast, accuracy of saccades to unfamiliar faces with familiar faces as distractors did not exceed chance. Saccades to faces with object distractors were even faster (110 to 120 ms) and equivalent for familiar and unfamiliar faces, indicating that familiarity does not affect ultra-rapid saccades. We propose that detectors of diagnostic facial features for familiar faces develop in visual cortices through learning and allow rapid detection that precedes explicit recognition of identity.

Neurofunctional Signature of Hyperfamiliarity for Unknown Faces

Hyperfamiliarity for unknown faces is a rare selective disorder that consists of the disturbing and abnormal feeling of familiarity for unknown faces, while recognition of known faces is normal. In one such patient we investigated with a multimodal neuroimaging design the hitherto undescribed neural signature associated with hyperfamiliarity feelings. Behaviorally, signal detection methods revealed that the patient's discrimination sensitivity between familiar and unfamiliar faces was significantly lower than that of matched controls, and her response criterion for familiarity decisions was significantly more liberal. At the neural level, while morphometric analysis and single-photon emission CT (SPECT) showed the atrophy and hypofunctioning of the left temporal regions, functional magnetic resonance imaging (fMRI) revealed that hyperfamiliarity feelings were selectively associated to enhanced activity in the right medial and inferior temporal cortices. We therefore characterize the neurofunctional signature of hyperfamiliarity for unknown faces as related to the loss of coordinated activity between the complementary face processing functions of the left and right temporal lobes.

Is that me or my twin? Lack of self-face recognition advantage in identical twins

Despite the increasing interest in twin studies and the stunning amount of research on face recognition, the ability of adult identical twins to discriminate their own faces from those of their co-twins has been scarcely investigated. One's own face is the most distinctive feature of the bodily self, and people typically show a clear advantage in recognizing their own face even more than other very familiar identities. Given the very high level of resemblance of their faces, monozygotic twins represent a unique model for exploring self-face processing. Herein we examined the ability of monozygotic twins to distinguish their own face from the face of their co-twin and of a highly familiar individual. Results show that twins equally recognize their own face and their twin's face. This lack of self-face advantage was negatively predicted by how much they felt physically similar to their co-twin and by their anxious or avoidant attachment style. We speculate that in monozygotic twins, the visual representation of the self-face overlaps with that of the co-twin. Thus, to distinguish the self from the co-twin, monozygotic twins have to rely much more than control participants on the multisensory integration processes upon which the sense of bodily self is based. Moreover, in keeping with the notion that attachment style influences perception of self and significant others, we propose that the observed self/co-twin confusion may depend upon insecure attachment.

Recognition of personally familiar faces and functional connectivity in Alzheimer's disease

Studies have reported that patients in the severe stages of Alzheimer's disease (AD) experience difficulties recognizing their own faces in recent photographs. Two case reports of late-stage AD showed that this loss of self-face recognition was temporally graded: photographs from the remote past were recognized more easily than more recent photographs. Little is known about the neural correlates of own face recognition abilities in AD patients, while neuroimaging studies in healthy adults have related these abilities to a bilateral fronto-parieto-occipital network. In this study, two behavioral experiments (experiments 1 and 2) and one functional magnetic resonance imaging (fMRI) experiment (second part of experiment 2) were conducted to compare mild AD patients (experiment 1) and moderate AD patients (experiment 2) with healthy older participants in a recognition task involving self and familiar faces from different decades of the participants' life. In moderate AD patients, variable performance allowed us to examine correlations between scores and resting-state fMRI in order to link behavioral data to cerebral activity. At the behavioral level, the results revealed that, in mild AD, self and familiar face recognition was preserved. Moreover, mild AD patients and healthy older participants showed an inverse temporal gradient, with faster recognition of self and familiar recent photographs than self and familiar remote photographs. However, in moderate AD, both self and familiar face recognition were affected. fMRI results showed that the higher the connectivity between the dorsomedial prefrontal cortex (dMPFC) and the right superior frontal gyrus (rSFG), the lower the self and familiar face recognition scores in moderate AD patients. Given that previous studies have related the superior frontal region to control processes rather than face recognition processes, these results might reflect less segregation and more interference between brain networks in AD. In other words, impaired face recognition in AD may be related to functional dedifferentiation of specific brain regions.

Inhibition of personally-relevant angry faces moderates the effect of empathy on interpersonal functioning

While empathy is typically assumed to promote effective social interactions, it can sometimes be detrimental when it is unrestrained and overgeneralized. The present study explored whether cognitive inhibition would moderate the effect of empathy on social functioning. Eighty healthy young adults underwent two assessments six months apart. Participants’ ability to suppress interference from distracting emotional stimuli was assessed using a Negative Affective Priming Task that included both generic and personally-relevant (i.e., participants’ intimate partners) facial expressions of emotion. The UCLA Life Stress Interview and Empathy Quotient were administered to measure interpersonal functioning and empathy respectively. Multilevel modeling demonstrated that higher empathy was associated with worse concurrent interpersonal outcomes for individuals who showed weak inhibition of the personally-relevant depictions of anger. The effect of empathy on social functioning might be dependent on individuals’ ability to suppress interference from meaningful emotional distractors in their environment.