Distinct neural substrates for the perception of real and virtual visual worlds

Principal component analysis reveals multiple consistent responses to naturalistic stimuli in children and adults

Functional MRI (fMRI) study of naturalistic conditions, for example, movie watching, usually focuses on shared responses across subjects. However, individual differences have been attracting increasing attention in search of group differences or associations with behavioral outcomes. Individual differences are typically studied by directly modeling the pair‐wise intersubject correlation matrix or projecting the relations onto a single dimension. We contend that it is critical to examine whether there are one or more consistent responses underlying the whole sample, because multiple components, if exist, may undermine the intersubject relations using the previous methods. We propose to use principal component analysis (PCA) to examine the heterogeneity of brain responses across subjects and project the individual variability into higher dimensions. By analyzing an fMRI dataset of children and adults watching a cartoon movie, we showed evidence of two consistent responses in the supramarginal gyrus and other regions. While the first components in many regions represented a response pattern mostly in older children and adults, the second components mainly represented the younger children. The second components in the supramarginal network resembled a delayed version of the first PCs for 4 s (2 TR), indicating slower responses in the younger children than the older children and adults. The analyses highlight the importance of identifying multiple consistent responses in responses to naturalistic stimuli. This PCA‐based approach could be complementary to the commonly used intersubject correlation to analyze movie‐watching data.

Movies and narratives as naturalistic stimuli in neuroimaging

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

High-fidelity vibrokinetic stimulation induces sustained changes in intercortical coherence during a cinematic experience

OBJECTIVE

High-fidelity vibrokinetic (HFVK) technology is widely used to enhance the immersiveness of audiovisual (AV) entertainment experiences. However, despite evidence that HFVK technology does subjectively enhance AV immersion, the underlying mechanism has not been clarified. Neurophysiological studies could provide important evidence to illuminate this mechanism, thereby benefiting HFVK stimulus design, and facilitating expansion of HFVK technology.

APPROACH

We conducted a between-subjects (VK, N = 11; Control, N = 9) exploratory study to measure the effect of HFVK stimulation through an HFVK seat on electroencephalographic cortical activity during an AV cinematic experience. Subjective appreciation of the experience was assessed and incorporated into statistical models exploring the effects of HFVK stimulation across cortical brain areas. We separately analyzed alpha-band (8-12 Hz) and theta-band (5-7 Hz) activities as indices of engagement and sensory processing, respectively. We also performed theta-band (5-7 Hz) coherence analyses using cortical seed areas identified from the theta activity analysis.

MAIN RESULTS

The right fusiform gyrus, inferiotemporal gyrus, and supramarginal gyrus, known for emotion, AV-spatial, and vestibular processing, were identified as seeds from theta analyses. Coherence from these areas was uniformly enhanced in HFVK subjects in right motor areas, albeit predominantly in those who were appreciative. Meanwhile, compared to control subjects, HFVK subjects exhibited uniform interhemispheric decoherence with the left insula, which is important for self-processing.

SIGNIFICANCE

The results collectively point to sustained decoherence between sensory and self-processing as a possible mechanism for how HFVK increases immersion, and that coordination of emotional, spatial, and vestibular processing hubs with the motor system may be required for appreciation of the HFVK-enhanced experience. Overall, this study offers the first ever demonstration that HFVK stimulation has a real and sustained effect on brain activity during a cinematic experience.

Reality Status Judgments of Real and Fantastical Events in Children's Prefrontal Cortex: An fNIRS Study

The present study aimed to examine neural mechanisms underlying the ability to differentiate reality from fantasy. Using functional near-infrared spectroscopy (fNIRS), we measured prefrontal activations in children and adults while they performed a reality judgment task. Participants’ task was to judge the reality status of events in fantastical and realistic videos. Behavioral data revealed that, although there was no accuracy difference, children showed significantly longer reaction times in making the judgments than did adults. The fNIRS data consistently revealed higher prefrontal activations in children than in adults when watching the videos and judging the reality of the events. These results suggest that when making judgments of event reality, children may require more cognitive resources and also mainly rely on their own personal experiences.

Movies in the magnet: Naturalistic paradigms in developmental functional neuroimaging

The use of movie-watching as an acquisition state for functional connectivity (FC) MRI has recently enabled multiple groups to obtain rich data sets in younger children with both substantial sample sizes and scan durations. Using naturalistic paradigms such as movies has also provided analytic flexibility for these developmental studies that extends beyond conventional resting state approaches. This review highlights the advantages and challenges of using movies for developmental neuroimaging and explores some of the methodological issues involved in designing pediatric studies with movies. Emerging themes from movie-watching studies are discussed, including an emphasis on intersubject correlations, developmental changes in network interactions under complex naturalistic conditions, and dynamic age-related changes in both sensory and higher-order network FC even in narrow age ranges. Converging evidence suggests an enhanced ability to identify brain-behavior correlations in children when using movie-watching data relative to both resting state and conventional tasks. Future directions and cautionary notes highlight the potential and the limitations of using movies to study FC in pediatric populations.

Phenomenal, bodily and brain correlates of fictional reappraisal as an implicit emotion regulation strategy

The ability to modulate our emotional experience, depending on our current goal and context, is of critical importance for adaptive behavior. This ability encompasses various emotion regulation strategies, such as fictional reappraisal, at stake whenever one engages in fictional works (e.g., movies, books, video games, virtual environments). Neuroscientific studies investigating the distinction between the processing of real and fictional entities have reported the involvement of brain structures related to self-relevance and emotion regulation, suggesting a threefold interaction between the appraisal of reality, aspects of the Self, and emotions. The main aim of this study is to investigate the effect of implicit fictional reappraisal on different components of emotion, as well as on the modulatory role of autobiographical and conceptual self-relevance. While recording electrodermal, cardiac, and brain activity (EEG), we presented negative and neutral pictures to 33 participants, describing them as either real or fictional. After each stimulus, the participants reported their subjective emotional experience, self-relevance of the stimuli, as well as their agreement with their description. Using the Bayesian mixed-modeling framework, we showed that stimuli presented as fictional, compared with real, were subjectively appraised as less intense and less negative, and elicited lower skin conductance response, stronger heart-rate deceleration, and lower late positive potential amplitudes. Finally, these phenomenal and physiological changes did, to a moderate extent, rely on variations of specific aspects of self-relevance. Implications for the neuroscientific study of implicit emotion regulation are discussed.

Resting state connectivity mediates the relationship between collectivism and social cognition

Humans are intrinsically social beings and it is natural that self-processing is associated with social cognition. The degree to which the self is perceived as a part of social environment is modulated by cultural stereotypes, such as collectivism and individualism. Here, we tested the hypothesis that individuals who endorse collectivist values would spontaneously think more about their relationships with other people and this association would be mediated by connectivity between the medial prefrontal cortex (MPFC) and the rest of the brain. Connectivity was evaluated based on resting state EEG data using the recently developed methods, which combine beamformer spatial filtering with seed based connectivity estimation. The formal mediation analysis revealed that collectivism is associated with an enhanced connectivity of MPFC with a set of cortical regions that are frequently co-activated in moral reasoning, empathy, and theory of mind tasks and with diminished connectivity with the precuneus\posterior cingulate cortex, which is involved in self-centered cognition. The relationship between collectivism and social cognition was mediated by MPFC connectivity with the left middle temporal gyrus implying that in participants with collectivistic attitude, thinking about relationships with other people may be associated with semantic memory retrieval and reasoning on moral issues and others' intentions.

When Fiction Is Just as Real as Fact: No Differences in Reading Behavior between Stories Believed to be Based on True or Fictional Events

Experiments have shown that compared to fictional texts, readers read factual texts faster and have better memory for described situations. Reading fictional texts on the other hand seems to improve memory for exact wordings and expressions. Most of these studies used a “newspaper” vs. “literature” comparison. In the present study, we investigated the effect of reader's expectation to whether information is true or fictional with a subtler manipulation by labeling short stories as either based on true or fictional events. In addition, we tested whether narrative perspective or individual preference in perspective taking affects reading true or fictional stories differently. In an online experiment, participants (final N = 1,742) read one story which was introduced as based on true events or as fictional (factor fictionality). The story could be narrated in either 1st or 3rd person perspective (factor perspective). We measured immersion in and appreciation of the story, perspective taking, as well as memory for events. We found no evidence that knowing a story is fictional or based on true events influences reading behavior or experiential aspects of reading. We suggest that it is not whether a story is true or fictional, but rather expectations toward certain reading situations (e.g., reading newspaper or literature) which affect behavior by activating appropriate reading goals. Results further confirm that narrative perspective partially influences perspective taking and experiential aspects of reading.

Self-distancing improves interpersonal perceptions and behavior by decreasing medial prefrontal cortex activity during the provision of criticism

Previous research suggests that people show increased self-referential processing when they provide criticism to others, and that this self-referential processing can have negative effects on interpersonal perceptions and behavior. The current research hypothesized that adopting a self-distanced perspective (i.e. thinking about a situation from a non-first person point of view), as compared with a typical self-immersed perspective (i.e. thinking about a situation from a first-person point of view), would reduce self-referential processing during the provision of criticism, and in turn improve interpersonal perceptions and behavior. We tested this hypothesis in an interracial context since research suggests that self-referential processing plays a role in damaging interracial relations. White participants prepared for mentorship from a self-immersed or self-distanced perspective. They then conveyed negative and positive evaluations to a Black mentee while electroencephalogram (EEG) was recorded. Source analysis revealed that priming a self-distanced (vs self-immersed) perspective predicted decreased activity in regions linked to self-referential processing (medial prefrontal cortex; MPFC) when providing negative evaluations. This decreased MPFC activity during negative evaluations, in turn, predicted verbal feedback that was perceived to be more positive, warm and helpful. Results suggest that self-distancing can improve interpersonal perceptions and behavior by decreasing self-referential processing during the provision of criticism.

Empathy-Related Responses to Depicted People in Art Works

Existing theories of empathic response to visual art works postulate the primacy of automatic embodied reaction to images based on mirror neuron mechanisms. Arguing for a more inclusive concept of empathy-related response and integrating four distinct bodies of literature, we discuss contextual, and personal factors which modulate empathic response to depicted people. We then present an integrative model of empathy-related responses to depicted people in art works. The model assumes that a response to empathy-eliciting figural artworks engages the dynamic interaction of two mutually interlinked sets of processes: socio-affective/cognitive processing, related to the person perception, and esthetic processing, primarily concerned with esthetic appreciation and judgment and attention to non-social aspects of the image. The model predicts that the specific pattern of interaction between empathy-related and esthetic processing is co-determined by several sets of factors: (i) the viewer's individual characteristics, (ii) the context variables (which include various modes of priming by narratives and other images), (iii) multidimensional features of the image, and (iv) aspects of a viewer's response. Finally we propose that the model is implemented by the interaction of functionally connected brain networks involved in socio-cognitive and esthetic processing.

The paradox of fiction: Emotional response toward fiction and the modulatory role of self-relevance

For over forty years, philosophers have struggled with the "paradox of fiction", which is the issue of how we can get emotionally involved with fictional characters and events. The few neuroscientific studies investigating the distinction between the processing of real and fictional entities have evidenced that midline cortical structures and lateral fronto-parietal regions are more engaged for real and fictional entities, respectively. Interestingly, the former network is engaged in autobiographical memory retrieval and self-reference, processes that are known to boost emotional reactivity, while the latter underpins emotion regulation. Thus, a possible modulation of the emotional response according to the nature (real or fictional) of the stimulus is conceivable. To test this hypothesis, we presented short emotional (negative and positive) and neutral video as fictional or real. For negative material, we found that subjective emotional experience, but not physiological arousal measured by electrodermal activity, was reduced in the fictional condition. Moreover, the amount of personal memories linked to the scenes counteracted this effect boosting the subjective emotional response. On the contrary, personal memories elicited by the scenes, but not fiction, modulate the emotional response for positive material. These results suggest that when a stimulus triggers a personal memory, the emotional response is less prone to be modulated by contextual factors, and suggest that personal engagement could be responsible for emotional reaction toward fiction. We discuss these results in the emotion regulation framework and underline their implications in informing theoretical accounts of emotion in the neuroscientific domain and the philosophical debate on the paradox of emotional response to fiction.

Categorizing identity from facial motion

Advances in marker-less motion capture technology now allow the accurate replication of facial motion and deformation in computer-generated imagery (CGI). A forced-choice discrimination paradigm using such CGI facial animations showed that human observers can categorize identity solely from facial motion cues. Animations were generated from motion captures acquired during natural speech, thus eliciting both rigid (head rotations and translations) and nonrigid (expressional changes) motion. To limit interferences from individual differences in facial form, all animations shared the same appearance. Observers were required to discriminate between different videos of facial motion and between the facial motions of different people. Performance was compared to the control condition of orientation-inverted facial motion. The results show that observers are able to make accurate discriminations of identity in the absence of all cues except facial motion. A clear inversion effect in both tasks provided consistency with previous studies, supporting the configural view of human face perception. The accuracy of this motion capture technology thus allowed stimuli to be generated that closely resembled real moving faces. Future studies may wish to implement such methodology when studying human face perception.

Animal-oriented virtual environments: illusion, dilation, and discovery

As a research tool, virtual environments (VEs) hold immense promise for brain scientists. Yet to fully realize this potential in non-human systems, theoretical and conceptual perspectives must be developed. When selectively coupled to nervous systems, virtual environments can help us better understand the functional architecture of animals’ brains during naturalistic behaviors. While this will no doubt allow us to further our understanding of the neural basis of behavior, there is also an opportunity to uncover the diversity inherent in brain activity and behavior. This is due to two properties of virtual environments: the ability to create sensory illusions, and the ability to dilate space and/or time. These and other potential manipulations will be characterized as the effects of virtuality. In addition, the systems-level outcomes of virtual environment enhanced perception will be discussed in the context of the uncanny valley and other expected relationships between emotional valence, cognition, and training. These effects and their usefulness for brain science will be understood in the context of three types of neurobehavioral phenomena: sensorimotor integration, spatial navigation, and interactivity. For each of these behaviors, a combination of illusory and space/time dilation examples will be reviewed. Once these examples are presented, the implications for improving upon virtual models for more directly inducing the mental phenomena of illusion and space/time dilation will be considered. To conclude, future directions for integrating the use of VEs into a strategy of broader biological inquiry will be presented.

Cultural differences in human brain activity: a quantitative meta-analysis

Psychologists have been trying to understand differences in cognition and behavior between East Asian and Western cultures within a single cognitive framework such as holistic versus analytic or interdependent versus independent processes. However, it remains unclear whether cultural differences in multiple psychological processes correspond to the same or different neural networks. We conducted a quantitative meta-analysis of 35 functional MRI studies to examine cultural differences in brain activity engaged in social and non-social processes. We showed that social cognitive processes are characterized by stronger activity in the dorsal medial prefrontal cortex, lateral frontal cortex and temporoparietal junction in East Asians but stronger activity in the anterior cingulate, ventral medial prefrontal cortex and bilateral insula in Westerners. Social affective processes are associated with stronger activity in the right dorsal lateral frontal cortex in East Asians but greater activity in the left insula and right temporal pole in Westerners. Non-social processes induce stronger activity in the left inferior parietal cortex, left middle occipital and left superior parietal cortex in East Asians but greater activations in the right lingual gyrus, right inferior parietal cortex and precuneus in Westerners. The results suggest that cultural differences in social and non-social processes are mediated by distinct neural networks. Moreover, East Asian cultures are associated with increased neural activity in the brain regions related to inference of others' mind and emotion regulation whereas Western cultures are associated with enhanced neural activity in the brain areas related to self-relevance encoding and emotional responses during social cognitive/affective processes.

Empathy for social exclusion involves the sensory-discriminative component of pain: a within-subject fMRI study

Recent research has shown that experiencing events that represent a significant threat to social bonds activates a network of brain areas associated with the sensory-discriminative aspects of pain. In the present study, we investigated whether the same brain areas are involved when witnessing social exclusion threats experienced by others. Using a within-subject design, we show that an ecologically valid experience of social exclusion recruits areas coding the somatosensory components of physical pain (posterior insular cortex and secondary somatosensory cortex). Furthermore, we show that this pattern of activation not only holds for directly experienced social pain, but also during empathy for social pain. Finally, we report that subgenual cingulate cortex is the only brain area conjointly active during empathy for physical and social pain. This supports recent theories that affective processing and homeostatic regulation are at the core of empathic responses.

Accessible cultural mind-set modulates default mode activity: evidence for the culturally situated brain

Self-construal priming modulates human behavior and associated neural activity. However, the neural activity associated with the self-construal priming procedure itself remains unknown. It is also unclear whether and how self-construal priming affects neural activity prior to engaging in a particular task. To address this gap, we scanned Chinese adults, using functional magnetic resonance imaging, during self-construal priming and a following resting state. We found that, relative to a calculation task, both interdependent and independent self-construal priming activated the ventral medial prefrontal cortex (MPFC) and the posterior cingulate cortex (PCC). The contrast of interdependent vs. independent self-construal priming also revealed increased activity in the dorsal MPFC and left middle frontal cortex. The regional homogeneity analysis of the resting-state activity revealed increased local synchronization of spontaneous activity in the dorsal MPFC but decreased local synchronization of spontaneous activity in the PCC when contrasting interdependent vs. independent self-construal priming. The functional connectivity analysis of the resting-state activity, however, did not show significant difference in synchronization of activities in remote brain regions between different priming conditions. Our findings suggest that accessible collectivistic/individualistic mind-set induced by self-construal priming is associated with modulations of both task-related and resting-state activity in the default mode network.

Extraversion and anterior vs. posterior DMN activity during self-referential thoughts

Recent studies show that fronto-posterior electroencephalogram (EEG) spectral power distribution is associated with personality. Specifically, extraversion is associated with an increase of spectral power in posterior cortical regions that overlap with the posterior default mode network (DMN) hub and a decrease of spectral power in anterior regions that overlap with the anterior DMN hub. Although there is evidence that dopaminergic neurotransmission may be involved, psychological processes that underlie these associations remain unclear. I hypothesize that these processes may have something to do with spontaneous self-referential thoughts. Specifically, I hypothesize that in extraverts self-referential thoughts may be associated with an increase of spectral power in the posterior DMN hub, whereas in introverts they may be associated with an increase of spectral power in the anterior DMN hub. After spontaneous EEG registration, participants were asked to fill in a questionnaire describing their thoughts during the registration. An item describing self-referential positive expectations (SRPE) was used to measure individual differences in the intensity of these processes. Source localization and independent component analyses were applied to EEG data to reveal oscillatory activity associated with the anterior and the posterior DMN hubs. Hierarchical regression analysis showed a significant interaction between extraversion scores and anterior vs. posterior DMN alpha activity in predicting individual differences in SRPE scores. In extraverts, high SRPE scores were associated with an increase of alpha power in the posterior DMN hub, whereas in introverts they were associated with an increase of alpha power in the anterior DMN hub. Results are discussed in terms of differential involvement of the two DMN hubs in self-related reward processes in extraverts and introverts.

Fact vs fiction--how paratextual information shapes our reading processes

Our life is full of stories: some of them depict real-life events and were reported, e.g. in the daily news or in autobiographies, whereas other stories, as often presented to us in movies and novels, are fictional. However, we have only little insights in the neurocognitive processes underlying the reading of factual as compared to fictional contents. We investigated the neurocognitive effects of reading short narratives, labeled to be either factual or fictional. Reading in a factual mode engaged an activation pattern suggesting an action-based reconstruction of the events depicted in a story. This process seems to be past-oriented and leads to shorter reaction times at the behavioral level. In contrast, the brain activation patterns corresponding to reading fiction seem to reflect a constructive simulation of what might have happened. This is in line with studies on imagination of possible past or future events.

Distinct neural systems involved in agency and animacy detection

We designed an fMRI experiment comparing perception of human faces and robotic faces producing emotional expressions. The purpose of our experiment was to investigate engagement of different parts of the social brain by viewing these animate and inanimate agents. Both human and robotic face expressions evoked activity in face-responsive regions in the fusiform gyrus and STS and in the putative human mirror neuron system. These results suggest that these areas mediate perception of agency, independently of whether the agents are living or not. By contrast, the human faces evoked stronger activity than did robotic faces in the medial pFC and the anterior temporal cortex--areas associated with the representation of others' mental states (theory of mind), whereas robotic faces evoked stronger activity in areas associated with perception of objects and mechanical movements. Our data demonstrate that the representation of the distinction between animate and inanimate agents involves areas that participate in attribution of mental stance.

Neurocognitive processes of the religious leader in Christians

Our recent work suggests that trait judgment of the self in Christians, relative to nonreligious subjects, is characterized by weakened neural coding of stimulus self-relatedness in the ventral medial prefrontal cortex (VMPFC) but enhanced evaluative processes of self-referential stimuli in the dorsal medial prefrontal cortex (DMPFC). The current study tested the hypothesis that Christian belief and practice produce a trait summary about the religious leader (Jesus) in the believers and thus episodic memory retrieval is involved to the minimum degree when making trait judgment of Jesus. Experiment 1 showed that to recall a specific incident to exemplify Jesus' trait facilitated behavioral performances associated with the following trait judgment of Jesus in nonreligious subjects but not in Christians. Experiment 2 showed that, for nonreligious subjects, trait judgments of both government and religious leaders resulted in enhanced functional connectivity between MPFC and posterior parietal cortex (PPC)/precuneus compared with self judgment. For Christian subjects, however, the functional connectivity between MPFC and PPC/precuneus differentiated between trait judgments of the government leader and the self but not between trait judgments of Jesus and the self. Our findings suggest that Christian belief and practice modulate the neurocognitive processes of the religious leader so that trait judgment of Jesus engages increased employment of semantic trait summary but decreased memory retrieval of behavioral episodes.

Using predictive motor control processes in a cognitive task: behavioral and neuroanatomical perspectives

This chapter reviews evidence regarding the predictive relationship between execution of actions and their effect on performance of cognitive tasks based on processing visual feedback. The concept of forward modeling of action refers to a process whereby simulated or executed actions evoke a predictive model of the future state and position of the effector. For visually guided tasks, this forward model might include the visual outcome of the action. We describe a series of behavioural experiments that suggest that forward model output generated during action performance can assist in the processing of related visual stimuli. Additional results from a neuroimaging experiment on this "motor-visual priming" indicate that the superior parietal lobule is a likely key structure for processing the relationship between performed movements and visual feedback of those movements, and that this predictive system can be accessed for cognitive tasks.

Neural processing of threat cues in social environments

Previous research showed that the processing of overt threat cues formed by evolutionary experience such as snake or angry face induced automatic increased responses of the emotion-related system consisting of the amygdala, the anterior cingulate, and the orbitofrontal cortex. The present study used functional magnetic resonance imaging (fMRI) to investigate brain circuits involved in perception of threat cues that lack obvious emotion contents but are potentially dangerous in a particular social situation. Subjects were scanned while watching images showing a person in either a safe or a potentially dangerous situation and being asked to detect threat signals or to evaluate the degree of threat. We found that, in contrast with gender identification, threat detection and evaluation were underpinned by a neural network, shared by both male and female subjects, consisting of the medial and lateral frontal cortex, superior parietal lobes, posterior middle temporal cortex, and cerebellum. In addition, detection of threat cues was associated with stronger posterior parietal activation for males than females. Our findings suggest that neural processing of evolutionary unprepared threat cues in social environments does not necessarily involve the emotion-related neural system and is influence by evolutionary pressure on sex differences.

Attention modulates the specificity of automatic imitation to human actors

The perception of actions performed by others activates one's own motor system. Recent studies disagree as to whether this effect is specific to actions performed by other humans, an issue complicated by differences in perceptual salience between human and non-human stimuli. We addressed this issue by examining the automatic imitation of actions stimulated by viewing a virtual, computer-generated, hand. This stimulus was held constant across conditions, but participants' attention to the virtualness of the hand was manipulated by informing some participants during instructions that they would see a "computer-generated model of a hand," while making no mention of this to others. In spite of this attentional manipulation, participants in both conditions were generally aware of the virtualness of the hand. Nevertheless, automatic imitation of the virtual hand was significantly reduced--but not eliminated--when participants were told they would see a virtual hand. These results demonstrate that attention modulates the "human bias" of automatic imitation to non-human actors.

Culture-sensitive neural substrates of human cognition: a transcultural neuroimaging approach

Our brains and minds are shaped by our experiences, which mainly occur in the context of the culture in which we develop and live. Although psychologists have provided abundant evidence for diversity of human cognition and behaviour across cultures, the question of whether the neural correlates of human cognition are also culture-dependent is often not considered by neuroscientists. However, recent transcultural neuroimaging studies have demonstrated that one's cultural background can influence the neural activity that underlies both high- and low-level cognitive functions. The findings provide a novel approach by which to distinguish culture-sensitive from culture-invariant neural mechanisms of human cognition.

Distinct neurocognitive strategies for comprehensions of human and artificial intelligence

Although humans have inevitably interacted with both human and artificial intelligence in real life situations, it is unknown whether the human brain engages homologous neurocognitive strategies to cope with both forms of intelligence. To investigate this, we scanned subjects, using functional MRI, while they inferred the reasoning processes conducted by human agents or by computers. We found that the inference of reasoning processes conducted by human agents but not by computers induced increased activity in the precuneus but decreased activity in the ventral medial prefrontal cortex and enhanced functional connectivity between the two brain areas. The findings provide evidence for distinct neurocognitive strategies of taking others' perspective and inhibiting the process referenced to the self that are specific to the comprehension of human intelligence.

Temporal dynamic of neural mechanisms involved in empathy for pain: An event-related brain potential study

Previous neuroimaging studies have identified a neural circuit that is involved in empathy for pain. However, the temporal dynamics of neural activities underlying empathic processes remains poorly understood. This was investigated in the current study by recording event-related brain potentials (ERPs) from healthy adults who were presented with pictures or cartoons of hands that were in painful or neutral situations. Subjects performed a pain judgment task that required attention to pain cues in the stimuli or a counting task that withdrew their attention from these cues. The ERP results showed early differentiation between painful and neutral stimuli over the frontal lobe at 140 ms after sensory stimulation. A long-latency empathic response was observed after 380 ms over the central-parietal regions and was more salient over the left than right hemispheres. The early and late empathic responses were, respectively, modulated by contextual reality of stimuli and by top-down attention to the pain cues. Moreover, the mean ERP amplitudes at 140-180 ms were correlated with subjective reports of the degree of perceived pain of others and of self-unpleasantness. The ERP results support a model of empathy for pain consisting of early emotional sharing and late cognitive evaluation.

Effects of agency on movement interference during observation of a moving dot stimulus

Human movement performance is subject to interference if the performer simultaneously observes an incongruent action. It has been proposed that this phenomenon is due to motor contagion during simultaneous movement performance–observation, with coactivation of shared action performance and action observation circuitry in the premotor cortex. The present experiments compared the interference effect during observation of a moving person with observation of moving dot stimuli: The dot display followed either a biologically plausible or implausible velocity profile. Interference effects due to dot observation were present for both biological and nonbiological velocity profiles when the participants were informed that they were observing prerecorded human movement and were absent when the dot motion was described as computer generated. These results suggest that the observer's belief regarding the origin of the dot motion (human–computer generated) modulates the processing of the dot movement stimuli on their later integration within the motor system, such that the belief regarding their biological origin is a more important determinant of interference effects than the stimulus kinematics.

Building artificial humans to understand humans

If we could build an android as a very humanlike robot, how would we humans distinguish a real human from an android? The answer to this question is not so easy. In human-android interaction, we cannot see the internal mechanism of the android, and thus we may simply believe that it is a human. This means that a human can be defined from two perspectives: one by organic mechanism and the other by appearance. Further, the current rapid progress in artificial organs makes this distinction confusing. The approach discussed in this article is to create artificial humans with humanlike appearances. The developed artificial humans, an android and a geminoid, can be used to improve understanding of humans through psychological and cognitive tests conducted using the artificial humans. We call this new approach to understanding humans android science.

Detecting agency from the biological motion of veridical vs animated agents

The ability to detect agency is fundamental for understanding the social world. Underlying this capacity are neural circuits that respond to patterns of intentional biological motion in the superior temporal sulcus and temporoparietal junction. Here we show that the brain's blood oxygenation level dependent (BOLD) response to such motion is modulated by the representation of the actor. Dynamic social interactions were portrayed by either live-action agents or computer-animated agents, enacting the exact same patterns of biological motion. Using an event-related design, we found that the BOLD response associated with the perception and interpretation of agency was greater when identical physical movements were performed by real rather than animated agents. This finding has important implications for previous work on biological motion that has relied upon computer-animated stimuli and demonstrates that the neural substrates of social perception are finely tuned toward real-world agents. In addition, the response in lateral temporal areas was observed in the absence of instructions to make mental inferences, thus demonstrating the spontaneous implementation of the intentional stance.

Decoding human brain activity during real-world experiences

The human brain evolved to function and survive in a highly stimulating, complex and fast-changing world. Attempting to ascertain the neural substrates of operating in naturalistic contexts represents a huge challenge. Recently, however, researchers have begun to use several innovative analysis methods to interrogate functional magnetic resonance imaging (fMRI) data collected during dynamic naturalistic tasks. Central to these new developments is the inventive approach taken to segregating neural activity linked to specific events within the overall continuous stream of complex stimulation. In this review, we discuss the recent literature, detailing the key studies and their methods. These analytical techniques can be applied in a wide range of cognitive domains and, thus, offer exciting new opportunities for gaining insights into the brain bases of thoughts and behaviours in the real-world setting where they normally occur.

Attention and reality constraints on the neural processes of empathy for pain

Recent brain imaging studies have shown that the neural substrates underlying the ability to infer and share the feeling of pain of other individuals overlap with the pain matrix that mediates the process of one's own pain. While there has been evidence that the neural activity mediating pain experience is influenced by top-down attention, it remains unclear whether the neural substrates of empathy for pain are modulated by top-down controlled mechanisms. The current work investigated whether the neural correlates of empathic processes of pain are altered by task demand and prior knowledge of stimulus reality. Subjects were scanned using functional magnetic resonance imaging (fMRI) while watching pictures or cartoons of hands that were in painful or neutral situations. Subjects were asked either to evaluate pain intensity supposedly felt by the model or to count the number of hands in the stimulus displays. Relative to counting neutral stimuli, rating pain intensity of painful pictures and cartoons induced increased activation in ACC/paracingulate and the right middle frontal gyrus. Rating pain intensity also activated the inferior frontal cortex bilaterally and the right insula/putamen for pictures but activated the left parietal cortex, the postcentral gyrus, and the occipito-temporal cortex for cartoons. However, the neural activities related to pain rating were eliminated when subjects counted the number of hands in the painful stimuli. In addition, the ACC activity associated with empathy for pain was stronger for the pictures than for the cartoons. Our findings indicate that the involvement of the neural substrates underlying pain-related empathy is constrained by top-down attention and contextual reality of stimuli.

Right hemisphere dominance in perceiving coherence of visual events

The visual world consists of static pictures as well as of coherent visual events. The present study investigated neural substrates underlying the perception of coherence of visual events that evolves over time. We measured brain activity using functional magnetic resonance imaging (fMRI) while adults watched briefly presented static images that were extracted from movie clips depicting coherent visual events. The images were presented either in the coherent order as they were displayed in the movie clips or in a random order. Relative to the random order presentation condition, static images presented in the coherent order generated stronger activation in the right middle temporal cortex, the right posterior superior temporal cortex, and the right inferior postcentral gyrus. The results provide neuroimaging evidence for the dominance of the right hemisphere in perceiving coherent visual events.

Being with virtual others: Neural correlates of social interaction

To characterize the neural correlates of being personally involved in social interaction as opposed to being a passive observer of social interaction between others we performed an fMRI study in which participants were gazed at by virtual characters (ME) or observed them looking at someone else (OTHER). In dynamic animations virtual characters then showed socially relevant facial expressions as they would appear in greeting and approach situations (SOC) or arbitrary facial movements (ARB). Differential neural activity associated with ME>OTHER was located in anterior medial prefrontal cortex in contrast to the precuneus for OTHER>ME. Perception of socially relevant facial expressions (SOC>ARB) led to differentially increased neural activity in ventral medial prefrontal cortex. Perception of arbitrary facial movements (ARB>SOC) differentially activated the middle temporal gyrus. The results, thus, show that activation of medial prefrontal cortex underlies both the perception of social communication indicated by facial expressions and the feeling of personal involvement indicated by eye gaze. Our data also demonstrate that distinct regions of medial prefrontal cortex contribute differentially to social cognition: whereas the ventral medial prefrontal cortex is recruited during the analysis of social content as accessible in interactionally relevant mimic gestures, differential activation of a more dorsal part of medial prefrontal cortex subserves the detection of self-relevance and may thus establish an intersubjective context in which communicative signals are evaluated.

Performing hand actions assists the visual discrimination of similar hand postures

Recent theoretical work has suggested that internal predictive signals are used for motor control and coordination. The predictive signal - proposed to be the output of a forward model - would be a sensory representation of action. Hence, these sensory representations could potentially influence other sensory processes. We report here how performance of hand actions assisted the visual discrimination of target hand postures presented at random times within an on-going series of hand images. Reaction times to discriminate the targets were significantly shorter when the displayed images were both sequential and congruent with the action being performed. Hence, the planning or execution of action appears to allow better prediction of a displayed series of congruent images. In further control experiments, we show that the motor-visual priming effect is unlikely to be due to differential attentional demands and it is specific to a first person perspective display; it is short lasting, being lost if a 500 ms delay is introduced between successive stimulus presentations. The data are interpreted as evidence supporting the hypothesis that forward models in the motor system provide action-specific sensory predictions that are available to cognitive processes.

Empathy examined through the neural mechanisms involved in imagining how I feel versus how you feel pain

Perspective-taking is a stepping stone to human empathy. When empathizing with another individual, one can imagine how the other perceives the situation and feels as a result. To what extent does imagining the other differs from imagining oneself in similar painful situations? In this functional magnetic resonance imaging experiment, participants were shown pictures of people with their hands or feet in painful or non-painful situations and instructed to imagine and rate the level of pain perceived from different perspectives. Both the Self's and the Other's perspectives were associated with activation in the neural network involved in pain processing, including the parietal operculum, anterior cingulate cortex (ACC; BA32) and anterior insula. However, the Self-perspective yielded higher pain ratings and involved the pain matrix more extensively in the secondary somatosensory cortex, the ACC (BA 24a'/24b'), and the insula proper. Adopting the perspective of the Other was associated with specific increase in the posterior cingulate/precuneus and the right temporo-parietal junction. These results show the similarities between Self- and Other-pain representation, but most interestingly they also highlight some distinctiveness between these two representations, which is a crucial aspect of human empathy. It may be what allows us to distinguish empathic responses to others versus our own personal distress. These findings are consistent with the view that empathy does not involve a complete Self-Other merging.