Behavioral and electrophysiological correlates of intact and scrambled body perception

Brain dynamics of visual anticipation during spatial occlusion tasks in expert tennis players

Stimulus identification and action outcome understanding for a rapid and accurate response selection, play a fundamental role in racquet sports. Here, we investigated the neurodynamics of visual anticipation in tennis manipulating the postural and kinematic information associated with the body of opponents by means of a spatial occlusion protocol. Event Related Potentials (ERPs) were evaluated in two groups of professional tennis players (N = 37) with different levels of expertise, while they observed pictures of opponents and predicted the landing position as fast and accurately as possible. The observed action was manipulated by deleting different body districts of the opponent (legs, ball, racket and arm, trunk). Full body image (no occlusion) was used as control condition. The worst accuracy and the slowest response time were observed in the occlusion of trunk and ball. The former was associated with a reduced amplitude of the ERP components likely linked to body processing (the N1 in the right hemisphere) and visual-motor integration awareness (the pP1), as well as with an increase of the late frontal negativity (the pN2), possibly reflecting an effort by the insula to recover and/or complete the most correct sensory-motor representation. In both occlusions, a decrease in the pP2 may reflect an impairment of decisional processes upon action execution following sensory evidence accumulation. Enhanced amplitude of the P3 and the pN2 components were found in more experienced players, suggesting a greater allocation of resources in the process connecting sensory encoding and response execution, and sensory-motor representation.

A multilevel Bayesian meta-analysis of the body inversion effect: Evaluating controversies over headless and sexualized bodies

Face and body perception rely on specialized processing mechanisms to interpret social information efficiently. The body inversion effect (BIE), refers to an inversion effect for bodies, such that recognition of bodies is impaired by inversion. The BIE, like the face inversion effect (FIE), is particularly important because a disproportionate BIE relative to inversion effects for objects could be interpreted in much the same way as the disproportionate FIE has often been characterized; that is, as evidence of specialized, configural processing. However, research supporting the BIE is marked by methodological heterogeneity and mixed findings. Our multilevel Bayesian meta-analysis addresses inconsistencies in the literature by pooling data from numerous studies to estimate the magnitude of the BIE across various methodological and stimulus properties. We included 180 effect sizes from 41 empirical articles representing data from 2,274 participants. Overall, we found that the BIE was moderate-large in magnitude (Hedges' g = 0.75). Importantly, the inversion effect was larger for bodies than objects (b = 0.42); however, the inversion effect for faces was larger than for bodies (b = 0.34). We tested the role of discrimination dimension, stimulus type, face/head inclusion, stimulus sexualization, and sexualized stimulus sex as moderators of the BIE. We found that the BIE was moderated by discrimination dimension, stimulus type, stimulus sexualization, and sexualized stimulus sex. By synthesizing the existing literature, we provide a better theoretical understanding of how underlying visual processing mechanisms may differ for different types of social information (i.e., bodies vs. faces).

Turning the Face Inversion Effect on Its Head: Violated Expectations of Orientation, Lighting, and Gravity Enhance N170 Amplitudes

Face inversion effects occur for both behavioral and electrophysiological responses when people view faces. In EEG, inverted faces are often reported to evoke an enhanced amplitude and delayed latency of the N170 ERP. This response has been attributed to the indexing of specialized face processing mechanisms within the brain. However, inspection of the literature revealed that, although N170 is consistently delayed to a variety of face representations, only photographed faces invoke enhanced N170 amplitudes upon inversion. This suggests that the increased N170 amplitudes to inverted faces may have other origins than the inversion of the face's structure. We hypothesize that the unique N170 amplitude response to inverted photographed faces stems from multiple expectation violations, over and above structural inversion. For instance, rotating an image of a face upside-down not only violates the expectation that faces appear upright but also lifelong priors about illumination and gravity. We recorded EEG while participants viewed face stimuli (upright vs. inverted), where the faces were illuminated from above versus below, and where the models were photographed upright versus hanging upside-down. The N170 amplitudes were found to be modulated by a complex interaction between orientation, lighting, and gravity factors, with the amplitudes largest when faces consistently violated all three expectations. These results confirm our hypothesis that face inversion effects on N170 amplitudes are driven by a violation of the viewer's expectations across several parameters that characterize faces, rather than a disruption in the configurational disposition of its features.

Theta- and Gamma-Band Activity Discriminates Face, Body and Object Perception

Face and body perception is mediated by configural mechanisms, which allow the perception of these stimuli as a whole, rather than the sum of individual parts. Indirect measures of configural processing in visual cognition are the face and body inversion effects (FIE and BIE), which refer to the drop in performance when these stimuli are perceived upside-down. Albeit FIE and BIE have been well characterized at the behavioral level, much still needs to be understood in terms of the neurophysiological correlates of these effects. Thus, in the current study, the brain’s electrical activity has been recorded by a 128 channel electroencephalogram (EEG) in 24 healthy participants while perceiving (upright and inverted) faces, bodies and houses. EEG data were analyzed in both the time domain (i.e., event-related potentials—ERPs) and the frequency domain [i.e., induced theta (5–7 Hz) and gamma (28–45 Hz) oscillations]. ERPs amplitude results showed increased N170 amplitude for inverted faces and bodies (compared to the same stimuli presented in canonical position) but not for houses. ERPs latency results showed delayed N170 components for inverted (vs. upright) faces, houses, but not bodies. Spectral analysis of induced oscillations indicated physiological FIE and BIE; that is decreased gamma-band synchronization over right occipito-temporal electrodes for inverted (vs. upright) faces, and increased bilateral frontoparietal theta-band synchronization for inverted (vs. upright) faces. Furthermore, increased left occipito-temporal and right frontal theta-band synchronization for upright (vs. inverted) bodies was found. Our findings, thus, demonstrate clear differences in the neurophysiological correlates of face and body perception. The neurophysiological FIE suggests disruption of feature binding processes (decrease in occipital gamma oscillations for inverted faces), together with enhanced feature-based attention (increase in frontoparietal theta oscillations for inverted faces). In contrast, the BIE may suggest that structural encoding for bodies is mediated by the first stages of configural processing (decrease in occipital theta oscillations for inverted bodies).

The Relationship Between Social Power and Sexual Objectification: Behavioral and ERP Data

Sexual objectification is very common in modern Western societies, especially toward women. Previous research has suggested that in Western cultures, social power could lead to objectification. Specifically, power activates an approaching tendency toward useful targets, in turn leading to instrumental objectification and sexual objectification of targets. However, previous research has mostly focused on Western cultures, and the neural correlates underlying this phenomenon remain unclear. To examine whether the effects of power can be generalized to Chinese cultural contexts and how power promotes the objectification of sexualized bodies, we conducted two studies using Chinese samples. In Study 1, we replicated the behavioral effects of social power on sexual objectification. Specifically, we found that power increased sexual objectification toward sexualized female rather than male bodies. In Study 2, we examined the absence of an N170 amplitude inversion effect as a possible neural correlate of sexual objectification and replicated the effects of power on sexual objectification through event-related potentials (ERPs). For participants in a high-power group, the N170 amplitude inversion effect emerged when processing sexualized male bodies (less sexual objectification) but not female bodies (more sexual objectification); this effect was not seen for those participants in a low-power group. Our findings provide behavioral and neural data that power leads to increased sexual objectification toward sexualized women in Chinese participants.

Abstract Representations of Emotions Perceived From the Face, Body, and Whole-Person Expressions in the Left Postcentral Gyrus

Emotions can be perceived through the face, body, and whole-person, while previous studies on the abstract representations of emotions only focused on the emotions of the face and body. It remains unclear whether emotions can be represented at an abstract level regardless of all three sensory cues in specific brain regions. In this study, we used the representational similarity analysis (RSA) to explore the hypothesis that the emotion category is independent of all three stimulus types and can be decoded based on the activity patterns elicited by different emotions. Functional magnetic resonance imaging (fMRI) data were collected when participants classified emotions (angry, fearful, and happy) expressed by videos of faces, bodies, and whole-persons. An abstract emotion model was defined to estimate the neural representational structure in the whole-brain RSA, which assumed that the neural patterns were significantly correlated in within-emotion conditions ignoring the stimulus types but uncorrelated in between-emotion conditions. A neural representational dissimilarity matrix (RDM) for each voxel was then compared to the abstract emotion model to examine whether specific clusters could identify the abstract representation of emotions that generalized across stimulus types. The significantly positive correlations between neural RDMs and models suggested that the abstract representation of emotions could be successfully captured by the representational space of specific clusters. The whole-brain RSA revealed an emotion-specific but stimulus category-independent neural representation in the left postcentral gyrus, left inferior parietal lobe (IPL) and right superior temporal sulcus (STS). Further cluster-based MVPA revealed that only the left postcentral gyrus could successfully distinguish three types of emotions for the two stimulus type pairs (face-body and body-whole person) and happy versus angry/fearful, which could be considered as positive versus negative for three stimulus type pairs, when the cross-modal classification analysis was performed. Our study suggested that abstract representations of three emotions (angry, fearful, and happy) could extend from the face and body stimuli to whole-person stimuli and the findings of this study provide support for abstract representations of emotions in the left postcentral gyrus.

Body inversion effect in monkeys

Humans visually process human body images depending on the configuration of the parts. However, little is known about whether this function is evolutionarily shared with nonhuman animals. In this study, we examined the body posture discrimination performance of capuchin monkeys, a highly social platyrrhine primate, in comparison to humans. We demonstrate that, like humans, monkeys exhibit a body inversion effect: body posture discrimination is impaired by inversion, which disrupts the configural relationships of body parts. The inversion effect in monkeys was observed when human body images were used, but not when the body parts were replaced with cubic and cylindrical figures, the positions of the parts were scrambled, or only part of a body was presented. Results in human participants showed similar patterns, though they also showed the inversion effect when the cubic/cylindrical body images were used. These results provide the first evidence for configural processing of body forms in monkeys and suggest that the visual attunement to social signals mediated by body postures is conserved through the evolution of primate vision.

When the body becomes no more than the sum of its parts: the neural correlates of scrambled versus intact sexualized bodies

Recent research found that configural information is less important for the processing of sexualized bodies than for the processing of nonsexualized bodies. The present investigation aims to expand these findings by directly manipulating configural versus analytic processing of sexualized and nonsexualized bodies. We posited that disrupting first-order relational information through scrambling should be associated with larger N170 amplitudes (scrambling effect) for nonsexualized bodies, whereas the scrambling manipulation should not modulate N170 amplitudes associated with sexualized bodies and objects. We presented images of scrambled versus intact sexualized bodies, nonsexualized bodies, and objects while the N170 was recorded. Consistent with our hypothesis, we found that the scrambling manipulation was associated with larger N170 amplitudes for nonsexualized bodies (i.e. scrambling effect), whereas no scrambling effect emerged for sexualized bodies and objects. This research is the first to show that sexualized bodies are processed analytically at a neural level. Implications for the literature in body perception and objectification will be discussed.

Revealing Clothing Does Not Make the Object: ERP Evidences That Cognitive Objectification is Driven by Posture Suggestiveness, Not by Revealing Clothing

Recent research found that sexualized bodies are visually processed similarly to objects. This article examines the effects of skin-to-clothing ratio and posture suggestiveness on cognitive objectification. Participants were presented images of upright versus inverted bodies while we recorded the N170. We used the N170 amplitude inversion effect (larger N170 amplitudes for inverted vs. upright stimuli) to assess cognitive objectification, with no N170 inversion effect indicating less configural processing and more cognitive objectification. Contrary to Hypothesis 1, skin-to-clothing ratio was not associated with cognitive objectification (Experiments 1-3). However, consistent with Hypothesis 2, we found that posture suggestiveness was the key driver of cognitive objectification (Experiment 2), even after controlling for body asymmetry (Experiment 3). This article showed that high (vs. low) posture suggestiveness caused cognitive objectification (regardless of body asymmetry), whereas high (vs. low) skin-to-clothing ratio did not. The implications for objectification and body perception literatures are discussed.

Early visual ERPs show stable body-sensitive patterns over a 4-week test period

Event-related potential (ERP) studies feature among the most cited papers in the field of body representation, with recent research highlighting the potential of ERPs as neuropsychiatric biomarkers. Despite this, investigation into how reliable early visual ERPs and body-sensitive effects are over time has been overlooked. This study therefore aimed to assess the stability of early body-sensitive effects and visual P1, N1 and VPP responses. Participants were asked to identify pictures of their own bodies, other bodies and houses during an EEG test session that was completed at the same time, once a week, for four consecutive weeks. Results showed that amplitude and latency of early visual components and their associated body-sensitive effects were stable over the 4-week period. Furthermore, correlational analyses revealed that VPP component amplitude might be more reliable than VPP latency and specific electrode sites might be more robust indicators of body-sensitive cortical activity than others. These findings suggest that visual P1, N1 and VPP responses, alongside body-sensitive N1/VPP effects, are robust indications of neuronal activity. We conclude that these components are eligible to be considered as electrophysiological biomarkers relevant to body representation.

Linear Representation of Emotions in Whole Persons by Combining Facial and Bodily Expressions in the Extrastriate Body Area

Our human brain can rapidly and effortlessly perceive a person’s emotional state by integrating the isolated emotional faces and bodies into a whole. Behavioral studies have suggested that the human brain encodes whole persons in a holistic rather than part-based manner. Neuroimaging studies have also shown that body-selective areas prefer whole persons to the sum of their parts. The body-selective areas played a crucial role in representing the relationships between emotions expressed by different parts. However, it remains unclear in which regions the perception of whole persons is represented by a combination of faces and bodies, and to what extent the combination can be influenced by the whole person’s emotions. In the present study, functional magnetic resonance imaging data were collected when participants performed an emotion distinction task. Multi-voxel pattern analysis was conducted to examine how the whole person-evoked responses were associated with the face- and body-evoked responses in several specific brain areas. We found that in the extrastriate body area (EBA), the whole person patterns were most closely correlated with weighted sums of face and body patterns, using different weights for happy expressions but equal weights for angry and fearful ones. These results were unique for the EBA. Our findings tentatively support the idea that the whole person patterns are represented in a part-based manner in the EBA, and modulated by emotions. These data will further our understanding of the neural mechanism underlying perceiving emotional persons.

The Neural Correlates of Cognitive Objectification

At an early stage of visual processing, human faces and bodies are typically associated with larger N170s when presented in an inverted (vs. upright) position, indexing the involvement of configural processing. We challenged this view and hypothesized that sexualized bodies would not be sensitive to inversion, thereby suggesting that they would be processed similarly to objects. Participants saw sexualized male and female bodies, nonsexualized male and female bodies, as well as objects in both upright and inverted positions while we recorded the N170. Results indicated that inverted (vs. upright) nonsexualized male and female bodies were associated with larger N170 amplitudes. In contrast, no N170 amplitude inversion effect emerged for sexualized male and female bodies or objects. These results suggest that sexualized bodies are processed similarly to objects and quite differently than nonsexualized bodies. We discuss the results and their implications in the light of the literatures in person perception and objectification.

Where You Look Matters for Body Perception: Preferred Gaze Location Contributes to the Body Inversion Effect

The Body Inversion Effect (BIE; reduced visual discrimination performance for inverted compared to upright bodies) suggests that bodies are visually processed configurally; however, the specific importance of head posture information in the BIE has been indicated in reports of BIE reduction for whole bodies with fixed head position and for headless bodies. Through measurement of gaze patterns and investigation of the causal relation of fixation location to visual body discrimination performance, the present study reveals joint contributions of feature and configuration processing to visual body discrimination. Participants predominantly gazed at the (body-centric) upper body for upright bodies and the lower body for inverted bodies in the context of an experimental paradigm directly comparable to that of prior studies of the BIE. Subsequent manipulation of fixation location indicates that these preferential gaze locations causally contributed to the BIE for whole bodies largely due to the informative nature of gazing at or near the head. Also, a BIE was detected for both whole and headless bodies even when fixation location on the body was held constant, indicating a role of configural processing in body discrimination, though inclusion of the head posture information was still highly discriminative in the context of such processing. Interestingly, the impact of configuration (upright and inverted) to the BIE appears greater than that of differential preferred gaze locations.

Steady-state visually evoked potential correlates of human body perception

In cognitive neuroscience, interest in the neuronal basis underlying the processing of human bodies is steadily increasing. Based on functional magnetic resonance imaging studies, it is assumed that the processing of pictures of human bodies is anchored in a network of specialized brain areas comprising the extrastriate and the fusiform body area (EBA, FBA). An alternative to examine the dynamics within these networks is electroencephalography, more specifically so-called steady-state visually evoked potentials (SSVEPs). In SSVEP tasks, a visual stimulus is presented repetitively at a predefined flickering rate and typically elicits a continuous oscillatory brain response at this frequency. This brain response is characterized by an excellent signal-to-noise ratio-a major advantage for source reconstructions. The main goal of present study was to demonstrate the feasibility of this method to study human body perception. To that end, we presented pictures of bodies and contrasted the resulting SSVEPs to two control conditions, i.e., non-objects and pictures of everyday objects (chairs). We found specific SSVEPs amplitude differences between bodies and both control conditions. Source reconstructions localized the SSVEP generators to a network of temporal, occipital and parietal areas. Interestingly, only body perception resulted in activity differences in middle temporal and lateral occipitotemporal areas, most likely reflecting the EBA/FBA.

The neural basis of perceiving person interactions

This study examined whether the grouping of people into meaningful social scenes (e.g., two people having a chat) impacts the basic perceptual analysis of each partaking individual. To explore this issue, we measured neural activity using functional magnetic resonance imaging (fMRI) while participants sex-categorized congruent as well as incongruent person dyads (i.e., two people interacting in a plausible or implausible manner). Incongruent person dyads elicited enhanced neural processing in several high-level visual areas dedicated to face and body encoding and in the posterior middle temporal gyrus compared to congruent person dyads. Incongruent and congruent person scenes were also successfully differentiated by a linear multivariate pattern classifier in the right fusiform body area and the left extrastriate body area. Finally, increases in the person scenes' meaningfulness as judged by independent observers was accompanied by enhanced activity in the bilateral posterior insula. These findings demonstrate that the processing of person scenes goes beyond a mere stimulus-bound encoding of their partaking agents, suggesting that changes in relations between agents affect their representation in category-selective regions of the visual cortex and beyond.

Is the whole the sum of its parts? Configural processing of headless bodies in the right fusiform gyrus

The current study aimed to explore the functional magnetic resonance (fMR)-adaption effect by presenting intact and scrambled headless bodies and faces. This fMR-adaption paradigm allows investigating processing specificity in distinct brain areas by comparing the blood-oxygen-level-dependent (BOLD) signal related to the presentation of same or different pairs of bodies. There is clear evidence that we prefer whole bodies compared to the sum of their parts. This effect refers to a subtype of configural processing termed first-order relational information. The preference for whole bodies seems to be associated with activation pattern in body-sensitive brain regions. However, it remains unclear until now, which cortical area exactly mediates this preference. In the present study, we investigated whether there are neuronal populations that show a selective adaption to whole bodies compared to the sum of their parts. The right fusiform body area (FBA) showed a preference for whole bodies compared to the sum of their parts as the right and left fusiform face area showed a preference for whole faces compared to the sum of their parts. Thus, the present data support the idea that configural body and face processing is mediated by the fusiform gyrus. The current data further support the view that bodies are a special stimulus class with specific characteristics which are processed in body-sensitive brain areas.

Bodies are Represented as Wholes Rather Than Their Sum of Parts in the Occipital-Temporal Cortex

Behavioral studies suggested that bodies are represented as wholes rather than in a part-based manner. However, neural selectivity for body stimuli is found for both whole bodies and body parts. It is therefore undetermined whether the neural representation of bodies is configural or part-based. We used functional MRI to test the role of first-order configuration on body representation in the human occipital-temporal cortex by comparing the response to a whole body versus the sum of its parts. Results show that body-selective areas, whether defined by selectivity to headless bodies or body parts, preferred whole bodies over their sum of parts and successfully decoded body configuration. This configural representation was specific to body stimuli and not found for faces. In contrast, general object areas showed no preference for wholes over parts and decoded the configuration of both bodies and faces. Finally, whereas effects of inversion on configural face representation were specific to face-selective mechanisms, effects of body inversion were not unique to body-selective mechanisms. We conclude that the neural representation of body parts is strengthened by their arrangement into an intact body, thereby demonstrating a central role of first-order configuration in the neural representation of bodies in their category-selective areas.