Interpretation of Social Interactions: Functional Imaging of Cognitive-Semiotic Categories During Naturalistic Viewing

COMMON AND DISTINCT NEURAL CORRELATES OF SOCIAL INTERACTION PERCEPTION AND THEORY OF MIND

Social cognition spans from perceiving agents and their interactions to making inferences based on theory of mind (ToM). Despite their frequent co-occurrence in real life, the commonality and distinction between social interaction perception and ToM at behavioral and neural levels remain unclear. Here, participants (N = 231) provided moment-by-moment ratings of four text and four audio narratives on social interactions and ToM engagement. Social interaction and ToM ratings were reliable (split-half r = .98 and .92, respectively) but only modestly correlated across time (r = .32). In a second sample (N = 90), we analyzed co-variation between normative social interaction and ToM ratings and functional magnetic resonance (fMRI) activity during narrative reading (text) and listening (audio). Social interaction perception and ToM activity maps generalized across text and audio presentation (r = .83 and .57 between unthresholded t maps, respectively). When ToM was held constant, merely perceiving social interactions activated all regions canonically associated with ToM under both modalities (FDR q < .01), including temporoparietal junction, superior temporal sulcus, medial prefrontal cortex, and precuneus. ToM activated these regions as well, indicating a shared, modality-general system for social interaction perception and ToM. Furthermore, ToM uniquely engaged lateral occipitotemporal cortex, left anterior intraparietal sulcus, and right premotor cortex. These results imply that perceiving social interactions automatically engages regions implicated in mental state inferences. In addition, ToM is distinct from social interaction perception in its recruitment of regions associated with higher-level cognitive processes, including action understanding and executive functions.

Inter-subject gamma oscillation synchronization as a biomarker of abnormal processing of social interaction in ADHD

Children with attention-deficit hyperactivity disorder (ADHD) have difficulties in social interactions. Studying brain activity during social interactions is difficult with conventional artificial stimuli. This pioneering study examined the neural correlates of social perception in children with ADHD and matched controls using naturalistic stimuli. We presented 20 children with ADHD and 20 age-and-sex-matched controls with tailored movies featuring high- or low-level social interactions while recording electroencephalographic signals. Both groups exhibited synchronized gamma-band oscillations, but controls demonstrated greater inter-subject correlations. Additionally, the difference in inter-subject correlations between high- and low-interaction movies was significantly larger in controls compared to ADHD patients. Between 55 and 75 Hz comparing viewing high interaction movies with low interaction moves, controls had a significantly larger weighting in the right parietal lobe, while ADHD patients had a significantly smaller weighting in the left occipital lobe. These findings reveal distinct spatiotemporal neural signatures in social interaction processing among children with ADHD and controls using naturalistic stimuli. These neural markers offer potential for group differentiation and assessing intervention efficacy, advancing our understanding ADHD-related social interaction mechanisms.

Gaze behavior in social interactions between beach volleyball players—An exploratory approach

Previous research has indicated that social interactions and gaze behavior analyses in a group setting could be essential tools in accomplishing group objectives. However, only a few studies have examined the impact of social interactions on group dynamics in team sports and their influence on team performance. This study aimed to investigate the effects of game performance pressure on the gaze behavior within social interactions between beach volleyball players during game-like situations. Therefore, 18 expert beach volleyball players conducted a high and a low game performance pressure condition while wearing an eye tracking system. The results indicate that higher game performance pressure leads to more and longer fixation on teammates’ faces. A higher need for communication without misunderstandings could explain this adaptation. The longer and more frequent look at the face could improve the receiving of verbal and non-verbal information of the teammate’s face. Further, players showed inter-individual strategies to cope with high game performance pressure regarding their gaze behavior, for example, increasing the number of fixations and the fixation duration on the teammate’s face. Thereby, this study opens a new avenue for research on social interaction and how it is influenced in/through sport.

The Bidirectional Social-Cognitive Mechanisms of the Social-Attention Symptoms of Autism

Differences in social attention development begin to be apparent in the 6th to 12th month of development in children with Autism Spectrum Disorder (ASD) and theoretically reflect important elements of its neurodevelopmental endophenotype. This paper examines alternative conceptual views of these early social attention symptoms and hypotheses about the mechanisms involved in their development. One model emphasizes mechanism involved in the spontaneous allocation of attention to faces, or social orienting. Alternatively, another model emphasizes mechanisms involved in the coordination of attention with other people, or joint attention, and the socially bi-directional nature of its development. This model raises the possibility that atypical responses of children to the attention or the gaze of a social partner directed toward themselves may be as important in the development of social attention symptoms as differences in the development of social orienting. Another model holds that symptoms of social attention may be important to early development, but may not impact older individuals with ASD. The alterative model is that the social attention symptoms in infancy (social orienting and joint attention), and social cognitive symptoms in childhood and adulthood share common neurodevelopmental substrates. Therefore, differences in early social attention and later social cognition constitute a developmentally continuous axis of symptom presentation in ASD. However, symptoms in older individuals may be best measured with in vivo measures of efficiency of social attention and social cognition in social interactions rather than the accuracy of response on analog tests used in measures with younger children. Finally, a third model suggests that the social attention symptoms may not truly be a symptom of ASD. Rather, they may be best conceptualized as stemming from differences domain general attention and motivation mechanisms. The alternative argued for here that infant social attention symptoms meet all the criteria of a unique dimension of the phenotype of ASD and the bi-directional phenomena involved in social attention cannot be fully explained in terms of domain general aspects of attention development.

Common and Distinct Disruptions of Cortical Surface Morphology Between Autism Spectrum Disorder Children With and Without SHANK3 Deficiency

SH3 and Multiple Ankyrin Repeat Domains 3 (SHANK3)-caused autism spectrum disorder (ASD) may present a unique opportunity to clarify the heterogeneous neuropathological mechanisms of ASD. However, the specificity and commonality of disrupted large-scale brain organization in SHANK3-deficient children remain largely unknown. The present study combined genetic tests, neurobehavioral evaluations, and magnetic resonance imaging, aiming to explore the disruptions of both local and networked cortical structural organization in ASD children with and without SHANK3 deficiency. Multiple surface morphological parameters such as cortical thickness (CT) and sulcus depth were estimated, and the graph theory was adopted to characterize the topological properties of structural covariance networks (SCNs). Finally, a correlation analysis between the alterations in brain morphological features and the neurobehavioral evaluations was performed. Compared with typically developed children, increased CT and reduced nodal degree were found in both ASD children with and without SHANK3 defects mainly in the lateral temporal cortex, prefrontal cortex (PFC), temporo-parietal junction (TPJ), superior temporal gyrus (STG), and limbic/paralimbic regions. Besides commonality, our findings showed some distinct abnormalities in ASD children with SHANK3 defects compared to those without. Locally, more changes in the STG and orbitofrontal cortex were exhibited in ASD children with SHANK3 defects, while more changes in the TPJ and inferior parietal lobe (IPL) in those without SHANK3 defects were observed. For the SCNs, a trend toward regular network topology was observed in ASD children with SHANK3 defects, but not in those without. In addition, ASD children with SHANK3 defects showed more alterations of nodal degrees in the anterior and posterior cingulate cortices and right insular, while there were more disruptions in the sensorimotor areas and the left insular and dorsomedial PFC in ASD without SHANK3 defects. Our findings indicate dissociable disruptions of local and networked brain morphological features in ASD children with and without SHANK3 deficiency. Moreover, this monogenic study may provide a valuable path for parsing the heterogeneity of brain disturbances in ASD.

Judgmental perception of co-speech gestures in MDD

Cognitive bias in depression may increase sensitivity to judgmental appraisal of communicative cues. Nonverbal communication encompassing co-speech gestures is crucial for social functioning and is perceived differentially by men and women, however, little is known about the effect of depression on the perception of appraisal. We investigate if a cognitive bias influences the perception of appraisal and judgement of nonverbal communication in major depressive disorder (MDD). During watching videos of speakers retelling a story and gesticulating, 22 patients with MDD and 22 matched healthy controls pressed a button when they perceived the speaker as appraising in a positive or negative way. The speakers were presented in four different conditions (with and without speech and with natural speaker or as stick-figures) to evaluate context effects. Inter-subject covariance (ISC) of the button-press time series measured consistency across the groups of the response pattern depending on the factors diagnosis and gender. Significant effects emerged for the factors diagnosis (p = .002), gender (p = .007), and their interaction (p < .001). The female healthy controls perceived the gestures more consistently appraising than male controls, the female patients, and male patients whereas the latter three groups did not differ. Further, the ISC measure for consistency correlated negatively with depression severity. The natural speaker video without audio speech yielded the highest responses consistency. Indeed co-speech gestures may drive these ISC effects because number of gestures but not facial shrugs correlated with ISC amplitude. During co-speech gestures, a cognitive bias led to disturbed perception of appraisal in MDD for females. Social communication is critical for functional outcomes in mental disorders; thus perception of gestural communication is important in rehabilitation.

Altered EEG Oscillatory Brain Networks During Music-Listening in Major Depression

To examine the electrophysiological underpinnings of the functional networks involved in music listening, previous approaches based on spatial independent component analysis (ICA) have recently been used to ongoing electroencephalography (EEG) and magnetoencephalography (MEG). However, those studies focused on healthy subjects, and failed to examine the group-level comparisons during music listening. Here, we combined group-level spatial Fourier ICA with acoustic feature extraction, to enable group comparisons in frequency-specific brain networks of musical feature processing. It was then applied to healthy subjects and subjects with major depressive disorder (MDD). The music-induced oscillatory brain patterns were determined by permutation correlation analysis between individual time courses of Fourier-ICA components and musical features. We found that (1) three components, including a beta sensorimotor network, a beta auditory network and an alpha medial visual network, were involved in music processing among most healthy subjects; and that (2) one alpha lateral component located in the left angular gyrus was engaged in music perception in most individuals with MDD. The proposed method allowed the statistical group comparison, and we found that: (1) the alpha lateral component was activated more strongly in healthy subjects than in the MDD individuals, and that (2) the derived frequency-dependent networks of musical feature processing seemed to be altered in MDD participants compared to healthy subjects. The proposed pipeline appears to be valuable for studying disrupted brain oscillations in psychiatric disorders during naturalistic paradigms.

Movies and narratives as naturalistic stimuli in neuroimaging

Using movies and narratives as naturalistic stimuli in human neuroimaging studies has yielded significant advances in understanding of cognitive and emotional functions. The relevant literature was reviewed, with emphasis on how the use of naturalistic stimuli has helped advance scientific understanding of human memory, attention, language, emotions, and social cognition in ways that would have been difficult otherwise. These advances include discovering a cortical hierarchy of temporal receptive windows, which supports processing of dynamic information that accumulates over several time scales, such as immediate reactions vs. slowly emerging patterns in social interactions. Naturalistic stimuli have also helped elucidate how the hippocampus supports segmentation and memorization of events in day-to-day life and have afforded insights into attentional brain mechanisms underlying our ability to adopt specific perspectives during natural viewing. Further, neuroimaging studies with naturalistic stimuli have revealed the role of the default-mode network in narrative-processing and in social cognition. Finally, by robustly eliciting genuine emotions, these stimuli have helped elucidate the brain basis of both basic and social emotions apparently manifested as highly overlapping yet distinguishable patterns of brain activity.

Cortical thickness, local gyrification index and fractal dimensionality in people with acute and recovered Anorexia Nervosa and in people with Bulimia Nervosa

Eating disorders (EDs) have a possible neurodevelopmental pathogenesis. Our study aim was to assess regional cortical thickness (CT), local gyrification index (lGI) and fractal dimensionality (FD), as specific markers of cortical neurodevelopment in ED females. Twenty-two women with acute anorexia nervosa (acuAN), 10 with recovered anorexia nervosa (recAN), 24 with bulimia nervosa (BN) and 35 female healthy controls (HC) underwent a 3T MRI scan. All data were processed by FreeSurfer. Compared to recAN group women with acuAN showed a lower CT in multiple areas, while compared to HC they showed lower CT in temporal regions. BN group showed higher CT values in temporal and paracentral areas compared to HC. In multiple cortical areas, AcuAN group showed greater values of lGI compared to recAN group and lower values of lGI compared to HC. The BN group showed lower lGI in left medial orbitofrontal cortex compared to HC. No significant differences were found in FD among the groups. Present results provide evidence of CT and lGI alterations in patients with AN and, for the first time, in those with BN. Although these alterations could be state-dependent phenomena, they may underlie psychopathological aspects of EDs.

Digital Storytelling in Early Childhood: Student Illustrations Shaping Social Interactions

This study tests an instructional model designed to empower students in an early childhood classroom as emerging digital storytellers. Educators can use digital storytelling to support students' learning by encouraging them to organize and express their ideas and knowledge in an individual and meaningful way while developing voice and facility in child-computer interactions. This work also helps develop traditional communication skills, fosters collaboration, and strengthens emergent literacy practices. Students develop enhanced communication skills by learning to organize their ideas, ask questions, express opinions, and construct narratives as they interact with others and computers in the creation of digital stories. The "Emerging Digital Storytellers" instructional model focuses on social-emotional development and finding student voice through writing and digital content construction in the early childhood educational context.