Embodied social interaction constitutes social cognition in pairs of humans: a minimalist virtual reality experiment

Virtually Connected: Do Shared Novel Activities in Virtual Reality Enhance Self-Expansion and Relationship Quality?

According to self-expansion theory, sharing novel experiences with a romantic partner can help prevent boredom and maintain relationship quality. However, in today's globalized modern world, partners spend less time together and are more likely to live apart than in previous generations, limiting opportunities for shared novel experiences. In two in-lab experiments, we tested whether shared novel activities in virtual reality (VR) could facilitate self-expansion, reduce boredom, and enhance relationship quality. In Study 1, couples (N = 183) engaged in a shared novel and exciting activity in either VR or over video. Participants in the VR condition reported greater presence (i.e., felt like they were in the same space as their partner) and were less bored during the interaction compared to the video condition, though no main effects emerged for reports of self-expansion or relationship quality (relationship satisfaction and closeness). Consistent with predictions, people who reported more presence, in turn, reported greater self-expansion, less boredom, and greater relationship quality. In Study 2, couples (N = 141) engaged in a novel and exciting or a mundane experience in VR. Results were mixed such that participants in the novel VR condition reported less boredom and greater closeness post-interaction, though no effects emerged for self-expansion or relationship satisfaction. In exploratory analyses accounting for immersion, couples who engaged in the novel virtual experience reported more self-expansion, less boredom, and greater closeness. The findings suggest that virtual interactions may have less potential than in-person interaction to promote self-expansion but offer interesting future directions given VR's ability to enhance presence beyond video interactions.

Neural empathy mechanisms are shared for physical and social pain, and increase from adolescence to older adulthood

Empathy is a critical component of social interaction that enables individuals to understand and share the emotions of others. We report a preregistered experiment in which 240 participants, including adolescents, young adults, and older adults, viewed images depicting hands and feet in physically or socially painful situations (versus nonpainful). Empathy was measured using imagined pain ratings and EEG mu suppression. Imagined pain was greater for physical versus social pain, with young adults showing particular sensitivity to social pain events compared to adolescents and older adults. Mu desynchronization was greater to pain versus no-pain situations, but the physical/social context did not modulate pain responses. Brain responses to painful situations increased linearly from adolescence to young and older adulthood. These findings highlight shared activity across the core empathy network for both physical and social pain contexts, and an empathic response that develops over the lifespan with accumulating social experience.

Embodied hyperscanning for studying social interaction: A scoping review of simultaneous brain and body measurements

We systematically investigated the application of embodied hyperscanning methodologies in social neuroscience research. Hyperscanning enables the simultaneous recording of neurophysiological and physiological signals from multiple participants. We highlight the trend toward integrating Mobile Brain/Body Imaging (MoBI) within the 4E research framework, which emphasizes the interconnectedness of brain, body, and environment. Our analysis revealed a geographic concentration of studies in the Global North, calling for global collaboration and transcultural research to balance the field. The predominant use of Magneto/Electroencephalogram (M/EEG) in these studies suggests a traditional brain-centric perspective in social neuroscience. Future research directions should focus on integrating diverse techniques to capture the dynamic interplay between brain and body functions in real-world contexts. Our review also finds a preference for tasks involving natural settings. Nevertheless, the analysis in hyperscanning studies is often limited to physiological signal synchrony between participants. This suggests a need for more holistic and complex approaches that combine inter-corporeal synchrony with intra-individual measures. We believe that the future of the neuroscience of relationships lies in embracing the complexity of cognition, integrating diverse methods and theories to enrich our grasp of human social behavior in its natural contexts.

Three roots of online toxicity: disembodiment, accountability, and disinhibition

Online communication is central to modern social life, yet it is often linked to toxic manifestations and reduced well-being. How and why online communication enables these toxic social effects remains unanswered. In this opinion, we propose three roots of online toxicity: disembodiment, limited accountability, and disinhibition. We suggest that virtual disembodiment results in a chain of psychological states primed for deleterious social interaction. Drawing from differences between face-to-face and online interactions, the framework highlights and addresses the fundamental problems that result in impaired communication between individuals and explicates its effects on social toxicity online.

Predicting social experience from dyadic interaction dynamics: the BallGame, a novel paradigm to study social engagement

Theories of embodied cognition suggest that a shared environment and ongoing sensorimotor interaction are central for interpersonal learning and engagement. To investigate the embodied, distributed and hence dynamically unfolding nature of social cognitive capacities, we present a novel laboratory-based coordination task: the BallGame. Our paradigm requires continuous sensing and acting between two players who jointly steer a virtual ball around obstacles towards as many targets as possible. By analysing highly resolved measures of movement coordination and gaming behaviour, game-concurrent experience ratings, semi-structured interviews, and personality questionnaires, we reveal contributions from different levels of observation on social experience. In particular, successful coordination (number of targets collected) and intermittent periods of high versus low movement coordination (variability of relation) emerged as prominent predictors of social experience. Importantly, having the same (but incomplete) view on the game environment strengthened interpersonal coordination, whereas complementary views enhanced engagement and tended to generate more complex interactive behaviour. Overall, we find evidence for a critical balance between similarity and synchrony on the one hand, and variability and difference on the other, for successful engagement in social interactions. Finally, following participant reports, we highlight how interpersonal experience emerges from specific histories of coordination that are closely related to the interaction context in both space and time.

An open-source perceptual crossing device for investigating brain dynamics during human interaction

The Perceptual Crossing Device (PCD) introduced in this report is an updated tool designed to facilitate the exploration of brain activity during human interaction with seamless real time integration with EEG equipment. It incorporates haptic and auditory feedback mechanisms, enabling interactions between two users within a virtual environment. Through a unique circular motion interface that enables intuitive virtual interactions, users can experience the presence of their counterpart via tactile or auditory cues. This paper highlights the key characteristics of the PCD, aiming to validate its efficacy in augmenting the understanding of human interactions. Furthermore, by offering an accessible and intuitive interface, the PCD stands to foster greater community engagement in the realm of embodied cognitive science and human interaction studies. Through this device, we anticipate a deeper comprehension of the complex neural dynamics underlying human interaction, thereby contributing a valuable resource to both the scientific community and the broader public.

The Dynamics of Social Interaction Among Evolved Model Agents

We offer three advances to the perceptual crossing simulation studies, which are aimed at challenging methodological individualism in the analysis of social cognition. First, we evolve and systematically test agents in rigorous conditions, identifying a set of 26 "robust circuits" with consistently high and generalizing performance. Next, we transform the sensor from discrete to continuous, facilitating a bifurcation analysis of the dynamics that shows that nonequilibrium dynamics are key to the mutual maintenance of interaction. Finally, we examine agents' performance with partners whose neural controllers are different from their own and with decoy objects of fixed frequency and amplitude. Nonclonal performance varies and is not predicted by genotypic distance. Frequency-amplitude values that fool the focal agent do not include the agent's own values. Altogether, our findings accentuate the importance of dynamical and nonclonal analyses for simulated sociality, emphasize the role of dialogue between artificial and human studies, and highlight the contributions of simulation studies to understanding social interactions.

Hybrid Life: Integrating biological, artificial, and cognitive systems

Artificial life is a research field studying what processes and properties define life, based on a multidisciplinary approach spanning the physical, natural, and computational sciences. Artificial life aims to foster a comprehensive study of life beyond "life as we know it" and toward "life as it could be," with theoretical, synthetic, and empirical models of the fundamental properties of living systems. While still a relatively young field, artificial life has flourished as an environment for researchers with different backgrounds, welcoming ideas, and contributions from a wide range of subjects. Hybrid Life brings our attention to some of the most recent developments within the artificial life community, rooted in more traditional artificial life studies but looking at new challenges emerging from interactions with other fields. Hybrid Life aims to cover studies that can lead to an understanding, from first principles, of what systems are and how biological and artificial systems can interact and integrate to form new kinds of hybrid (living) systems, individuals, and societies. To do so, it focuses on three complementary perspectives: theories of systems and agents, hybrid augmentation, and hybrid interaction. Theories of systems and agents are used to define systems, how they differ (e.g., biological or artificial, autonomous, or nonautonomous), and how multiple systems relate in order to form new hybrid systems. Hybrid augmentation focuses on implementations of systems so tightly connected that they act as a single, integrated one. Hybrid interaction is centered around interactions within a heterogeneous group of distinct living and nonliving systems. After discussing some of the major sources of inspiration for these themes, we will focus on an overview of the works that appeared in Hybrid Life special sessions, hosted by the annual Artificial Life Conference between 2018 and 2022. This article is categorized under: Neuroscience > Cognition Philosophy > Artificial Intelligence Computer Science and Robotics > Robotics.

Ecological and Convergent Validity of Experimentally and Dynamically Assessed Capacity for Social Contingency Detection Using the Perceptual Crossing Experiment in Adolescence

The Perceptual Crossing Experiment (PCE) captures the capacity for social contingency detection using real-time social interaction dynamics but has not been externally validated. We tested ecological and convergent validity of the PCE in a sample of 208 adolescents from the general population, aged 11 to 19 years. We expected associations between PCE performance and (a) quantity and quality of social interaction in daily life, using Experience Sampling Methodology (ESM; ecological validity) and (b) self-reported social skills using a questionnaire (convergent validity). We also expected PCE performance to better explain variance in ESM social measures than self-reported social skills. Multilevel analyses showed that only self-reported social skills were positively associated with social experience of company in daily life. These initial results do not support ecological and convergent validity of the PCE. However, fueled by novel insights regarding the complexity of capturing social dynamics, we identified promising methodological advances for future validation efforts.

PCE simulation toolkit: a platform for perceptual crossing experiment research

The Perceptual Crossing Experiment (PCE) has been the object of study for over a decade, and aims at explaining how we perceive, interact with, and understand each other in real-time. In addition to human participant studies, a number of computational models have investigated how virtual agents can solve this task. However, the set of implementation choices that has been explored to date is rather limited, and the large number of variables that can be used make it very difficult to replicate the results. The main objective of this paper is to describe the PCE Simulation Toolkit we have developed and published as an open-source repository on GitHub. We hope that this effort will help make future PCE simulation results reproducible and advance research in the understanding of possible behaviors in this experimental paradigm. At the end of this paper, we present two case studies of evolved agents that demonstrate how parameter choices affect the simulations.

Machine Impostors Can Avoid Human Detection and Interrupt the Formation of Stable Conventions by Imitating Past Interactions: A Minimal Turing Test

Interactions between humans and bots are increasingly common online, prompting some legislators to pass laws that require bots to disclose their identity. The Turing test is a classic thought experiment testing humans' ability to distinguish a bot impostor from a real human from exchanging text messages. In the current study, we propose a minimal Turing test that avoids natural language, thus allowing us to study the foundations of human communication. In particular, we investigate the relative roles of conventions and reciprocal interaction in determining successful communication. Participants in our task could communicate only by moving an abstract shape in a 2D space. We asked participants to categorize their online social interaction as being with a human partner or a bot impostor. The main hypotheses were that access to the interaction history of a pair would make a bot impostor more deceptive and interrupt the formation of novel conventions between the human participants. Copying their previous interactions prevents humans from successfully communicating through repeating what already worked before. By comparing bots that imitate behavior from the same or a different dyad, we find that impostors are harder to detect when they copy the participants' own partners, leading to less conventional interactions. We also show that reciprocity is beneficial for communicative success when the bot impostor prevents conventionality. We conclude that machine impostors can avoid detection and interrupt the formation of stable conventions by imitating past interactions, and that both reciprocity and conventionality are adaptive strategies under the right circumstances. Our results provide new insights into the emergence of communication and suggest that online bots mining personal information, for example, on social media, might become indistinguishable from humans more easily.

Establishing conversational engagement and being effective: The role of body movement in mediated communication

A model for investigating the effects of body movement on conversational effectiveness in computer-mediated communication (CMC) is developed based on theories of motor cognition and embodiment. Movement is relevant to a wide range of CMC settings, including remote interviews, court testimonials, instructing, medical consultation, and socializing. The present work allows for a consideration of different forms of motoric activation, including gesturing and full-body motion, in mediated conversational settings and the derivation of a range of testable hypothesis. Motor cognition and embodiment provide an account of how speaker and listener become subject to the consequences of the muscular activation patterns that come with body movement. While movement supports internal elaboration, thus helping the speaker in formulating messages, it also has direct effects on the listener through behavioral synchrony and motor contagion. The effects of movement in CMC environments depend on two general characteristics: the level of visibility of movement and the extent to which the technology facilitates or inhibits movement. Available channels, set-up of technology, and further customization therefore determine whether movement can fulfil its internal functions (relevant to cognitive-affective elaboration of what is being said by the speaker) and its external functions (relevant to what is being perceived by and activated within the listener). Several indicators of conversational effectiveness are identified that serve as outcome variables. This MCEE model is intended to help users, developers and service provides to make CMC more engaging and more meaningful.

How to orchestrate a soccer team: Generalized synchronization promoted by rhythmic acoustic stimuli

Interpersonal coordination requires precise actions concerted in space and time in a self-organized manner. We found, using soccer teams as a testing ground, that a common timeframe provided by adequate acoustic stimuli improves the interplay between teammates. We provide quantitative evidence that the connectivity between teammates and the scoring rate of male soccer teams improve significantly when playing under the influence of an appropriate acoustic environment. Unexpectedly, female teams do not show any improvement under the same experimental conditions. We show by follow-up experiments that the acoustic rhythm modulates the attention level of the participants with a pronounced tempo preference and a marked gender difference in the preferred tempo. These results lead to a consistent explanation in terms of the dynamical system theory, nonlinear resonances, and dynamic attention theory, which may illuminate generic mechanisms of the brain dynamics and may have an impact on the design of novel training strategies in team sports.

Embodied Rationality Through Game Theoretic Glasses: An Empirical Point of Contact

The conceptual foundations, features, and scope of the notion of rationality are increasingly being affected by developments in embodied cognitive science. This article starts from the idea of embodied rationality, and aims to develop a frame in which a debate with the classical, possibly bounded, notion of rationality-as-consistency can take place. To this end, I develop a game theoretic description of a real time interaction setup in which participants' behaviors can be used to compare the enactive approach, which underlies embodied rationality, with game theoretic approaches to human interaction. The Perceptual Crossing Paradigm is a minimal interaction interface where two participants each control an avatar on a shared virtual line, and are tasked with cooperatively finding each other among distractor objects. It is well known that the best performance on this task is obtained when both participants let their movements coordinate with the objects they encounter, which they do without any prior knowledge of efficient interaction strategies in the system. A game theoretic model of this paradigm shows that this task can be described as an Assurance game, which allows for comparing game theoretical approaches and the enactive approach on two main fronts. First, accounting for the ability of participants to interactively solve the Assurance game; second, accounting for the evolution of choice landscapes resulting from evolving normative realms in the task. Similarly to the series of paradoxes which have fueled debates in economics in the past century, this analysis aims to serve as an interpretation testbed which can fuel the current debate on rationality.

Creative Togetherness. A Joint-Methods Analysis of Collaborative Artistic Performance

In the present study, we combined first-, second-, and third-person levels of analysis to explore the feeling of being and acting together in the context of collaborative artistic performance. Following participation in an international competition held in Czech Republic in 2018, a team of ten artistic swimmers took part in the study. First, a self-assessment instrument was administered to rate the different aspects of togetherness emerging from their collective activity; second, interviews based on video recordings of their performance were conducted individually with all team members; and third, the performance was evaluated by external artistic swimming experts. By combining these levels of analysis in different ways, we explore how changes in togetherness and lived experience in individual behavior may shape, disrupt, and (re-)stabilize joint performance. Our findings suggest that the experience of being and acting together is transient and changing, often alternating phases of decrease and increase in felt togetherness that can be consistently recognized by swimmers and external raters.

[Re]moving Bodies - A Shared Diminished Reality Installation for Exploring Relational Movement

In this article we explore an epistemic approach we name dis/embodiment and introduce "Articulations," an interdisciplinary project bringing together Virtual Reality (VR) designers, cognitive scientists, dancers, anthropologists, and human-machine interaction specialists. According to Erin Manning, our sense of self and other emerges from processes of bodying and relational movement (becoming oneself by moving in relation with the world). The aim of the project is to exploit the potential of multi-person VR in order to explore the intersubjective dynamics of relational movement and bodying, and to do so with scientific, artistic and therapeutic purposes in mind. To achieve this bridge, we bring up a novel paradigm we name "Shared Diminished Reality". It consists in using minimalist representation to instantiate users' bodies in the virtual space. Instead of using humanoid avatars or full body skeletons, we reduce the representation of the moving bodies to three spheres whose trajectories reflect the tracking of the head and the two wrists. This "diminished"virtual rendition of the body-in-movement, we call dis/embodiment. It provides a simple but clear experience of one's own responsive movement in relation to the world and other bodies. It also allows for subtle manipulations of bodies' perceptual and cross-perceptual feedback and simplifies the tracking and the analysis of movements. After having introduced the epistemic framework, the basic architecture, and the empirical method informing the installation, we present and discuss, as a proof-of-concept, some data collected in a situated experiment at a science-art event. We investigate motion patterns observed in different experimental conditions (in which participants either could or could not see the representation of their own hands in the virtual space) and their relation with subjective reports collected. We conclude with reflection on further possibilities of our installation in exploring bodying and relational movement.

Socializing Sensorimotor Contingencies

The aim of this review is to highlight the idea of grounding social cognition in sensorimotor interactions shared across agents. We discuss an action-oriented account that emerges from a broader interpretation of the concept of sensorimotor contingencies. We suggest that dynamic informational and sensorimotor coupling across agents can mediate the deployment of action-effect contingencies in social contexts. We propose this concept of socializing sensorimotor contingencies (socSMCs) as a shared framework of analysis for processes within and across brains and bodies, and their physical and social environments. In doing so, we integrate insights from different fields, including neuroscience, psychology, and research on human-robot interaction. We review studies on dynamic embodied interaction and highlight empirical findings that suggest an important role of sensorimotor and informational entrainment in social contexts. Furthermore, we discuss links to closely related concepts, such as enactivism, models of coordination dynamics and others, and clarify differences to approaches that focus on mentalizing and high-level cognitive representations. Moreover, we consider conceptual implications of rethinking cognition as social sensorimotor coupling. The insight that social cognitive phenomena like joint attention, mutual trust or empathy rely heavily on the informational and sensorimotor coupling between agents may provide novel remedies for people with disturbed social cognition and for situations of disturbed social interaction. Furthermore, our proposal has potential applications in the field of human-robot interaction where socSMCs principles might lead to more natural and intuitive interfaces for human users.

Does co-presence affect the way we perceive and respond to emotional interactions?

This study compared how two virtual display conditions of human body expressions influenced explicit and implicit dimensions of emotion perception and response behavior in women and men. Two avatars displayed emotional interactions (angry, sad, affectionate, happy) in a "pictorial" condition depicting the emotional interactive partners on a screen within a virtual environment and a "visual" condition allowing participants to share space with the avatars, thereby enhancing co-presence and agency. Subsequently to stimulus presentation, explicit valence perception and response tendency (i.e. the explicit tendency to avoid or approach the situation) were assessed on rating scales. Implicit responses, i.e. postural and autonomic responses towards the observed interactions were measured by means of postural displacement and changes in skin conductance. Results showed that self-reported presence differed between pictorial and visual conditions, however, it was not correlated with skin conductance responses. Valence perception was only marginally influenced by the virtual condition and not at all by explicit response behavior. There were gender-mediated effects on postural response tendencies as well as gender differences in explicit response behavior but not in valence perception. Exploratory analyses revealed a link between valence perception and preferred behavioral response in women but not in men. We conclude that the display condition seems to influence automatic motivational tendencies but not higher level cognitive evaluations. Moreover, intragroup differences in explicit and implicit response behavior highlight the importance of individual factors beyond gender.

Ethical Challenges of Using Virtual Environments in the Assessment and Treatment of Psychopathological Disorders

Clinicians are increasingly interested in the potential of virtual environments for research and praxes. Virtual environments include both immersive and non-immersive simulations of everyday activities. Moreover, algorithmic devices and adaptive virtual environments allow clinicians a medium for personalizing technologies to their patients. There is also increasing recognition of social virtual environments that connect virtual environments to social networks. Although there has been a great deal of deliberation on these novel technologies for assessment and treatment, less discourse has occurred around the ethical challenges that may ensue when these technologies are applied clinically. In this paper, some of the ethical issues involved in the clinical use of novel technologies are discussed.

A Hybrid Human-Neurorobotics Approach to Primary Intersubjectivity via Active Inference

Interdisciplinary efforts from developmental psychology, phenomenology, and philosophy of mind, have studied the rudiments of social cognition and conceptualized distinct forms of intersubjective communication and interaction at human early life. Interaction theorists consider primary intersubjectivity a non-mentalist, pre-theoretical, non-conceptual sort of processes that ground a certain level of communication and understanding, and provide support to higher-level cognitive skills. We argue the study of human/neurorobot interaction consists in a unique opportunity to deepen understanding of underlying mechanisms in social cognition through synthetic modeling, while allowing to examine a second person experiential (2PP) access to intersubjectivity in embodied dyadic interaction. Concretely, we propose the study of primary intersubjectivity as a 2PP experience characterized by predictive engagement, where perception, cognition, and action are accounted for an hermeneutic circle in dyadic interaction. From our interpretation of the concept of active inference in free-energy principle theory, we propose an open-source methodology named neural robotics library (NRL) for experimental human/neurorobot interaction, wherein a demonstration program named virtual Cartesian robot (VCBot) provides an opportunity to experience the aforementioned embodied interaction to general audiences. Lastly, through a study case, we discuss some ways human-robot primary intersubjectivity can contribute to cognitive science research, such as to the fields of developmental psychology, educational technology, and cognitive rehabilitation.

Time and Body. 2020. [DOI: 10.1017/9781108776660]

Time and Body promotes the application of phenomenological psychopathology and embodied research to a broad spectrum of mental disorders. In a new and practical way, it integrates the latest research on the temporal and intersubjective constitution of the body, self and its mental disorders from phenomenological, embodied and interdisciplinary research perspectives. The authors investigate how temporal processes apply to the contribution of embodiment and selfhood, as well as to their destabilization, such as in eating disorders and borderline personality disorders, schizophrenia, depression, social anxiety or dementia. The chapters demonstrate the applicability of phenomenological psychopathology to a range of illnesses and its relevance to treatment and clinical practice.

The Feeling Is Mutual: Clarity of Haptics-Mediated Social Perception Is Not Associated With the Recognition of the Other, Only With Recognition of Each Other

The enactive theory of perception hypothesizes that perceptual access to objects depends on the mastery of sensorimotor contingencies, that is, on the know-how of the regular ways in which changes in sensations depend on changes in movements. This hypothesis can be extended into the social domain: perception of other minds is constituted by mastery of self-other contingencies, that is, by the know-how of the regular ways in which changes in others' movements depend on changes in one's movements. We investigated this proposal using the perceptual crossing paradigm, in which pairs of players are required to locate each other in an invisible one-dimensional virtual space by using a minimal haptic interface. We recorded and analyzed the real-time embodied social interaction of 10 pairs of adult participants. The results reveal a process of implicit perceptual learning: on average, clarity of perceiving the other's presence increased over trials and then stabilized. However, a clearer perception of the other was not associated with correctness of recognition as such, but with both players correctly recognizing each other. Furthermore, the moments of correct mutual recognition tended to happen within seconds. The fact that changes in social experience can only be explained by the successful performance at the level of the dyad, and that this veridical mutual perception tends toward synchronization, lead us to hypothesize that integration of neural activity across both players played a role.

Behavioral implications of temporal lobe epilepsy on social contingency

OBJECTIVE

Temporal lobe epilepsy (TLE) is a chronic condition classically characterized by recurrent unprovoked episodes of involuntary violent motion and behavior whose degree and nature often overshadow the more subtle interictal neuropsychiatric symptoms. The purpose of this research was to investigate further the nature of cognitive impairment seen in social interaction within the population with TLE.

METHODS

We recorded the dynamics of real-time sensorimotor interaction in 10 pairs of control participants and ten pairs of participants with drug-resistantTLE using a minimalistic human-computer interface paradigm known as "perceptual crossing." We investigated whether TLE is associated with impaired detection of social contingency, i.e.,reduced sensitivity to their teammate's responsiveness to their behavior.

RESULTS

Our analysis reveals that using a simplified, computer-mediated, embodied form of social interaction, people with TLE demonstrated a statistically significant decrease in identification accuracy ratio (p-value is 0.00084,p < 0.05), a decrease in turn-taking (p-value is 0.03216,p < 0.05), decrease in player-object discrimination specificity (p-value is 0.00695,p < 0.05), and a decrease time spend in contact both in absolute terms (p-value is 0.00181, p < 0.05) and as a percentage of time after first contact (p-value is 0.0268, p < 0.05) when compared with age-gender-matched controls.

DISCUSSION

We found that coregulated interactions differed significantly between subjects with drug-resistantTLE and age-gender-matched controls consistent with prior meta-analysis observations regarding social cognition impairment in TLE. This is the first study to demonstrate social contingency impairment through dyadic interaction in the population with TLE.

What binds us? Inter-brain neural synchronization and its implications for theories of human consciousness

The association between neural oscillations and functional integration is widely recognized in the study of human cognition. Large-scale synchronization of neural activity has also been proposed as the neural basis of consciousness. Intriguingly, a growing number of studies in social cognitive neuroscience reveal that phase synchronization similarly appears across brains during meaningful social interaction. Moreover, this inter-brain synchronization has been associated with subjective reports of social connectedness, engagement, and cooperativeness, as well as experiences of social cohesion and ‘self-other merging’. These findings challenge the standard view of human consciousness as essentially first-person singular and private. We therefore revisit the recent controversy over the possibility of extended consciousness and argue that evidence of inter-brain synchronization in the fastest frequency bands overcomes the hitherto most convincing sceptical position. If this proposal is on the right track, our understanding of human consciousness would be profoundly transformed, and we propose a method to test this proposal experimentally.

Investigating real-time social interaction in pairs of adolescents with the Perceptual Crossing Experiment

The study of real-time social interaction provides ecologically valid insight into social behavior. The objective of the current research is to experimentally assess real-time social contingency detection in an adolescent population, using a shortened version of the Perceptual Crossing Experiment (PCE). Pairs of 148 adolescents aged between 12 and 19 were instructed to find each other in a virtual environment interspersed with other objects by interacting with each other using tactile feedback only. Across six rounds, participants demonstrated increasing accuracy in social contingency detection, which was associated with increasing subjective experience of the mutual interaction. Subjective experience was highest in rounds when both participants were simultaneously accurate in detecting each other's presence. The six-round version yielded comparable social contingency detection outcome measures to a ten-round version of the task. The shortened six-round version of the PCE has therefore enabled us to extend the previous findings on social contingency detection in adults to an adolescent population, enabling implementation in prospective research designs to assess the development of social contingency detection over time.

Temporal Structure in Haptic Signaling Under a Cooperative Task

Haptic communication between humans plays an important role in society. Although this form of communication is ubiquitous at all levels of society and of human development, little is known about how synchronized coordination of motion between two persons leads to higher-order cognitive functions used in communication. In this study, we developed a novel experimental paradigm of a coin-collecting task in which participants used their hands to control a rod to jointly collect the coins on the screen. We characterized the haptic interactions between paired participants while they were taking part in a cooperative task. The individual participants first completed this task on their own and then with a randomly assigned partner for the cooperative task. Single participant experiments were used as a baseline to compare results of the paired participants. Forces applied to the rod were translated to four possible haptic states which encode the combination of the haptic interactions. As a next step, pairs of consecutive haptic states were then combined into 16 possible haptic signals which were classified in terms of their temporal patterns using a Tsallis q-exponential function. For paired participants, 80% of the haptic signals could be fit by the Tsallis q-exponential. On the other hand, only 30% of the signals found in the single-participant trials could be fit by the Tsallis q-exponential. This shows a clear difference in the temporal structures of haptic signals when participants are interacting with each other and when they are not. We also found a large difference in the number of haptic signals used by paired participants and singles. Single participants only used 1/4 of the possible haptic signals. Paired participants, on the other hand, used more than half of the possible signals. These results suggest that temporal structures present in haptic communication could be linked to the emergence of language at an evolutionary level.

Interpersonal synchrony feels good but impedes self-regulation of affect

The social benefits of interpersonal synchrony are widely recognized. Yet, little is known about its impact on the self. According to enactive cognitive science, the human self for its stability and regulation needs to balance social attunement with disengagement from others. Too much interpersonal synchrony is considered detrimental for a person’s ability to self-regulate. In this study, 66 adults took part in the Body-Conversation Task (BCT), a dyadic movement task promoting spontaneous social interaction. Using whole-body behavioural imaging, we investigated the simultaneous impact of interpersonal synchrony (between persons) and intrapersonal synchrony (within a person) on positive affect and self-regulation of affect. We hypothesized that interpersonal synchrony’s known tendency to increase positive affect would have a trade-off, decreasing a person’s ability to self-regulate affect. Interpersonal synchrony predicted an increase in positive affect. Consistent with our hypothesis, it simultaneously predicted a weakening in self-regulation of affect. Intrapersonal synchrony, however, tended to oppose these effects. Our findings challenge the widespread belief that harmony with others has only beneficial effects, pointing to the need to better understand the impact of interaction dynamics on the stability and regulation of the human self.

Multi-Scale Coordination of Distinctive Movement Patterns During Embodied Interaction Between Adults With High-Functioning Autism and Neurotypicals

Autism Spectrum Disorder (ASD) can be understood as a social interaction disorder. This requires researchers to take a “second-person” stance and to use experimental setups based on bidirectional interactions. The present work offers a quantitative description of movement patterns exhibited during computer-mediated real-time sensorimotor interaction in 10 dyads of adult participants, each consisting of one control individual (CTRL) and one individual with high-functioning autism (HFA). We applied time-series analyses to their movements and found two main results. First, multi-scale coordination between participants was present. Second, despite this dyadic alignment and our previous finding that individuals with HFA can be equally sensitive to the other’s presence, individuals’ movements differed in style: in contrast to CTRLs, HFA participants appeared less inclined to sustain mutual interaction and instead explored the virtual environment more generally. This finding is consistent with social motivation deficit accounts of ASD, as well as with hypersensitivity-motivated avoidance of overstimulation. Our research demonstrates the utility of time series analyses for the second-person stance and complements previous work focused on non-dynamical and performance-based variables.

Coordinated Interpersonal Behaviour in Collective Dance Improvisation: The Aesthetics of Kinaesthetic Togetherness

Collective dance improvisation (e.g., traditional and social dancing, contact improvisation) is a participatory, relational and embodied art form which eschews standard concepts in aesthetics. We present our ongoing research into the mechanisms underlying the lived experience of “togetherness” associated with such practices. Togetherness in collective dance improvisation is kinaesthetic (based on movement and its perception), and so can be simultaneously addressed from the perspective of the performers and the spectators, and be measured. We utilise these multiple levels of description: the first-person, phenomenological level of personal experiences, the third-person description of brain and body activity, and the level of interpersonal dynamics. Here, we describe two of our protocols: a four-person mirror game and a ‘rhythm battle’ dance improvisation score. Using an interpersonal closeness measure after the practice, we correlate subjective sense of individual/group connectedness and observed levels of in-group temporal synchronization. We propose that kinaesthetic togetherness, or interpersonal resonance, is integral to the aesthetic pleasure of the participants and spectators, and that embodied feeling of togetherness might play a role more generally in aesthetic experience in the performing arts.

Sensitivity to Social Contingency in Adults with High-Functioning Autism during Computer-Mediated Embodied Interaction

Autism Spectrum Disorder (ASD) can be understood as a social interaction disorder. This makes the emerging "second-person approach" to social cognition a more promising framework for studying ASD than classical approaches focusing on mindreading capacities in detached, observer-based arrangements. According to the second-person approach, embodied, perceptual, and embedded or interactive capabilities are also required for understanding others, and these are hypothesized to be compromised in ASD. We therefore recorded the dynamics of real-time sensorimotor interaction in pairs of control participants and participants with High-Functioning Autism (HFA), using the minimalistic human-computer interface paradigm known as "perceptual crossing" (PC). We investigated whether HFA is associated with impaired detection of social contingency, i.e., a reduced sensitivity to the other's responsiveness to one's own behavior. Surprisingly, our analysis reveals that, at least under the conditions of this highly simplified, computer-mediated, embodied form of social interaction, people with HFA perform equally well as controls. This finding supports the increasing use of virtual reality interfaces for helping people with ASD to better compensate for their social disabilities. Further dynamical analyses are necessary for a better understanding of the mechanisms that are leading to the somewhat surprising results here obtained.

Observing and participating in social interactions: Action perception and action control across the autistic spectrum

Autism is a developmental condition, characterized by difficulties of social interaction and communication, as well as restricted interests and repetitive behaviors. Although several important conceptions have shed light on specific facets, there is still no consensus about a universal yet specific theory in terms of its underlying mechanisms. While some theories have exclusively focused on sensory aspects, others have emphasized social difficulties. However, sensory and social processes in autism might be interconnected to a higher degree than what has been traditionally thought. We propose that a mismatch in sensory abilities across individuals can lead to difficulties on a social, i.e. interpersonal level and vice versa. In this article, we, therefore, selectively review evidence indicating an interrelationship between perceptual and social difficulties in autism. Additionally, we link this body of research with studies, which investigate the mechanisms of action control in social contexts. By doing so, we highlight that autistic traits are also crucially related to differences in integration, anticipation and automatic responding to social cues, rather than a mere inability to register and learn from social cues. Importantly, such differences may only manifest themselves in sufficiently complex situations, such as real-life social interactions, where such processes are inextricably linked.

Quantifying Collaboration with a Co-Creative Drawing Agent

This article describes a new technique for quantifying creative collaboration and applies it to the user study evaluation of a co-creative drawing agent. We present a cognitive framework called creative sense-making that provides a new method to visualize and quantify the interaction dynamics of creative collaboration, for example, the rhythm of interaction, style of turn taking, and the manner in which participants are mutually making sense of a situation. The creative sense-making framework includes a qualitative coding technique, interaction coding software, an analysis method, and the cognitive theory behind these applications. This framework and analysis method are applied to empirical studies of the Drawing Apprentice collaborative sketching system to compare human collaboration with a co-creative AI agent vs. a Wizard of Oz setup. The analysis demonstrates how the proposed technique can be used to analyze interaction data using continuous functions (e.g., integrations and moving averages) to measure and evaluate how collaborations unfold through time.

A Sensorimotor Signature of the Transition to Conscious Social Perception: Co-regulation of Active and Passive Touch

It is not yet well understood how we become conscious of the presence of other people as being other subjects in their own right. Developmental and phenomenological approaches are converging on a relational hypothesis: my perception of a "you" is primarily constituted by another subject's attention being directed toward "me." This is particularly the case when my body is being physically explored in an intentional manner. We set out to characterize the sensorimotor signature of the transition to being aware of the other by re-analyzing time series of embodied interactions between pairs of adults (recorded during a "perceptual crossing" experiment). Measures of turn-taking and movement synchrony were used to quantify social coordination, and transfer entropy was used to quantify direction of influence. We found that the transition leading to one's conscious perception of the other's presence was indeed characterized by a significant increase in one's passive reception of the other's tactile stimulations. Unexpectedly, one's clear experience of such passive touch was consistently followed by a switch to active touching of the other, while the other correspondingly became more passive, which suggests that this intersubjective experience was reciprocally co-regulated by both participants.

Joint action in an elite rowing pair crew after intensive team training: The reinforcement of extra-personal processes

The present study is a follow-up case report of the study from R'Kiouak and colleagues (2016). From the initial study that analyzed how individual experts rowed together while they never had practiced together, we seized here the opportunity to investigate how both rowers synchronize after having intensively practiced joint action through a national training program in which they were invited to take part. The joint action of 2 individual expert rowers, which composed a coxless pair crew, was tracked on-the-water at the end of a team-training program. We first determined how each rower experienced the joint action at each instance of oars' strokes during a 12min race. A phenomenological analysis evidenced several categories of how rowers shared lived experiences of their joint action. From mechanical data captured through an automatic recording device, we then scrutinized the mechanical signatures that correlated with each phenomenological sample. By comparing the present case report to the initial study, results suggested that, after the training program (a) rowers shared more meaningful experience of their joint action, and (b) only the boat velocity's index contributed to explain why oars stroke were alternatively lived as effective or detrimental. The present case report thus suggests that joint action training in rowing might imply an increase in the joint sense-making activities, probably associated with a change from an inter-personal to an extra-personal meaningful mode of co-regulation of the joint action.

Fluctuations of the experience of togetherness within the team over time: task-cohesion and shared understanding throughout a sporting regular season

Based on a diagnosis action research design, the present study assessed the fluctuations of the team experience of togetherness. Reported experiences of 12 basketball team members playing in the under-18 years old national championship were studied during a four-month training and competitive period. Time series analysis (Auto-Regressive Integrated Moving Average procedures) served to describe temporal properties of the way in which the fluctuations of task-cohesion and shared understanding were step-by-step experienced over time, respectively. Correlations, running-correlations and cross-lagged correlations were used to describe the temporal links that governed the relationships between both phenomena. The results indicated that the task-cohesion dimensions differed mainly for shared understanding dynamics in that their time fluctuations were not embedded in external events, and that the variations in shared understanding tend to precede 'individual attractions to the task' variations with seven team practical sessions. This study argues for further investigation of how 'togetherness' is experienced alternatively as a feeling of cohesion or shared understanding. Practitioner Summary: The present action research study investigated the experience that the team members have to share information during practice, and the subsequent benefices on team cohesion. Results call for specific interventions that make team members accept the fluctuating nature of team phenomena, to help them maintaining their daily efforts.

What does the interactive brain hypothesis mean for social neuroscience? A dialogue

A recent framework inspired by phenomenological philosophy, dynamical systems theory, embodied cognition and robotics has proposed the interactive brain hypothesis (IBH). Whereas mainstream social neuroscience views social cognition as arising solely from events in the brain, the IBH argues that social cognition requires, in addition, causal relations between the brain and the social environment. We discuss, in turn, the foundational claims for the IBH in its strongest form; classical views of cognition that can be raised against the IBH; a defence of the IBH in the light of these arguments; and a response to this. Our goal is to initiate a dialogue between cognitive neuroscience and enactive views of social cognition. We conclude by suggesting some new directions and emphases that social neuroscience might take.

Time-Series Analysis of Embodied Interaction: Movement Variability and Complexity Matching As Dyadic Properties

There is a growing consensus that a fuller understanding of social cognition depends on more systematic studies of real-time social interaction. Such studies require methods that can deal with the complex dynamics taking place at multiple interdependent temporal and spatial scales, spanning sub-personal, personal, and dyadic levels of analysis. We demonstrate the value of adopting an extended multi-scale approach by re-analyzing movement time-series generated in a study of embodied dyadic interaction in a minimal virtual reality environment (a perceptual crossing experiment). Reduced movement variability revealed an interdependence between social awareness and social coordination that cannot be accounted for by either subjective or objective factors alone: it picks out interactions in which subjective and objective conditions are convergent (i.e., elevated coordination is perceived as clearly social, and impaired coordination is perceived as socially ambiguous). This finding is consistent with the claim that interpersonal interaction can be partially constitutive of direct social perception. Clustering statistics (Allan Factor) of salient events revealed fractal scaling. Complexity matching defined as the similarity between these scaling laws was significantly more pronounced in pairs of participants as compared to surrogate dyads. This further highlights the multi-scale and distributed character of social interaction and extends previous complexity matching results from dyadic conversation to non-verbal social interaction dynamics. Trials with successful joint interaction were also associated with an increase in local coordination. Consequently, a local coordination pattern emerges on the background of complex dyadic interactions in the PCE task and makes joint successful performance possible.

Joint Perception of a Shared Object: A Minimalist Perceptual Crossing Experiment

The minimalist perceptual crossing paradigm has emphasized the essential role of interpersonal dynamics on social understanding. Within the particular case of minimalist interaction, it has been argued that interpersonal processes can constitute social cognition, at least partially, which calls for a paradigm shift in social cognition studies. In this paper, we review several perceptual crossing experiments and their theoretical implications, and propose an original experiment to go beyond strictly dyadic interactions. Whereas past experiments have used objects as distracters of dyadic interaction, our experiment aims at integrating objects themselves as the goal of interpersonal coordination. We asked 24 subjects to participate in a minimalist perceptual crossing experiment where they had to decide, based on their on-line interaction in a one-dimensional digital space, which of the objects they perceived was also perceptible by their partner. The main results suggest that the mutual awareness of a shared object (SO) arises from the quality of sensorimotor coordination between the partners. Indeed, the presence of a SO acts as a simultaneous affordance that attracts and structures individual perceptive activities, giving both partners the opportunity to co-construct a shared world where their respective actions make sense. We discuss our results by way of an enactive account of social cognition, taking the joint perception of a SO as a first step to account for joint attention.

Joint Action of a Pair of Rowers in a Race: Shared Experiences of Effectiveness Are Shaped by Interpersonal Mechanical States

The purpose of this study was to understand how a single pair of expert individual rowers experienced their crew functioning in natural conditions when asked to practice a joint movement for the first time. To fulfill this objective, we conducted a field study of interpersonal coordination that combined phenomenological and mechanical data from a coxless pair activity, to analyze the dynamics of the (inter)subjective experience compared with the dynamics of the team coordination. Using an enactivist approach to social couplings, these heterogeneous data were combined to explore the salience (and accuracy) of individuals' shared experiences of their joint action. First, we determined how each rower experienced the continuous crew functioning states (e.g., feelings of the boat's glide). Second, the phenomenological data helped us to build several categories of oar strokes (i.e., cycles), experienced by the rowers as either detrimentally or effectively performed strokes. Third, the mechanical signatures that correlated with each phenomenological category were tracked at various level of organization (i.e., individual-, interpersonal-, and boat-levels). The results indicated that (a) the two rowers did not pay attention to their joint action during most of the cycles, (b) some cycles were simultaneously lived as a salient, meaningful experience of either a detrimental (n = 15 cycles) or an effective (n = 18 cycles) joint action, and (c) the mechanical signatures diverged across the delineated phenomenological categories, suggesting that the way in which the cycles were experienced emerged from the variance in some mechanical parameters (i.e., differences in peak force level and mean force). Notably, the mechanical measures that helped to explain differences within the phenomenological categories were found at the interpersonal level of analysis, thus suggesting an intentional inter-personal mode of regulation of their joint action. This result is further challenged and discussed in light of extra-personal regulation processes that might concurrently explain why participants did not make an extensive salient experience of their joint action. We conclude that attempts to combine phenomenological and mechanical data should be pursued to continue the research on how individuals regulate the effectiveness of their joint actions' dynamics.

How and why affective and reactive virtual agents will bring new insights on social cognitive disorders in schizophrenia? An illustration with a virtual card game paradigm

In recent decades, many studies have shown that schizophrenia is associated with severe social cognitive impairments affecting key components, such as the recognition of emotions, theory of mind, attributional style, and metacognition. Most studies investigated each construct separately, precluding analysis of the interactive and immersive nature of real-life situation. Specialized batteries of tests are under investigation to assess social cognition, which is thought now as a link between neurocognitive disorders and impaired functioning. However, this link accounts for a limited part of the variance of real-life functioning. To fill this gap, advances in virtual reality and affective computing have made it possible to carry out experimental investigations of naturalistic social cognition, in controlled conditions, with good reproducibility. This approach is illustrated with the description of a new paradigm based on an original virtual card game in which subjects interpret emotional displays from a female virtual agent, and decipher her helping intentions. Independent variables concerning emotional expression in terms of valence and intensity were manipulated. We show how several useful dependant variables, ranging from classic experimental psychology data to metacognition or subjective experiences records, may be extracted from a single experiment. Methodological issues about the immersion into a simulated intersubjective situation are considered. The example of this new flexible experimental setting, with regards to the many constructs recognized in social neurosciences, constitutes a rationale for focusing on this potential intermediate link between standardized tests and real-life functioning, and also for using it as an innovative media for cognitive remediation.

Quantifying long-range correlations and 1/f patterns in a minimal experiment of social interaction

In recent years, researchers in social cognition have found the “perceptual crossing paradigm” to be both a theoretical and practical advance toward meeting particular challenges. This paradigm has been used to analyze the type of interactive processes that emerge in minimal interactions and it has allowed progress toward understanding of the principles of social cognition processes. In this paper, we analyze whether some critical aspects of these interactions could not have been observed by previous studies. We consider alternative indicators that could complete, or even lead us to rethink, the current interpretation of the results obtained from both experimental and simulated modeling in the fields of social interactions and minimal perceptual crossing. In particular, we discuss the possibility that previous experiments have been analytically constrained to a short-term dynamic type of player response. Additionally, we propose the possibility of considering these experiments from a more suitable framework based on the use and analysis of long-range correlations and fractal dynamics. We will also reveal evidence supporting the idea that social interactions are deployed along many scales of activity. Specifically, we propose that the fractal structure of the interactions could be a more adequate framework to understand the type of social interaction patterns generated in a social engagement.

Enacting a social ecology: radically embodied intersubjectivity

Embodied approaches to cognitive science frequently describe the mind as “world-involving,” indicating complementary and interdependent relationships between an agent and its environment. The precise nature of the environment is frequently left ill-described, however, and provides a challenge for such approaches, particularly, it is noted here, for the enactive approach which emphasizes this complementarity in quite radical terms. This paper argues that enactivists should work to find common cause with a dynamic form of ecological psychology, a theoretical perspective that provides the most explicit theory of the psychological environment currently extant. In doing so, the intersubjective, cultural nature of the ecology of human psychology is explored, with the challenges this poses for both enactivist and ecological approaches outlined. The theory of behavior settings (Barker, 1968; Schoggen, 1989) is used to present a framework for resolving some of these challenges. Drawing these various strands together an outline of a radical embodied account of intersubjectivity and social activity is presented.

Embodiment of intersubjective time: relational dynamics as attractors in the temporal coordination of interpersonal behaviors and experiences

This paper addresses the issue of “being together,” and more specifically the issue of “being together in time.” We provide with an integrative framework that is inspired by phenomenology, the enactive approach and dynamical systems theories. To do so, we first define embodiment as a living and lived phenomenon that emerges from agent-world coupling. We then show that embodiment is essentially dynamical and therefore we describe experiential, behavioral and brain dynamics. Both lived temporality and the temporality of the living appear to be complex, multiscale phenomena. Next we discuss embodied dynamics in the context of interpersonal interactions, and briefly review the empirical literature on between-persons temporal coordination. Overall, we propose that being together in time emerges from the relational dynamics of embodied interactions and their flexible co-regulation.

Using minimal human-computer interfaces for studying the interactive development of social awareness

According to the enactive approach to cognitive science, perception is essentially a skillful engagement with the world. Learning how to engage via a human-computer interface (HCI) can therefore be taken as an instance of developing a new mode of experiencing. Similarly, social perception is theorized to be primarily constituted by skillful engagement between people, which implies that it is possible to investigate the origins and development of social awareness using multi-user HCIs. We analyzed the trial-by-trial objective and subjective changes in sociality that took place during a perceptual crossing experiment in which embodied interaction between pairs of adults was mediated over a minimalist haptic HCI. Since that study required participants to implicitly relearn how to mutually engage so as to perceive each other's presence, we hypothesized that there would be indications that the initial developmental stages of social awareness were recapitulated. Preliminary results reveal that, despite the lack of explicit feedback about task performance, there was a trend for the clarity of social awareness to increase over time. We discuss the methodological challenges involved in evaluating whether this trend was characterized by distinct developmental stages of objective behavior and subjective experience.