Eye contact marks the rise and fall of shared attention in conversation

How and Why People Synchronize: An Integrated Perspective

Academic AbstractInterpersonal synchrony, the alignment of behavior and/or physiology during interactions, is a pervasive phenomenon observed in diverse social contexts. Here we synthesize across contexts and behaviors to classify the different forms and functions of synchrony. We provide a concise framework for classifying the manifold forms of synchrony along six dimensions: periodicity, discreteness, spatial similarity, directionality, leader-follower dynamics, and observability. We also distill the various proposed functions of interpersonal synchrony into four interconnected functions: reducing complexity and improving understanding, accomplishing joint tasks, strengthening social connection, and influencing partners' behavior. These functions derive from first principles, emerge from each other, and are accomplished by some forms of synchrony more than others. Effective synchrony flexibly adapts to social goals and more synchrony is not always better. Our synthesis offers a shared framework and language for the field, allowing for better cross-context and cross-behavior comparisons, generating new hypotheses, and highlighting future research directions.

Influence of autistic traits and communication role on eye contact behavior during face-to-face interaction

Eye contact is a central component in face-to-face interactions. It is important in structuring communicative exchanges and offers critical insights into others' interests and intentions. To better understand eye contact in face-to-face interactions, we applied a novel, non-intrusive deep-learning-based dual-camera system and investigated associations between eye contact and autistic traits as well as self-reported eye contact discomfort during a referential communication task, where participants and the experimenter had to guess, in turn, a word known by the other individual. Corroborating previous research, we found that participants' eye gaze and mutual eye contact were inversely related to autistic traits. In addition, our findings revealed different behaviors depending on the role in the dyad: listening and guessing were associated with increased eye contact compared with describing words. In the listening and guessing condition, only a subgroup who reported eye contact discomfort had a lower amount of eye gaze and eye contact. When describing words, higher autistic traits were associated with reduced eye gaze and eye contact. Our data indicate that eye contact is inversely associated with autistic traits when describing words, and that eye gaze is modulated by the communicative role in a conversation.

Eyes meet, hands greet: The art of timing in social interactions

Shaking hands is a fundamental form of social interaction. The current study used high-definition cameras during a university graduation ceremony to examine the temporal sequencing of eye contact and shaking hands. Analyses revealed that mutual gaze always preceded shaking hands. A follow up investigation manipulated gaze when shaking hands, and found that participants take significantly longer to accept a handshake when an outstretched hand precedes eye contact. These findings demonstrate that the timing between a person's gaze and their offer to shake hands is critical to how their action is interpreted.

Misplaced Divides? Discussing Political Disagreement With Strangers Can Be Unexpectedly Positive

Differences of opinion between people are common in everyday life, but discussing those differences openly in conversation may be unnecessarily rare. We report three experiments (N = 1,264 U.S.-based adults) demonstrating that people's interest in discussing important but potentially divisive topics is guided by their expectations about how positively the conversation will unfold, leaving them more interested in having a conversation with someone who agrees versus disagrees with them. People's expectations about their conversations, however, were systematically miscalibrated such that people underestimated how positive these conversations would be-especially in cases of disagreement. Miscalibrated expectations stemmed from underestimating the degree of common ground that would emerge in conversation and from failing to appreciate the power of social forces in conversation that create social connection. Misunderstanding the outcomes of conversation could lead people to avoid discussing disagreements more often, creating a misplaced barrier to learning, social connection, free inquiry, and free expression.

No evidence for adult smartphone use affecting attribution of communicative intention in toddlers: Online imitation study using the Sock Ball Task

Adults infer others' communicative intentions, or lack thereof, from various types of information. Young children may be initially limited to attributions based on a small set of ostensive signals. It is unknown when richer pragmatic inferences about communicative intentions emerge in development. We sought novel type of evidence for such inferences in 17-to-19-month-olds. We hypothesized that toddlers recognize adults' smartphone use in face-to-face interactions as incongruous with ostension and would rely on this interpretation when inferring the communicative intention of a model in a new imitation task conducted entirely online, dubbed the Sock Ball Task. In Experiment 1 with a between-subject design, we tested the hypothesis by assessing toddlers' (N = 48) imitation of sub-efficient means and the goal-outcome presented by a model, who interrupted her ostensive demonstration either by using a smartphone or by fiddling with her wristwatch, depending on the condition. We expected toddlers to imitate the sub-efficient means more faithfully in the wristwatch condition than in the smartphone condition. But there was no significant effect of condition on imitation of neither means nor goal. Thus, our hypothesis was not borne out by the results. In Experiment 2, using a within-subject design, we first assessed toddlers' (N = 24) performance in a no-demonstration baseline and then again after a no-disruption ostensive demonstration. In all three conditions with ostensive demonstration (Experiment 1: smartphone, wristwatch; Experiment 2: no-disruption), toddlers produced the demonstrated sub-efficient means significantly above the baseline level. In the no-disruption condition, goals were also imitated significantly above the baseline level. We conclude that the Sock Ball Task is a valid research tool for studying toddler imitation of novel means actions with objects. We end by discussing suggestions for improving the task in future studies.

Interpersonal eye-tracking reveals the dynamics of interacting minds

The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.

The Emerging Science of Interacting Minds

For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation. The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we behave. Here we discuss the key methodological challenges that have limited progress in establishing a robust science of how minds interact and the new tools that are beginning to overcome these challenges. A deep understanding of the human mind requires studying the context within which it originates and exists: social interaction.

Catching a (sine) wave: Temporal dynamics of nonverbal synchrony in social anxiety disorder

Individuals with social anxiety disorder (SAD) experience a range of interpersonal problems and studies have found that nonverbal synchrony (the coordination between interaction partners' movements) may be impaired in dyads in which one individual has SAD (Asher et al., 2020). In the present study, we examined the temporal dynamics of nonverbal synchrony during "getting aquatinted" conversations of individuals with and without SAD. Specifically, participants (n = 146) formed either SAD dyads (dyads in which one individual had SAD and the other did not; n = 37 dyads), or control dyads (dyads in which both individuals did not have SAD; n = 36 dyads). Dyads were randomized to either small talk or closeness-generating (i.e., intimate) conversations. We found that during conversations, nonverbal synchrony followed a repeating pattern of increases and decreases that was best modeled by a sinusoidal wave (explained variance = 63.74 %). We found significant Diagnosis × Social Context interactions in the temporal dynamics of nonverbal synchrony (i.e., in the parameters of sine waves). Specifically, we found that for SAD dyads (but not control dyads), the average sine wave amplitude which indicates increases and decreases in nonverbal synchrony was greater during small talk conversations compared to closeness-generating conversations. In addition, we found that among control dyads (but not SAD dyads), the average vertical offset of sine waves (i.e., the average level of nonverbal synchrony) during closeness-generating conversations was greater compared to small talk conversations. The findings are interpreted within the context of the social anxiety literature as capturing two distinct social-anxiety related processes, and suggest that when examined temporally (rather than averaged), nonverbal synchrony may be an important implicit biomarker of SAD.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Communicative signals during joint attention promote neural processes of infants and caregivers

Communicative signals such as eye contact increase infants' brain activation to visual stimuli and promote joint attention. Our study assessed whether communicative signals during joint attention enhance infant-caregiver dyads' neural responses to objects, and their neural synchrony. To track mutual attention processes, we applied rhythmic visual stimulation (RVS), presenting images of objects to 12-month-old infants and their mothers (n = 37 dyads), while we recorded dyads' brain activity (i.e., steady-state visual evoked potentials, SSVEPs) with electroencephalography (EEG) hyperscanning. Within dyads, mothers either communicatively showed the images to their infant or watched the images without communicative engagement. Communicative cues increased infants' and mothers' SSVEPs at central-occipital-parietal, and central electrode sites, respectively. Infants showed significantly more gaze behaviour to images during communicative engagement. Dyadic neural synchrony (SSVEP amplitude envelope correlations, AECs) was not modulated by communicative cues. Taken together, maternal communicative cues in joint attention increase infants' neural responses to objects, and shape mothers' own attention processes. We show that communicative cues enhance cortical visual processing, thus play an essential role in social learning. Future studies need to elucidate the effect of communicative cues on neural synchrony during joint attention. Finally, our study introduces RVS to study infant-caregiver neural dynamics in social contexts.

Social interaction links active musical rhythm engagement and expressive communication in autistic toddlers

Rhythm is implicated in both social and linguistic development. Rhythm perception and production skills are also key vulnerabilities in neurodevelopmental disorders such as autism which impact social communication. However, direct links between musical rhythm engagement and expressive communication in autism is not clearly evident. This absence of a direct connection between rhythm and expressive communication indicates that the mechanism of action between rhythm and expressive communication may recruit other cognitive or developmental factors. We hypothesized that social interactions, including general interpersonal relationships and interactive music-making involving children and caregivers, were a significant such factor, particularly in autism. To test this, we collected data from parents of autistic and nonautistic children 14-36 months of age, including parent reports of their children's rhythmic musical engagement, general social skills, parent-child musical interactions, and expressive communication skills. Path analysis revealed a system of independent, indirect pathways from rhythmic musical engagement to expressive communication via social skills and parent-child musical interactions in autistic toddlers. Such a system implies both that social and musical interactions represent crucial links between rhythm and language and that different kinds of social interactions play parallel, independent roles linking rhythmic musical engagement with expressive communication skills.

Characterizing the mechanisms of social connection

Understanding how individuals form and maintain strong social networks has emerged as a significant public health priority as a result of the increased focus on the epidemic of loneliness and the myriad protective benefits conferred by social connection. In this review, we highlight the psychological and neural mechanisms that enable us to connect with others, which in turn help buffer against the consequences of stress and isolation. Central to this process is the experience of rewards derived from positive social interactions, which encourage the sharing of perspectives and preferences that unite individuals. Sharing affective states with others helps us to align our understanding of the world with another's, thereby continuing to reinforce bonds and strengthen relationships. These psychological processes depend on neural systems supporting reward and social cognitive function. Lastly, we also consider limitations associated with pursuing healthy social connections and outline potential avenues of future research.

Theory of collective mind

Theory of mind research has traditionally focused on the ascription of mental states to a single individual. Here, we introduce a theory of collective mind: the ascription of a unified mental state to a group of agents with convergent experiences. Rather than differentiation between one's personal perspective and that of another agent, a theory of collective mind requires perspectival unification across agents. We review recent scholarship across the cognitive sciences concerning the conceptual foundations of collective mind representations and their empirical induction through the synchronous arrival of shared information. Research suggests that representations of a collective mind cause psychological amplification of co-attended stimuli, create relational bonds, and increase cooperation, among co-attendees.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

A Brain-To-Brain Mechanism for Social Transmission of Threat Learning

Survival and adaptation in environments require swift and efficacious learning about what is dangerous. Across species, much of such threat learning is acquired socially, e.g., through the observation of others' ("demonstrators'") defensive behaviors. However, the specific neural mechanisms responsible for the integration of information shared between demonstrators and observers remain largely unknown. This dearth of knowledge is addressed by performing magnetoencephalography (MEG) neuroimaging in demonstrator-observer dyads. A set of stimuli are first shown to a demonstrator whose defensive responses are filmed and later presented to an observer, while neuronal activity is recorded sequentially from both individuals who never interacted directly. These results show that brain-to-brain coupling (BtBC) in the fronto-limbic circuit (including insula, ventromedial, and dorsolateral prefrontal cortex) within demonstrator-observer dyads predict subsequent expressions of learning in the observer. Importantly, the predictive power of BtBC magnifies when a threat is imminent to the demonstrator. Furthermore, BtBC depends on how observers perceive their social status relative to the demonstrator, likely driven by shared attention and emotion, as bolstered by dyadic pupillary coupling. Taken together, this study describes a brain-to-brain mechanism for social threat learning, involving BtBC, which reflects social relationships and predicts adaptive, learned behaviors.

Listen to resonate: Better listening as a gateway to interpersonal positivity resonance through enhanced sensory connection and perceived safety

Although often experienced individually, emotions are at times co-experienced with others, collectively. One type of collective emotion, termed positivity resonance, refers to coexperienced positive affect accompanied by caring non-verbal behavioral synchrony and biological synchrony across persons. Growing evidence illustrates the contributions of positivity resonance to individual, relational, and community well-being. Two conditions theorized as conducive for the emergence of positivity resonance are real-time sensory connection and perceived safety. Here, we explore listening as an interpersonal process that can serve to enhance real-time sensory connection and perceived safety and thereby increase positivity resonance among conversation partners. Specifically, we present evidence that connects listening to direct gaze (i.e., real-time sensory connection) and psychological safety (i.e., perceived safety). We close by offering a framework to guide future research that can test whether and how conversational listening functions to create more moments of positivity resonance in interpersonal contexts.

Moving beyond the lab: investigating empathy through the Empirical 5E approach

Empathy is a complex and multifaceted phenomenon that plays a crucial role in human social interactions. Recent developments in social neuroscience have provided valuable insights into the neural underpinnings and bodily mechanisms underlying empathy. This methodology often prioritizes precision, replicability, internal validity, and confound control. However, fully understanding the complexity of empathy seems unattainable by solely relying on artificial and controlled laboratory settings, while overlooking a comprehensive view of empathy through an ecological experimental approach. In this article, we propose articulating an integrative theoretical and methodological framework based on the 5E approach (the "E"s stand for embodied, embedded, enacted, emotional, and extended perspectives of empathy), highlighting the relevance of studying empathy as an active interaction between embodied agents, embedded in a shared real-world environment. In addition, we illustrate how a novel multimodal approach including mobile brain and body imaging (MoBi) combined with phenomenological methods, and the implementation of interactive paradigms in a natural context, are adequate procedures to study empathy from the 5E approach. In doing so, we present the Empirical 5E approach (E5E) as an integrative scientific framework to bridge brain/body and phenomenological attributes in an interbody interactive setting. Progressing toward an E5E approach can be crucial to understanding empathy in accordance with the complexity of how it is experienced in the real world.

A novel end-to-end dual-camera system for eye gaze synchrony assessment in face-to-face interaction

Quantification of face-to-face interaction can provide highly relevant information in cognitive and psychological science research. Current commercial glint-dependent solutions suffer from several disadvantages and limitations when applied in face-to-face interaction, including data loss, parallax errors, the inconvenience and distracting effect of wearables, and/or the need for several cameras to capture each person. Here we present a novel eye-tracking solution, consisting of a dual-camera system used in conjunction with an individually optimized deep learning approach that aims to overcome some of these limitations. Our data show that this system can accurately classify gaze location within different areas of the face of two interlocutors, and capture subtle differences in interpersonal gaze synchrony between two individuals during a (semi-)naturalistic face-to-face interaction.

Caregiver linguistic alignment to autistic and typically developing children: A natural language processing approach illuminates the interactive components of language development

BACKGROUND

Language development is a highly interactive activity. However, most research on linguistic environment has focused on the quantity and complexity of linguistic input to children, with current models showing that complexity facilitates language in both typically developing (TD) and autistic children.

AIMS

After reviewing existing work on caregiver engagement of children's utterances, we aim to operationalize such engagement with automated measures of linguistic alignment, thereby providing scalable tools to assess caregivers' active reuse of their children's language. By assessing the presence of alignment, its sensitivity to the child's individual differences and how well it predicts language development beyond current models across the two groups, we showcase the usefulness of the approach and provide initial empirical foundations for further conceptual and empirical investigations.

METHODS

We measure lexical, syntactic and semantic types of caregiver alignment in a longitudinal corpus involving 32 adult-autistic child and 35 adult-TD child dyads, with children between 2 and 5 years of age. We assess the extent to which caregivers repeat their children's words, syntax, and semantics, and whether these repetitions predict language development beyond more standard predictors.

RESULTS

Caregivers tend to re-use their child's language in a way that is related to the child's individual, primarily linguistic, differences. Caregivers' alignment provides unique information improving our ability to predict future language development in both typical and autistic children.

CONCLUSIONS

We provide evidence that language development also relies on interactive conversational processes, previously understudied. We share carefully detailed methods, and open-source scripts so as to systematically extend our approach to new contexts and languages.

Synchrony to a beat predicts synchrony with other minds

Synchrony has been used to describe simple beat entrainment as well as correlated mental processes between people, leading some to question whether the term conflates distinct phenomena. Here we ask whether simple synchrony (beat entrainment) predicts more complex attentional synchrony, consistent with a common mechanism. While eye-tracked, participants listened to regularly spaced tones and indicated changes in volume. Across multiple sessions, we found a reliable individual difference: some people entrained their attention more than others, as reflected in beat-matched pupil dilations that predicted performance. In a second study, eye-tracked participants completed the beat task and then listened to a storyteller, who had been previously recorded while eye-tracked. An individual's tendency to entrain to a beat predicted how strongly their pupils synchronized with those of the storyteller, a corollary of shared attention. The tendency to synchronize is a stable individual difference that predicts attentional synchrony across contexts and complexity.

Gender Differences among Healthcare Providers in the Promotion of Patient-, Person- and Family-Centered Care-And Its Implications for Providing Quality Healthcare

The concept of "patient-centered care" (PCC) emphasizes patients' autonomy and is commonly promoted as a good healthcare practice that all of medicine should strive for. Here, we assessed how six medical specialties-pediatrics, OBGYN, orthopedics, radiology, dermatology, and neurosurgery-have engaged with PCC and its derivative concepts of "person-centered care" (PeCC) and "family-centered care" (FCC) as a function of the number of female physicians in each field. To achieve this, we conducted a scoping review of three databases-PubMed, CINAHL, and PsycInfo-to assess the extent that PCC, PeCC, FCC, and RCC were referenced by different specialties in the medical literature. Reference to PCC and PeCC in the literature correlates significantly with the number of female physicians in each field (all p < 0.00001) except for neurosurgery (p > 0.5). Pediatrics shows the most extensive reference to PCC, followed by OBGYN, with a significant difference between all disciplines (p < 0.001). FCC remains exclusively embraced by pediatrics. Our results align with documented cognitive differences between men and women that recognize gender differences in empathizing (E) versus systemizing (S) with females demonstrating E > S, which supports PCC/PeCC/FCC approaches to healthcare.

The development of the conversation skills assessment tool

Background and aims

Having a conversation with someone or even more within a group of people is complex. We are never taught at school how to do it, which implies we consider having a conversation as something simple and straightforward. Instead, we just learn from observing others. Some people are great conversationalists - it comes naturally to them - while others struggle. Some people may not fully understand how the process works, how turn-taking happens, don't understand visual cues such as body language and facial expressions, and fail to comprehend that some topics may be appropriate or inappropriate. This can be the case for both neurotypical and neurodivergent people. The Conversation skills Assessment Tool has been developed in this first instance to help in assessing and examining conversation skills in an intervention with young autistic adults on a virtual platform (a virtual world). This paper will present the evolution of the new measure through the exploratory phase, the development phase and finally a detailed account of the inter-rater reliability process.

Methods

The intervention associated with this study was carried out though a multiple baseline design with 3 autistic participants (in their early 20 s) and took place over 4 phases (15-17 sessions). The sessions involved semi-structured conversations in face-to-face (phases 1 and 4) and virtual (phases 2 and 3) settings and were videotaped with the participants' consent. Twelve of those were used by this study in the development process through iterative inter-rater reliability stages between two coding teams.

Results

Evaluation of the Conversation skills Assessment Tool tool revealed the potential benefit of implementing interventions with measures that more objectively and concretely (e.g., by noting frequencies) assess observable behaviours that are associated with having positive conversations with others. Beyond this, it is anticipated that Conversation skills Assessment Tool can emerge as a tool capable of not only accounting for the environment an interaction takes place in (e.g., professional, casual), but also offers beneficial feedback for both autistic students and other populations (e.g., young children, English language learners).

Conclusions

This measure has the potential to offer quantifiable and trackable guidance to people who have difficulties conversing. The authors do not wish to perpetuate an ableist social construct of what is a 'good' conversation, nor do they suggest that conversation skills training is useful solely for people with communication and/or socialization difficulties. Rather, they hope that Conversation skills Assessment Tool can be adopted more broadly to give both neurotypical and neurodivergent people a better understanding of how to communicate more effectively with others, while also becoming more aware and accepting of differing conversational styles.

Implications

Because of its ability to track (or self-monitor) one's development of conversational skills over time, Conversation skills Assessment Tool could serve as an educative tool in early childhood education. It can be used by occupational/speech therapists and other professionals and also used to self-monitor one's development of conversational skills. Conversation skills Assessment Tool was developed to assess conversation skills on a one-to-one basis; therefore, another iteration of Conversation skills Assessment Tool would have to look at group conversations.

Abstract and concrete concepts in conversation

Concepts allow us to make sense of the world. Most evidence on their acquisition and representation comes from studies of single decontextualized words and focuses on the opposition between concrete and abstract concepts (e.g., "bottle" vs. "truth"). A significant step forward in research on concepts consists in investigating them in online interaction during their use. Our study examines linguistic exchanges analyzing the differences between sub-kinds of concepts. Participants were submitted to an online task in which they had to simulate a conversational exchange by responding to sentences involving sub-kinds of concrete (tools, animals, food) and abstract concepts (PS, philosophical-spiritual; EMSS, emotional-social, PSTQ, physical-spatio-temporal-quantitative). We found differences in content: foods evoked interoception; tools and animals elicited materials, spatial, auditive features, confirming their sensorimotor grounding. PS and EMSS yielded inner experiences (e.g., emotions, cognitive states, introspections) and opposed PSTQ, tied to visual properties and concrete agency. More crucially, the various concepts elicited different interactional dynamics: more abstract concepts generated higher uncertainty and more interactive exchanges than concrete ones. Investigating concepts in situated interactions opens new possibilities for studying conceptual knowledge and its pragmatic and social aspects.

A convergent interaction engine: vocal communication among marmoset monkeys

To understand the primate origins of the human interaction engine, it is worthwhile to focus not only on great apes but also on callitrichid monkeys (marmosets and tamarins). Like humans, but unlike great apes, callitrichids are cooperative breeders, and thus habitually engage in coordinated joint actions, for instance when an infant is handed over from one group member to another. We first explore the hypothesis that these habitual cooperative interactions, the marmoset interactional ethology, are supported by the same key elements as found in the human interaction engine: mutual gaze (during joint action), turn-taking, volubility, as well as group-wide prosociality and trust. Marmosets show clear evidence of these features. We next examine the prediction that, if such an interaction engine can indeed give rise to more flexible communication, callitrichids may also possess elaborate communicative skills. A review of marmoset vocal communication confirms unusual abilities in these small primates: high volubility and large vocal repertoires, vocal learning and babbling in immatures, and voluntary usage and control. We end by discussing how the adoption of cooperative breeding during human evolution may have catalysed language evolution by adding these convergent consequences to the great ape-like cognitive system of our hominin ancestors. This article is part of the theme issue 'Revisiting the human 'interaction engine': comparative approaches to social action coordination'.

Getting our Affect Together: Shared Representations as the Core of Empathy

Empathy is a construct that is notoriously difficult to define. Murphy and colleagues argue for leaning into the construct's inherent fuzziness and reverting to what they term a classical definition informed by the observations of philosophers and clinicians: as a dynamic, “unfolding process of imaginatively experiencing the subjective consciousness of another person, sensing, understanding, and structuring the world as if one were that person.” Although consistent with some historical conceptualizations, this definition risks incorporating so many processes it would make empathy difficult to operationalize or distinguish from any generally socially sensitive interaction. Defining empathy instead as the attempted representation, or simulation, of another's subjective internal experiences (whether sensory, affective, or cognitive) would increase its clarity and empirical utility.

Eye Contact in Video Communication: Experiences of Co-creating Relationships

As a result of the COVID-19 pandemic, increased number of persons have been forced to limit their interactions with friends and families to contact via video, which excludes eye-contact. The aim of this study was to examine individuals’ experiences of the difference between forced skewed visuality and the ability for eye-contact in conversations. Two custom-made units allowed 15 participants interacting in dyads to alternate between being able to make eye contact and having that ability removed through skewed visuality. Participants reported their experiences in semi-structured interviews. Data analyzed with qualitative content analysis resulted in three themes: Shared eye contact allows us to create our relationship together; With eye contact, we adjust to each other to feel more connected and less intimidated; and We get more self-conscious when the visuality is skewed or shifting. The results imply that skewed visuality as forced lack of eye-contact in video conversations effects embodied non-verbal processes related to sense of connectedness and participatory sensemaking, creating a sense of both emotional and physical distance, as well as heightening self-awareness about the need of actively regulating the other. We argue that this is one of the ways to understand the impact of moving interactions to online communication.

Social synchronization of brain activity increases during eye-contact

Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization.

Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.

Resonance as a Design Strategy for AI and Social Robots

Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human-robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of "sympathetic resonance" as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human-robot interactions.

Understanding Design Features of Music and Language: The Choric/Dialogic Distinction

Music and spoken language share certain characteristics: both consist of sequences of acoustic elements that are combinatorically combined, and these elements partition the same continuous acoustic dimensions (frequency, formant space and duration). However, the resulting categories differ sharply: scale tones and note durations of small integer ratios appear in music, while speech uses phonemes, lexical tone, and non-isochronous durations. Why did music and language diverge into the two systems we have today, differing in these specific features? We propose a framework based on information theory and a reverse-engineering perspective, suggesting that design features of music and language are a response to their differential deployment along three different continuous dimensions. These include the familiar propositional-aesthetic ('goal') and repetitive-novel ('novelty') dimensions, and a dialogic-choric ('interactivity') dimension that is our focus here. Specifically, we hypothesize that music exhibits specializations enhancing coherent production by several individuals concurrently-the 'choric' context. In contrast, language is specialized for exchange in tightly coordinated turn-taking-'dialogic' contexts. We examine the evidence for our framework, both from humans and non-human animals, and conclude that many proposed design features of music and language follow naturally from their use in distinct dialogic and choric communicative contexts. Furthermore, the hybrid nature of intermediate systems like poetry, chant, or solo lament follows from their deployment in the less typical interactive context.

Liking as a balance between synchronization, complexity and novelty

Synchronization has been identified as a key aspect in social bonding. While synchronization could be maximized by increasing the predictability of an interaction, such predictability is in tension with individuals’ level of interest, which is tied to the interaction’s complexity and novelty. In this study, we tested the interplay between synchronization and interest. We asked 104 female dyads to play the Mirror Game, in which they had to move their hands as coordinately as possible, and then report how much they liked each other. Utilizing information theory and video processing tools, we found that a combination of movement synchronization and complexity explained liking almost two times better than movement synchronization alone. Moreover, we found that people initiated novel and challenging interactions, even though they paid a price—being less synchronized. Examining the interactions’ dynamics, we found that people who liked each other moved in a more synchronized, complex, and novel manner during most of the interaction. This suggests that in addition to synchronization, maintaining interest may be critical for positive social bonding. Thus, we propose a new framework in which balancing synchronization and interest, rather than merely maximizing synchronization, optimizes the interaction quality.

Human face and gaze perception is highly context specific and involves bottom-up and top-down neural processing

This review summarizes human perception and processing of face and gaze signals. Face and gaze signals are important means of non-verbal social communication. The review highlights that: (1) some evidence is available suggesting that the perception and processing of facial information starts in the prenatal period; (2) the perception and processing of face identity, expression and gaze direction is highly context specific, the effect of race and culture being a case in point. Culture affects by means of experiential shaping and social categorization the way in which information on face and gaze is collected and perceived; (3) face and gaze processing occurs in the so-called 'social brain'. Accumulating evidence suggests that the processing of facial identity, facial emotional expression and gaze involves two parallel and interacting pathways: a fast and crude subcortical route and a slower cortical pathway. The flow of information is bi-directional and includes bottom-up and top-down processing. The cortical networks particularly include the fusiform gyrus, superior temporal sulcus (STS), intraparietal sulcus, temporoparietal junction and medial prefrontal cortex.

Simultaneous functional MRI of two awake marmosets

Social cognition is a dynamic process that requires the perception and integration of a complex set of idiosyncratic features between interacting conspecifics. Here we present a method for simultaneously measuring the whole-brain activation of two socially interacting marmoset monkeys using functional magnetic resonance imaging. MRI hardware (a radiofrequency coil and peripheral devices) and image-processing pipelines were developed to assess brain responses to socialization, both on an intra-brain and inter-brain level. Notably, the brain activation of a marmoset when viewing a second marmoset in-person versus when viewing a pre-recorded video of the same marmoset-i.e., when either capable or incapable of socially interacting with a visible conspecific-demonstrates increased activation in the face-patch network. This method enables a wide range of possibilities for potentially studying social function and dysfunction in a non-human primate model.