Frontal alpha oscillations distinguish leaders from followers: multivariate decoding of mutually interacting brains

Is what I think what you think? Multilayer network-based inter-brain synchrony approach

Social interaction plays a crucial role in human societies, encompassing complex dynamics among individuals. To understand social interaction at the neural level, researchers have utilized hyperscanning in several social settings. These studies have mainly focused on inter-brain synchrony and the efficiency of paired functional brain networks, examining group interactions in dyads. However, this approach may not fully capture the complexity of multiple interactions, potentially leading to gaps in understanding inter-network differences. To overcome this limitation, the present study aims to bridge this gap by introducing methodological enhancements using the multilayer network approach, which is tailored to extract features from multiple networks. We applied this strategy to analyze the triad condition during social behavior processes to identify group interaction indices. Additionally, to validate our methodology, we compared the multilayer networks of triad conditions with group synchrony to paired conditions without group synchrony, focusing on statistical differences between alpha and beta waves. Correlation analysis between inter-brain and group networks revealed that this methodology accurately reflects the characteristics of actual behavioral synchrony. The findings of our study suggest that measures of paired brain synchrony and group interaction may exhibit distinct trends, offering valuable insights into interpreting group synchrony.

Two-brain microstates: A novel hyperscanning-EEG method for quantifying task-driven inter-brain asymmetry

BACKGROUND

The neural mechanisms underlying real-time social interaction remain poorly understood. While hyperscanning has emerged as a popular method to better understand inter-brain mechanisms, inter-brain methods remain underdeveloped, and primarily focused on inter-brain synchronization (IBS).

NEW METHOD

We developed a novel approach employing two-brain EEG microstates, to investigate neural mechanisms during symmetric and asymmetric interactive tasks. Microstates are quasi-stable configurations of brain activity that have been proposed to represent basic building blocks for mental processing. Expanding the microstate methodology to dyads of interacting participants enables us to investigate quasi-stable moments of inter-brain synchronous and asymmetric activity.

RESULTS

Conventional microstates fitted to individuals were not related to the different interactive conditions. However, two-brain microstates were modulated in the observer-actor condition, compared to all other conditions where participants had more symmetric task demands, and the same trend was observed for the follower-leader condition. This indicates differences in resting state default-mode network activity during interactions with asymmetric tasks.

COMPARISON WITH EXISTING METHODS

Hyperscanning studies have primarily estimated IBS based on functional connectivity measures. However, localized connections are often hard to interpret on a larger scale when multiple connections across brains are found to be important. Two-brain microstates offer an alternative approach to evaluate neural activity from a large-scale global network perspective, by quantifying task-driven asymmetric neural states between interacting individuals.

CONCLUSIONS

We present a novel method using two-brain microstates, including open-source code, which expands the current hyperscanning-EEG methodology to measure and potentially identify both synchronous and asymmetric inter-brain states during real-time social interaction.

Interpersonal Physiological Synchrony During Dyadic Joint Action Is Increased by Task Novelty and Reduced by Social Anxiety

Interpersonal physiological synchrony refers to the temporal coordination of autonomic states during social encounters. Previous studies indicate that physiological synchrony may arise during nonverbal interactions. Nevertheless, the role played by contextual and individual factors in determining its emergence is understudied. In this work, we examined heart rate synchrony during a cooperative joint action task, exploring how task constraints, novelty, and behavioral synchrony influence physiological alignment. To achieve this, we periodically modulated task demands by alternating between peer-to-peer and leader-follower dynamics, as well as between complementary and imitative movements, and their combinations. Additionally, we assessed the role of individual differences by examining the impact of dyad members' Social Anxiety and Perspective Taking levels. We further investigated how task demands and personal traits shape the perceived quality of social interactions and subject-level heart rate variability. Our findings revealed a significant increase in physiological synchrony and a decrease in perceived interaction quality when participants switched to a novel task version (i.e., during switch blocks) compared to task repetition. Task switching was also associated with increased heart rate variability. Notably, Social Anxiety negatively predicted physiological synchrony, suggesting that more socially anxious dyads were less likely to achieve physiological alignment. However, no relationship was observed between physiological synchrony and task performance. Overall, our results suggest that physiological synchrony intensifies when dyads navigate the challenge of learning a novel task together, and that both contextual and individual aspects contribute to its emergence.

A framework for joint music making: Behavioral findings, neural processes, and computational models

Across different epochs and societies, humans occasionally gather to jointly make music. This universal form of collective behavior is as fascinating as it is fragmentedly understood. As the interest in joint music making (JMM) rapidly grows, we review the state-of-the-art of this emerging science, blending behavioral, neural, and computational contributions. We present a conceptual framework synthesizing research on JMM within four components. The framework is centered upon interpersonal coordination, a crucial requirement for JMM. The other components imply the influence of individuals' (past) experience, (current) social factors, and (future) goals on real-time coordination. Our aim is to promote the development of JMM research by organizing existing work, inspiring new questions, and fostering accessibility for researchers belonging to other research communities.

Children in sync: exploring how interpersonal synchrony experience induces cooperation between child peers

Synchronous interpersonal movements induce positive prosocial behaviors in adults and children. The processes that underlie this are debated. Here, we investigate the extent to which visual cues available during synchrony experience-particularly shared facial expressions and mutual eye contact-are necessary. Pairs of same-sex 4-year-olds (N = 216 children; 50% girls; 81% white) from the US were randomly assigned to synchronized versus asynchronized swinging experience. Access to visual information was experimentally manipulated by using a transparent versus translucent barrier between the children. The translucent barrier acted as a visual filter preventing children from monitoring facial cues while still enabling them to see whether the partner was swinging in synchrony. After the swinging experience, all pairs of children were administered the same tests of cooperation. The children administered synchronous movement performed better on the cooperation tasks, and there was no significant difference as a function of barrier transparency. This suggests that the positive effects of synchrony do not require visual resolution of the partner's social-emotional facial cues. These findings advance our understanding about factors contributing to synchrony-induced cooperation between children.

Embodied hyperscanning for studying social interaction: A scoping review of simultaneous brain and body measurements

We systematically investigated the application of embodied hyperscanning methodologies in social neuroscience research. Hyperscanning enables the simultaneous recording of neurophysiological and physiological signals from multiple participants. We highlight the trend toward integrating Mobile Brain/Body Imaging (MoBI) within the 4E research framework, which emphasizes the interconnectedness of brain, body, and environment. Our analysis revealed a geographic concentration of studies in the Global North, calling for global collaboration and transcultural research to balance the field. The predominant use of Magneto/Electroencephalogram (M/EEG) in these studies suggests a traditional brain-centric perspective in social neuroscience. Future research directions should focus on integrating diverse techniques to capture the dynamic interplay between brain and body functions in real-world contexts. Our review also finds a preference for tasks involving natural settings. Nevertheless, the analysis in hyperscanning studies is often limited to physiological signal synchrony between participants. This suggests a need for more holistic and complex approaches that combine inter-corporeal synchrony with intra-individual measures. We believe that the future of the neuroscience of relationships lies in embracing the complexity of cognition, integrating diverse methods and theories to enrich our grasp of human social behavior in its natural contexts.

Synergy of the mirror neuron system and the mentalizing system in a single brain and between brains during joint actions

Cooperative action involves the simulation of actions and their co-representation by two or more people. This requires the involvement of two complex brain systems: the mirror neuron system (MNS) and the mentalizing system (MENT), both of critical importance for successful social interaction. However, their internal organization and the potential synergy of both systems during joint actions (JA) are yet to be determined. The aim of this study was to examine the role and interaction of these two fundamental systems-MENT and MNS-during continuous interaction. To this hand, we conducted a multiple-brain connectivity analysis in the source domain during a motor cooperation task using high-density EEG dual-recordings providing relevant insights into the roles of MNS and MENT at the intra- and interbrain levels. In particular, the intra-brain analysis demonstrated the essential function of both systems during JA, as well as the crucial role played by single brain regions of both neural mechanisms during cooperative activities. Specifically, our intra-brain analysis revealed that both neural mechanisms are essential during Joint Action (JA), showing a solid connection between MNS and MENT and a central role of the single brain regions of both mechanisms during cooperative actions. Additionally, our inter-brain study revealed increased inter-subject connections involving the motor system, MENT and MNS. Thus, our findings show a mutual influence between two interacting agents, based on synchronization of MNS and MENT systems. Our results actually encourage more research into the still-largely unknown realm of inter-brain dynamics and contribute to expand the body of knowledge in social neuroscience.

Regression of Multiple Conversation Aspects using Dyadic Physiological Measurements

Dyadic physiological responses are correlated with the quality of interpersonal processes - for example, the degree of "connectedness" in education and mental health counseling. Pattern recognition algorithms could be applied to such dyadic responses to identify the states of specific dyads, but such pattern recognition has primarily focused on classification. This paper instead uses regression algorithms to estimate three conversation aspects (valence, arousal, balance) from heart rate, skin conductance, respiration, and skin temperature. Data were collected from 35 dyads who engaged in 20 minutes of conversation, divided into 10 two-minute intervals. Each interval was rated with regard to conversation valence, arousal, and balance by an observer. When regression algorithms (support vector machines and Gaussian process regression) were trained on other data from the same dyad, they were able to estimate valence, arousal and balance with lower errors than a simple baseline estimator. However, when algorithms were trained on data from other dyads, errors were not lower than those of the baseline estimator. Overall, results indicate that, as long as training data from the same dyad are available, autonomic nervous system responses can be combined with regression algorithms to estimate multiple dyadic conversation aspects with some accuracy. This has applications in education and mental health counseling, though fundamental issues remain to be addressed before the technology is used in practice.

A practical guide to EEG hyperscanning in joint action research: from motivation to implementation

Developments in cognitive neuroscience have led to the emergence of hyperscanning, the simultaneous measurement of brain activity from multiple people. Hyperscanning is useful for investigating social cognition, including joint action, because of its ability to capture neural processes that occur within and between people as they coordinate actions toward a shared goal. Here, we provide a practical guide for researchers considering using hyperscanning to study joint action and seeking to avoid frequently raised concerns from hyperscanning skeptics. We focus specifically on Electroencephalography (EEG) hyperscanning, which is widely available and optimally suited for capturing fine-grained temporal dynamics of action coordination. Our guidelines cover questions that are likely to arise when planning a hyperscanning project, ranging from whether hyperscanning is appropriate for answering one's research questions to considerations for study design, dependent variable selection, data analysis and visualization. By following clear guidelines that facilitate careful consideration of the theoretical implications of research design choices and other methodological decisions, joint action researchers can mitigate interpretability issues and maximize the benefits of hyperscanning paradigms.

Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.

Distinct social behavior and inter-brain connectivity in Dyads with autistic individuals

Autism Spectrum Disorder (ASD) is defined by distinctive socio-cognitive behaviors that deviate from typical patterns. Notably, social imitation skills appear to be particularly impacted, manifesting early on in development. This paper compared the behavior and inter-brain dynamics of dyads made up of two typically developing (TD) participants with mixed dyads made up of ASD and TD participants during social imitation tasks. By combining kinematics and EEG-hyperscanning, we show that individuals with ASD exhibited a preference for the follower rather than the lead role in imitating scenarios. Moreover, the study revealed inter-brain synchrony differences, with low-alpha inter-brain synchrony differentiating control and mixed dyads. The study's findings suggest the importance of studying interpersonal phenomena in dynamic and ecological settings and using hyperscanning methods to capture inter-brain dynamics during actual social interactions.

Having a chat and then watching a movie: how social interaction synchronises our brains during co-watching

How does co-presence change our neural experience of the world? Can a conversation change how we synchronise with our partner during later events? Using fNIRS hyperscanning, we measured brain activity from 27 pairs of familiar adults simultaneously over frontal, temporal and parietal regions bilaterally, as they co-watched two different episodes of a short cartoon. In-between the two episodes, each pair engaged in a face-to-face conversation on topics unrelated to the cartoon episodes. Brain synchrony was calculated using wavelet transform coherence and computed separately for real pairs and shuffled pseudo) pairs. Findings reveal that real pairs showed increased brain synchrony over right Dorso-Lateral Pre-Frontal cortex (DLPFC) and right Superior Parietal Lobe (SPL), compared to pseudo pairs (who had never seen each other and watched the same movie at different times; uncorrected for multiple comparisons). In addition, co-watching after a conversation was associated with greater synchrony over right TPJ compared to co-watching before a conversation, and this effect was significantly higher in real pairs (who engaged in conversation with each other) compared to pseudo pairs (who had a conversation with someone else; uncorrected for multiple comparisons). The present study has shed the light on the role of social interaction in modulating brain synchrony across people not just during social interaction, but even for subsequent non-social activities. These results have implications in the growing domain of naturalistic neuroimaging and interactive neuroscience.

It takes a village: A multi-brain approach to studying multigenerational family communication

Grandparents play a critical role in child rearing across the globe. Yet, there is a shortage of neurobiological research examining the relationship between grandparents and their grandchildren. We employ multi-brain neurocomputational models to simulate how changes in neurophysiological processes in both development and healthy aging affect multigenerational inter-brain coupling - a neural marker that has been linked to a range of socio-emotional and cognitive outcomes. The simulations suggest that grandparent-child interactions may be paired with higher inter-brain coupling than parent-child interactions, raising the possibility that the former may be more advantageous under certain conditions. Critically, this enhancement of inter-brain coupling for grandparent-child interactions is more pronounced in tri-generational interactions that also include a parent, which may speak to findings that grandparent involvement in childrearing is most beneficial if the parent is also an active household member. Together, these findings underscore that a better understanding of the neurobiological basis of cross-generational interactions is vital, and that such knowledge can be helpful in guiding interventions that consider the whole family. We advocate for a community neuroscience approach in developmental social neuroscience to capture the diversity of child-caregiver relationships in real-world settings.

Dyadic cooperation with human and artificial agents: Event-related potentials trace dynamic role taking during an interactive game

Humans are highly co-operative and thus cognitively, affectively, and motivationally tuned to pursue shared goals. Yet, cooperative tasks typically require people to constantly take and switch individual roles. Task relevance is dictated by these roles and thereby dynamically changing. Here, we designed a dyadic game to test whether the family of P3 components can trace this dynamic allocation of task relevance. We demonstrate that late positive event-related potential (ERP) modulations not only reflect predictable asymmetries between receiving and sending information but also differentiate whether the receiver's role is related to correct decision making or action monitoring. Furthermore, similar results were observed when playing the game with a computer, suggesting that experimental games may motivate humans to similarly cooperate with an artificial agent. Overall, late positive ERP waves provide a real-time measure of how role taking dynamically shapes the meaning and relevance of stimuli within collaborative contexts. Our results, therefore, shed light on how the processes of mutual coordination unfold during dyadic cooperation.

Age differences in interbrain synchronization during peer cooperation: an EEG hyperscanning study

Healthy peer relationships could provide emotional and social support for adolescents experiencing dramatic physical and environmental changes. Examining age differences in cognitive neural processing during peer interaction provides insight into adolescent interpersonal contact and "social brain" development. The present study compared the age differences between adolescents and adults by examining the behavior and interbrain synchronization of pairs in a cooperative computer game task. 32 pairs of adolescents and 31 pairs of adults were recruited as participants. The reaction times and interbrain synchronization of the participants were measured. The results revealed that interbrain synchronization activation following the onset of the "ready signal" was primarily detected in low-frequency bands such as delta and theta. Adolescent pairs' interbrain synchronization activations were significantly higher than those of adult pairs in the anterior and central brain regions, such as the frontal, frontal-central, and parietal lobes. Correlation analysis indicated a positive correlation between occipital region interbrain synchronization and behavioral performance. The findings provide behavioral and neurophysiological evidence for the characteristics of adolescent interpersonal cognitive processing and point to the significance of low-frequency interbrain synchronization in interpersonal coordination.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

Automated Classification of Dyadic Conversation Scenarios using Autonomic Nervous System Responses

Two people's physiological responses become more similar as those people talk or cooperate, a phenomenon called physiological synchrony. The degree of synchrony correlates with conversation engagement and cooperation quality, and could thus be used to characterize interpersonal interaction. In this study, we used a combination of physiological synchrony metrics and pattern recognition algorithms to automatically classify four different dyadic conversation scenarios: two-sided positive conversation, two-sided negative conversation, and two one-sided scenarios. Heart rate, skin conductance, respiration and peripheral skin temperature were measured from 16 dyads in all four scenarios, and individual as well as synchrony features were extracted from them. A two-stage classifier based on stepwise feature selection and linear discriminant analysis achieved a four-class classification accuracy of 75.0% in leave-dyad-out crossvalidation. Removing synchrony features reduced accuracy to 65.6%, indicating that synchrony is informative. In the future, such classification algorithms may be used to, e.g., provide real-time feedback about conversation mood to participants, with applications in areas such as mental health counseling and education. The approach may also generalize to group scenarios and adjacent areas such as cooperation and competition.

Preceding and trailing role-taking in dyad synchronization using finger tapping

In ensembles, people synchronize the timings of their movements with those of others. Players sometimes take on preceding and trailing roles, whereby one's beat is either slightly earlier or slightly later than that of another. In this study, we aimed to clarify whether the division of preceding and trailing roles occurs in simple rhythmic coordination among non-musicians. Additionally, we investigated the temporal dependencies between these roles. We conducted a synchronous-continuous tapping task involving pairs of people, whereby pairs of participants first tapped to synchronize with a metronome. After the metronome stopped, the participants synchronized their taps to their partners' tap timings, which were presented as auditory stimuli. Except in one trial, the pairs involved participants taking on preceding and trailing roles. Compared to the participants taking on the trailing role, those taking on the preceding role demonstrated enhanced phase-correction responses, while those taking on the trailing role significantly adapted their tempos to match those of their partners. As a result, people spontaneously divided into preceding and trailing roles. The preceding participants tended to reduce asynchronies, while the trailing participants tended to match their tempo to their partners'.

Head motion synchrony in unidirectional and bidirectional verbal communication

Interpersonal communication includes verbal and nonverbal communication. Verbal communication comprises one-way (e.g., a speech or lecture) and interactive verbal communication (e.g., daily conversations or meetings), which we frequently encounter. Nonverbal communication has considerable influence on interpersonal communication, and body motion synchrony is known to be an important factor for successful communication and social interaction. However, most research on body motion synchrony has been elucidated by either the setting of one-way verbal transmission or the verbal interaction setting, and it remains unclear whether verbal directionality and interactivity affect body motion synchrony. One-way and two-way (interactive) verbal communication is implicated in designed or undesigned leader-follower relationships, and also in the complexity and diversity of interpersonal interactions, where two-way verbal communication is more complex and diverse than in the one-way condition. In this study, we tested head motion synchrony between the one-way verbal communication condition (in which the roles of the speaker and listener are fixed) and the two-way verbal communication condition (where the speaker and listener can freely engage in a conversation). Therefore, although no statistically significant difference in synchrony activity (relative frequency) was found, a statistically significant difference was observed in synchrony direction (temporal lead-lag structure as mimicry) and intensity. Specifically, the synchrony direction in two-way verbal communication was close to zero, but this in one-way verbal communication was synchronized with the listener's movement predominantly delayed. Furthermore, synchrony intensity, in terms of the degree of variation in the phase difference distribution, was significantly higher in the one-way verbal communication than in the two-way condition, with bigger time-shifts being observed in the latter. This result suggests that verbal interaction does not affect the overall frequency of head motion synchrony but does affect the temporal lead-lag structure and coherence.

Proactive or reactive? Neural oscillatory insight into the leader-follower dynamics of early infant-caregiver interaction

We know that infants' ability to coordinate attention with others toward the end of the first year is fundamental to language acquisition and social cognition. Yet, we understand little about the neural and cognitive mechanisms driving infant attention in shared interaction: do infants play a proactive role in creating episodes of joint attention? Recording electroencephalography (EEG) from 12-mo-old infants while they engaged in table-top play with their caregiver, we examined the communicative behaviors and neural activity preceding and following infant- vs. adult-led joint attention. Infant-led episodes of joint attention appeared largely reactive: they were not associated with increased theta power, a neural marker of endogenously driven attention, and infants did not increase their ostensive signals before the initiation. Infants were, however, sensitive to whether their initiations were responded to. When caregivers joined their attentional focus, infants showed increased alpha suppression, a pattern of neural activity associated with predictive processing. Our results suggest that at 10 to 12 mo, infants are not routinely proactive in creating joint attention episodes yet. They do, however, anticipate behavioral contingency, a potentially foundational mechanism for the emergence of intentional communication.

An fMRI-study of leading and following using rhythmic tapping

Leading and following is about synchronizing and joining actions in accordance with the differences that the leader and follower roles provide. The neural reactivity representing these roles was measured in an explorative fMRI-study, where two persons lead and followed each other in finger tapping using simple, individual, pre-learnt rhythms. All participants acted both as leader and follower. Neural reactivity for both lead and follow related to social awareness and adaptation distributed over the lateral STG, STS and TPJ. Reactivity for follow contrasted with lead mostly reflected sensorimotor and rhythmic processing in cerebellum IV, V, somatosensory cortex and SMA. During leading, as opposed to following, neural reactivity was observed in the insula and bilaterally in the superior temporal gyrus, pointing toward empathy, sharing of feelings, temporal coding and social engagement. Areas for continuous adaptation, in the posterior cerebellum and Rolandic operculum, were activated during both leading and following. This study indicated mutual adaptation of leader and follower during tapping and that the roles gave rise to largely similar neuronal reactivity. The differences between the roles indicated that leading was more socially focused and following had more motoric- and temporally related neural reactivity.

Emergent and planned interpersonal synchronization are both sensitive to 'tempo aftereffect contagion'

Interpersonal synchronization is fundamental for motor coordination during social interactions. Discerning emergent (entrainment) from planned synchronization represents a non-trivial issue in visually bonded individuals acting together, as well as assessing whether inter-individual differences, e.g., in autistic traits, modulate both types of synchronization. In a visuomotor finger-tapping task, two participants replicated a target tempo either synchronizing ('joint' condition) or not ('non-interactive' condition, 'non-int') with each other. One participant was exposed ('induced') to tempo aftereffect (a medium tempo seems faster or slower after exposure to slower or faster inducing tempi), but not the other participant ('not induced'); thus they had different timing perceptions of the same target. We assessed to what degree emergent and/or planned synchronization affected dyads by analyzing inter-tap-intervals, synchronization indexes, and cross-correlation coefficients. Results revealed a 'tempo aftereffect contagion': inter-tap-intervals of both induced and not-induced participants showed aftereffect in both the joint and non-int conditions. Moreover, aftereffects did not correlate across conditions suggesting they might be due to (at least in part) different processes, but the propensity for tempo aftereffect contagion correlated with individuals' autistic traits only in the non-int condition. Finally, participants co-adjusted their tapping more in the joint condition than in the non-int one, as confirmed by higher synchronization indexes and the mutual adaptation pattern of cross-correlation coefficients. Altogether, these results show the subtle interplay between emergent and planned interpersonal synchronization mechanisms that act on a millisecond timescale independently from synching or not with the partner.

Cortico-cerebellar audio-motor regions coordinate self and other in musical joint action

Joint music performance requires flexible sensorimotor coordination between self and other. Cognitive and sensory parameters of joint action-such as shared knowledge or temporal (a)synchrony-influence this coordination by shifting the balance between self-other segregation and integration. To investigate the neural bases of these parameters and their interaction during joint action, we asked pianists to play on an MR-compatible piano, in duet with a partner outside of the scanner room. Motor knowledge of the partner's musical part and the temporal compatibility of the partner's action feedback were manipulated. First, we found stronger activity and functional connectivity within cortico-cerebellar audio-motor networks when pianists had practiced their partner's part before. This indicates that they simulated and anticipated the auditory feedback of the partner by virtue of an internal model. Second, we observed stronger cerebellar activity and reduced behavioral adaptation when pianists encountered subtle asynchronies between these model-based anticipations and the perceived sensory outcome of (familiar) partner actions, indicating a shift towards self-other segregation. These combined findings demonstrate that cortico-cerebellar audio-motor networks link motor knowledge and other-produced sounds depending on cognitive and sensory factors of the joint performance, and play a crucial role in balancing self-other integration and segregation.

Learning acquisition of consistent leader-follower relationships depends on implicit haptic interactions

Are leaders made or born? Leader-follower roles have been well characterized in social science, but they remain somewhat obscure in sensory-motor coordination. Furthermore, it is unknown how and why leader-follower relationships are acquired, including innate versus acquired controversies. We developed a novel asymmetrical coordination task in which two participants (dyad) need to collaborate in transporting a simulated beam while maintaining its horizontal attitude. This experimental paradigm was implemented by twin robotic manipulanda, simulated beam dynamics, haptic interactions, and a projection screen. Clear leader-follower relationships were learned only when strong haptic feedback was introduced. This phenomenon occurred despite participants not being informed that they were interacting with each other and the large number of equally-valid alternative dyadic coordination strategies. We demonstrate the emergence of consistent leader-follower relationships in sensory-motor coordination, and further show that haptic interaction is essential for dyadic co-adaptation. These results provide insights into neural mechanisms responsible for the formation of leader-follower relationships in our society.

Brain networks for temporal adaptation, anticipation, and sensory-motor integration in rhythmic human behavior

Human interaction often requires the precise yet flexible interpersonal coordination of rhythmic behavior, as in group music making. The present fMRI study investigates the functional brain networks that may facilitate such behavior by enabling temporal adaptation (error correction), prediction, and the monitoring and integration of information about 'self' and the external environment. Participants were required to synchronize finger taps with computer-controlled auditory sequences that were presented either at a globally steady tempo with local adaptations to the participants' tap timing (Virtual Partner task) or with gradual tempo accelerations and decelerations but without adaptation (Tempo Change task). Connectome-based predictive modelling was used to examine patterns of brain functional connectivity related to individual differences in behavioral performance and parameter estimates from the adaptation and anticipation model (ADAM) of sensorimotor synchronization for these two tasks under conditions of varying cognitive load. Results revealed distinct but overlapping brain networks associated with ADAM-derived estimates of temporal adaptation, anticipation, and the integration of self-controlled and externally controlled processes across task conditions. The partial overlap between ADAM networks suggests common hub regions that modulate functional connectivity within and between the brain's resting-state networks and additional sensory-motor regions and subcortical structures in a manner reflecting coordination skill. Such network reconfiguration might facilitate sensorimotor synchronization by enabling shifts in focus on internal and external information, and, in social contexts requiring interpersonal coordination, variations in the degree of simultaneous integration and segregation of these information sources in internal models that support self, other, and joint action planning and prediction.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

Alpha oscillations related to self-other integration and distinction during live orchestral performance: A naturalistic case study

Ensemble music performance requires musicians to achieve precise interpersonal coordination while maintaining autonomous control over their own actions. To do so, musicians dynamically shift between integrating other performers' actions into their own action plans and maintaining a distinction between their own and others' actions. Research in laboratory settings has shown that this dynamic process of self-other integration and distinction is indexed by sensorimotor alpha oscillations. The purpose of the current descriptive case study was to examine oscillations related to self-other integration and distinction in a naturalistic performance context. We measured alpha activity from four violinists during a concert hall performance of a 60-musician orchestra. We selected a musical piece from the orchestra's repertoire and, before analyzing alpha activity, performed a score analysis to divide the piece into sections that were expected to strongly promote self-other integration and distinction. In line with previous laboratory findings, performers showed suppressed and enhanced alpha activity during musical sections that promoted self-other integration and distinction, respectively. The current study thus provides preliminary evidence that findings from carefully controlled laboratory experiments generalize to complex real-world performance. Its findings also suggest directions for future research and potential applications of interest to musicians, music educators, and music therapists.

The performance monitoring system is attuned to others' actions during dyadic motor interactions

Interpersonal motor interactions require the simultaneous monitoring of one's own and one's partner's actions. To characterize how the action monitoring system tracks self and other behavior during synchronous interactions, we combined electroencephalography recordings and immersive virtual reality in two tasks where participants were asked to synchronize their actions with those of a virtual partner (VP). The two tasks differed in the features to be monitored: the Goal task required participants to predict and monitor the VP's reaching goal; the Spatial task required participants to predict and monitor the VP's reaching trajectory. In both tasks, the VP performed unexpected movement changes to which the participant needed to adapt. By extracting the neural activity locked to the detection of unexpected changes in the VP's action (other-monitoring) or to the participants' action-replanning (self-monitoring), we show that the monitoring system is more attuned to others' than to one's own actions. Additionally, distinctive neural responses to VP's unexpected goals and trajectory corrections were found: goal changes were reflected both in early fronto-central and later posterior neural responses while trajectory deviations were reflected only in later posterior responses. Altogether, our results indicate that the monitoring system adopts an inherent social mode to handle interpersonal motor interactions.

Bringing social interaction at the core of organizational neuroscience

Organizations are composed of individuals working together for achieving specific goals, and interpersonal dynamics do exert a strong influence on workplace behaviour. Nevertheless, the dual and multiple perspective of interactions has been scarcely considered by Organizational Neuroscience (ON), the emerging field of study that aims at incorporating findings from cognitive and brain sciences into the investigation of organizational behaviour. This perspective article aims to highlight the potential benefits of adopting experimental settings involving two or more participants (the so-called "second person" approach) for studying the neural bases of organizational behaviour. Specifically, we stress the idea that moving beyond the individual perspective and capturing the dynamical relationships occurring within dyads or groups (e.g., leaders and followers, salespersons and clients, teams) might bring novel insights into the rising field of ON. In addition, designing research paradigms that reliably recreate real work and life situations might increase the generalizability and ecological validity of its results. We start with a brief overview of the current state of ON research and we continue by describing the second-person approach to social neuroscience. In the last paragraph, we try and outline how this approach could be extended to ON. To this end, we focus on leadership, group processes and emotional contagion as potential targets of interpersonal ON research.

The specificity, situational modulations, and behavioral correlates of parent-child neural synchrony

In recent years, aiming to uncover the neural mechanism of parent-child interaction and link it to the children's social development, a newly developed index, namely, parent-child inter-brain neural synchronization (INS) has attracted growing interest. Existing studies have mainly focused on three aspects of the INS; these are the specificity of the INS (i.e., stronger INS for parent-child dyads than stranger-child dyads), the situational modulations of the INS (i.e., how the valence of the situation or the types of interaction modulate INS), and the associations between the INS and the state-like behavioral tendencies or trait-like individual features of the parents and children. This review summarizes the existing findings in line with these three topics and provides preliminary suggestions to promote parent-child INS. In the meanwhile, the inconsistent findings and unstudied questions were discussed, opening new avenues for future studies.

Delta-Alpha EEG pattern reflects the interoceptive focus effect on interpersonal motor synchronization

Little is known about how the modulation of the interoceptive focus impacts the neural correlates of high-level social processes, such as synchronization mechanisms. Therefore, the current study aims to explore the intraindividual electrophysiological (EEG) patterns induced by the interoceptive focus on breath when performing cognitive and motor tasks requiring interpersonal synchronization. A sample of 28 healthy caucasian adults was recruited and asked to perform two tasks requiring interpersonal synchronization during two distinct conditions: while focusing on the breath or without the focus on the breath. EEG frequency bands (delta, theta, alpha, and beta band) were recorded from the frontal, temporo-central, and parieto-occipital regions of interest. Significant results were observed for the delta and alpha bands. Notably, higher mean delta values and alpha desynchronization were observed in the temporo-central area during the focus on the breath condition when performing the motor compared to the cognitive synchronization task. Taken together these results could be interpreted considering the functional meaning of delta and alpha band in relation to motor synchronization. Indeed, motor delta oscillations shape the dynamics of motor behaviors and motor neural processes, while alpha band attenuation was previously observed during generation, observation, and imagery of movement and is considered to reflect cortical motor activity and action-perception coupling. Overall, the research shows that an EEG delta-alpha pattern emerges in the temporo-central areas at the intra-individual level, indicating the attention to visceral signals, particularly during interpersonal motor synchrony.

Distinct neural couplings to shared goal and action coordination in joint action: evidence based on fNIRS hyperscanning

Joint action is central to human nature, enabling individuals to coordinate in time and space to achieve a joint outcome. Such interaction typically involves two key elements: shared goal and action coordination. Yet, the substrates entrained to these two components in joint action remained unclear. In the current study, dyads performed two tasks involving both sharing goal and action coordination, i.e. complementary joint action and imitative joint action, a task only involving shared goal and a task only involving action coordination, while their brain activities were recorded by the functional near-infrared spectroscopy hyperscanning technique. The results showed that both complementary and imitative joint action (i.e. involving shared goal and action coordination) elicited better behavioral performance than the task only involving shared goal/action coordination. We observed that the interbrain synchronization (IBS) at the right inferior frontal cortex (IFC) entrained more to shared goal, while left-IFC IBS entrained more to action coordination. We also observed that the right-IFC IBS was greater during completing a complementary action than an imitative action. Our results suggest that IFC plays an important role in joint action, with distinct lateralization for the sub-components of joint action.

The promises and pitfalls of functional magnetic resonance imaging hyperscanning for social interaction research

Social neuroscience combines tools and perspectives from social psychology and neuroscience to understand how people interact with their social world. Here we discuss a relatively new method-hyperscanning-to study real-time, interactive social interactions using functional magnetic resonance imaging (fMRI). We highlight three contributions that fMRI hyperscanning makes to the study of the social mind: (1) Naturalism: it shifts the focus from tightly-controlled stimuli to more naturalistic social interactions; (2) Multi-person Dynamics: it shifts the focus from individuals as the unit of analysis to dyads and groups; and (3) Neural Resolution: fMRI hyperscanning captures high-resolution neural patterns and dynamics across the whole brain, unlike other neuroimaging hyperscanning methods (e.g., electroencephalogram, functional near-infrared spectroscopy). Finally, we describe the practical considerations and challenges that fMRI hyperscanning researchers must navigate. We hope researchers will harness this powerful new paradigm to address pressing questions in today's society.

Task-related, intrinsic oscillatory and aperiodic neural activity predict performance in naturalistic team-based training scenarios

Effective teams are essential for optimally functioning societies. However, little is known regarding the neural basis of two or more individuals engaging cooperatively in real-world tasks, such as in operational training environments. In this exploratory study, we recruited forty individuals paired as twenty dyads and recorded dual-EEG at rest and during realistic training scenarios of increasing complexity using virtual simulation systems. We estimated markers of intrinsic brain activity (i.e., individual alpha frequency and aperiodic activity), as well as task-related theta and alpha oscillations. Using nonlinear modelling and a logistic regression machine learning model, we found that resting-state EEG predicts performance and can also reliably differentiate between members within a dyad. Task-related theta and alpha activity during easy training tasks predicted later performance on complex training to a greater extent than prior behaviour. These findings complement laboratory-based research on both oscillatory and aperiodic activity in higher-order cognition and provide evidence that theta and alpha activity play a critical role in complex task performance in team environments.

Dual-MEG interbrain synchronization during turn-taking verbal interactions between mothers and children

Verbal interaction and imitation are essential for language learning and development in young children. However, it is unclear how mother-child dyads synchronize oscillatory neural activity at the cortical level in turn-based speech interactions. Our study investigated interbrain synchrony in mother-child pairs during a turn-taking paradigm of verbal imitation. A dual-MEG (magnetoencephalography) setup was used to measure brain activity from interactive mother-child pairs simultaneously. Interpersonal neural synchronization was compared between socially interactive and noninteractive tasks (passive listening to pure tones). Interbrain networks showed increased synchronization during the socially interactive compared to noninteractive conditions in the theta and alpha bands. Enhanced interpersonal brain synchrony was observed in the right angular gyrus, right triangular, and left opercular parts of the inferior frontal gyrus. Moreover, these parietal and frontal regions appear to be the cortical hubs exhibiting a high number of interbrain connections. These cortical areas could serve as a neural marker for the interactive component in verbal social communication. The present study is the first to investigate mother-child interbrain neural synchronization during verbal social interactions using a dual-MEG setup. Our results advance our understanding of turn-taking during verbal interaction between mother-child dyads and suggest a role for social "gating" in language learning.

Magnetoencephalography Hyperscanning Evidence of Differing Cognitive Strategies Due to Social Role During Auditory Communication

Auditory communication is an essential form of human social interaction. However, the intra-brain cortical-oscillatory drivers of auditory communication exchange remain relatively unexplored. We used improvisational music performance to simulate and capture the creativity and turn-taking dynamics of natural auditory communication. Using magnetoencephalography (MEG) hyperscanning in musicians, we targeted brain activity during periods of music communication imagery, and separately analyzed theta (5–7 Hz), alpha (8–13 Hz), and beta (15–29 Hz) source-level activity using a within-subjects, two-factor approach which considered the assigned social role of the subject (leader or follower) and whether communication responses were improvisational (yes or no). Theta activity related to improvisational communication and social role significantly interacted in the left isthmus cingulate cortex. Social role was furthermore differentiated by pronounced occipital alpha and beta amplitude increases suggestive of working memory retention engagement in Followers but not Leaders. The results offer compelling evidence for both musical and social neuroscience that the cognitive strategies, and correspondingly the memory and attention-associated oscillatory brain activities of interlocutors during communication differs according to their social role/hierarchy, thereby indicating that social role/hierarchy needs to be controlled for in social neuroscience research.

Increased or decreased? Interpersonal neural synchronization in group creation

Group creation is the process by which group members collaborate to produce novel and useful ideas or products, including ideas generation and evaluation. However, the interpersonal neural mechanism of group creation during natural communication remains unclear. In this study, two groups of same-sex dyads with similar individual creativity collaborated to complete the Product Improvement Task (creative condition) and the Item Purchase Plan Task (control condition), respectively. Functional near-infrared spectroscopy (fNIRS) was used to record both members' neural activity in the left prefrontal (lPFC) and right temporal-parietal junction (rTPJ) regions during the task. Considering that the role asymmetry of group members may have an impact on interpersonal neural patterns, we identified leaders and followers in the dyads based on participant performance. The results showed that leaders and followers in the creative condition had significantly lower interpersonal neural synchronization (INS) in the right superior temporal gyrus-left superior frontal gyrus, right supramarginal gyrus-left superior frontal gyrus, and right supramarginal gyrus-left middle frontal gyrus than in the control condition. Partial multivariate Granger causality analyses revealed the influence between dyads was bidirectional but was significantly stronger from the leaders to the followers than the other direction. In addition, in the creative task, the INS was significantly associated with novelty, appropriateness, and conflict of views. All these findings suggest that the ideas generation and ideas evaluation process in group creation have poor interpersonal neural activity coupling due to factors such as the difficulty of understanding novel ideas. However, performances may be improved when groups can better integrate views and reach collective understanding, intentions, and goals. Furthermore, we found that there are differences in the dynamics of INS in different brain regions. The INS related to the novelty of the group creation decreased in the early stages, while the INS related to the appropriateness decreased in the middle stages. Our findings reveal a unique interpersonal neural pattern of group creation processes in the context of natural communication.

Social synchronization of brain activity increases during eye-contact

Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization.

Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.

Music in the brain

Music is ubiquitous across human cultures - as a source of affective and pleasurable experience, moving us both physically and emotionally - and learning to play music shapes both brain structure and brain function. Music processing in the brain - namely, the perception of melody, harmony and rhythm - has traditionally been studied as an auditory phenomenon using passive listening paradigms. However, when listening to music, we actively generate predictions about what is likely to happen next. This enactive aspect has led to a more comprehensive understanding of music processing involving brain structures implicated in action, emotion and learning. Here we review the cognitive neuroscience literature of music perception. We show that music perception, action, emotion and learning all rest on the human brain's fundamental capacity for prediction - as formulated by the predictive coding of music model. This Review elucidates how this formulation of music perception and expertise in individuals can be extended to account for the dynamics and underlying brain mechanisms of collective music making. This in turn has important implications for human creativity as evinced by music improvisation. These recent advances shed new light on what makes music meaningful from a neuroscientific perspective.

Social EEG: A novel neurodevelopmental approach to studying brain-behavior links and brain-to-brain synchrony during naturalistic toddler-parent interactions

Despite increasing emphasis on emergent brain-behavior patterns supporting language, cognitive, and socioemotional development in toddlerhood, methodologic challenges impede their characterization. Toddlers are notoriously difficult to engage in brain research, leaving a developmental window in which neural processes are understudied. Further, electroencephalography (EEG) and event-related potential paradigms at this age typically employ structured, experimental tasks that rarely reflect formative naturalistic interactions with caregivers. Here, we introduce and provide proof of concept for a new "Social EEG" paradigm, in which parent-toddler dyads interact naturally during EEG recording. Parents and toddlers sit at a table together and engage in different activities, such as book sharing or watching a movie. EEG is time locked to the video recording of their interaction. Offline, behavioral data are microcoded with mutually exclusive engagement state codes. From 216 sessions to date with 2- and 3-year-old toddlers and their parents, 72% of dyads successfully completed the full Social EEG paradigm, suggesting that it is possible to collect dual EEG from parents and toddlers during naturalistic interactions. In addition to providing naturalistic information about child neural development within the caregiving context, this paradigm holds promise for examination of emerging constructs such as brain-to-brain synchrony in parents and children.

Intra-individual behavioural and neural signatures of audience effects and interactions in a mirror-game paradigm

We often perform actions while observed by others, yet the behavioural and neural signatures of audience effects remain understudied. Performing actions while being observed has been shown to result in more emphasized movements in musicians and dancers, as well as during communicative actions. Here, we investigate the behavioural and neural mechanisms of observed actions in relation to individual actions in isolation and interactive joint actions. Movement kinematics and EEG were recorded in 42 participants (21 pairs) during a mirror-game paradigm, while participants produced improvised movements alone, while observed by a partner, or by synchronizing movements with the partner. Participants produced largest movements when being observed, and observed actors and dyads in interaction produced slower and less variable movements in contrast with acting alone. On a neural level, we observed increased mu suppression during interaction, as well as to a lesser extent during observed actions, relative to individual actions. Moreover, we observed increased widespread functional brain connectivity during observed actions relative to both individual and interactive actions, suggesting increased intra-individual monitoring and action-perception integration as a result of audience effects. These results suggest that observed actors take observers into account in their action plans by increasing self-monitoring; on a behavioural level, observed actions are similar to emergent interactive actions, characterized by slower and more predictable movements.

A Two-Person Neuroscience Approach for Social Anxiety: A Paradigm With Interbrain Synchrony and Neurofeedback

Social anxiety disorder has been widely recognised as one of the most commonly diagnosed mental disorders. Individuals with social anxiety disorder experience difficulties during social interactions that are essential in the regular functioning of daily routines; perpetually motivating research into the aetiology, maintenance and treatment methods. Traditionally, social and clinical neuroscience studies incorporated protocols testing one participant at a time. However, it has been recently suggested that such protocols are unable to directly assess social interaction performance, which can be revealed by testing multiple individuals simultaneously. The principle of two-person neuroscience highlights the interpersonal aspect of social interactions that observes behaviour and brain activity from both (or all) constituents of the interaction, rather than analysing on an individual level or an individual observation of a social situation. Therefore, two-person neuroscience could be a promising direction for assessment and intervention of the social anxiety disorder. In this paper, we propose a novel paradigm which integrates two-person neuroscience in a neurofeedback protocol. Neurofeedback and interbrain synchrony, a branch of two-person neuroscience, are discussed in their own capacities for their relationship with social anxiety disorder and relevance to the paradigm. The newly proposed paradigm sets out to assess the social interaction performance using interbrain synchrony between interacting individuals, and to employ a multi-user neurofeedback protocol for intervention of the social anxiety.

Inter-Brain Synchronization During Sandplay Therapy: Individual Analyses

Interactions between the client (Cl) and therapist (Th) evolve therapeutic relationships in psychotherapy. An interpersonal link or therapeutic space is implicitly developed, wherein certain important elements are expressed and shared. However, neural basis of psychotherapy, especially of non-verbal modalities, have scarcely been explored. Therefore, we examined the neural backgrounds of such therapeutic alliances during sandplay, a powerful art/play therapy technique. Real-time and simultaneous measurement of hemodynamics was conducted in the prefrontal cortex (PFC) of Cl-Th pairs participating in sandplay and subsequent interview sessions through multichannel near-infrared spectroscopy. As sandplay is highly individualized, and no two sessions and products (sandtrays) are the same, we expected variation in interactive patterns in the Cl–Th pairs. Nevertheless, we observed a statistically significant correlation between the spatio-temporal patterns in signals produced by the homologous regions of the brains. During the sandplay condition, significant correlations were obtained in the lateral PFC and frontopolar (FP) regions in the real Cl-Th pairs. Furthermore, a significant correlation was observed in the FP region for the interview condition. The correlations found in our study were explained as a “remote” synchronization (i.e., unconnected peripheral oscillators synchronizing through a hub maintaining free desynchronized dynamics) between two subjects in a pair, possibly representing the neural foundation of empathy, which arises commonly in sandplay therapy (ST).

Electrophysiological Correlates of Social Decision-making: An EEG Investigation of a Modified Ultimatum Game

Cooperation behaviors during social decision-making have been shown to be sensitive to manipulations of context. However, it remains unclear how aspects of context in dynamic social interactions, such as observed nonverbal behaviors, may modulate cooperation decisions and the associated neural mechanisms. In this study, participants responded to offers from proposers to split $10 in an Ultimatum Game following observation of proposer approach (friendly) or avoidance (nonfriendly) behaviors, displayed by dynamic whole-body animated avatars, or following a nonsocial interaction control condition. As expected, behavioral results showed that participants tended to have greater acceptance rates for unfair offers following observed nonverbal social interactions with proposers compared with control, suggesting an enhancing effect of social interactions on cooperative decisions. ERP results showed greater N1 and N2 responses at the beginning of social interaction conditions compared with control, and greater sustained and late positivity responses for observed approach and avoidance proposer behaviors compared with control. Event-related spectral perturbation (ERSP) results showed differential sensitivity within theta, alpha, and beta bands during observation of social interactions and offers that was associated with subsequent decision behaviors. Together, these results point to the impact of proposers' nonverbal behaviors on subsequent cooperation decisions at both behavioral and neural levels. The ERP and ERSP findings suggest modulated attention, monitoring, and processing of biological motion during the observed nonverbal social interactions, influencing the participants' responses to offers. These findings shed light on electrophysiological correlates of response to observed social interactions that predict subsequent social decisions.

Is there collaboration specific neurophysiological activation during collaborative task activity? An analysis of brain responses using electroencephalography and hyperscanning

Collaboration between two individuals is thought to be associated with the synchrony of two different brain activities. Indeed, prefrontal cortical activation and alpha frequency band modulation has been widely reported, but little is known about interbrain synchrony (IBS) changes occurring during social interaction such as collaboration or competition. In this study, we assess the dynamic of IBS variation in order to provide novel insights into the frequency band modulation underlying collaboration. To address this question, we used electroencephalography (EEG) to simultaneously record the brain activity of two individuals playing a computer-based game facing four different conditions: collaboration, competition, single participation, and passive observation. The computer-based game consisted of a fast button response task. Using data recorded in sensor space, we calculated an IBS value for each frequency band using both wavelet coherence transform and phase-locking value and performed single-subject analysis to compare each condition. We found significant IBS in frontal electrodes only present during collaboration associated with alpha frequency band modulation. In addition, we observed significant IBS in the theta frequency band for both collaboration and competition conditions, along with a significant single-subject cortical activity. Competition is distinguishable through single-subject activity in several regions and frequency bands of the brain. Performance is correlated with single-subject frontal activation during collaboration in the alpha and beta frequency band.

Automatic Estimation of Interpersonal Engagement During Naturalistic Conversation Using Dyadic Physiological Measurements

Physiological responses of two interacting individuals contain a wealth of information about the dyad: for example, the degree of engagement or trust. However, nearly all studies on dyadic physiological responses have targeted group-level analysis: e.g., correlating physiology and engagement in a large sample. Conversely, this paper presents a study where physiological measurements are combined with machine learning algorithms to dynamically estimate the engagement of individual dyads. Sixteen dyads completed 15-min naturalistic conversations and self-reported their engagement on a visual analog scale every 60 s. Four physiological signals (electrocardiography, skin conductance, respiration, skin temperature) were recorded, and both individual physiological features (e.g., each participant's heart rate) and synchrony features (indicating degree of physiological similarity between two participants) were extracted. Multiple regression algorithms were used to estimate self-reported engagement based on physiological features using either leave-interval-out crossvalidation (training on 14 60-s intervals from a dyad and testing on the 15th interval from the same dyad) or leave-dyad-out crossvalidation (training on 15 dyads and testing on the 16th). In leave-interval-out crossvalidation, the regression algorithms achieved accuracy similar to a 'baseline' estimator that simply took the median engagement of the other 14 intervals. In leave-dyad-out crossvalidation, machine learning achieved a slightly higher accuracy than the baseline estimator and higher accuracy than an independent human observer. Secondary analyses showed that removing synchrony features and personality characteristics from the input dataset negatively impacted estimation accuracy and that engagement estimation error was correlated with personality traits. Results demonstrate the feasibility of dynamically estimating interpersonal engagement during naturalistic conversation using physiological measurements, which has potential applications in both conversation monitoring and conversation enhancement. However, as many of our estimation errors are difficult to contextualize, further work is needed to determine acceptable estimation accuracies.

Temporal Coordination in Piano Duet Networked Music Performance (NMP): Interactions Between Acoustic Transmission Latency and Musical Role Asymmetries

Today’s audio, visual, and internet technologies allow people to interact despite physical distances, for casual conversation, group workouts, or musical performance. Musical ensemble performance is unique because interaction integrity critically depends on the timing between each performer’s actions and when their acoustic outcomes arrive. Acoustic transmission latency (ATL) between players is substantially longer for networked music performance (NMP) compared to traditional in-person spaces where musicians can easily adapt. Previous work has shown that longer ATLs slow the average tempo in ensemble performance, and that asymmetric co-actor roles and empathy-related traits affect coordination patterns in joint action. Thus, we are interested in how musicians collectively adapt to a given latency and how such adaptation patterns vary with their task-related and person-related asymmetries. Here, we examined how two pianists performed duets while hearing each other’s auditory outcomes with an ATL of 10, 20, or 40 ms. To test the hypotheses regarding task-related asymmetries, we designed duets such that pianists had: (1) a starting or joining role and (2) a similar or dissimilar musical part compared to their co-performer, with respect to pitch range and melodic contour. Results replicated previous clapping-duet findings showing that longer ATLs are associated with greater temporal asynchrony between partners and increased average tempo slowing. While co-performer asynchronies were not affected by performer role or part similarity, at the longer ATLs starting performers displayed slower tempos and smaller tempo variability than joining performers. This asymmetry of stability vs. flexibility between starters and joiners may sustain coordination, consistent with recent joint action findings. Our data also suggest that relative independence in musical parts may mitigate ATL-related challenges. Additionally, there may be a relationship between co-performer differences in empathy-related personality traits such as locus of control and coordination during performance under the influence of ATL. Incorporating the emergent coordinative dynamics between performers could help further innovation of music technologies and composition techniques for NMP.

A metastable attractor model of self-other integration (MEAMSO) in rhythmic synchronization

Human interaction is often accompanied by synchronized bodily rhythms. Such synchronization may emerge spontaneously as when a crowd's applause turns into a steady beat, be encouraged as in nursery rhymes, or be intentional as in the case of playing music together. The latter has been extensively studied using joint finger-tapping paradigms as a simplified version of rhythmic interpersonal synchronization. A key finding is that synchronization in such cases is multifaceted, with synchronized behaviour resting upon different synchronization strategies such as mutual adaptation, leading-following and leading-leading. However, there are multiple open questions regarding the mechanism behind these strategies and how they develop dynamically over time. Here, we propose a metastable attractor model of self-other integration (MEAMSO). This model conceptualizes dyadic rhythmic interpersonal synchronization as a process of integrating and segregating signals of self and other. Perceived sounds are continuously evaluated as either being attributed to self-produced or other-produced actions. The model entails a metastable system with two particular attractor states: one where an individual maintains two separate predictive models for self- and other-produced actions, and the other where these two predictive models integrate into one. The MEAMSO explains the three known synchronization strategies and makes testable predictions about the dynamics of interpersonal synchronization both in behaviour and the brain. This article is part of the theme issue 'Synchrony and rhythm interaction: from the brain to behavioural ecology'.