A Multi-Brain Framework for Social Interaction

Social context modulates multibrain broadband dynamics and functional brain-to-brain coupling in the group of mice

Although mice are social, multiple animals' neural activities are rarely explored. To characterise the neural activities during multi-brain interaction, we simultaneously recorded local field potentials (LFP) in the prefrontal cortex of four mice. The social context and locomotive states predominately modulated the entire LFP structure. The power of lower frequency bands-delta to alpha-were correlated with each other and anti-correlated with gamma power. The high-to-low-power ratio (HLR) provided a useful measure to understand LFP changes along the change of behavioural and locomotive states. The HLR during huddled conditions was lower than that during non-huddled conditions, dividing the social context into two. Multi-brain analyses of HLR indicated that the mice in the group displayed high cross-correlation. The mice in the group often showed unilateral precedence of HLR by Granger causality analysis, possibly comprising a hierarchical social structure. Overall, this study shows the importance of the social environment in brain dynamics and emphasises the simultaneous multi-brain recordings in social neuroscience.

Why behaviour matters: Studying inter-brain coordination during child-caregiver interaction

Modern technology allows for simultaneous neuroimaging from interacting caregiver-child dyads. Whereas most analyses that examine the coordination between brain regions within an individual brain do so by measuring changes relative to observed events, studies that examine coordination between two interacting brains generally do this by measuring average intra-brain coordination across entire blocks or experimental conditions. In other words, they do not examine changes in inter-brain coordination relative to individual behavioural events. Here, we discuss the limitations of this approach. First, we present data suggesting that fine-grained temporal interdependencies in behaviour can leave residual artifact in neuroimaging data. We show how artifact can manifest as both power and (through that) phase synchrony effects in EEG and affect wavelet transform coherence in fNIRS analyses. Second, we discuss different possible mechanistic explanations of how inter-brain coordination is established and maintained. We argue that non-event-locked approaches struggle to differentiate between them. Instead, we contend that approaches which examine how interpersonal dynamics change around behavioural events have better potential for addressing possible artifactual confounds and for teasing apart the overlapping mechanisms that drive changes in inter-brain coordination.

How does the human brain process noisy speech in real life? Insights from the second-person neuroscience perspective

Comprehending speech with the existence of background noise is of great importance for human life. In the past decades, a large number of psychological, cognitive and neuroscientific research has explored the neurocognitive mechanisms of speech-in-noise comprehension. However, as limited by the low ecological validity of the speech stimuli and the experimental paradigm, as well as the inadequate attention on the high-order linguistic and extralinguistic processes, there remains much unknown about how the brain processes noisy speech in real-life scenarios. A recently emerging approach, i.e., the second-person neuroscience approach, provides a novel conceptual framework. It measures both of the speaker's and the listener's neural activities, and estimates the speaker-listener neural coupling with regarding of the speaker's production-related neural activity as a standardized reference. The second-person approach not only promotes the use of naturalistic speech but also allows for free communication between speaker and listener as in a close-to-life context. In this review, we first briefly review the previous discoveries about how the brain processes speech in noise; then, we introduce the principles and advantages of the second-person neuroscience approach and discuss its implications to unravel the linguistic and extralinguistic processes during speech-in-noise comprehension; finally, we conclude by proposing some critical issues and calls for more research interests in the second-person approach, which would further extend the present knowledge about how people comprehend speech in noise.

Inter-brain desynchronization in social interaction: a consequence of subjective involvement?

Hyperscanning approaches to human neuroscience aim to uncover the neural mechanisms of social interaction. They have been largely guided by the expectation that increased levels of engagement between two persons will be supported by higher levels of inter-brain synchrony (IBS). A common approach to measuring IBS is phase synchrony in the context of EEG hyperscanning. Yet the growing number of experimental findings does not yield a straightforward interpretation, which has prompted critical reflections about the field's theoretical and methodological principles. In this perspective piece, we make a conceptual contribution to this debate by considering the role of a possibly overlooked effect of inter-brain desynchronization (IBD), as for example measured by decreased phase synchrony. A principled reason to expect this role comes from the recent proposal of irruption theory, which operationalizes the efficacy of a person's subjective involvement in behavior generation in terms of increased neural entropy. Accordingly, IBD is predicted to increase with one or more participant's socially motivated subjective involvement in interaction, because of the associated increase in their neural entropy. Additionally, the relative prominence of IBD compared to IBS is expected to vary in time, as well as across frequency bands, depending on the extent that subjective involvement is elicited by the task and/or desired by the person. If irruption theory is on the right track, it could thereby help to explain the notable variability of IBS in social interaction in terms of a countertendency from another factor: IBD due to subjective involvement.

The role of visual and auditory information in social event segmentation

Humans organise their social worlds into social and nonsocial events. Social event segmentation refers to the ability to parse the environmental content into social and nonsocial events or units. Here, we investigated the role that perceptual information from visual and auditory modalities, in isolation and in conjunction, played in social event segmentation. Participants viewed a video clip depicting an interaction between two actors and marked the boundaries of social and nonsocial events. Depending on the condition, the clip at first contained only auditory or only visual information. Then, the clip was shown containing both auditory and visual information. Higher overall group consensus and response consistency in parsing the clip was found for social segmentation and when both auditory and visual information was available. Presenting the clip in the visual domain only benefitted group agreement in social segmentation while the inclusion of auditory information (under the audiovisual condition) also improved response consistency in nonsocial segmentation. Thus, social segmentation utilises information from the visual modality, with the auditory cues contributing under ambiguous or uncertain conditions and during segmentation of nonsocial content.

Mothers and fathers show different neural synchrony with their children during shared experiences

Parent-child shared experiences has an important influence on social development in children although contributions of mothers and fathers may differ. Neural synchronicity occurs between mothers and fathers and their children during social interactions but it is unclear whether they differ in this respect. We used data from simultaneous fNIRS hyperscanning in mothers (n = 33) and fathers (n = 29) and their children (3-4 years) to determine different patterns and strengths of neural synchronization in the frontal cortex during co-viewing of videos or free-play. Mothers showed greater synchrony with child than fathers during passive viewing of videos and the synchronization was positively associated with video complexity and negatively associated with parental stress. During play interactions, mothers showed more controlling behaviors over their child and greater evidence for joint gaze and joint imitation play with child whereas fathers spent more time gazing at other things. In addition, different aspects of child communication promoted neural synchrony between mothers and fathers and child during active play interactions. Overall, our findings indicate greater neural and behavioral synchrony between mothers than fathers and young children during passive or active shared experiences, although for both it was weakened by parental distress and child difficulty.

Dynamic mutual predictions during social learning: A computational and interbrain model

During social interactions, we constantly learn about the thoughts, feelings, and personality traits of our interaction partners. Learning in social interactions is critical for bond formation and acquiring knowledge. Importantly, this type of learning is typically bi-directional, as both partners learn about each other simultaneously. Here we review the literature on social learning and propose a new computational and neural model characterizing mutual predictions that take place within and between interactions. According to our model, each partner in the interaction attempts to minimize the prediction error of the self and the interaction partner. In most cases, these inferential models become similar over time, thus enabling mutual understanding to develop. At the neural level, this type of social learning may be supported by interbrain plasticity, defined as a change in interbrain coupling over time in neural networks associated with social learning, among them the mentalizing network, the observation-execution system, and the hippocampus. The mutual prediction model constitutes a promising means of providing empirically verifiable accounts of how relationships develop over time.

Gating of Social Behavior by Inhibitory Inputs from Hippocampal CA1 to Retrosplenial Agranular Cortex

The retrosplenial cortex has been implicated in processing sensory information and spatial learning, with abnormal neural activity reported in association with psychedelics and in mouse and non-human primate models of autism spectrum disorders (ASDs). The direct role of the retrosplenial cortex in regulating social behaviors remains unclear. In this work, we reveal that neural activity in the retrosplenial agranular cortex (RSA), a subregion of the retrosplenial cortex, is initially activated, then quickly suppressed upon social contact. This up-down phase of RSA neurons is crucial for normal social behaviors. Parvalbumin-positive GABAergic neurons in the hippocampal CA1 region were found to send inhibitory projections to the RSA. Blocking these CA1-RSA inhibitory inputs significantly impaired social behavior. Notably, enhancing the CA1-RSA inhibitory input rescued the social behavior defects in an ASD mouse model. This work suggests a neural mechanism for the salience processing of social behavior and identifies a potential target for ASD intervention using neural modulation approaches.

Neurophysiological and behavioral synchronization in group-living and sleeping mice

Social interactions profoundly influence animal development, physiology, and behavior. Yet, how sleep-a central behavioral and neurophysiological process-is modulated by social interactions is poorly understood. Here, we characterized sleep behavior and neurophysiology in freely moving and co-living mice under different social conditions. We utilized wireless neurophysiological devices to simultaneously record multiple individuals within a group for 24 h, alongside video acquisition. We first demonstrated that mice seek physical contact before sleep initiation and sleep while in close proximity to each other (hereafter, "huddling"). To determine whether huddling during sleep is a motivated behavior, we devised a novel behavioral apparatus allowing mice to choose whether to sleep in close proximity to a conspecific or in solitude, under different environmental conditions. We also applied a deep-learning-based approach to classify huddling behavior. We demonstrate that mice are willing to forgo their preferred sleep location, even under thermoneutral conditions, to gain access to social contact during sleep. This strongly suggests that the motivation for prolonged physical contact-which we term somatolonging-drives huddling behavior. We then characterized sleep architecture under different social conditions and uncovered a social-dependent modulation of sleep. We also revealed coordination in multiple neurophysiological features among co-sleeping individuals, including in the timing of falling asleep and waking up and non-rapid eye movement sleep (NREMS) intensity. Notably, the timing of rapid eye movement sleep (REMS) was synchronized among co-sleeping male siblings but not co-sleeping female or unfamiliar mice. Our findings provide novel insights into the motivation for physical contact and the extent of social-dependent plasticity in sleep.

Mobile fNIRS for exploring inter-brain synchrony across generations and time

While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.

Inter-brain neural mechanism and influencing factors underlying different cooperative behaviors: a hyperscanning study

Cooperative behavior is a vital social interaction which plays a vital role in improving human survival and reproduction. However, few empirical studies have examined the differences between cooperative behaviors and the underlying neural substrates. In the present study, the brain activity of familiar dyads of the same sex was measured using functional near-infrared spectroscopy during three cooperative tasks (cooperative button-press, tangram, and Jenga tasks). We also measured the dyads' empathic abilities and personality traits to investigate the relationships between individual characteristics and neural markers. The results showed that first, there were significant differences in intra-brain activation and inter-brain synchronization among different cooperative tasks in three dimensions: social cognition, behavioral response, and cognitive processing. Second, male participants require stronger intra-brain activation to achieve the same inter-brain synchronization level as women in cooperative tasks. Third, when performing cooperative tasks involving high cognitive demands, Big Five Neuroticism may be an important predictor of neural activation in female participants. Inter-brain synchronization plays an important role in the frontal and temporoparietal junctions during interpersonal cooperation. Furthermore, this study demonstrates that mutual prediction theory is crucial for understanding the neural mechanisms of cooperative behavior.

Increased interbrain synchronization and neural efficiency of the frontal cortex to enhance human coordinative behavior: A combined hyper-tES and fNIRS study

Coordination is crucial for individuals to achieve common goals; however, the causal relationship between coordination behavior and neural activity has not yet been explored. Interbrain synchronization (IBS) and neural efficiency in cortical areas associated with the mirror neuron system (MNS) are considered two potential brain mechanisms. In the present study, we attempted to clarify how the two mechanisms facilitate coordination using hypertranscranial electrical stimulation (hyper-tES). A total of 124 healthy young adults were randomly divided into three groups (the hyper-tACS, hyper-tDCS and sham groups) and underwent modulation of the right inferior frontal gyrus (IFG) during functional near-infrared spectroscopy (fNIRS). Increased IBS of the PFC or neural efficiency of the right IFG (related to the MNS) was accompanied by greater coordination behavior; IBS had longer-lasting effects on behavior. Our findings highlight the importance of IBS and neural efficiency of the frontal cortex for coordination and suggest potential interventions to improve coordination in different temporal windows.

Disorganized Communication and Social Dysfunction in Schizophrenia: Emerging Concepts and Methods

PURPOSE OF REVIEW

In this review, we embrace the emerging field of second-person neuroscience to address disorganization in schizophrenia. We argue that the focus of interest for disorganization is the interpersonal space where shared mental processes ('social mind') occur based on the bio-behavioural synchrony between two (or more) interacting people. We lay out several bio-behavioural measures that can capture the component parts of this process. In particular, we highlight the real-time imaging technology of hyperscanning that enables multi-person analysis of naturalistic social interaction. We illustrate how these measures can be used in empirical studies by posing disorganization as a problem of interpersonal processing.

RECENT FINDINGS

Traditionally, disorganized speech and behaviour have been studied as the product of hidden cognitive processes ('private mind'). A dysfunction in these processes was attributed to the brain afflicted by the illness ('brain-bound mechanisms'). But this approach has contributed to challenges in measuring and quantifying disorganization. Consequently, the single-brain focus has not provided satisfactory clarity or led to effective treatments for persistent social dysfunction in schizophrenia. Social dysfunction is a core feature of schizophrenia. This dysfunction arises from disorganized interpersonal interaction that typifies the social profile of affected individuals. We outline challenges in employing several emerging concepts and methods and how they can be addressed to investigate the mechanisms of social dysfunction in schizophrenia.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Partner similarity and social cognitive traits predict social interaction success among strangers

Social interactions are a ubiquitous part of engaging in the world around us, and determining what makes an interaction successful is necessary for social well-being. This study examined the separate contributions of individual social cognitive ability and partner similarity to social interaction success among strangers, measured by a cooperative communication task and self-reported interaction quality. Sixty participants engaged in a 1-h virtual social interaction with an unfamiliar partner (a laboratory confederate) including a 30-min cooperative 'mind-reading' game and then completed several individual tasks and surveys. They then underwent a separate functional MRI session in which they passively viewed video clips that varied in content. The neural responses to these videos were correlated with those of their confederate interaction partners to yield a measure of pairwise neural similarity. We found that trait empathy (assessed by the interpersonal reactivity index) and neural similarity to partner both predicted communication success in the mind-reading game. In contrast, perceived similarity to partner and (to a much lesser extent) trait mind-reading motivation predicted self-reported interaction quality. These results highlight the importance of sharing perspectives in successful communication as well as differences between neurobiological similarity and perceived similarity in supporting different types of interaction success.

Social circuits and their dysfunction in autism spectrum disorder

Social behaviors, how individuals act cooperatively and competitively with conspecifics, are widely seen across species. Rodents display various social behaviors, and many different behavioral paradigms have been used for investigating their neural circuit bases. Social behavior is highly vulnerable to brain network dysfunction caused by neurological and neuropsychiatric conditions such as autism spectrum disorders (ASDs). Studying mouse models of ASD provides a promising avenue toward elucidating mechanisms of abnormal social behavior and potential therapeutic targets for treatment. In this review, we outline recent progress and key findings on neural circuit mechanisms underlying social behavior, with particular emphasis on rodent studies that monitor and manipulate the activity of specific circuits using modern systems neuroscience approaches. Social behavior is mediated by a distributed brain-wide network among major cortical (e.g., medial prefrontal cortex (mPFC), anterior cingulate cortex, and insular cortex (IC)) and subcortical (e.g., nucleus accumbens, basolateral amygdala (BLA), and ventral tegmental area) structures, influenced by multiple neuromodulatory systems (e.g., oxytocin, dopamine, and serotonin). We particularly draw special attention to IC as a unique cortical area that mediates multisensory integration, encoding of ongoing social interaction, social decision-making, emotion, and empathy. Additionally, a synthesis of studies investigating ASD mouse models demonstrates that dysfunctions in mPFC-BLA circuitry and neuromodulation are prominent. Pharmacological rescues by local or systemic (e.g., oral) administration of various drugs have provided valuable clues for developing new therapeutic agents for ASD. Future efforts and technological advances will push forward the next frontiers in this field, such as the elucidation of brain-wide network activity and inter-brain neural dynamics during real and virtual social interactions, and the establishment of circuit-based therapy for disorders affecting social functions.

Intra- and inter-brain synchrony oscillations underlying social adjustment

Humans naturally synchronize their behavior with other people. However, although it happens almost automatically, adjusting behavior and conformity to others is a complex phenomenon whose neural mechanisms are still yet to be understood entirely. The present experiment aimed to study the oscillatory synchronization mechanisms underlying automatic dyadic convergence in an EEG hyperscanning experiment. Thirty-six people performed a cooperative decision-making task where dyads had to guess the correct position of a point on a line. A reinforcement learning algorithm was used to model different aspects of the participants' behavior and their expectations of their peers. Intra- and inter-connectivity among electrode sites were assessed using inter-site phase clustering in three main frequency bands (theta, alpha, beta) using a two-level Bayesian mixed-effects modeling approach. The results showed two oscillatory synchronization dynamics related to attention and executive functions in alpha and reinforcement learning in theta. In addition, inter-brain synchrony was mainly driven by beta oscillations. This study contributes preliminary evidence on the phase-coherence mechanism underlying inter-personal behavioral adjustment.

Neural mechanisms of comforting: Prosocial touch and stress buffering

Comforting is a crucial form of prosocial behavior that is important for maintaining social unity and improving the physical and emotional well-being of social species. It is often expressed through affiliative social touch toward someone in distress, providing relief for their distressed state. In the face of increasing global distress, these actions are paramount to the continued improvement of individual welfare and the collective good. Understanding the neural mechanisms responsible for promoting actions focused on benefitting others is particularly important and timely. Here, we review prosocial comforting behavior, emphasizing synthesizing recent studies carried out using rodent models. We discuss its underlying behavioral expression and motivations, and then explore both the neurobiology of prosocial comforting in a helper animal and the neurobiology of stress relief following social touch in a recipient as part of a feedback loop interaction.

Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony

Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.

Virtual reality-based real-time imaging reveals abnormal cortical dynamics during behavioral transitions in a mouse model of autism

Functional connectivity (FC) can provide insight into cortical circuit dysfunction in neuropsychiatric disorders. However, dynamic changes in FC related to locomotion with sensory feedback remain to be elucidated. To investigate FC dynamics in locomoting mice, we develop mesoscopic Ca2+ imaging with a virtual reality (VR) environment. We find rapid reorganization of cortical FC in response to changing behavioral states. By using machine learning classification, behavioral states are accurately decoded. We then use our VR-based imaging system to study cortical FC in a mouse model of autism and find that locomotion states are associated with altered FC dynamics. Furthermore, we identify FC patterns involving the motor area as the most distinguishing features of the autism mice from wild-type mice during behavioral transitions, which might correlate with motor clumsiness in individuals with autism. Our VR-based real-time imaging system provides crucial information to understand FC dynamics linked to behavioral abnormality of neuropsychiatric disorders.

The role of empathy in shared intentionality: Contributions from Inter-Processual Self theory

Research in psychology related to the conceptualization of empathy has been on the rise in the last decades. However, we argue that there is still space for further research to help capture the important notion of empathy and its theoretical and conceptual depth. Following a critical review of the current state of the research that conceptualizes and measures empathy, we focus on works that highlight the importance of a shared vision and its relevance in psychology and neuroscience. Considering the state of the art of current neuroscientific and psychological approaches to empathy, we argue for the relevance of shared intention and shared vision in empathy-related actions. Upon review of different models that emphasize a shared vision for informing research on empathy, we suggest that a newly developed theory of self, human growth and action–the so-called Inter-Processual Self theory (IPS)–can significantly and novelly inform the theorization on empathy beyond what the literature has stated to date. Then, we show how an understanding of integrity as a relational act that requires empathy is an essential mechanism for current key research on empathy and its related concepts and models. Ultimately, we aim to present IPS as a distinctive proposal to expand upon the conceptualization of empathy.

EphB2-dependent prefrontal cortex activation promotes long-range social approach and partner responsiveness

Social behavior starts with dynamic approach prior to the final consummation. The flexible processes ensure mutual feedback across social brains to transmit signals. However, how the brain responds to the initial social stimuli precisely to elicit timed behaviors remains elusive. Here, by using real-time calcium recording, we identify the abnormalities of EphB2 mutant with autism-associated Q858X mutation in processing long-range approach and accurate activity of prefrontal cortex (dmPFC). The EphB2-dependent dmPFC activation precedes the behavioral onset and is actively associated with subsequent social action with the partner. Furthermore, we find that partner dmPFC activity is responsive coordinately to the approaching WT mouse rather than Q858X mutant mouse, and the social defects caused by the mutation are rescued by synchro-optogenetic activation in dmPFC of paired social partners. These results thus reveal that EphB2 sustains neuronal activation in the dmPFC that is essential for the proactive modulation of social approach to initial social interaction.

Speaking and listening to inter-brain relationships

Studies of inter-brain relationships thrive, and yet many reservations regarding their scope and interpretation of these phenomena have been raised by the scientific community. It is thus essential to establish common ground on methodological and conceptual definitions related to this topic and to open debate about any remaining points of uncertainty. We here offer insights to improve the conceptual clarity and empirical standards offered by social neuroscience studies of inter-personal interaction using hyperscanning with a particular focus on verbal communication.

Spatio-temporal dynamics of oscillatory brain activity during the observation of actions and interactions between point-light agents

Predicting actions from non-verbal cues and using them to optimise one's response behaviour (i.e. interpersonal predictive coding) is essential in everyday social interactions. We aimed to investigate the neural correlates of different cognitive processes evolving over time during interpersonal predictive coding. Thirty-nine participants watched two agents depicted by moving point-light stimuli while an electroencephalogram (EEG) was recorded. One well-recognizable agent performed either a 'communicative' or an 'individual' action. The second agent either was blended into a cluster of noise dots (i.e. present) or was entirely replaced by noise dots (i.e. absent), which participants had to differentiate. EEG amplitude and coherence analyses for theta, alpha and beta frequency bands revealed a dynamic pattern unfolding over time: Watching communicative actions was associated with enhanced coupling within medial anterior regions involved in social and mentalising processes and with dorsolateral prefrontal activation indicating a higher deployment of cognitive resources. Trying to detect the agent in the cluster of noise dots without having seen communicative cues was related to enhanced coupling in posterior regions for social perception and visual processing. Observing an expected outcome was modulated by motor system activation. Finally, when the agent was detected correctly, activation in posterior areas for visual processing of socially relevant features was increased. Taken together, our results demonstrate that it is crucial to consider the temporal dynamics of social interactions and of their neural correlates to better understand interpersonal predictive coding. This could lead to optimised treatment approaches for individuals with problems in social interactions.

Formal perspectives on shared interbrain activity in social communication: Insights from information and control theories

The mechanisms underlying a reorientation of neuroscience from a single-brain to a multi-brain frame of reference have long been with us. These revolve around the evolutionary exaptation of the inevitable second-law 'leakage' of crosstalk between co-resident cognitive phenomena. Crosstalk characterizes such processes as immune response, wound-healing, gene expression, as so on, up through and including far more rapid neural processes. It is not a great leap-of-faith to infer that similar phenomena affect/afflict social interactions between individuals within and across populations.

Pain control based on oscillatory brain activity using transcranial alternating current stimulation: An integrative review

Developing effective tools and strategies to relieve chronic pain is a high-priority scientific and clinical goal. In particular, the brain regions related to pain processing have been investigated as potential targets to relieve pain by non-invasive brain stimulation (NIBS). In addition to elucidating the relationship between pain and oscillatory brain activity, transcranial alternating current stimulation (tACS), which can non-invasively entrain oscillatory brain activity and modulate oscillatory brain communication, has attracted scientific attention as a possible technique to control pain. This review focuses on the use of tACS to relieve pain through the manipulation of oscillatory brain activity and its potential clinical applications. Several studies have reported that tACS on a single brain reduces pain by normalizing abnormal oscillatory brain activity in patients with chronic pain. Interpersonal tACS approaches based on inter-brain synchrony to manipulate inter-brain communication may result in pain relief via prosocial effects. Pain is encoded by the spatiotemporal neural communication that represents the integration of cognitive, emotional-affective, and sensorimotor aspects of pain. Therefore, future studies should seek to identify the pathological oscillatory brain communication in chronic pain as a therapeutic target for tACS. In conclusion, tACS could be effective for re-establishing oscillatory brain activity and assisting social interaction, and it might help develop novel approaches for pain control.

Neural correlates of eye contact and social function in autism spectrum disorder

Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.

Distinct neural couplings to shared goal and action coordination in joint action: evidence based on fNIRS hyperscanning

Joint action is central to human nature, enabling individuals to coordinate in time and space to achieve a joint outcome. Such interaction typically involves two key elements: shared goal and action coordination. Yet, the substrates entrained to these two components in joint action remained unclear. In the current study, dyads performed two tasks involving both sharing goal and action coordination, i.e. complementary joint action and imitative joint action, a task only involving shared goal and a task only involving action coordination, while their brain activities were recorded by the functional near-infrared spectroscopy hyperscanning technique. The results showed that both complementary and imitative joint action (i.e. involving shared goal and action coordination) elicited better behavioral performance than the task only involving shared goal/action coordination. We observed that the interbrain synchronization (IBS) at the right inferior frontal cortex (IFC) entrained more to shared goal, while left-IFC IBS entrained more to action coordination. We also observed that the right-IFC IBS was greater during completing a complementary action than an imitative action. Our results suggest that IFC plays an important role in joint action, with distinct lateralization for the sub-components of joint action.

Neural basis of prosocial behavior

The ability to behave in ways that benefit other individuals' well-being is among the most celebrated human characteristics crucial for social cohesiveness. Across mammalian species, animals display various forms of prosocial behaviors - comforting, helping, and resource sharing - to support others' emotions, goals, and/or material needs. In this review, we provide a cross-species view of the behavioral manifestations, proximate and ultimate drives, and neural mechanisms of prosocial behaviors. We summarize key findings from recent studies in humans and rodents that have shed light on the neural mechanisms underlying different processes essential for prosocial interactions, from perception and empathic sharing of others' states to prosocial decisions and actions.

Endogenous sources of interbrain synchrony in duetting pianists

When people interact with each other, their brains synchronize. However, it remains unclear whether interbrain synchrony (IBS) is functionally relevant for social interaction or stems from exposure of individual brains to identical sensorimotor information. To disentangle these views, the current dual-EEG study investigated amplitude-based IBS in pianists jointly performing duets containing a silent pause followed by a tempo change. First, we manipulated the similarity of the anticipated tempo change and measured IBS during the pause, hence, capturing the alignment of purely endogenous, temporal plans without sound or movement. Notably, right posterior gamma IBS was higher when partners planned similar tempi, it predicted whether partners' tempi matched after the pause, and it was modulated only in real, not in surrogate pairs. Second, we manipulated the familiarity with the partner's actions and measured IBS during joint performance with sound. Although sensorimotor information was similar across conditions, gamma IBS was higher when partners were unfamiliar with each other's part and had to attend more closely to the sound of the performance. These combined findings demonstrate that IBS is not merely an epiphenomenon of shared sensorimotor information but can also hinge on endogenous, cognitive processes crucial for behavioral synchrony and successful social interaction.

Musical Meter Induces Interbrain Synchronization during Interpersonal Coordination

Music induces people to coordinate with one another. Here, we conduct two experiments to examine the underlying mechanism of the interbrain synchronization (IBS) that is induced by interpersonal coordination when people are exposed to musical beat and meter. In experiment 1, brain signals at the frontal cortex were recorded simultaneously from two participants of a dyad by using functional near-infrared spectroscopy (fNIRS) hyperscanning, while each tapped their fingers to aural feedback from their partner (coordination task) or from themselves (independence task) with and without the musical meter. The results showed enhanced IBS at the left-middle frontal cortex in case of the coordination task with musical beat and meter. The IBS was significantly correlated with the participants performance in terms of coordination. In experiment 2, we further examined the IBS while the participants coordinated their behaviors in various metrical contexts, such as strong and weak meters (i.e., high/low loudness of acoustically accenting beats). The results showed that strong meters elicited higher IBS at the middle frontal cortex than weak meters. These findings reveal that the musical beat and meter can affect brain-to-brain coupling in action coordination between people, and provide insights into the interbrain mechanism underlying the effects of music on cooperation.

Speaker-listener neural coupling reveals a right-lateralized mechanism for non-native speech-in-noise comprehension

While the increasingly globalized world has brought more and more demands for non-native language communication, the prevalence of background noise in everyday life poses a great challenge to non-native speech comprehension. The present study employed an interbrain approach based on functional near-infrared spectroscopy (fNIRS) to explore how people adapt to comprehend non-native speech information in noise. A group of Korean participants who acquired Chinese as their non-native language was invited to listen to Chinese narratives at 4 noise levels (no noise, 2 dB, -6 dB, and - 9 dB). These narratives were real-life stories spoken by native Chinese speakers. Processing of the non-native speech was associated with significant fNIRS-based listener-speaker neural couplings mainly over the right hemisphere at both the listener's and the speaker's sides. More importantly, the neural couplings from the listener's right superior temporal gyrus, the right middle temporal gyrus, as well as the right postcentral gyrus were found to be positively correlated with their individual comprehension performance at the strongest noise level (-9 dB). These results provide interbrain evidence in support of the right-lateralized mechanism for non-native speech processing and suggest that both an auditory-based and a sensorimotor-based mechanism contributed to the non-native speech-in-noise comprehension.

Ca2+ imaging of self and other in medial prefrontal cortex during social dominance interactions in a tube test

The study of social dominance interactions between animals offers a window onto the decision-making involved in establishing dominance hierarchies and an opportunity to examine changes in social behavior observed in certain neurogenetic disorders. Competitive social interactions, such as in the widely used tube test, reflect this decision-making. Previous studies have focused on the different patterns of behavior seen in the dominant and submissive animal, neural correlates of effortful behavior believed to mediate the outcome of such encounters, and interbrain correlations of neural activity. Using a rigorous mutual information criterion, we now report that neural responses recorded with endoscopic calcium imaging in the prelimbic zone of the medial prefrontal cortex show unique correlations to specific dominance-related behaviors. Interanimal analyses revealed cell/behavior correlations that are primarily with an animal's own behavior or with the other animal's behavior, or the coincident behavior of both animals (such as pushing by one and resisting by the other). The comparison of unique and coincident cells helps to disentangle cell firing that reflects an animal's own or the other's specific behavior from situations reflecting conjoint action. These correlates point to a more cognitive rather than a solely behavioral dimension of social interactions that needs to be considered in the design of neurobiological studies of social behavior. These could prove useful in studies of disorders affecting social recognition and social engagement, and the treatment of disorders of social interaction.

Transcranial Electrical Stimulation Offers the Possibility of Improving Teamwork Among Military Pilots: A Review

Effective teamwork among military pilots is key to successful mission completion. The underlying neural mechanism of teamwork is thought to be inter-brain synchronization (IBS). IBS could also be explained as an incidental phenomenon of cooperative behavior, but the causality between IBS and cooperative behavior could be clarified by directly producing IBS through extra external stimuli applied to functional brain regions. As a non-invasive technology for altering brain function, transcranial electrical stimulation might have the potential to explore whether top-down enhancement of the synchronization of multiple brains can change cooperative behavioral performance among members of a team. This review focuses on the characteristic features of teamwork among military pilots and variations in neuroimaging obtained by hyper-scanning. Furthermore, we discuss the possibility that transcranial electrical stimulation could be used to improve teamwork among military pilots, try to provide a feasible design for doing so, and emphasize crucial aspects to be addressed by future research.

Social synchronization of brain activity increases during eye-contact

Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization.

Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.

Interbrain synchrony: on wavy ground

In recent years the study of dynamic, between-brain coupling mechanisms has taken social neuroscience by storm. In particular, interbrain synchrony (IBS) is a putative neural mechanism said to promote social interactions by enabling the functional integration of multiple brains. In this article, I argue that this research is beset with three pervasive and interrelated problems. First, the field lacks a widely accepted definition of IBS. Second, IBS wants for theories that can guide the design and interpretation of experiments. Third, a potpourri of tasks and empirical methods permits undue flexibility when testing the hypothesis. These factors synergistically undermine IBS as a theoretical construct. I finish by recommending measures that can address these issues.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

Resonance as a Design Strategy for AI and Social Robots

Resonance, a powerful and pervasive phenomenon, appears to play a major role in human interactions. This article investigates the relationship between the physical mechanism of resonance and the human experience of resonance, and considers possibilities for enhancing the experience of resonance within human-robot interactions. We first introduce resonance as a widespread cultural and scientific metaphor. Then, we review the nature of "sympathetic resonance" as a physical mechanism. Following this introduction, the remainder of the article is organized in two parts. In part one, we review the role of resonance (including synchronization and rhythmic entrainment) in human cognition and social interactions. Then, in part two, we review resonance-related phenomena in robotics and artificial intelligence (AI). These two reviews serve as ground for the introduction of a design strategy and combinatorial design space for shaping resonant interactions with robots and AI. We conclude by posing hypotheses and research questions for future empirical studies and discuss a range of ethical and aesthetic issues associated with resonance in human-robot interactions.

Perspectives on Rehabilitation Using Non-invasive Brain Stimulation Based on Second-Person Neuroscience of Teaching-Learning Interactions

Recent advances in second-person neuroscience have allowed the underlying neural mechanisms involved in teaching-learning interactions to be better understood. Teaching is not merely a one-way transfer of information from teacher to student; it is a complex interaction that requires metacognitive and mentalizing skills to understand others’ intentions and integrate information regarding oneself and others. Physiotherapy involving therapists instructing patients on how to improve their motor skills is a clinical field in which teaching-learning interactions play a central role. Accumulating evidence suggests that non-invasive brain stimulation (NIBS) modulates cognitive functions; however, NIBS approaches to teaching-learning interactions are yet to be utilized in rehabilitation. In this review, I evaluate the present research into NIBS and its role in enhancing metacognitive and mentalizing abilities; I then review hyperscanning studies of teaching-learning interactions and explore the potential clinical applications of NIBS in rehabilitation. Dual-brain stimulation using NIBS has been developed based on findings of brain-to-brain synchrony in hyperscanning studies, and it is delivered simultaneously to two individuals to increase inter-brain synchronized oscillations at the stimulated frequency. Artificial induction of brain-to-brain synchrony has the potential to promote instruction-based learning. The brain-to-brain interface, which induces inter-brain synchronization by adjusting the patient’s brain activity, using NIBS, to the therapist’s brain activity, could have a positive effect on both therapist-patient interactions and rehabilitation outcomes. NIBS based on second-person neuroscience has the potential to serve as a useful addition to the current neuroscientific methods used in complementary interventions for rehabilitation.

A unifying mechanism governing inter-brain neural relationship during social interactions

A key goal of social neuroscience is to understand the inter-brain neural relationship-the relationship between the neural activity of socially interacting individuals. Decades of research investigating this relationship have focused on the similarity in neural activity across brains. Here, we instead asked how neural activity differs between brains, and how that difference evolves alongside activity patterns shared between brains. Applying this framework to bats engaged in spontaneous social interactions revealed two complementary phenomena characterizing the inter-brain neural relationship: fast fluctuations of activity difference across brains unfolding in parallel with slow activity covariation across brains. A model reproduced these observations and generated multiple predictions that we confirmed using experimental data involving pairs of bats and a larger social group of bats. The model suggests that a simple computational mechanism involving positive and negative feedback could explain diverse experimental observations regarding the inter-brain neural relationship.

Parietal maps of visual signals for bodily action planning

The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.

Wireless multilateral devices for optogenetic studies of individual and social behaviors

Advanced technologies for controlled delivery of light to targeted locations in biological tissues are essential to neuroscience research that applies optogenetics in animal models. Fully implantable, miniaturized devices with wireless control and power-harvesting strategies offer an appealing set of attributes in this context, particularly for studies that are incompatible with conventional fiber-optic approaches or battery-powered head stages. Limited programmable control and narrow options in illumination profiles constrain the use of existing devices. The results reported here overcome these drawbacks via two platforms, both with real-time user programmability over multiple independent light sources, in head-mounted and back-mounted designs. Engineering studies of the optoelectronic and thermal properties of these systems define their capabilities and key design considerations. Neuroscience applications demonstrate that induction of interbrain neuronal synchrony in the medial prefrontal cortex shapes social interaction within groups of mice, highlighting the power of real-time subject-specific programmability of the wireless optogenetic platforms introduced here.

Prefrontal Inter-brain Synchronization Reflects Convergence and Divergence of Flow Dynamics in Collaborative Learning: A Pilot Study

Flow is a highly motivated and affectively positive state in which a person is deeply engaged in an activity and feeling enjoyment from it. In collaborative activities, it would be optimal if all participants were in a state of flow. However, flow states fluctuate amongst individuals due to differences in the dynamics of motivation and cognition. To explore the possibility that inter-brain synchronization can provide a quantitative measure of the convergence and divergence of collective motivational dynamics, we conducted a pilot study to investigate the relationship between inter-brain synchronization and the interpersonal similarity of flow state dynamics during the collaborative learning process. In two English as a Foreign Language (EFL) classes, students were divided into groups of three-four and seated at desks facing each other while conducting a 60-min group work. In both classes, two groups with four members were randomly selected, and their medial prefrontal neural activities were measured simultaneously using wireless functional near-infrared spectroscopy (fNIRS) devices. Later the participants observed their own activities on recorded videos and retrospectively rated their subjective degree of flow state on a seven-point scale for each 2-min period. For the pairs of students whose neural activities were measured, the similarity of their flow experience dynamics was evaluated by the temporal correlation between their flow ratings. Prefrontal inter-brain synchronization of the same student pairs during group work was evaluated using wavelet transform coherence. Statistical analyses revealed that: (1) flow dynamics were significantly more similar for the student pairs within the same group compared to the pairs of students assigned across different groups; (2) prefrontal inter-brain synchronization in the relatively short time scale (9.3-13.9 s) was significantly higher for the within-group pairs than for the cross-group pairs; and (3) the prefrontal inter-brain synchronization at the same short time scale was significantly and positively correlated with the similarity of flow dynamics, even after controlling for the effects of within- vs. cross-group pair types from the two variables. These suggest that inter-brain synchronization can indeed provide a quantitative measure for converging and diverging collective motivational dynamics during collaborative learning, with higher inter-brain synchronization corresponding to a more convergent flow experience.

From the field to the lab and back: neuroethology of primate social behavior

Social mammals with more numerous and stronger social relationships live longer, healthier lives. Despite the established importance of social relationships, our understanding of the neurobiological mechanisms by which they are pursued, formed, and maintained in primates remains largely confined to highly controlled laboratory settings which do not allow natural, dynamic social interactions to unfold. In this review, we argue that the neurobiological study of primate social behavior would benefit from adopting a neuroethological approach, that is, a perspective grounded in natural, species-typical behavior, with careful selection of animal models according to the scientific question at hand. We highlight macaques and marmosets as key animal models for human social behavior and summarize recent findings in the social domain for both species. We then review pioneering studies of dynamic social behaviors in small animals, which can inspire studies in larger primates where the technological landscape is now ripe for an ethological overhaul.

Organization of neural circuits underlying social behavior: A consideration of the medial amygdala

The medial amygdala (MeA) is critical for the expression of a broad range of social behaviors, and is also connected to many other brain regions that mediate those same behaviors. Here, we summarize recent advances toward elucidating mechanisms that enable the MeA to regulate a diversity of social behaviors, and also consider what role the MeA plays within the broader network of regions that orchestrate social sensorimotor transformations. We outline the molecular, anatomical, and electrophysiological features of the MeA that segregate distinct social behaviors, propose experimental strategies to disambiguate sensory representations from behavioral function in the context of a social interaction, and consider to what extent MeA function may overlap with other regions mediating similar behaviors.