Frontal temporal and parietal systems synchronize within and across brains during live eye-to-eye contact

Evaluating Speaker-Listener Cognitive Effort in Speech Communication Through Brain-to-Brain Synchrony: A Pilot Functional Near-Infrared Spectroscopy Investigation

PURPOSE

We explore a new approach to the study of cognitive effort involved in listening to speech by measuring the brain activity in a listener in relation to the brain activity in a speaker. We hypothesize that the strength of this brain-to-brain synchrony (coupling) reflects the magnitude of cognitive effort involved in verbal communication and includes both listening effort and speaking effort. We investigate whether interbrain synchrony is greater in native-to-native versus native-to-nonnative communication using functional near-infrared spectroscopy (fNIRS).

METHOD

Two speakers participated, a native speaker of American English and a native speaker of Korean who spoke English as a second language. Each speaker was fitted with the fNIRS cap and told short stories. The native English speaker provided the English narratives, and the Korean speaker provided both the nonnative (accented) English and Korean narratives. In separate sessions, fNIRS data were obtained from seven English monolingual participants ages 20-24 years who listened to each speaker's stories. After listening to each story in native and nonnative English, they retold the content, and their transcripts and audio recordings were analyzed for comprehension and discourse fluency, measured in the number of hesitations and articulation rate. No story retellings were obtained for narratives in Korean (an incomprehensible language for English listeners). Utilizing fNIRS technique termed sequential scanning, we quantified the brain-to-brain synchronization in each speaker-listener dyad.

RESULTS

For native-to-native dyads, multiple brain regions associated with various linguistic and executive functions were activated. There was a weaker coupling for native-to-nonnative dyads, and only the brain regions associated with higher order cognitive processes and functions were synchronized. All listeners understood the content of all stories, but they hesitated significantly more when retelling stories told in accented English. The nonnative speaker hesitated significantly more often than the native speaker and had a significantly slower articulation rate. There was no brain-to-brain coupling during listening to Korean, indicating a break in communication when listeners failed to comprehend the speaker.

CONCLUSIONS

We found that effortful speech processing decreased interbrain synchrony and delayed comprehension processes. The obtained brain-based and behavioral patterns are consistent with our proposal that cognitive effort in verbal communication pertains to both the listener and the speaker and that brain-to-brain synchrony can be an indicator of differences in their cumulative communicative effort.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.25452142.

Enhancing Brain-Computer Interface Performance by Incorporating Brain-to-Brain Coupling

Human cooperation relies on key features of social interaction in order to reach desirable outcomes. Similarly, human-robot interaction may benefit from integration with human-human interaction factors. In this paper, we aim to investigate brain-to-brain coupling during motor imagery (MI)-based brain-computer interface (BCI) training using eye-contact and hand-touch interaction. Twelve pairs of friends (experimental group) and 10 pairs of strangers (control group) were recruited for MI-based BCI tests concurrent with electroencephalography (EEG) hyperscanning. Event-related desynchronization (ERD) was estimated to measure cortical activation, and interbrain functional connectivity was assessed using multilevel statistical analysis. Furthermore, we compared BCI classification performance under different social interaction conditions. In the experimental group, greater ERD was found around the contralateral sensorimotor cortex under social interaction conditions compared with MI without any social interaction. Notably, EEG channels with decreased power were mainly distributed around the frontal, central, and occipital regions. A significant increase in interbrain coupling was also found under social interaction conditions. BCI decoding accuracies were significantly improved in the eye contact condition and eye and hand contact condition compared with the no-interaction condition. However, for the strangers' group, no positive effects were observed in comparisons of cortical activations between interaction and no-interaction conditions. These findings indicate that social interaction can improve the neural synchronization between familiar partners with enhanced brain activations and brain-to-brain coupling. This study may provide a novel method for enhancing MI-based BCI performance in conjunction with neural synchronization between users.

Acute stress impairs intentional memory suppression through aberrant prefrontal cortex activation in high trait ruminators

Objective

Research shows that the effect of acute stress on intentional memory suppression could be modulated by individual differences in psychological traits. However, whether acute stress distinctly affects intentional memory suppression in high trait ruminators, a high at-risk group of stress-related disorders, and the neural correlations, remains unclear.

Method

55 healthy college students were divided into high and low trait ruminators (HTR and LTR), Following stress manipulation, a Think/No Think task assessed the memory suppression performance. Functional near-infrared spectroscopy was applied to explore the neural correlates. Psychophysiological interaction analyses were used to assess how the functional connectivity between a seed region and another brain region was modulated by tasks during memory suppression, further mediating memory suppression performance and state rumination.

Results

The HTR exhibited poorer memory suppression performance than the LTR under the stress condition. Aberrant activation patterns and task-modulated functional connectivity in the dorsal prefrontal cortex (DLPFC) and superior temporal gyrus (STG) were observed only in the HTR during memory suppression under the stress condition. The effect of memory suppression performance on the state rumination of individuals was significantly mediated by the task-modulated functional connectivity between the DLPFC and STG.

Conclusions

The findings could provide insights for prevention or early intervention in the development of stress-related disorders in HTR.

Interpersonal eye-tracking reveals the dynamics of interacting minds

The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.

Interpersonal neural synchrony and mental disorders: unlocking potential pathways for clinical interventions

Introduction

Interpersonal synchronization involves the alignment of behavioral, affective, physiological, and brain states during social interactions. It facilitates empathy, emotion regulation, and prosocial commitment. Mental disorders characterized by social interaction dysfunction, such as Autism Spectrum Disorder (ASD), Reactive Attachment Disorder (RAD), and Social Anxiety Disorder (SAD), often exhibit atypical synchronization with others across multiple levels. With the introduction of the "second-person" neuroscience perspective, our understanding of interpersonal neural synchronization (INS) has improved, however, so far, it has hardly impacted the development of novel therapeutic interventions.

Methods

To evaluate the potential of INS-based treatments for mental disorders, we performed two systematic literature searches identifying studies that directly target INS through neurofeedback (12 publications; 9 independent studies) or brain stimulation techniques (7 studies), following PRISMA guidelines. In addition, we narratively review indirect INS manipulations through behavioral, biofeedback, or hormonal interventions. We discuss the potential of such treatments for ASD, RAD, and SAD and using a systematic database search assess the acceptability of neurofeedback (4 studies) and neurostimulation (4 studies) in patients with social dysfunction.

Results

Although behavioral approaches, such as engaging in eye contact or cooperative actions, have been shown to be associated with increased INS, little is known about potential long-term consequences of such interventions. Few proof-of-concept studies have utilized brain stimulation techniques, like transcranial direct current stimulation or INS-based neurofeedback, showing feasibility and preliminary evidence that such interventions can boost behavioral synchrony and social connectedness. Yet, optimal brain stimulation protocols and neurofeedback parameters are still undefined. For ASD, RAD, or SAD, so far no randomized controlled trial has proven the efficacy of direct INS-based intervention techniques, although in general brain stimulation and neurofeedback methods seem to be well accepted in these patient groups.

Discussion

Significant work remains to translate INS-based manipulations into effective treatments for social interaction disorders. Future research should focus on mechanistic insights into INS, technological advancements, and rigorous design standards. Furthermore, it will be key to compare interventions directly targeting INS to those targeting other modalities of synchrony as well as to define optimal target dyads and target synchrony states in clinical interventions.

Investigating mother-child inter-brain synchrony in a naturalistic paradigm: A functional near infrared spectroscopy (fNIRS) hyperscanning study

Successful social interactions between mothers and children are hypothesised to play a significant role in a child's social, cognitive and language development. Earlier research has confirmed, through structured experimental paradigms, that these interactions could be underpinned by coordinated neural activity. Nevertheless, the extent of neural synchrony during real-life, ecologically valid interactions between mothers and their children remains largely unexplored. In this study, we investigated mother-child inter-brain synchrony using a naturalistic free-play paradigm. We also examined the relationship between neural synchrony, verbal communication patterns and personality traits to further understand the underpinnings of brain synchrony. Twelve children aged between 3 and 5 years old and their mothers participated in this study. Neural synchrony in mother-child dyads were measured bilaterally over frontal and temporal areas using functional Near Infra-red Spectroscopy (fNIRS) whilst the dyads were asked to play with child-friendly toys together (interactive condition) and separately (independent condition). Communication patterns were captured via video recordings and conversational turns were coded. Compared to the independent condition, mother-child dyads showed increased neural synchrony in the interactive condition across the prefrontal cortex and temporo-parietal junction. There was no significant relationship found between neural synchrony and turn-taking and between neural synchrony and the personality traits of each member of the dyad. Overall, we demonstrate the feasibility of measuring inter-brain synchrony between mothers and children in a naturalistic environment. These findings can inform future study designs to assess inter-brain synchrony between parents and pre-lingual children and/or children with communication needs.

Communicative signals during joint attention promote neural processes of infants and caregivers

Communicative signals such as eye contact increase infants' brain activation to visual stimuli and promote joint attention. Our study assessed whether communicative signals during joint attention enhance infant-caregiver dyads' neural responses to objects, and their neural synchrony. To track mutual attention processes, we applied rhythmic visual stimulation (RVS), presenting images of objects to 12-month-old infants and their mothers (n = 37 dyads), while we recorded dyads' brain activity (i.e., steady-state visual evoked potentials, SSVEPs) with electroencephalography (EEG) hyperscanning. Within dyads, mothers either communicatively showed the images to their infant or watched the images without communicative engagement. Communicative cues increased infants' and mothers' SSVEPs at central-occipital-parietal, and central electrode sites, respectively. Infants showed significantly more gaze behaviour to images during communicative engagement. Dyadic neural synchrony (SSVEP amplitude envelope correlations, AECs) was not modulated by communicative cues. Taken together, maternal communicative cues in joint attention increase infants' neural responses to objects, and shape mothers' own attention processes. We show that communicative cues enhance cortical visual processing, thus play an essential role in social learning. Future studies need to elucidate the effect of communicative cues on neural synchrony during joint attention. Finally, our study introduces RVS to study infant-caregiver neural dynamics in social contexts.

Mobile fNIRS for exploring inter-brain synchrony across generations and time

While still relatively rare, longitudinal hyperscanning studies are exceptionally valuable for documenting changes in inter-brain synchrony, which may in turn underpin how behaviors develop and evolve in social settings. The generalizability and ecological validity of this experimental approach hinges on the selected imaging technique being mobile-a requirement met by functional near-infrared spectroscopy (fNIRS). fNIRS has most frequently been used to examine the development of inter-brain synchrony and behavior in child-parent dyads. In this position paper, we contend that dedicating attention to longitudinal and intergenerational hyperscanning stands to benefit the fields of social and cognitive neuroscience more broadly. We argue that this approach is particularly relevant for understanding the neural mechanisms underpinning intergenerational social dynamics, and potentially for benchmarking progress in psychological and social interventions, many of which are situated in intergenerational contexts. In line with our position, we highlight areas of intergenerational research that stand to be enhanced by longitudinal hyperscanning with mobile devices, describe challenges that may arise from measuring across generations in the real world, and offer potential solutions.

Quantification of inter-brain coupling: A review of current methods used in haemodynamic and electrophysiological hyperscanning studies

Hyperscanning is a form of neuroimaging experiment where the brains of two or more participants are imaged simultaneously whilst they interact. Within the domain of social neuroscience, hyperscanning is increasingly used to measure inter-brain coupling (IBC) and explore how brain responses change in tandem during social interaction. In addition to cognitive research, some have suggested that quantification of the interplay between interacting participants can be used as a biomarker for a variety of cognitive mechanisms aswell as to investigate mental health and developmental conditions including schizophrenia, social anxiety and autism. However, many different methods have been used to quantify brain coupling and this can lead to questions about comparability across studies and reduce research reproducibility. Here, we review methods for quantifying IBC, and suggest some ways moving forward. Following the PRISMA guidelines, we reviewed 215 hyperscanning studies, across four different brain imaging modalities: functional near-infrared spectroscopy (fNIRS), functional magnetic resonance (fMRI), electroencephalography (EEG) and magnetoencephalography (MEG). Overall, the review identified a total of 27 different methods used to compute IBC. The most common hyperscanning modality is fNIRS, used by 119 studies, 89 of which adopted wavelet coherence. Based on the results of this literature survey, we first report summary statistics of the hyperscanning field, followed by a brief overview of each signal that is obtained from each neuroimaging modality used in hyperscanning. We then discuss the rationale, assumptions and suitability of each method to different modalities which can be used to investigate IBC. Finally, we discuss issues surrounding the interpretation of each method.

Pseudo-mutual gazing enhances interbrain synchrony during remote joint attention tasking

INTRODUCTION

Mutual gaze enables people to share attention and increase engagement during social interactions through intentional and implicit messages. Although previous studies have explored gaze behaviors and neural mechanisms underlying in-person eye contact, the growing prevalence of remote communication has raised questions about how to establish mutual gaze remotely and how the brains of interacting individuals synchronize.

METHODS

To address these questions, we conducted a study using eye trackers to create a pseudo-mutual gaze channel that mirrors the gazes of each interacting dyad on their respective remote screens. To demonstrate fluctuations in coupling across brains, we incorporated electroencephalographic hyperscanning techniques to simultaneously record the brain activity of interacting dyads engaged in a joint attention task in player-observer, collaborative, and competitive modes.

RESULTS

Our results indicated that mutual gaze could improve the efficiency of joint attention activities among remote partners. Moreover, by employing the phase locking value, we could estimate interbrain synchrony (IBS) and observe low-frequency couplings in the frontal and temporal regions that varied based on the interaction mode. While dyadic gender composition significantly affected gaze patterns, it did not impact the IBS.

CONCLUSION

These results provide insight into the neurological mechanisms underlying remote interaction through the pseudo-mutual gaze channel and have significant implications for developing effective online communication environments.

From distal to proximal to interactive: behavioral and brain synchrony during attraction, courtship, and sexual interaction-implications for clinical assessments of relationship style and quality

INTRODUCTION

Synchronous behaviors between individuals are nonverbal signs of closeness and common purpose. In the flow from initial attraction to intimate sexual interaction, attention and synchrony move from distal to proximal to interactive and are mediated by sensitized activation of neural systems for sexual motivation, arousal, and desire and those that recognize and mimic common facial and body movements between individuals. When reinforced by sexual pleasure and other relationship rewards, this results in the strengthening of attraction and bonding and the display of more common motor patterns. As relationships falter, nonverbal behaviors likely become asynchronous.

OBJECTIVES

To define behavioral, romantic, and sexual synchrony during phases of attraction and how their disruption can be observed and utilized by clinicians to assess individual relationship styles and quality.

METHODS

We review the literature on behavioral and attentional synchrony in humans and animals in an effort to understand experiential and innate mechanisms of synchrony and asynchrony and how they develop, as well as implications for attraction, relationship initiation, maintenance of romantic and sexual closeness, and relationship disintegration.

RESULTS

Evidence is presented that behavioral synchrony and the neural mechanisms that underlie it are vital to relationship formation and satisfaction.

CONCLUSION

Behavioral synchrony helps to create feelings of sexual and romantic synergy, cohesion, and arousal among individuals. Asynchrony is aversive and can spark feelings of discontent, aversion, and jealousy. Thus, observing patterns of nonverbal sexual and romantic synchrony between individuals offers insights into the potential quality of their relationships.

Depth from motion parallax: Deictic consistency, eye contact, and a serious problem with Zoom

The dynamics of head and eye gaze between two or more individuals displayed during verbal and nonverbal face-to-face communication contains a wealth of information and is used for both volitionary and unconscious signaling. Current video communication systems convey visual signals about gaze behavior and other directional cues, but the information they carry is often spurious and potentially misleading. I discuss the consequences of this situation, identify the source of the problem as a more general lack of deictic consistency, and demonstrate that using display technologies that simulate motion parallax are both necessary and sufficient to alleviate it. I then devise an avatar-based remote communication solution that achieves deictic consistency and provides natural, dynamic eye contact for computer-mediated audiovisual communication.

Interpersonal brain synchronization during face-to-face economic exchange between acquainted dyads

Interpersonal brain synchronization (IBS) has been observed during social interactions and involves various factors, such as familiarity with the partner and type of social activity. A previous study has shown that face-to-face (FF) interactions in pairs of strangers increase IBS. However, it is unclear whether this can be observed when the nature of the interacting partners is different. Herein, we aimed to extend these findings to pairs of acquaintances. Neural activity in the frontal and temporal regions was recorded using functional near-infrared spectroscopy hyperscanning. Participants played an ultimatum game that required virtual economic exchange in two experimental settings: face-to-face and face-blocked conditions. Random pair analysis confirmed whether IBS was induced by social interaction. Contrary to the aforementioned study, our results did not show any cooperative behavior or task-induced IBS increase. Conversely, the random pair analysis results revealed that the pair-specific IBS was significant only in the task condition at the left and right superior frontal, middle frontal, orbital superior frontal, right superior temporal, precentral and postcentral gyri. Our results tentatively suggested that FF interaction in acquainted pairs did not increase IBS and supported the idea that IBS is affected by 'with whom we interact and how'.

Spontaneous dyadic behaviour predicts the emergence of interpersonal neural synchrony

Synchronization of neural activity across brains - interpersonal neural synchrony (INS) - is emerging as a powerful marker of social interaction that predicts success of multi-person coordination, communication, and cooperation. As the origins of INS are poorly understood, we tested whether and how INS might emerge from spontaneous dyadic behavior. We recorded neural activity (EEG) and human behavior (full-body kinematics, eye movements and facial expressions) while dyads of participants were instructed to look at each other without speaking or making co-verbal gestures. We made four fundamental observations. First, despite the absence of a structured social task, INS emerged spontaneously only when participants were able to see each other. Second, we show that such spontaneous INS, comprising specific spectral and topographic profiles, did not merely reflect intra-personal modulations of neural activity, but it rather reflected real-time and dyad-specific coupling of neural activities. Third, using state-of-art video-image processing and deep learning, we extracted the temporal unfolding of three notable social behavioral cues - body movement, eye contact, and smiling - and demonstrated that these behaviors also spontaneously synchronized within dyads. Fourth, we probed the correlates of INS in such synchronized social behaviors. Using cross-correlation and Granger causality analyses, we show that synchronized social behaviors anticipate and in fact Granger cause INS. These results provide proof-of-concept evidence for studying interpersonal neural and behavioral synchrony under natural and unconstrained conditions. Most importantly, the results suggest that INS could be conceptualized as an emergent property of two coupled neural systems: an entrainment phenomenon, promoted by real-time dyadic behavior.

Mobile cognition: imaging the human brain in the 'real world'

Cognitive neuroscience studies in humans have enabled decades of impactful discoveries but have primarily been limited to recording the brain activity of immobile participants in a laboratory setting. In recent years, advances in neuroimaging technologies have enabled recordings of human brain activity to be obtained during freely moving behaviours in the real world. Here, we propose that these mobile neuroimaging methods can provide unique insights into the neural mechanisms of human cognition and contribute to the development of novel treatments for neurological and psychiatric disorders. We further discuss the challenges associated with studying naturalistic human behaviours in complex real-world settings as well as strategies for overcoming them. We conclude that mobile neuroimaging methods have the potential to bring about a new era of cognitive neuroscience in which neural mechanisms can be studied with increased ecological validity and with the ability to address questions about natural behaviour and cognitive processes in humans engaged in dynamic real-world experiences.

Zoom disrupts eye contact behaviour: problems and solutions

Natural, dynamic eye contact behaviour is critical to social interaction but is dysfunctional in video conferencing. In analysing the problem, I introduce the concept of directionality and emphasize the critical role of motion parallax. I then sketch approaches towards re-establishing directionality and enabling natural, dynamic eye contact in video conferences.

Neural mechanisms for emotional contagion and spontaneous mimicry of live facial expressions

Viewing a live facial expression typically elicits a similar expression by the observer (facial mimicry) that is associated with a concordant emotional experience (emotional contagion). The model of embodied emotion proposes that emotional contagion and facial mimicry are functionally linked although the neural underpinnings are not known. To address this knowledge gap, we employed a live two-person paradigm (n = 20 dyads) using functional near-infrared spectroscopy during live emotive face-processing while also measuring eye-tracking, facial classifications and ratings of emotion. One dyadic partner, 'Movie Watcher', was instructed to emote natural facial expressions while viewing evocative short movie clips. The other dyadic partner, 'Face Watcher', viewed the Movie Watcher's face. Task and rest blocks were implemented by timed epochs of clear and opaque glass that separated partners. Dyadic roles were alternated during the experiment. Mean cross-partner correlations of facial expressions (r = 0.36 ± 0.11 s.e.m.) and mean cross-partner affect ratings (r = 0.67 ± 0.04) were consistent with facial mimicry and emotional contagion, respectively. Neural correlates of emotional contagion based on covariates of partner affect ratings included angular and supramarginal gyri, whereas neural correlates of the live facial action units included motor cortex and ventral face-processing areas. Findings suggest distinct neural components for facial mimicry and emotional contagion. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Interpersonal Competition in Elderly Couples: A Functional Near-Infrared Spectroscopy Hyperscanning Study

Elderly people tend not to compete with others, and if they do, the mechanism behind the competition is not clear. In this study, groups of elderly couples and matched cross-sex controls were recruited to perform a competitive button-pressing task, while their brain signals were simultaneously collected using functional near-infrared spectroscopy (fNIRS) hyperscanning. Several fundamental observations were made. First, controls showed attenuated interpersonal competition across task processes, but couples held the competition with each other. Second, couples demonstrated increased inter-brain synchronization (IBS) between the middle temporal cortex and the temporoparietal junction across task processes. Third, Granger causality analysis in couples revealed significant differences between the directions (i.e., from men to women, and from women to men) in the first half of the competitive task, whereas there was no significant difference in the second half. Finally, the groups of couples and controls could be successfully discriminated against based on IBS by using a machine-learning approach. In sum, these findings indicate that elderly couples can maintain interpersonal competition, and such maintenance might be associated with changes in the IBS of the mentalizing system. It suggests the possible positive impact of long-term spouse relationships on interpersonal interactions, both behaviorally and neurally, in terms of competition.

Mother-Infant Brain-to-Brain Synchrony Patterns Reflect Caregiving Profiles

Biobehavioral synchrony, the coordination of physiological and behavioral signals between mother and infant during social contact, tunes the child's brain to the social world. Probing this mechanism from a two-brain perspective, we examine the associations between patterns of mother-infant inter-brain synchrony and the two well-studied maternal behavioral orientations-sensitivity and intrusiveness-which have repeatedly been shown to predict positive and negative socio-emotional outcomes, respectively. Using dual-electroencephalogram (EEG) recordings, we measure inter-brain connectivity between 60 mothers and their 5- to 12-month-old infants during face-to-face interaction. Thirty inter-brain connections show significantly higher correlations during the real mother-infant face-to-face interaction compared to surrogate data. Brain-behavior correlations indicate that higher maternal sensitivity linked with greater mother-infant neural synchrony, whereas higher maternal intrusiveness is associated with lower inter-brain coordination. Post hoc analysis reveals that the mother-right-frontal-infant-left-temporal connection is particularly sensitive to the mother's sensitive style, while the mother-left-frontal-infant-right-temporal connection indexes the intrusive style. Our results support the perspective that inter-brain synchrony is a mechanism by which mature brains externally regulate immature brains to social living and suggest that one pathway by which sensitivity and intrusiveness exert their long-term effect may relate to the provision of coordinated inputs to the social brain during its sensitive period of maturation.

Multimodal Approach for Characterizing the Quality of Parent-Child Interaction: A Single Synchronization Source May Not Tell the Whole Story

The interaction between the parent and child is essential for the child's cognitive and emotional development and sets the path for future well-being. These interactions, starting from birth, are necessary for providing the sensory stimulation the child needs in the critical time window of brain development. The characterization of parent-child interactions is traditionally performed by human decoding. This approach is considered the leading and most accurate way of characterizing the quality of these interactions. However, the development of computational tools and especially the concept of parent-child synchronization opened up an additional source of data characterizing these interactions in an objective, less human-labor manner. Such sources include brain-to-brain, voice/speech, eye contact, motor, and heart-rate synchronization. However, can a single source synchronization dataset accurately represent parent-child interaction? Will attending to the same stimulation, often resulting in a higher brain-to-brain synchronization, be considered an interactive condition? In this perspective, we will try to convey a new concept of the child-parent interaction synchronization (CHIPS) matrix, which includes the different sources of signals generated during an interaction. Such a model may assist in explaining the source of interaction alterations in the case of child/parent developmental/emotional or sensory deficits and may open up new ways of assessing interventions and changes in parent-child interactions along development. We will discuss this interaction during one of the parent-child joint activities providing opportunities for interaction, i.e., storytelling.

Neural and visual processing of social gaze cueing in typical and ASD adults

Atypical eye gaze in joint attention is a clinical characteristic of autism spectrum disorder (ASD). Despite this documented symptom, neural processing of joint attention tasks in real-life social interactions is not understood. To address this knowledge gap, functional-near infrared spectroscopy (fNIRS) and eye-tracking data were acquired simultaneously as ASD and typically developed (TD) individuals engaged in a gaze-directed joint attention task with a live human and robot partner. We test the hypothesis that face processing deficits in ASD are greater for interactive faces than for simulated (robot) faces. Consistent with prior findings, neural responses during human gaze cueing modulated by face visual dwell time resulted in increased activity of ventral frontal regions in ASD and dorsal parietal systems in TD participants. Hypoactivity of the right dorsal parietal area during live human gaze cueing was correlated with autism spectrum symptom severity: Brief Observations of Symptoms of Autism (BOSA) scores (r = âˆ'0.86). Contrarily, neural activity in response to robot gaze cueing modulated by visual acquisition factors activated dorsal parietal systems in ASD, and this neural activity was not related to autism symptom severity (r = 0.06). These results are consistent with the hypothesis that altered encoding of incoming facial information to the dorsal parietal cortex is specific to live human faces in ASD. These findings open new directions for understanding joint attention difficulties in ASD by providing a connection between superior parietal lobule activity and live interaction with human faces.

Lay Summary

Little is known about why it is so difficult for autistic individuals to make eye contact with other people. We find that in a live face-to-face viewing task with a robot, the brains of autistic participants were similar to typical participants but not when the partner was a live human. Findings suggest that difficulties in real-life social situations for autistic individuals may be specific to difficulties with live social interaction rather than general face gaze.

Functional near-infrared spectroscopy is a useful tool for multi-perspective psychobiological study of neurophysiological correlates of parenting behaviour

The quality of the relationship between caregiver and child has long-term effects on the cognitive and socio-emotional development of children. A process involved in human parenting is the bio-behavioural synchrony that occurs between the partners in the relationship during interaction. Through interaction, bio-behavioural synchronicity allows the adaptation of the physiological systems of the parent to those of the child and promotes the positive development and modelling of the child's social brain. The role of bio-behavioural synchrony in building social bonds could be investigated using functional near-infrared spectroscopy (fNIRS). In this paper we have (a) highlighted the importance of the quality of the caregiver-child relationship for the child's cognitive and socio-emotional development, as well as the relevance of infantile stimuli in the activation of parenting behaviour; (b) discussed the tools used in the study of the neurophysiological substrates of the parental response; (c) proposed fNIRS as a particularly suitable tool for the study of parental responses; and (d) underlined the need for a multi-systemic psychobiological approach to understand the mechanisms that regulate caregiver-child interactions and their bio-behavioural synchrony. We propose to adopt a multi-system psychobiological approach to the study of parental behaviour and social interaction.

Two-in-one system and behavior-specific brain synchrony during goal-free cooperative creation: an analytical approach combining automated behavioral classification and the event-related generalized linear model

SIGNIFICANCE

In hyperscanning studies of natural social interactions, behavioral coding is usually necessary to extract brain synchronizations specific to a particular behavior. The more natural the task is, the heavier the coding effort is. We propose an analytical approach to resolve this dilemma, providing insights and avenues for future work in interactive social neuroscience.

AIM

The objective is to solve the laborious coding problem for naturalistic hyperscanning by proposing a convenient analytical approach and to uncover brain synchronization mechanisms related to human cooperative behavior when the ultimate goal is highly free and creative.

APPROACH

This functional near-infrared spectroscopy hyperscanning study challenged a cooperative goal-free creative game in which dyads can communicate freely without time constraints and developed an analytical approach that combines automated behavior classification (computer vision) with a generalized linear model (GLM) in an event-related manner. Thirty-nine dyads participated in this study.

RESULTS

Conventional wavelet-transformed coherence (WTC) analysis showed that joint play induced robust between-brain synchronization (BBS) among the hub-like superior and middle temporal regions and the frontopolar and dorsomedial/dorsolateral prefrontal cortex (PFC) in the right hemisphere, in contrast to sparse within-brain synchronization (WBS). Contrarily, similar regions within a single brain showed strong WBS with similar connection patterns during independent play. These findings indicate a two-in-one system for performing creative problem-solving tasks. Further, WTC-GLM analysis combined with computer vision successfully extracted BBS, which was specific to the events when one of the participants raised his/her face to the other. This brain-to-brain synchrony between the right dorsolateral PFC and the right temporo-parietal junction suggests joint functioning of these areas when mentalization is necessary under situations with restricted social signals.

CONCLUSIONS

Our proposed analytical approach combining computer vision and WTC-GLM can be applied to extract inter-brain synchrony associated with social behaviors of interest.

Technologically-assisted communication attenuates inter-brain synchrony

The transition to technologically-assisted communication has permeated all facets of human social life; yet, its impact on the social brain is still unknown and the effects may be particularly intense during periods of developmental transitions. Applying a two-brain perspective, the current preregistered study utilized hyperscanning EEG to measure brain-to-brain synchrony in 62 mother-child pairs at the transition to adolescence (child age; M = 12.26, range 10-14) during live face-to-face interaction versus technologically-assisted remote communication. The live interaction elicited 9 significant cross-brain links between densely inter-connected frontal and temporal areas in the beta range [14-30 Hz]. Mother's right frontal region connected with the child's right and left frontal, temporal, and central regions, suggesting its regulatory role in organizing the two-brain dynamics. In contrast, the remote interaction elicited only 1 significant cross-brain-cross-hemisphere link, attenuating the robust right-to-right-brain connectivity during live social moments that communicates socio-affective signals. Furthermore, while the level of social behavior was comparable between the two interactions, brain-behavior associations emerged only during the live exchange. Mother-child right temporal-temporal synchrony linked with moments of shared gaze and the degree of child engagement and empathic behavior correlated with right frontal-frontal synchrony. Our findings indicate that human co-presence is underpinned by specific neurobiological processes that should be studied in depth. Much further research is needed to tease apart whether the "Zoom fatigue" experienced during technological communication may stem, in part, from overload on more limited inter-brain connections and to address the potential cost of social technology for brain maturation, particularly among youth.

Emotional modulation of cortical activity during gum chewing: A functional near-infrared spectroscopy study

Distinct brain regions are known to be associated with various emotional states. Cortical activity may be modulated by emotional states that are triggered by flavors during food intake. We examined cortical activity during chewing with different flavors and assessed the emotional modulation of cortical activity using multichannel near-infrared spectroscopy. Thirty-six right-handed volunteers participated in this crossover trial. The participants experienced positive and negative emotions from chewing flavorful (palatable) or less flavorful (unpalatable) gums, respectively for 5 min. Participants rated the taste, odor, and deliciousness of each gum using a visual analog scale. Bilateral hemodynamic responses in the frontal and parietal lobes, bilateral masseter muscle activation, and heart rate were measured during gum chewing. Changes in all measured data during gum chewing were also evaluated. The ratings of the tastes and odors of each gum significantly differed among the participants (P < 0.001). Hemodynamic response changes were significantly elevated in the bilateral primary sensorimotor cortex during gum-chewing, in comparison to resting. The difference in hemodynamic responses between palatable and unpalatable gum conditions was detected in the left frontopolar/dorsolateral prefrontal cortex. Muscle activation and heart rate were not significantly different between different gum types. Our findings indicate that differential processing in the left prefrontal cortex might be responsible for the emotional states caused by palatable and unpalatable foods.

Neural correlates of eye contact and social function in autism spectrum disorder

Reluctance to make eye contact during natural interactions is a central diagnostic criterion for autism spectrum disorder (ASD). However, the underlying neural correlates for eye contacts in ASD are unknown, and diagnostic biomarkers are active areas of investigation. Here, neuroimaging, eye-tracking, and pupillometry data were acquired simultaneously using two-person functional near-infrared spectroscopy (fNIRS) during live "in-person" eye-to-eye contact and eye-gaze at a video face for typically-developed (TD) and participants with ASD to identify the neural correlates of live eye-to-eye contact in both groups. Comparisons between ASD and TD showed decreased right dorsal-parietal activity and increased right ventral temporal-parietal activity for ASD during live eye-to-eye contact (p≤0.05, FDR-corrected) and reduced cross-brain coherence consistent with atypical neural systems for live eye contact. Hypoactivity of right dorsal-parietal regions during eye contact in ASD was further associated with gold standard measures of social performance by the correlation of neural responses and individual measures of: ADOS-2, Autism Diagnostic Observation Schedule, 2nd Edition (r = -0.76, -0.92 and -0.77); and SRS-2, Social Responsiveness Scale, Second Edition (r = -0.58). The findings indicate that as categorized social ability decreases, neural responses to real eye-contact in the right dorsal parietal region also decrease consistent with a neural correlate for social characteristics in ASD.

The promises and pitfalls of functional magnetic resonance imaging hyperscanning for social interaction research

Social neuroscience combines tools and perspectives from social psychology and neuroscience to understand how people interact with their social world. Here we discuss a relatively new method-hyperscanning-to study real-time, interactive social interactions using functional magnetic resonance imaging (fMRI). We highlight three contributions that fMRI hyperscanning makes to the study of the social mind: (1) Naturalism: it shifts the focus from tightly-controlled stimuli to more naturalistic social interactions; (2) Multi-person Dynamics: it shifts the focus from individuals as the unit of analysis to dyads and groups; and (3) Neural Resolution: fMRI hyperscanning captures high-resolution neural patterns and dynamics across the whole brain, unlike other neuroimaging hyperscanning methods (e.g., electroencephalogram, functional near-infrared spectroscopy). Finally, we describe the practical considerations and challenges that fMRI hyperscanning researchers must navigate. We hope researchers will harness this powerful new paradigm to address pressing questions in today's society.

Enhanced Mirror Neuron Network Activity and Effective Connectivity during Live Interaction Among Female Subjects

Facial expressions are indispensable in daily human communication. Previous neuroimaging studies investigating facial expression processing have presented pre-recorded stimuli and lacked live face-to-face interaction. Our paradigm alternated between presentations of real-time model performance and pre-recorded videos of dynamic facial expressions to participants. Simultaneous functional magnetic resonance imaging (fMRI) and facial electromyography activity recordings, as well as post-scan valence and arousal ratings were acquired from 44 female participants. Live facial expressions enhanced the subjective valence and arousal ratings as well as facial muscular responses. Live performances showed greater engagement of the right posterior superior temporal sulcus (pSTS), right inferior frontal gyrus (IFG), right amygdala and right fusiform gyrus, and modulated the effective connectivity within the right mirror neuron system (IFG, pSTS, and right inferior parietal lobule). A support vector machine algorithm could classify multivoxel activation patterns in brain regions involved in dynamic facial expression processing in the mentalizing networks (anterior and posterior cingulate cortex). These results indicate that live social interaction modulates the activity and connectivity of the right mirror neuron system and enhances spontaneous mimicry, further facilitating emotional contagion.

Dual-MEG interbrain synchronization during turn-taking verbal interactions between mothers and children

Verbal interaction and imitation are essential for language learning and development in young children. However, it is unclear how mother-child dyads synchronize oscillatory neural activity at the cortical level in turn-based speech interactions. Our study investigated interbrain synchrony in mother-child pairs during a turn-taking paradigm of verbal imitation. A dual-MEG (magnetoencephalography) setup was used to measure brain activity from interactive mother-child pairs simultaneously. Interpersonal neural synchronization was compared between socially interactive and noninteractive tasks (passive listening to pure tones). Interbrain networks showed increased synchronization during the socially interactive compared to noninteractive conditions in the theta and alpha bands. Enhanced interpersonal brain synchrony was observed in the right angular gyrus, right triangular, and left opercular parts of the inferior frontal gyrus. Moreover, these parietal and frontal regions appear to be the cortical hubs exhibiting a high number of interbrain connections. These cortical areas could serve as a neural marker for the interactive component in verbal social communication. The present study is the first to investigate mother-child interbrain neural synchronization during verbal social interactions using a dual-MEG setup. Our results advance our understanding of turn-taking during verbal interaction between mother-child dyads and suggest a role for social "gating" in language learning.

Activation in Right Dorsolateral Prefrontal Cortex Underlies Stuttering Anticipation

People who stutter learn to anticipate many of their overt stuttering events. Despite the critical role of anticipation, particularly how responses to anticipation shape stuttering behaviors, the neural bases associated with anticipation are unknown. We used a novel approach to identify anticipated and unanticipated words, which were produced by 22 adult stutterers in a delayed-response task while hemodynamic activity was measured using functional near infrared spectroscopy (fNIRS). Twenty-two control participants were included such that each individualized set of anticipated and unanticipated words was produced by one stutterer and one control participant. We conducted an analysis on the right dorsolateral prefrontal cortex (R-DLPFC) based on converging lines of evidence from the stuttering and cognitive control literatures. We also assessed connectivity between the R-DLPFC and right supramarginal gyrus (R-SMG), two key nodes of the frontoparietal network (FPN), to assess the role of cognitive control, and particularly error-likelihood monitoring, in stuttering anticipation. All analyses focused on the five-second anticipation phase preceding the go signal to produce speech. The results indicate that anticipated words are associated with elevated activation in the R-DLPFC, and that compared to non-stutterers, stutterers exhibit greater activity in the R-DLPFC, irrespective of anticipation. Further, anticipated words are associated with reduced connectivity between the R-DLPFC and R-SMG. These findings highlight the potential roles of the R-DLPFC and the greater FPN as a neural substrate of stuttering anticipation. The results also support previous accounts of error-likelihood monitoring and action-stopping in stuttering anticipation. Overall, this work offers numerous directions for future research with clinical implications for targeted neuromodulation.

Optical imaging and spectroscopy for the study of the human brain: status report

This report is the second part of a comprehensive two-part series aimed at reviewing an extensive and diverse toolkit of novel methods to explore brain health and function. While the first report focused on neurophotonic tools mostly applicable to animal studies, here, we highlight optical spectroscopy and imaging methods relevant to noninvasive human brain studies. We outline current state-of-the-art technologies and software advances, explore the most recent impact of these technologies on neuroscience and clinical applications, identify the areas where innovation is needed, and provide an outlook for the future directions.

An Approach to Neuroimaging Interpersonal Interactions in Mental Health Interventions

BACKGROUND

Conventional paradigms in clinical neuroscience tend to be constrained in terms of ecological validity, raising several challenges to studying the mechanisms mediating treatments and outcomes in clinical settings. Addressing these issues requires real-world neuroimaging techniques that are capable of continuously collecting data during free-flowing interpersonal interactions and that allow for experimental designs that are representative of the clinical situations in which they occur.

METHODS

In this work, we developed a paradigm that fractionates the major components of human-to-human verbal interactions occurring in clinical situations and used functional near-infrared spectroscopy to assess the brain systems underlying clinician-client discourse (N = 30).

RESULTS

Cross-brain neural coupling between people was significantly greater during clinical interactions compared with everyday life verbal communication, particularly between the prefrontal cortex (e.g., inferior frontal gyrus) and inferior parietal lobule (e.g., supramarginal gyrus). The clinical tasks revealed extensive increases in activity across the prefrontal cortex, especially in the rostral prefrontal cortex (area 10), during periods in which participants were required to silently reason about the dysfunctional cognitions of the other person.

CONCLUSIONS

This work demonstrates a novel experimental approach to investigating the neural underpinnings of interpersonal interactions that typically occur in clinical settings, and its findings support the idea that particular prefrontal systems might be critical to cultivating mental health.

Social signalling as a framework for second-person neuroscience

Despite the recent increase in second-person neuroscience research, it is still hard to understand which neurocognitive mechanisms underlie real-time social behaviours. Here, we propose that social signalling can help us understand social interactions both at the single- and two-brain level in terms of social signal exchanges between senders and receivers. First, we show how subtle manipulations of being watched provide an important tool to dissect meaningful social signals. We then focus on how social signalling can help us build testable hypotheses for second-person neuroscience with the example of imitation and gaze behaviour. Finally, we suggest that linking neural activity to specific social signals will be key to fully understand the neurocognitive systems engaged during face-to-face interactions.

Eye Contact in Video Communication: Experiences of Co-creating Relationships

As a result of the COVID-19 pandemic, increased number of persons have been forced to limit their interactions with friends and families to contact via video, which excludes eye-contact. The aim of this study was to examine individuals’ experiences of the difference between forced skewed visuality and the ability for eye-contact in conversations. Two custom-made units allowed 15 participants interacting in dyads to alternate between being able to make eye contact and having that ability removed through skewed visuality. Participants reported their experiences in semi-structured interviews. Data analyzed with qualitative content analysis resulted in three themes: Shared eye contact allows us to create our relationship together; With eye contact, we adjust to each other to feel more connected and less intimidated; and We get more self-conscious when the visuality is skewed or shifting. The results imply that skewed visuality as forced lack of eye-contact in video conversations effects embodied non-verbal processes related to sense of connectedness and participatory sensemaking, creating a sense of both emotional and physical distance, as well as heightening self-awareness about the need of actively regulating the other. We argue that this is one of the ways to understand the impact of moving interactions to online communication.

Asymmetric Prefrontal Cortex Activation Associated with Mutual Gaze of Mothers and Children during Shared Play

Mother–child shared play provides rich opportunities for mutual symmetrical interactions that serve to foster bond formation in dyads. Mutual gaze, a symmetrical behaviour that occurs during direct eye contact between two partners, conveys important cues of social engagement, affect and attention. However, it is not known whether the prefrontal cortical areas responsible for higher-order social cognition of mothers and children likewise exhibit neural symmetry; that is, similarity in direction of neural activation in mothers and children. This study used functional Near-infrared Spectroscopy (fNIRS) hyperscanning on 22 pairs of mothers and their preschool-aged children as they engaged in a 10-min free-play session together. The play interaction was video recorded and instances of mutual gaze were coded for after the experiment. Multivariate linear regression analyses revealed that neural asymmetry occurred during mother–child mutual gaze, where mothers showed a deactivation of prefrontal activity whereas children showed an activation instead. Findings suggest that mothers and children may employ divergent prefrontal mechanisms when engaged in symmetrical behaviours such as mutual gaze. Future studies could ascertain whether the asymmetric nature of a parent–child relationship, or potential neurodevelopmental differences in social processing between adults and children, significantly contribute to this observation.

Social synchronization of brain activity increases during eye-contact

Humans make eye-contact to extract information about other people’s mental states, recruiting dedicated brain networks that process information about the self and others. Recent studies show that eye-contact increases the synchronization between two brains but do not consider its effects on activity within single brains. Here we investigate how eye-contact affects the frequency and direction of the synchronization within and between two brains and the corresponding network characteristics. We also evaluate the functional relevance of eye-contact networks by comparing inter- and intra-brain networks of friends vs. strangers and the direction of synchronization between leaders and followers. We show that eye-contact increases higher inter- and intra-brain synchronization in the gamma frequency band. Network analysis reveals that some brain areas serve as hubs linking within- and between-brain networks. During eye-contact, friends show higher inter-brain synchronization than strangers. Dyads with clear leader/follower roles demonstrate higher synchronization from leader to follower in the alpha frequency band. Importantly, eye-contact affects synchronization between brains more than within brains, demonstrating that eye-contact is an inherently social signal. Future work should elucidate the causal mechanisms behind eye-contact induced synchronization.

Friends making eye-contact have higher inter-brain synchronization than strangers. Eye-contact affects neural synchronization between brains more than within a brain, highlighting that eye-contact is an inherently social signal.

Systemic physiology augmented functional near-infrared spectroscopy hyperscanning: a first evaluation investigating entrainment of spontaneous activity of brain and body physiology between subjects

Significance: Functional near-infrared spectroscopy (fNIRS) enables measuring the brain activity of two subjects while they interact, i.e., the hyperscanning approach. Aim: In our exploratory study, we extended classical fNIRS hyperscanning by adding systemic physiological measures to obtain systemic physiology augmented fNIRS (SPA-fNIRS) hyperscanning while blocking and not blocking the visual communication between the subjects. This approach enables access brain-to-brain, brain-to-body, and body-to-body coupling between the subjects simultaneously. Approach: Twenty-four pairs of subjects participated in the experiment. The paradigm consisted of two subjects that sat in front of each other and had their eyes closed for 10 min, followed by a phase of 10 min where they made eye contact. Brain and body activity was measured continuously by SPA-fNIRS. Results: Our study shows that making eye contact for a prolonged time causes significant changes in brain-to-brain, brain-to-body, and body-to-body coupling, indicating that eye contact is followed by entrainment of the physiology between subjects. Subjects that knew each other generally showed a larger trend to change between the two conditions. Conclusions: The main point of this study is to introduce a new framework to investigate brain-to-brain, body-to-body, and brain-to-body coupling through a simple social experimental paradigm. The study revealed that eye contact leads to significant synchronization of spontaneous activity of the brain and body physiology. Our study is the first that employed the SPA-fNIRS approach and showed its usefulness to investigate complex interpersonal physiological changes.

Investigation of functional near-infrared spectroscopy signal quality and development of the hemodynamic phase correlation signal

Significance: There is a longstanding recommendation within the field of fNIRS to use oxygenated (HbO 2 ) and deoxygenated (HHb) hemoglobin when analyzing and interpreting results. Despite this, many fNIRS studies do focus onHbO 2 only. Previous work has shown thatHbO 2 on its own is susceptible to systemic interference and results may mostly reflect that rather than functional activation. Studies using bothHbO 2 and HHb to draw their conclusions do so with varying methods and can lead to discrepancies between studies. The combination ofHbO 2 and HHb has been recommended as a method to utilize both signals in analysis. Aim: We present the development of the hemodynamic phase correlation (HPC) signal to combineHbO 2 and HHb as recommended to utilize both signals in the analysis. We use synthetic and experimental data to evaluate how the HPC and current signals used for fNIRS analysis compare. Approach: About 18 synthetic datasets were formed using resting-state fNIRS data acquired from 16 channels over the frontal lobe. To simulate fNIRS data for a block-design task, we superimposed a synthetic task-related hemodynamic response to the resting state data. This data was used to develop an HPC-general linear model (GLM) framework. Experiments were conducted to investigate the performance of each signal at different SNR and to investigate the effect of false positives on the data. Performance was based on each signal's mean T -value across channels. Experimental data recorded from 128 participants across 134 channels during a finger-tapping task were used to investigate the performance of multiple signals [HbO 2 , HHb, HbT, HbD, correlation-based signal improvement (CBSI), and HPC] on real data. Signal performance was evaluated on its ability to localize activation to a specific region of interest. Results: Results from varying the SNR show that the HPC signal has the highest performance for high SNRs. The CBSI performed the best for medium-low SNR. The next analysis evaluated how false positives affect the signals. The analyses evaluating the effect of false positives showed that the HPC and CBSI signals reflect the effect of false positives onHbO 2 and HHb. The analysis of real experimental data revealed that the HPC and HHb signals provide localization to the primary motor cortex with the highest accuracy. Conclusions: We developed a new hemodynamic signal (HPC) with the potential to overcome the current limitations of usingHbO 2 and HHb separately. Our results suggest that the HPC signal provides comparable accuracy to HHb to localize functional activation while at the same time being more robust against false positives.

Measuring the temporal dynamics of inter-personal neural entrainment in continuous child-adult EEG hyperscanning data

Current approaches to analysing EEG hyperscanning data in the developmental literature typically consider interpersonal entrainment between interacting physiological systems as a time-invariant property. This approach obscures crucial information about how entrainment between interacting systems is established and maintained over time. Here, we describe methods, and present computational algorithms, that will allow researchers to address this gap in the literature. We focus on how two different approaches to measuring entrainment, namely concurrent (e.g., power correlations, phase locking) and sequential (e.g., Granger causality) measures, can be applied to three aspects of the brain signal: amplitude, power, and phase. We guide the reader through worked examples using simulated data on how to leverage these methods to measure changes in interbrain entrainment. For each, we aim to provide a detailed explanation of the interpretation and application of these analyses when studying neural entrainment during early social interactions.

The Bidirectional Social-Cognitive Mechanisms of the Social-Attention Symptoms of Autism

Differences in social attention development begin to be apparent in the 6th to 12th month of development in children with Autism Spectrum Disorder (ASD) and theoretically reflect important elements of its neurodevelopmental endophenotype. This paper examines alternative conceptual views of these early social attention symptoms and hypotheses about the mechanisms involved in their development. One model emphasizes mechanism involved in the spontaneous allocation of attention to faces, or social orienting. Alternatively, another model emphasizes mechanisms involved in the coordination of attention with other people, or joint attention, and the socially bi-directional nature of its development. This model raises the possibility that atypical responses of children to the attention or the gaze of a social partner directed toward themselves may be as important in the development of social attention symptoms as differences in the development of social orienting. Another model holds that symptoms of social attention may be important to early development, but may not impact older individuals with ASD. The alterative model is that the social attention symptoms in infancy (social orienting and joint attention), and social cognitive symptoms in childhood and adulthood share common neurodevelopmental substrates. Therefore, differences in early social attention and later social cognition constitute a developmentally continuous axis of symptom presentation in ASD. However, symptoms in older individuals may be best measured with in vivo measures of efficiency of social attention and social cognition in social interactions rather than the accuracy of response on analog tests used in measures with younger children. Finally, a third model suggests that the social attention symptoms may not truly be a symptom of ASD. Rather, they may be best conceptualized as stemming from differences domain general attention and motivation mechanisms. The alternative argued for here that infant social attention symptoms meet all the criteria of a unique dimension of the phenotype of ASD and the bi-directional phenomena involved in social attention cannot be fully explained in terms of domain general aspects of attention development.

Maternal chemosignals enhance infant-adult brain-to-brain synchrony

Maternal body odors serve as important safety-promoting and social recognition signals, but their role in human brain maturation is largely unknown. Utilizing ecological paradigms and dual- electroencephalography recording, we examined the effects of maternal chemosignals on brain-to-brain synchrony during infant-mother and infant-stranger interactions with and without the presence of maternal body odors. Neural connectivity of right-to-right brain theta synchrony emerged across conditions, sensitizing key nodes of the infant’s social brain during its maturational period. Infant-mother interaction elicited greater brain-to-brain synchrony; however, maternal chemosignals attenuated this difference. Infants exhibited more social attention, positive arousal, and safety/approach behaviors in the maternal chemosignals condition, which augmented infant-stranger neural synchrony. Human mothers use interbrain mechanisms to tune the infant’s social brain, and chemosignals may sustain the transfer of infant sociality from the mother-infant bond to life within social groups.

Opportunities and Limitations of Mobile Neuroimaging Technologies in Educational Neuroscience

As the field of educational neuroscience continues to grow, questions have emerged regarding the ecological validity and applicability of this research to educational practice. Recent advances in mobile neuroimaging technologies have made it possible to conduct neuroscientific studies directly in naturalistic learning environments. We propose that embedding mobile neuroimaging research in a cycle (Matusz, Dikker, Huth, & Perrodin, 2019), involving lab-based, seminaturalistic, and fully naturalistic experiments, is well suited for addressing educational questions. With this review, we take a cautious approach, by discussing the valuable insights that can be gained from mobile neuroimaging technology, including electroencephalography and functional near-infrared spectroscopy, as well as the challenges posed by bringing neuroscientific methods into the classroom. Research paradigms used alongside mobile neuroimaging technology vary considerably. To illustrate this point, studies are discussed with increasingly naturalistic designs. We conclude with several ethical considerations that should be taken into account in this unique area of research.

Experiencing Happiness Together Facilitates Dyadic Coordination through the Enhanced Interpersonal Neural Synchronization

Experiencing positive emotions together facilitates interpersonal understanding and promotes subsequent social interaction among individuals. However, the neural underpinnings of such emotional-social effect remain to be discovered. Current study employed the fNIRS-based hyperscanning to investigate the above mentioned relationship. After participants in dyad watching movie clips with happily or neutral emotion, they were asked to perform the interpersonal cooperative task, with their neural activation of prefrontal cortex (PFC) being recorded simultaneously via functional near infrared spectroscopy. Results suggested that compared with the neutral movie watching together, a higher interpersonal neural synchronization (INS) in left inferior frontal gyrus during participant dyads watching happiness movie together. Subsequently, dyads in happiness showed more effective coordination interaction during performed the interpersonal cooperation task compared to those in the neutral condition, and such facilitated effect was associated with increased cooperation-related INS at left middle frontal cortex. A mediation analysis showed that the coordination interaction fully mediated the relationship between the emotion-induced INS during the happiness movie-viewing and the cooperation-related INS in interpersonal cooperation. Taken together, our findings suggest that the faciliatory effect experiencing happiness together has on interpersonal cooperation can be reliably reflected by the INS magnitude at the brain level.

The Interpersonal Neuroscience of Social Learning

The study of the brain mechanisms underpinning social behavior is currently undergoing a paradigm shift, moving its focus from single individuals to the real-time interaction among groups of individuals. Although this development opens unprecedented opportunities to study how interpersonal brain activity shapes behaviors through learning, there have been few direct connections to the rich field of learning science. Our article examines how the rapidly developing field of interpersonal neuroscience is (and could be) contributing to our understanding of social learning. To this end, we first review recent research extracting indices of brain-to-brain coupling (BtBC) in the context of social behaviors and, in particular, social learning. We then discuss how studying communicative behaviors during learning can aid the interpretation of BtBC and how studying BtBC can inform our understanding of such behaviors. We then discuss how BtBC and communicative behaviors collectively can predict learning outcomes, and we suggest several causative and mechanistic models. Finally, we highlight key methodological and interpretational challenges as well as exciting opportunities for integrating research in interpersonal neuroscience with social learning, and we propose a multiperson framework for understanding how interpersonal transmission of information between individual brains shapes social learning.

Eye contact marks the rise and fall of shared attention in conversation

Conversation is the platform where minds meet: the venue where information is shared, ideas cocreated, cultural norms shaped, and social bonds forged. Its frequency and ease belie its complexity. Every conversation weaves a unique shared narrative from the contributions of independent minds, requiring partners to flexibly move into and out of alignment as needed for conversation to both cohere and evolve. How two minds achieve this coordination is poorly understood. Here we test whether eye contact, a common feature of conversation, predicts this coordination by measuring dyadic pupillary synchrony (a corollary of shared attention) during natural conversation. We find that eye contact is positively correlated with synchrony as well as ratings of engagement by conversation partners. However, rather than elicit synchrony, eye contact commences as synchrony peaks and predicts its immediate and subsequent decline until eye contact breaks. This relationship suggests that eye contact signals when shared attention is high. Furthermore, we speculate that eye contact may play a corrective role in disrupting shared attention (reducing synchrony) as needed to facilitate independent contributions to conversation.

Bridging the gap between emotion and joint action

Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.

Distinct Contributions of Genes and Environment to Visual Size Illusion and the Underlying Neural Mechanism

As exemplified by the Ebbinghaus illusion, the perceived size of an object can be significantly biased by its surrounding context. The phenomenon is experienced by humans as well as other species, hence likely evolutionarily adaptive. Here, we examined the heritability of the Ebbinghaus illusion using a combination of the classic twin method and multichannel functional near-infrared spectroscopy. Results show that genes account for over 50% of the variance in the strength of the experienced illusion. Interestingly, activations evoked by the Ebbinghaus stimuli in the early visual cortex are explained by genetic factors whereas those in the posterior temporal cortex are explained by environmental factors. In parallel, the feedforward functional connectivity between the occipital cortex and the temporal cortex is modulated by genetic effects whereas the feedback functional connectivity is entirely shaped by environment, despite both being significantly correlated with the strength of the experienced illusion. These findings demonstrate that genetic and environmental factors work in tandem to shape the context-dependent visual size illusion, and shed new light on the links among genes, environment, brain, and subjective experience.

Bidirectional Connectivity Between Broca's Area and Wernicke's Area During Interactive Verbal Communication

Aim: This investigation aims to advance the understanding of neural dynamics that underlies live and natural interactions during spoken dialogue between two individuals. Introduction: The underlying hypothesis is that functional connectivity between canonical speech areas in the human brain will be modulated by social interaction. Methods: Granger causality was applied to compare directional connectivity across Broca's and Wernicke's areas during verbal conditions consisting of interactive and noninteractive communication. Thirty-three pairs of healthy adult participants alternately talked and listened to each other while performing an object naming and description task that was either interactive or not during hyperscanning with functional near-infrared spectroscopy (fNIRS). In the noninteractive condition, the speaker named and described a picture-object without reference to the partner's description. In the interactive condition, the speaker performed the same task but included an interactive response about the preceding comments of the partner. Causality measures of hemodynamic responses from Broca's and Wernicke's areas were compared between real, surrogate, and shuffled trials within dyads. Results: The interactive communication was characterized by bidirectional connectivity between Wernicke's and Broca's areas of the listener's brain. Whereas this connectivity was unidirectional in the speaker's brain. In the case of the noninteractive condition, both speaker's and listener's brains showed unidirectional top-down (Broca's area to Wernicke's area) connectivity. Conclusion: Together, directional connectivity as determined by Granger analysis reveals bidirectional flow of neuronal information during dynamic two-person verbal interaction for processes that are active during listening (reception) and not during talking (production). Findings are consistent with prior contrast findings (general linear model) showing neural modulation of the receptive language system associated with Wernicke's area during a two-person live interaction. Impact statement The neural dynamics that underlies real-life social interactions is an emergent topic of interest. Dynamically coupled cross-brain neural mechanisms between interacting partners during verbal dialogue have been shown within Wernicke's area. However, it is not known how within-brain long-range neural mechanisms operate during these live social functions. Using Granger causality analysis, we show bidirectional neural activity between Broca's and Wernicke's areas during interactive dialogue compared with a noninteractive control task showing only unidirectional activity. Findings are consistent with an Interactive Brain Model where long-range neural mechanisms process interactive processes associated with rapid and spontaneous spoken social cues.