Synchronization between instructor and observer when learning a complex bimanual skill

Onscreen presence of instructors in video lectures affects learners' neural synchrony and visual attention during multimedia learning

COVID-19 forced students to rely on online learning using multimedia tools, and multimedia learning continues to impact education beyond the pandemic. In this study, we combined behavioral, eye-tracking, and neuroimaging paradigms to identify multimedia learning processes and outcomes. College students viewed four video lectures including slides with either an onscreen human instructor, an animated instructor, or no onscreen instructor. Brain activity was recorded via fMRI, visual attention was recorded via eye-tracking, and learning outcome was assessed via post-tests. Onscreen presence of instructor, compared with no instructor presence, resulted in superior post-test performance, less visual attention on the slide, more synchronized eye movements during learning, and higher neural synchronization in cortical networks associated with socio-emotional processing and working memory. Individual variation in cognitive and socio-emotional abilities and intersubject neural synchronization revealed different levels of cognitive and socio-emotional processing in different learning conditions. The instructor-present condition evoked increased synchronization, likely reflecting extra processing demands in attentional control, working memory engagement, and socio-emotional processing. Although human instructors and animated instructors led to comparable learning outcomes, the effects were due to the dynamic interplay of information processing vs. attentional distraction. These findings reflect a benefit-cost trade-off where multimedia learning outcome is enhanced only when the cognitive benefits motivated by the social presence of onscreen instructor outweigh the cognitive costs brought about by concurrent attentional distraction unrelated to learning.

Attachment Reminders Trigger Widespread Synchrony across Multiple Brains

Infant stimuli elicit widespread neural and behavioral response in human adults, and such massive allocation of resources attests to the evolutionary significance of the primary attachment. Here, we examined whether attachment reminders also trigger cross-brain concordance and generate greater neural uniformity, as indicated by intersubject correlation. Human mothers were imaged twice in oxytocin/placebo administration design, and stimuli included four ecological videos of a standard unfamiliar mother and infant: two infant/mother alone (Alone) and two mother-infant dyadic contexts (Social). Theory-driven analysis measured cross-brain synchrony in preregistered nodes of the parental caregiving network (PCN), which integrates subcortical structures underpinning mammalian mothering with cortical areas implicated in simulation, mentalization, and emotion regulation, and data-driven analysis assessed brain-wide concordance using whole-brain parcellation. Results demonstrated widespread cross-brain synchrony in both the PCN and across the neuroaxis, from primary sensory/somatosensory areas, through insular-cingulate regions, to temporal and prefrontal cortices. The Social context yielded significantly more cross-brain concordance, with PCNs striatum, parahippocampal gyrus, superior temporal sulcus, ACC, and PFC displaying cross-brain synchrony only to mother-infant social cues. Moment-by-moment fluctuations in mother-infant social synchrony, ranging from episodes of low synchrony to tightly coordinated positive bouts, were tracked online by cross-brain concordance in the preregistered ACC. Findings indicate that social attachment stimuli, representing evolutionary-salient universal cues that require no verbal narrative, trigger substantial interbrain concordance and suggest that the mother-infant bond, an icon standing at the heart of human civilization, may function to glue brains into a unified experience and bind humans into social groups.SIGNIFICANCE STATEMENT Infant stimuli elicit widespread neural response in human adults, attesting to their evolutionary significance, but do they also trigger cross-brain concordance and induce neural uniformity among perceivers? We measured cross-brain synchrony to ecological mother-infant videos. We used theory-driven analysis, measuring cross-brain concordance in the parenting network, and data-driven analysis, assessing brain-wide concordance using whole-brain parcellation. Attachment cues triggered widespread cross-brain concordance in both the parenting network and across the neuroaxis. Moment-by-moment fluctuations in behavioral synchrony were tracked online by cross-brain variability in ACC. Attachment reminders bind humans' brains into a unitary experience and stimuli characterized by social synchrony enhance neural similarity among participants, describing one mechanism by which attachment bonds provide the neural template for the consolidation of social groups.

A Brain-To-Brain Mechanism for Social Transmission of Threat Learning

Survival and adaptation in environments require swift and efficacious learning about what is dangerous. Across species, much of such threat learning is acquired socially, e.g., through the observation of others' ("demonstrators'") defensive behaviors. However, the specific neural mechanisms responsible for the integration of information shared between demonstrators and observers remain largely unknown. This dearth of knowledge is addressed by performing magnetoencephalography (MEG) neuroimaging in demonstrator-observer dyads. A set of stimuli are first shown to a demonstrator whose defensive responses are filmed and later presented to an observer, while neuronal activity is recorded sequentially from both individuals who never interacted directly. These results show that brain-to-brain coupling (BtBC) in the fronto-limbic circuit (including insula, ventromedial, and dorsolateral prefrontal cortex) within demonstrator-observer dyads predict subsequent expressions of learning in the observer. Importantly, the predictive power of BtBC magnifies when a threat is imminent to the demonstrator. Furthermore, BtBC depends on how observers perceive their social status relative to the demonstrator, likely driven by shared attention and emotion, as bolstered by dyadic pupillary coupling. Taken together, this study describes a brain-to-brain mechanism for social threat learning, involving BtBC, which reflects social relationships and predicts adaptive, learned behaviors.

Revealing the neurobiology underlying interpersonal neural synchronization with multimodal data fusion

Humans synchronize with one another to foster successful interactions. Here, we use a multimodal data fusion approach with the aim of elucidating the neurobiological mechanisms by which interpersonal neural synchronization (INS) occurs. Our meta-analysis of 22 functional magnetic resonance imaging and 69 near-infrared spectroscopy hyperscanning experiments (740 and 3721 subjects) revealed robust brain regional correlates of INS in the right temporoparietal junction and left ventral prefrontal cortex. Integrating this meta-analytic information with public databases, biobehavioral and brain-functional association analyses suggested that INS involves sensory-integrative hubs with functional connections to mentalizing and attention networks. On the molecular and genetic levels, we found INS to be associated with GABAergic neurotransmission and layer IV/V neuronal circuits, protracted developmental gene expression patterns, and disorders of neurodevelopment. Although limited by the indirect nature of phenotypic-molecular association analyses, our findings generate new testable hypotheses on the neurobiological basis of INS.

Dual-site TMS as a tool to probe effective interactions within the motor network: a review

Dual-site transcranial magnetic stimulation (ds-TMS) is well suited to investigate the causal effect of distant brain regions on the primary motor cortex, both at rest and during motor performance and learning. However, given the broad set of stimulation parameters, clarity about which parameters are most effective for identifying particular interactions is lacking. Here, evidence describing inter- and intra-hemispheric interactions during rest and in the context of motor tasks is reviewed. Our aims are threefold: (1) provide a detailed overview of ds-TMS literature regarding inter- and intra-hemispheric connectivity; (2) describe the applicability and contributions of these interactions to motor control, and; (3) discuss the practical implications and future directions. Of the 3659 studies screened, 109 were included and discussed. Overall, there is remarkable variability in the experimental context for assessing ds-TMS interactions, as well as in the use and reporting of stimulation parameters, hindering a quantitative comparison of results across studies. Further studies examining ds-TMS interactions in a systematic manner, and in which all critical parameters are carefully reported, are needed.

Deficit in observational learning in experimental epilepsy

Individuals use the observation of a conspecific to learn new behaviors and skills in many species. Whether observational learning is affected in epilepsy is not known. Using the pilocarpine rat model of epilepsy, we assessed learning by observation in a spatial task. The task involves a naive animal observing a demonstrator animal seeking a reward at a specific spatial location. After five observational sessions, the observer is allowed to explore the rewarded space and look for the reward. Although control observer rats succeed in finding the reward when allowed to explore the rewarded space, epileptic animals fail. However, epileptic animals are able to successfully learn the location of the reward through their own experience after several trial sessions. Thus, epileptic animals show a clear deficit in learning by observation. This result may be clinically relevant, in particular in children who strongly rely on observational learning.

The Interpersonal Neuroscience of Social Learning

The study of the brain mechanisms underpinning social behavior is currently undergoing a paradigm shift, moving its focus from single individuals to the real-time interaction among groups of individuals. Although this development opens unprecedented opportunities to study how interpersonal brain activity shapes behaviors through learning, there have been few direct connections to the rich field of learning science. Our article examines how the rapidly developing field of interpersonal neuroscience is (and could be) contributing to our understanding of social learning. To this end, we first review recent research extracting indices of brain-to-brain coupling (BtBC) in the context of social behaviors and, in particular, social learning. We then discuss how studying communicative behaviors during learning can aid the interpretation of BtBC and how studying BtBC can inform our understanding of such behaviors. We then discuss how BtBC and communicative behaviors collectively can predict learning outcomes, and we suggest several causative and mechanistic models. Finally, we highlight key methodological and interpretational challenges as well as exciting opportunities for integrating research in interpersonal neuroscience with social learning, and we propose a multiperson framework for understanding how interpersonal transmission of information between individual brains shapes social learning.

A New Statistical Approach for fNIRS Hyperscanning to Predict Brain Activity of Preschoolers' Using Teacher's

Hyperscanning studies using functional Near-Infrared Spectroscopy (fNIRS) have been performed to understand the neural mechanisms underlying human-human interactions. In this study, we propose a novel methodological approach that is developed for fNIRS multi-brain analysis. Our method uses support vector regression (SVR) to predict one brain activity time series using another as the predictor. We applied the proposed methodology to explore the teacher-student interaction, which plays a critical role in the formal learning process. In an illustrative application, we collected fNIRS data of the teacher and preschoolers’ dyads performing an interaction task. The teacher explained to the child how to add two numbers in the context of a game. The Prefrontal cortex and temporal-parietal junction of both teacher and student were recorded. A multivariate regression model was built for each channel in each dyad, with the student’s signal as the response variable and the teacher’s ones as the predictors. We compared the predictions of SVR with the conventional ordinary least square (OLS) predictor. The results predicted by the SVR model were statistically significantly correlated with the actual test data at least one channel-pair for all dyads. Overall, 29/90 channel-pairs across the five dyads (18 channels 5 dyads = 90 channel-pairs) presented significant signal predictions withthe SVR approach. The conventional OLS resulted in only 4 out of 90 valid predictions. These results demonstrated that the SVR could be used to perform channel-wise predictions across individuals, and the teachers’ cortical activity can be used to predict the student brain hemodynamic response.

Synchronous vs. non-synchronous imitation: Using dance to explore interpersonal coordination during observational learning

Observational learning can enhance the acquisition and performance quality of complex motor skills. While an extensive body of research has focused on the benefits of synchronous (i.e., concurrent physical practice) and non-synchronous (i.e., delayed physical practice) observational learning strategies, the question remains as to whether these approaches differentially influence performance outcomes. Accordingly, we investigate the differential outcomes of synchronous and non-synchronous observational training contexts using a novel dance sequence. Using multidimensional cross-recurrence quantification analysis, movement time-series were recorded for novice dancers who either synchronised with (n = 22) or observed and then imitated (n = 20) an expert dancer. Participants performed a 16-count choreographed dance sequence for 20 trials assisted by the expert, followed by one final, unassisted performance trial. Although end-state performance did not significantly differ between synchronous and non-synchronous learners, a significant decline in performance quality from imitation to independent replication was shown for synchronous learners. A non-significant positive trend in performance accuracy was shown for non-synchronous learners. For all participants, better imitative performance across training trials led to better end-state performance, but only for the accuracy (and not timing) of movement reproduction. Collectively, the results suggest that synchronous learners came to rely on a real-time mapping process between visual input from the expert and their own visual and proprioceptive intrinsic feedback, to the detriment of learning. Thus, the act of synchronising alone does not ensure an appropriate training context for advanced sequence learning.

Social processing by the primate medial frontal cortex

The primate medial frontal cortex is comprised of several brain regions that are consistently implicated in regulating complex social behaviors. The medial frontal cortex is also critically involved in many non-social behaviors, such as those involved in reward, affective, and decision-making processes, broadly implicating the fundamental role of the medial frontal cortex in internally guided cognition. An essential question therefore is what unique contributions, if any, does the medial frontal cortex make to social behaviors? In this chapter, we outline several neural algorithms necessary for mediating adaptive social interactions and discuss selected evidence from behavioral neurophysiology experiments supporting the role of the medial frontal cortex in implementing these algorithms. By doing so, we primarily focus on research in nonhuman primates and examine several key attributes of the medial frontal cortex. Specifically, we review neuronal substrates in the medial frontal cortex uniquely suitable for enabling social monitoring, observational and vicarious learning, as well as predicting the behaviors of social partners. Moreover, by utilizing the three levels of organization in information processing systems proposed by Marr (1982) and recently adapted by Lockwood, Apps, and Chang (2020) for social information processing, we survey selected social functions of the medial frontal cortex through the lens of socially relevant algorithms and implementations. Overall, this chapter provides a broad overview of the behavioral neurophysiology literature endorsing the importance of socially relevant neural algorithms implemented by the primate medial frontal cortex for regulating social interactions.