Relational neuroscience: Insights from hyperscanning research

Humans are highly social, typically without this ability requiring noticeable efforts. Yet, such social fluency poses challenges both for the human brain to compute and for scientists to study. Over the last few decades, neuroscientific research of human sociality has witnessed a shift in focus from single-brain analysis to complex dynamics occurring across several brains, posing questions about what these dynamics mean and how they relate to multifaceted behavioural models. We propose the term 'Relational Neuroscience' to collate the interdisciplinary research field devoted to modelling the inter-brain dynamics subserving human connections, spanning from real-time joint experiences to long-term social bonds. Hyperscanning, i.e., simultaneously measuring brain activity from multiple individuals, has proven to be a highly promising technique to investigate inter-brain dynamics. Here, we discuss how hyperscanning can help investigate questions within the field of Relational Neuroscience, considering a variety of subfields, including cooperative interactions in dyads and groups, empathy, attachment and bonding, and developmental neuroscience. While presenting Relational Neuroscience in the light of hyperscanning, our discussion also takes into account behaviour, physiology and endocrinology to properly interpret inter-brain dynamics within social contexts. We consider the strengths but also the limitations and caveats of hyperscanning to answer questions about interacting people. The aim is to provide an integrative framework for future work to build better theories across a variety of contexts and research subfields to model human sociality.

The neurosociological paradigm of the metaverse

Metaverse integrates people into the virtual world, and challenges depend on advances in human, technological, and procedural dimensions. Until now, solutions to these challenges have not involved extensive neurosociological research. The study explores the pioneering neurosociological paradigm in metaverse, emphasizing its potential to revolutionize our understanding of social interactions through advanced methodologies such as hyperscanning and interbrain synchrony. This convergence presents unprecedented opportunities for neurotypical and neurodivergent individuals due to technology personalization. Traditional face-to-face, interbrain coupling, and metaverse interactions are empirically substantiated. Biomarkers of social interaction as feedback between social brain networks and metaverse is presented. The innovative contribution of findings to the broader literature on metaverse and neurosociology is substantiated. This article also discusses the ethical aspects of integrating the neurosociological paradigm into the metaverse.

Embodied hyperscanning for studying social interaction: A scoping review of simultaneous brain and body measurements

We systematically investigated the application of embodied hyperscanning methodologies in social neuroscience research. Hyperscanning enables the simultaneous recording of neurophysiological and physiological signals from multiple participants. We highlight the trend toward integrating Mobile Brain/Body Imaging (MoBI) within the 4E research framework, which emphasizes the interconnectedness of brain, body, and environment. Our analysis revealed a geographic concentration of studies in the Global North, calling for global collaboration and transcultural research to balance the field. The predominant use of Magneto/Electroencephalogram (M/EEG) in these studies suggests a traditional brain-centric perspective in social neuroscience. Future research directions should focus on integrating diverse techniques to capture the dynamic interplay between brain and body functions in real-world contexts. Our review also finds a preference for tasks involving natural settings. Nevertheless, the analysis in hyperscanning studies is often limited to physiological signal synchrony between participants. This suggests a need for more holistic and complex approaches that combine inter-corporeal synchrony with intra-individual measures. We believe that the future of the neuroscience of relationships lies in embracing the complexity of cognition, integrating diverse methods and theories to enrich our grasp of human social behavior in its natural contexts.

Hyperscanning literature after two decades of neuroscientific research: A scientometric review

Hyperscanning, a neuroimaging approach introduced in 2002 for simultaneously recording the brain activity of multiple participants, has significantly contributed to our understanding of social interactions. Nevertheless, the existing literature requires systematic organization to advance our knowledge. This study, after two decades of hyperscanning research, aims to identify the primary thematic domains and the most influential documents in the field. We conducted a scientometric analysis to examine co-citation patterns quantitatively, using a sample of 548 documents retrieved from Scopus and their 32,022 cited references. Our analysis revealed ten major thematic domains in hyperscanning research, with the most impactful document authored by Czeszumski and colleagues in 2020. Notably, while hyperscanning was initially developed for functional magnetic resonance imaging (fMRI), our findings indicate a substantial influence of research conducted using electroencephalography (EEG) and functional near-infrared spectroscopy (fNIRS). The introduction of fNIRS and advancements in EEG methods have enabled the implementation of more ecologically valid experiments for investigating social interactions. The study also highlights the need for more research that combines multi-brain neural stimulation with neuroimaging techniques to understand the causal role played by interpersonal neural synchrony in social interactions.

From physical to digital: A theoretical-methodological primer on designing hyperscanning investigations to explore remote exchanges

As individuals increasingly engage in social interactions through digital mediums, understanding the neuroscientific underpinnings of such exchanges becomes a critical challenge and a valuable opportunity. In line with a second-person neuroscience approach, understanding the forms of interpersonal syntonisation that occur during digital interactions is pivotal for grasping the mechanisms underlying successful collaboration in virtual spaces. The hyperscanning paradigm, involving the simultaneous monitoring of the brains and bodies of multiple interacting individuals, seems to be a powerful tool for unravelling the neural correlates of interpersonal syntonisation in social exchanges. We posit that such approach can now open new windows on interacting brains' responses even to digitally-conveyed social cues, offering insights into how social information is processed in the absence of traditional face-to-face settings. Yet, such paradigm shift raises challenging methodological questions, which should be answered properly to conduct significant and informative hyperscanning investigations. Here, we provide an introduction to core methodological issues dedicated to novices approaching the design of hyperscanning investigations of remote exchanges in natural settings, focusing on the selection of neuroscientific devices, synchronization of data streams, and data analysis approaches. Finally, a methodological checklist for devising robust hyperscanning studies on digital interactions is presented.

A scalable and robust system for audience EEG recordings

The neural mechanisms that unfold when humans form a large group defined by an overarching context, such as audiences in theater or sports, are largely unknown and unexplored. This is mainly due to the lack of availability of a scalable system that can record the brain activity from a significantly large portion of such an audience simultaneously. Although the technology for such a system has been readily available for a long time, the high cost as well as the large overhead in human resources and logistic planning have prohibited the development of such a system. However, during the recent years reduction in technology costs and size have led to the emergence of low-cost, consumer-oriented EEG systems, developed primarily for recreational use. Here by combining such a low-cost EEG system with other off-the-shelve hardware and tailor-made software, we develop in the lab and test in a cinema such a scalable EEG hyper-scanning system. The system has a robust and stable performance and achieves accurate unambiguous alignment of the recorded data of the different EEG headsets. These characteristics combined with small preparation time and low-cost make it an ideal candidate for recording large portions of audiences.

Technologies for Multimodal Interaction in Extended Reality—A Scoping Review

When designing extended reality (XR) applications, it is important to consider multimodal interaction techniques, which employ several human senses simultaneously. Multimodal interaction can transform how people communicate remotely, practice for tasks, entertain themselves, process information visualizations, and make decisions based on the provided information. This scoping review summarized recent advances in multimodal interaction technologies for head-mounted display-based (HMD) XR systems. Our purpose was to provide a succinct, yet clear, insightful, and structured overview of emerging, underused multimodal technologies beyond standard video and audio for XR interaction, and to find research gaps. The review aimed to help XR practitioners to apply multimodal interaction techniques and interaction researchers to direct future efforts towards relevant issues on multimodal XR. We conclude with our perspective on promising research avenues for multimodal interaction technologies.