Decoupled circular-polarized dual-head volume coil pair for studying two interacting human brains with dyadic fMRI

Naturalistic Hyperscanning with Wearable Magnetoencephalography

The evolution of human cognitive function is reliant on complex social interactions which form the behavioural foundation of who we are. These social capacities are subject to dramatic change in disease and injury; yet their supporting neural substrates remain poorly understood. Hyperscanning employs functional neuroimaging to simultaneously assess brain activity in two individuals and offers the best means to understand the neural basis of social interaction. However, present technologies are limited, either by poor performance (low spatial/temporal precision) or an unnatural scanning environment (claustrophobic scanners, with interactions via video). Here, we describe hyperscanning using wearable magnetoencephalography (MEG) based on optically pumped magnetometers (OPMs). We demonstrate our approach by simultaneously measuring brain activity in two subjects undertaking two separate tasks-an interactive touching task and a ball game. Despite large and unpredictable subject motion, sensorimotor brain activity was delineated clearly, and the correlation of the envelope of neuronal oscillations between the two subjects was demonstrated. Our results show that unlike existing modalities, OPM-MEG combines high-fidelity data acquisition and a naturalistic setting and thus presents significant potential to investigate neural correlates of social interaction.

Hybrid active and passive local shimming (HAPLS) for two-region MRI

PURPOSE

An MRI scanner is equipped with global shim systems for shimming one region of interest (ROI) only. However, it often fails to reach state-of-the-art when shimming two isolated regions of interest simultaneously, even though the two-area shimming can be essential in scan scenarios, such as bilateral breasts or dyadic brains. To address these challenges, a hybrid active and passive local shimming technique is proposed to simultaneously shim two isolated region-of-interest areas within the whole FOV.

METHODS

A local passive shimming system is constructed by optimized bilateral ferromagnetic chip arrays to compensate for the magnet's significant high-order B0 inhomogeneities at the boundary of the manufacturer's specified homogeneous volume, thus locally improving the available FOV. The local active shimming consists of 40-channel DC loops powered by 64-channel current amplifiers. With the optimized current distribution, active shimming can correct the residual low-order B0 inhomogeneities and subject-specific field inhomogeneities. In addition, active shimming is used to homogenize the center frequencies of the two regions.

RESULTS

With the implementation of the hybrid active and passive local shimming, the 95% peak-to-peak was reduced from 1.92 to 1.12 ppm by 41.7%, and RMS decreased from 0.473 to 0.255 ppm by 46.1% in a two-phantom experiment. The volume ratio containing MR voxels within a 0.5-ppm frequency span increased from 64.3% to 81.3% by 26.3%.

CONCLUSION

The proposed hybrid active and passive local shimming technique uses both passive and active local shimming, and it can efficiently shim two areas simultaneously, which is an unmet need for a commercial MRI scanner.

Two-monkey fMRI setup for investigating multifaceted aspects of social cognition and behavior involving a real-live conspecific

While brain research over the past decades has shed light on the neural correlates of social cognition and behavior in human and non-human primates, most of this research has been performed in virtual settings requiring subjects to observe pictures or recorded videos instead of observing or interacting with another real-live individual. Here we present a two-monkey fMRI setup, allowing examining whole brain responses in macaque monkeys while they observe or interact face-to-face with another real-live conspecific. We tested this setup by comparing overall brain responses during observation of conspecific hand actions in a virtual (observation of recorded videos of actions) or live context (observation of a real-live conspecific performing actions). This dyadic monkey fMRI setup allows examining brain-wide responses in macaque monkeys during different aspects of social behavior, including observation of real-live actions and sensations, social facilitation, joint-attention and social interactions.

Simultaneous functional MRI of two awake marmosets

Social cognition is a dynamic process that requires the perception and integration of a complex set of idiosyncratic features between interacting conspecifics. Here we present a method for simultaneously measuring the whole-brain activation of two socially interacting marmoset monkeys using functional magnetic resonance imaging. MRI hardware (a radiofrequency coil and peripheral devices) and image-processing pipelines were developed to assess brain responses to socialization, both on an intra-brain and inter-brain level. Notably, the brain activation of a marmoset when viewing a second marmoset in-person versus when viewing a pre-recorded video of the same marmoset-i.e., when either capable or incapable of socially interacting with a visible conspecific-demonstrates increased activation in the face-patch network. This method enables a wide range of possibilities for potentially studying social function and dysfunction in a non-human primate model.

Levels of naturalism in social neuroscience research

In order to understand ecologically meaningful social behaviors and their neural substrates in humans and other animals, researchers have been using a variety of social stimuli in the laboratory with a goal of extracting specific processes in real-life scenarios. However, certain stimuli may not be sufficiently effective at evoking typical social behaviors and neural responses. Here, we review empirical research employing different types of social stimuli by classifying them into five levels of naturalism. We describe the advantages and limitations while providing selected example studies for each level. We emphasize the important trade-off between experimental control and ecological validity across the five levels of naturalism. Taking advantage of newly emerging tools, such as real-time videos, virtual avatars, and wireless neural sampling techniques, researchers are now more than ever able to adopt social stimuli at a higher level of naturalism to better capture the dynamics and contingency of real-life social interaction.

Beyond synchrony: the capacity of fMRI hyperscanning for the study of human social interaction

Hyperscanning-simultaneous brain scanning of two or more individuals-holds great promise in elucidating the neurobiological underpinnings of social cognitive functions. This article focuses on functional magnetic resonance imaging (fMRI) hyperscanning and identifies promising targets for studying the neuroscience of social interaction with fMRI hyperscanning. Specifically, we present applications of fMRI hyperscanning in the study of social interaction along with promising analysis approaches for fMRI hyperscanning, with its high spatial and low temporal resolution. We first review fMRI hyperscanning studies in social neuroscience and evaluate the premise of using this costly neuroimaging paradigm. Many second-person social neuroscience studies are possible without fMRI hyperscanning. However, certain fundamental aspects of social cognition in real-life social interactions, including different roles of interactors, shared intention emerging through interaction and history of interaction, can be addressed only with hyperscanning. We argue that these fundamental aspects have not often been investigated in fMRI hyperscanning studies. We then discuss the implication of the signal coupling found in fMRI hyperscanning and consider analysis approaches that make fair use of it. With fMRI hyperscanning, we can explore not only synchronous brain activations but whole-brain asymmetric activation patterns with a lagged association between interacting individuals.

Neural Correlates of Group Versus Individual Problem Solving Revealed by fMRI

Group problem solving is a prototypical complex collective intellectual activity. Psychological research provides compelling evidence that problem solving in groups is both qualitatively and quantitatively different from doing so alone. However, the question of whether individual and collective problem solving involve the same neural substrate has not yet been addressed, mainly due to methodological limitations. In the current study, functional magnetic resonance imaging was performed to compare brain activation when participants solved Raven-like matrix problems in a small group and individually. In the group condition, the participant in the scanner was able to discuss the problem with other team members using a special communication device. In the individual condition, the participant was required to think aloud while solving the problem in the silent presence of the other team members. Greater activation was found in several brain regions during group problem solving, including the medial prefrontal cortex; lateral parietal, cingulate, precuneus and retrosplenial cortices; frontal and temporal poles. These areas have been identified as potential components of the so-called "social brain" on the basis of research using offline judgments of material related to socializing. Therefore, this study demonstrated the actual involvement of these regions in real-time social interactions, such as group problem solving. However, further connectivity analysis revealed that the social brain components are co-activated, but do not increase their coupling during cooperation as would be suggested for a holistic network. We suggest that the social mode of the brain may be described instead as a re-configuration of connectivity between basic networks, and we found decreased connectivity between the language and salience networks in the group compared to the individual condition. A control experiment showed that the findings from the main experiment cannot be entirely accounted for by discourse comprehension. Thus, the study demonstrates affordances provided by the presented new technique for neuroimaging the "group mind," implementing the single-brain version of the second-person neuroscience approach.

Imaging Real-Time Tactile Interaction With Two-Person Dual-Coil fMRI

Studies of brain mechanisms supporting social interaction are demanding because real interaction only occurs when persons are in contact. Instead, most brain imaging studies scan subjects individually. Here we present a proof-of-concept demonstration of two-person blood oxygenation dependent (BOLD) imaging of brain activity from two individuals interacting inside the bore of a single MRI scanner. We developed a custom 16-channel (8 + 8 channels) two-helmet coil with two separate receiver-coil pairs providing whole-brain coverage, while bringing participants into a shared physical space and realistic face-to-face contact. Ten subject pairs were scanned with the setup. During the experiment, subjects took turns in tapping each other's lip versus observing and feeling the taps timed by auditory instructions. Networks of sensorimotor brain areas were engaged alternatingly in the subjects during executing motor actions as well as observing and feeling them; these responses were clearly distinguishable from the auditory responses occurring similarly in both participants. Even though the signal-to-noise ratio of our coil system was compromised compared with standard 32-channel head coils, our results show that the two-person fMRI scanning is feasible for studying the brain basis of social interaction.

Interbrain cortical synchronization encodes multiple aspects of social interactions in monkey pairs

While it is well known that the primate brain evolved to cope with complex social contingencies, the neurophysiological manifestation of social interactions in primates is not well understood. Here, concurrent wireless neuronal ensemble recordings from pairs of monkeys were conducted to measure interbrain cortical synchronization (ICS) during a whole-body navigation task that involved continuous social interaction of two monkeys. One monkey, the passenger, was carried in a robotic wheelchair to a food dispenser, while a second monkey, the observer, remained stationary, watching the passenger. The two monkeys alternated the passenger and the observer roles. Concurrent neuronal ensemble recordings from the monkeys' motor cortex and the premotor dorsal area revealed episodic occurrence of ICS with probability that depended on the wheelchair kinematics, the passenger-observer distance, and the passenger-food distance - the social-interaction factors previously described in behavioral studies. These results suggest that ICS represents specific aspects of primate social interactions.

Sharing the social world via intersubject neural synchronisation

Sociability and capability of shared mental states are hallmarks of the human species, and pursuing shared goals oftentimes requires coordinating both behaviour and mental states. Here we review recent work using indices of intersubject neural synchronisation for measuring similarity of mental states across individuals. We discuss the methodological advances and limitations in the analyses based on intersubject synchrony, and discuss how these kinds of model-free analysis techniques enable the investigation of the brain basis of complex social processes. We argue that similarity of brain activity across individuals can be used, under certain conditions, to index the similarity of their subjective states of consciousness, and thus be used for investigating brain basis of mutual understanding and cooperation.

Neural Substrate of Group Mental Health: Insights from Multi-Brain Reference Frame in Functional Neuroimaging

Contemporary mental health practice primarily centers around the neurobiological and psychological processes at the individual level. However, a more careful consideration of interpersonal and other group-level attributes (e.g., interpersonal relationship, mutual trust/hostility, interdependence, and cooperation) and a better grasp of their pathology can add a crucial dimension to our understanding of mental health problems. A few recent studies have delved into the interpersonal behavioral processes in the context of different psychiatric abnormalities. Neuroimaging can supplement these approaches by providing insight into the neurobiology of interpersonal functioning. Keeping this view in mind, we discuss a recently developed approach in functional neuroimaging that calls for a shift from a focus on neural information contained within brain space to a multi-brain framework exploring degree of similarity/dissimilarity of neural signals between multiple interacting brains. We hypothesize novel applications of quantitative neuroimaging markers like inter-subject correlation that might be able to evaluate the role of interpersonal attributes affecting an individual or a group. Empirical evidences of the usage of these markers in understanding the neurobiology of social interactions are provided to argue for their application in future mental health research.

Cluster imaging of multi-brain networks (CIMBN): a general framework for hyperscanning and modeling a group of interacting brains

Studying the neural basis of human social interactions is a key topic in the field of social neuroscience. Brain imaging studies in this field usually focus on the neural correlates of the social interactions between two participants. However, as the participant number further increases, even by a small amount, great difficulties raise. One challenge is how to concurrently scan all the interacting brains with high ecological validity, especially for a large number of participants. The other challenge is how to effectively model the complex group interaction behaviors emerging from the intricate neural information exchange among a group of socially organized people. Confronting these challenges, we propose a new approach called "Cluster Imaging of Multi-brain Networks" (CIMBN). CIMBN consists of two parts. The first part is a cluster imaging technique with high ecological validity based on multiple functional near-infrared spectroscopy (fNIRS) systems. Using this technique, we can easily extend the simultaneous imaging capacity of social neuroscience studies up to dozens of participants. The second part of CIMBN is a multi-brain network (MBN) modeling method based on graph theory. By taking each brain as a network node and the relationship between any two brains as a network edge, one can construct a network model for a group of interacting brains. The emergent group social behaviors can then be studied using the network's properties, such as its topological structure and information exchange efficiency. Although there is still much work to do, as a general framework for hyperscanning and modeling a group of interacting brains, CIMBN can provide new insights into the neural correlates of group social interactions, and advance social neuroscience and social psychology.

Dual logic and cerebral coordinates for reciprocal interaction in eye contact

In order to scientifically study the human brain’s response to face-to-face social interaction, the scientific method itself needs to be reconsidered so that both quantitative observation and symbolic reasoning can be adapted to the situation where the observer is also observed. In light of the recent development of dyadic fMRI which can directly observe dyadic brain interacting in one MRI scanner, this paper aims to establish a new form of logic, dual logic, which provides a theoretical platform for deductive reasoning in a complementary dual system with emergence mechanism. Applying the dual logic in the dfMRI experimental design and data analysis, the exogenous and endogenous dual systems in the BOLD responses can be identified; the non-reciprocal responses in the dual system can be suppressed; a cerebral coordinate for reciprocal interaction can be generated. Elucidated by dual logic deductions, the cerebral coordinate for reciprocal interaction suggests: the exogenous and endogenous systems consist of the empathy network and the mentalization network respectively; the default-mode network emerges from the resting state to activation in the endogenous system during reciprocal interaction; the cingulate plays an essential role in the emergence from the exogenous system to the endogenous system. Overall, the dual logic deductions are supported by the dfMRI experimental results and are consistent with current literature. Both the theoretical framework and experimental method set the stage to formally apply the scientific method in studying complex social interaction.

Dual logic and dual neural basis for reciprocal social interaction in eye contact

Dyadic brain interactions during eye contact engage multiple processes and recruit multiple networks. To fully characterize these concurrent activities, it's essential to establish the neural basis for reciprocal social interaction. So far most approaches in this pursuit suffered from the limitations in either insufficient dyadic test instruments or entwined reciprocal and non-reciprocal cerebral responses. To address these two challenges, this study not only employed a dual-head coil to directly acquire dyadic fMRI data, but also developed a dual logic to deductively untwine the reciprocal social interactive state and non-reciprocal affective state in cerebral responses. As results, a data-driven neural basis for visual reciprocal interaction is derived, which mainly consists of imitation-empathy network and mentalizing network to facilitate the exogenous and endogenous dual processes. Applications of the neural basis in extracting dyadic network synchronizations are exemplified. In addition, the dual logic formulated emergence of the endogenous process and predicted the default-mode network.

Emergence of the default-mode network from resting-state to activation-state in reciprocal social interaction via eye contact

The default-mode network has been identified as a resting state BOLD response that is often associated with self-referential or sensory task-passive processes. Many recent studies reveal that this vaguely defined network often plays an essential role in many pervasive mental diseases. By taking advantage of the recent development of dyadic fMRI, this study presents the initial experimental evidence that the default-mode network emerges from resting-state to activation-state in social interaction during live eye contact. Moreover, by comparing the BOLD responses between dyadic fMRI and monadic fMRI, it suggests that live eye contact excites empathy networks in the exogenous system which further activates the default mode network in endogenous system; whereas seeing eyes in face pictures activates completely different brain responses in which the default-mode network remains in resting-state.

From naturalistic neuroscience to modeling radical embodiment with narrative enactive systems

Mainstream cognitive neuroscience has begun to accept the idea of embodied mind, which assumes that the human mind is fundamentally constituted by the dynamical interactions of the brain, body, and the environment. In today's paradigm of naturalistic neurosciences, subjects are exposed to rich contexts, such as video sequences or entire films, under relatively controlled conditions, against which researchers can interpret changes in neural responses within a time window. However, from the point of view of radical embodied cognitive neuroscience, the increasing complexity alone will not suffice as the explanatory apparatus for dynamical embodiment and situatedness of the mind. We suggest that narrative enactive systems with dynamically adaptive content as stimuli, may serve better to account for the embodied mind engaged with the surrounding world. Among the ensuing challenges for neuroimaging studies is how to interpret brain data against broad temporal contexts of previous experiences that condition the unfolding experience of nowness. We propose means to tackle this issue, as well as ways to limit the exponentially growing combinatoria of narrative paths to a controllable number.

Social neuroscience and hyperscanning techniques: past, present and future

This paper reviews the published literature on the hyperscanning methodologies using hemodynamic or neuro-electric modalities. In particular, we describe how different brain recording devices have been employed in different experimental paradigms to gain information about the subtle nature of human interactions. This review also included papers based on single-subject recordings in which a correlation was found between the activities of different (non-simultaneously recorded) participants in the experiment. The descriptions begin with the methodological issues related to the simultaneous measurements and the descriptions of the results generated by such approaches will follow. Finally, a discussion of the possible future uses of such new approaches to explore human social interactions will be presented.

Enactive cinema paves way for understanding complex real-time social interaction in neuroimaging experiments

We outline general theoretical and practical implications of what we promote as enactive cinema for the neuroscientific study of online socio-emotional interaction. In a real-time functional magnetic resonance imaging (rt-fMRI) setting, participants are immersed in cinematic experiences that simulate social situations. While viewing, their physiological reactions—including brain responses—are tracked, representing implicit and unconscious experiences of the on-going social situations. These reactions, in turn, are analyzed in real-time and fed back to modify the cinematic sequences they are viewing while being scanned. Due to the engaging cinematic content, the proposed setting focuses on living-by in terms of shared psycho-physiological epiphenomena of experience rather than active coping in terms of goal-oriented motor actions. It constitutes a means to parametrically modify stimuli that depict social situations and their broader environmental contexts. As an alternative to studying the variation of brain responses as a function of a priori fixed stimuli, this method can be applied to survey the range of stimuli that evoke similar responses across participants at particular brain regions of interest.