Estimation of the cortical activity from simultaneous multi-subject recordings during the prisoner's dilemma

Winners and losers in brain computer interface competitive gaming: Directional connectivity analysis

OBJECTIVE

to characterize the direction within and between brain connectivity in winning and losing players in a competitive brain-computer interface game.

APPROACH

ten dyads (26.9 ± 4.7 years old, eight females and 12 males) participated in the study. In a competitive game based on neurofeedback, they used their relative alpha (RA) band power from the electrode location Pz, to control a virtual seesaw. The players in each pair were separated into winners (W) and losers (L) based on their scores. Intrabrain connectivity was analyzed using multivariate Granger Causality (GC) and Directed Transfer Function, while interbrain connectivity was analyzed using bivariate GC.

RESULTS

linear regression analysis revealed a significant relationship (p<0.05) between RA and individual scores. During the game, W players maintained a higher RA than L players, although it was not higher than their baseline RA. The analysis of intrabrain GC indicated that both groups engaged in general social interactions, but only the W group succeeded in controlling their brain activity at Pz. Group L applied an inappropriate metal strategy, characterized by strong activity in the left frontal cortex, indicative of collaborative gaming. Interbrain GC showed a larger flow of information from the L to the W group, suggesting a higher capability of the W group to monitor the activity of their opponent.

SIGNIFICANCE

both innate neurological indices and gaming mental strategies contribute to game outcomes. Future studies should investigate whether there is a causal relationship between these two factors.

A Two-Person Neuroscience Approach for Social Anxiety: A Paradigm With Interbrain Synchrony and Neurofeedback

Social anxiety disorder has been widely recognised as one of the most commonly diagnosed mental disorders. Individuals with social anxiety disorder experience difficulties during social interactions that are essential in the regular functioning of daily routines; perpetually motivating research into the aetiology, maintenance and treatment methods. Traditionally, social and clinical neuroscience studies incorporated protocols testing one participant at a time. However, it has been recently suggested that such protocols are unable to directly assess social interaction performance, which can be revealed by testing multiple individuals simultaneously. The principle of two-person neuroscience highlights the interpersonal aspect of social interactions that observes behaviour and brain activity from both (or all) constituents of the interaction, rather than analysing on an individual level or an individual observation of a social situation. Therefore, two-person neuroscience could be a promising direction for assessment and intervention of the social anxiety disorder. In this paper, we propose a novel paradigm which integrates two-person neuroscience in a neurofeedback protocol. Neurofeedback and interbrain synchrony, a branch of two-person neuroscience, are discussed in their own capacities for their relationship with social anxiety disorder and relevance to the paradigm. The newly proposed paradigm sets out to assess the social interaction performance using interbrain synchrony between interacting individuals, and to employ a multi-user neurofeedback protocol for intervention of the social anxiety.

Beyond physical entrainment: competitive and cooperative mental stances during identical joint-action tasks differently affect inter-subjective neural synchrony and judgments of agency

Little work has examined how mental stance alone, apart from physical entrainment, affects between-participant neural synchrony during joint social interaction. We report the first findings on how cooperative and competitive mental stances, even during identical visuomotor joint-action tasks, result in distinct neural oscillatory signatures in low beta and theta band between-participant phase synchrony. Two participants jointly controlled a cursor and were instructed to either compete or cooperate to move it to one of three targets. The visuomotor output was identical for both the compete and cooperate conditions because participants were privately given the same target for experimental trials. Cooperation enhanced theta band between-participant phase-locking value (PLV) midtrial at 1-2 seconds, reflecting activation of systems for social coordination to move the cursor in a shared direction. Competition enhanced low beta between-participant PLV, shifting from temporal to frontal regions, indicating that participants focused only on their target and later evaluated self-agency as winner or loser. This interpretation of the neural signature was corroborated by participants' greater post-trial ratings of the degree of control over the cursor during competition. Top-down cooperative and competitive mental stances shape perceptions of social context and affect interpersonal neural synchrony important for representation of self and others' actions.

Multivariate model for cooperation: bridging social physiological compliance and hyperscanning

The neurophysiological analysis of cooperation has evolved over the past 20 years, moving towards the research of common patterns in neurophysiological signals of people interacting. Social physiological compliance (SPC) and hyperscanning represent two frameworks for the joint analysis of autonomic and brain signals, respectively. Each of the two approaches allows to know about a single layer of cooperation according to the nature of these signals: SPC provides information mainly related to emotions, and hyperscanning that related to cognitive aspects. In this work, after the analysis of the state of the art of SPC and hyperscanning, we explored the possibility to unify the two approaches creating a complete neurophysiological model for cooperation considering both affective and cognitive mechanisms We synchronously recorded electrodermal activity, cardiac and brain signals of 14 cooperative dyads. Time series from these signals were extracted, and multivariate Granger causality was computed. The results showed that only when subjects in a dyad cooperate there is a statistically significant causality between the multivariate variables representing each subject. Moreover, the entity of this statistical relationship correlates with the dyad’s performance. Finally, given the novelty of this approach and its exploratory nature, we provided its strengths and limitations.

Elevated Inter-Brain Coherence Between Subjects With Concordant Stances During Discussion of Social Issues

Social media platforms offer convenient, instantaneous social sharing on a mass scale with tremendous impact on public perceptions, opinions, and behavior. There is a need to understand why information spreads including the human motivations, cognitive processes, and neural dynamics of large-scale sharing. This study introduces a novel approach for investigating the effect social media messaging and in-person discussion has on the inter-brain dynamics within small groups of participants. The psychophysiological impact of information campaigns and narrative messaging within a closed social media environment was assessed using 24-channel wireless EEG. Data were acquired from three- or four-person groups while subjects debated contemporary social issues framed by four scenarios of varying controversy: (a) investing in ethical vs. unethical corporations, (b) selecting travel destination based on social awareness, (c) determining verdict in a murder trial and the punishment of life in prison or death penalty, and (d) decision to vaccinate. Pre-/post-scenario questionnaires assess the effects of the social media information. Inter-brain coherence between subject pairs on each social issue discussed by subjects was analyzed by concordance, agreement vs. disagreement, and by group unanimity, unanimous vs. not unanimous. Subject pairs that agreed on the social issues raised in the scenarios had significantly greater inter-brain coherence in gamma frequency range than disagreeing pairs over cortical regions known to be involved in social interactions. These effects were magnified when comparing groups where subject pairs were unanimous in their stance on the social issues for some but not all scenarios. While there was considerable overlap between scenarios in what EEG channels were significant, there was enough variability to indicate the possibility of scenario-specific effects on inter-brain coherence.

Brain-to-Brain Neural Synchrony During Social Interactions: A Systematic Review on Hyperscanning Studies

The aim of this study was to conduct a comprehensive review on hyperscanning research (measuring brain activity simultaneously from more than two people interacting) using an explicit systematic method, the preferred reporting items for systematic reviews and meta-analyses (PRISMA). Data were searched from IEEE Xplore, PubMed, Engineering Village, Web of Science and Scopus databases. Inclusion criteria were journal articles written in English from 2000 to 19 June 2019. A total of 126 empirical studies were screened out to address three specific questions regarding the neuroimaging method, the application domain, and the experiment paradigm. Results showed that the most used neuroimaging method with hyperscanning was magnetoencephalography/electroencephalography (MEG/EEG; 47%), and the least used neuroimaging method was hyper-transcranial Alternating Current Stimulation (tACS) (1%). Applications in cognition accounted for almost half the studies (48%), while educational applications accounted for less than 5% of the studies. Applications in decision-making tasks were the second most common (26%), shortly followed by applications in motor synchronization (23%). The findings from this systematic review that were based on documented, transparent and reproducible searches should help build cumulative knowledge and guide future research regarding inter-brain neural synchrony during social interactions, that is, hyperscanning research.

EEG Hyperconnectivity Study on Saxophone Quartet Playing in Ensemble

A professional quartet of saxophonists playing in ensemble provides a perfect scenario to study the eventual occurrence of synchronous oscillatory brain activity across subjects. Here, we applied hyperscanning methodologies for simultaneously recordings of electroencephalographic (EEG) signals from four professional saxophonists while they observ an audiovideo recording of their own previous musical performance. An ad-hoc musical composition was written for the study. At debriefing, the subjects were asked to answer two questionnaires to assess their empathy trait and the musical leadership. In order to estimate the hyperconnectivity of each musician we proposed a measure which combines phase synchronization index of brain oscillations and graph theory framework. The inter-connectivity level of each musician was statistically compared. Statistical results revealed a significant lower hyperconnectivity in the left Brodmann area 44 for the Soprano with respect to the other three members. Recent theories attributed this brain region (Broca's area) to music generation, empathy processes and communication. We hypothesize a relationship between brain-to-brain connectivity level and the musical role within the quartet.

Cooperation and Competition with Hyperscanning Methods: Review and Future Application to Emotion Domain

Cooperation and competition, as two common and opposite examples of interpersonal dynamics, are thought to be reflected by different cognitive, neural, and behavioral patterns. According to the conventional approach, they have been explored by measuring subjects' reactions during individual performance or turn-based interactions in artificial settings, that don't allow on-line, ecological enactment of real-life social exchange. Considering the importance of these factors, and accounting for the complexity of such phenomena, the hyperscanning approach emerged as a multi-subject paradigm since it allows the simultaneous recording of the brain activity from multiple participants interacting. In this view, the present paper aimed at reviewing the most significant work about cooperation and competition by EEG hyperscanning technique, which proved to be a promising tool in capturing the sudden course of social interactions. In detail, the review will consider and group different experimental tasks that have been developed so far: (1) paradigms that used rhythm, music and motor synchronization; (2) card tasks taken from the Game Theory; (3) computerized tasks; and (4) possible real-life applications. Finally, although highlighting the potential contribution of such approach, some important limitations about these paradigms will be elucidated, with a specific focus on the emotional domain.

NIRS-Based Hyperscanning Reveals Inter-brain Neural Synchronization during Cooperative Jenga Game with Face-to-Face Communication

Functional near-infrared spectroscopy (fNIRS) is an increasingly popular technology for studying social cognition. In particular, fNIRS permits simultaneous measurement of hemodynamic activity in two or more individuals interacting in a naturalistic setting. Here, we used fNIRS hyperscanning to study social cognition and communication in human dyads engaged in cooperative and obstructive interaction while they played the game of Jenga™. Novel methods were developed to identify synchronized channels for each dyad and a structural node-based spatial registration approach was utilized for inter-dyad analyses. Strong inter-brain neural synchrony (INS) was observed in the posterior region of the right middle and superior frontal gyrus, in particular Brodmann area 8 (BA8), during cooperative and obstructive interaction. This synchrony was not observed during the parallel game play condition and the dialog section, suggesting that BA8 was involved in goal-oriented social interaction such as complex interactive movements and social decision-making. INS was also observed in the dorsomedial prefrontal cortex (dmPFC), in particular Brodmann 9, during cooperative interaction only. These additional findings suggest that BA9 may be particularly engaged when theory-of-mind (ToM) is required for cooperative social interaction. The new methods described here have the potential to significantly extend fNIRS applications to social cognitive research.

Social neuroscience and hyperscanning techniques: past, present and future

This paper reviews the published literature on the hyperscanning methodologies using hemodynamic or neuro-electric modalities. In particular, we describe how different brain recording devices have been employed in different experimental paradigms to gain information about the subtle nature of human interactions. This review also included papers based on single-subject recordings in which a correlation was found between the activities of different (non-simultaneously recorded) participants in the experiment. The descriptions begin with the methodological issues related to the simultaneous measurements and the descriptions of the results generated by such approaches will follow. Finally, a discussion of the possible future uses of such new approaches to explore human social interactions will be presented.

On the interpretation of synchronization in EEG hyperscanning studies: a cautionary note

EEG Hyperscanning is a method for studying two or more individuals simultaneously with the objective of elucidating how co-variations in their neural activity (i.e., hyperconnectivity) are influenced by their behavioral and social interactions. The aim of this study was to compare the performance of different hyper-connectivity measures using (i) simulated data, where the degree of coupling could be systematically manipulated, and (ii) individually recorded human EEG combined into pseudo-pairs of participants where no hyper-connections could exist. With simulated data we found that each of the most widely used measures of hyperconnectivity were biased and detected hyper-connections where none existed. With pseudo-pairs of human data we found spurious hyper-connections that arose because there were genuine similarities between the EEG recorded from different people independently but under the same experimental conditions. Specifically, there were systematic differences between experimental conditions in terms of the rhythmicity of the EEG that were common across participants. As any imbalance between experimental conditions in terms of stimulus presentation or movement may affect the rhythmicity of the EEG, this problem could apply in many hyperscanning contexts. Furthermore, as these spurious hyper-connections reflected real similarities between the EEGs, they were not Type-1 errors that could be overcome by some appropriate statistical control. However, some measures that have not previously been used in hyperconnectivity studies, notably the circular correlation co-efficient (CCorr), were less susceptible to detecting spurious hyper-connections of this type. The reason for this advantage in performance is discussed and the use of the CCorr as an alternative measure of hyperconnectivity is advocated.

Inter-brain synchronization during coordination of speech rhythm in human-to-human social interaction

Behavioral rhythms synchronize between humans for communication; however, the relationship of brain rhythm synchronization during speech rhythm synchronization between individuals remains unclear. Here, we conducted alternating speech tasks in which two subjects alternately pronounced letters of the alphabet during hyperscanning electroencephalography. Twenty pairs of subjects performed the task before and after each subject individually performed the task with a machine that pronounced letters at almost constant intervals. Speech rhythms were more likely to become synchronized in human-human tasks than human-machine tasks. Moreover, theta/alpha (6-12 Hz) amplitudes synchronized in the same temporal and lateral-parietal regions in each pair. Behavioral and inter-brain synchronizations were enhanced after human-machine tasks. These results indicate that inter-brain synchronizations are tightly linked to speech synchronizations between subjects. Furthermore, theta/alpha inter-brain synchronizations were also found in subjects while they observed human-machine tasks, which suggests that the inter-brain synchronization might reflect empathy for others' speech rhythms.

Study of the functional hyperconnectivity between couples of pilots during flight simulation: an EEG hyperscanning study

Brain Hyperscanning, i.e. the simultaneous recording of the cerebral activity of different human subjects involved in interaction tasks, is a very recent field of Neuroscience aiming at understanding the cerebral processes generating and generated by social interactions. This approach allows the observation and modeling of the neural signature specifically dependent on the interaction between subjects, and, even more interestingly, of the functional links existing between the activities in the brains of the subjects interacting together. In this EEG hyperscanning study we explored the functional hyperconnectivity between the activity in different scalp sites of couples of Civil Aviation Pilots during different phases of a flight reproduced in a flight simulator. Results shown a dense network of connections between the two brains in the takeoff and landing phases, when the cooperation between them is maximal, in contrast with phases during which the activity of the two pilots was independent, when no or quite few links were shown. These results confirms that the study of the brain connectivity between the activity simultaneously acquired in human brains during interaction tasks can provide important information about the neural basis of the "spirit of the group".

Cortical activity and functional hyperconnectivity by simultaneous EEG recordings from interacting couples of professional pilots

Controlling an aircraft during a flight is a compelling condition, which requires a strict and well coded interaction between the crew. The interaction level between the Captain and the First Officer changes during the flight, ranging from a maximum (during takeoff and landing, as well as in case of a failure of the instrumentation or other emergency situations) to a minimum during quiet mid-flight. In this study, our aim is to investigate the neural correlates of different kinds and levels of interaction between couples of professional crew members by means of the innovative technique called brain hyperscanning, i.e. the simultaneous recording of the hemodynamic or neuroelectrical activity of different human subjects involved in interaction tasks. This approach allows the observation and modeling of the neural signature specifically dependent on the interaction between subjects, and, even more interestingly, of the functional links existing between the brain activities of the subjects interacting together. In this EEG hyperscanning study, different phases of a flight were reproduced in a professional flight simulator, which allowed, on one side, to reproduce the ecological setting of a real flight, and, on the other, to keep under control the different levels of interaction induced in the crew by means of systematic and simulated failures of the aircraft instrumentation. Results of the procedure of linear inverse estimation, together with functional hyperconnectivity estimated by means of Partial Directed Coherence, showed a dense network of connections between the activity in the two brains in the takeoff and landing phases, when the cooperation between the crew is maximal, while conversely no significant links were shown during the phases in which the activity of the two pilots was independent.