Visuo-motor interference with a virtual partner is equally present in cooperative and competitive interactions

Perceptual Training in Ice Hockey: Bridging the Eyes-Puck Gap Using Virtual Reality

BACKGROUND

Some cognitive and perceptual determinants of sports performance can be arduous to train using conventional methods. In ice-hockey, this is the case for the players' ability to identify the largest exposed area (LEA), i.e., the goal area that is the least covered by the goaltender from a puck perspective. We developed a virtual reality (VR) application to quantify and train the players' ability to identify the LEA from a wide range of shooting positions. Thirty-four professional ice-hockey players were tested. Between two test sessions, half of the players followed a specific feedback-based training (feedback group), whereas the other players practiced without feedback (control group).

RESULTS

For the players of the feedback group, perceptual performance was significantly better after training, whereas it remained unaltered for the players of the control group. For both groups, perceptual performance decreased as the amplitude of the eyes-puck difference (i.e., the difference of perspective between the eyes and the puck) increased. This relationship vanished after training for the feedback group but not for the control group.

CONCLUSIONS

We took advantage of VR technology to assess and train the perceptual ability to identify the LEA from a puck perspective, which would be difficult using traditional methods. Only 15 min of specific feedback-based training significantly and substantially improved the perceptual performance of professional ice-hockey players, thereby evidencing the effectiveness of our application for training an important perceptual skill in ice hockey.

Interpersonal Physiological Synchrony During Dyadic Joint Action Is Increased by Task Novelty and Reduced by Social Anxiety

Interpersonal physiological synchrony refers to the temporal coordination of autonomic states during social encounters. Previous studies indicate that physiological synchrony may arise during nonverbal interactions. Nevertheless, the role played by contextual and individual factors in determining its emergence is understudied. In this work, we examined heart rate synchrony during a cooperative joint action task, exploring how task constraints, novelty, and behavioral synchrony influence physiological alignment. To achieve this, we periodically modulated task demands by alternating between peer-to-peer and leader-follower dynamics, as well as between complementary and imitative movements, and their combinations. Additionally, we assessed the role of individual differences by examining the impact of dyad members' Social Anxiety and Perspective Taking levels. We further investigated how task demands and personal traits shape the perceived quality of social interactions and subject-level heart rate variability. Our findings revealed a significant increase in physiological synchrony and a decrease in perceived interaction quality when participants switched to a novel task version (i.e., during switch blocks) compared to task repetition. Task switching was also associated with increased heart rate variability. Notably, Social Anxiety negatively predicted physiological synchrony, suggesting that more socially anxious dyads were less likely to achieve physiological alignment. However, no relationship was observed between physiological synchrony and task performance. Overall, our results suggest that physiological synchrony intensifies when dyads navigate the challenge of learning a novel task together, and that both contextual and individual aspects contribute to its emergence.

It's not all in your feet: Improving penalty kick performance with human-avatar interaction and machine learning

Penalty kicks are increasingly decisive in major international football competitions. Yet, over 30% of shootout kicks are missed. The outcome of the kick often relies on the ability of the penalty taker to exploit anticipatory movements of the goalkeeper to redirect the kick toward the open side of the goal. Unfortunately, this ability is difficult to train using classical methods. We used an augmented reality simulator displaying an holographic goalkeeper to test and train penalty kick performance with 13 young elite players. Machine learning algorithms were used to optimize the learning rate by maintaining an optimal level of training difficulty. Ten training sessions of 20 kicks reduced the redirection threshold by 120 ms, which constituted a 28% reduction with respect to the baseline threshold. Importantly, redirection threshold reduction was observed for all trained players, and all things being equal, it corresponded to an estimated 35% improvement of the success rate.

Individual differences in cooperative and competitive play strategies

INTRODUCTION

Cooperation and competition are common in social interactions. It is not clear how individual differences in personality may predict performance strategies under these two contexts. We evaluated whether instructions to play cooperatively and competitively would differentially affect dyads playing a Pong video game. We hypothesized that instructions to play cooperatively would result in lower overall points scored and differences in paddle control kinematics relative to when participants were instructed to play competitively. We also predicted that higher scores in prosociality and Sportspersonship would be related to better performance during cooperative than competitive conditions.

METHODS

Pairs of participants played a Pong video game under cooperative and competitive instructions. During competitive trials, participants were instructed to score more points against one another to win the game. During the cooperative trials, participants were instructed to work together to score as few points against one another as possible. After game play, each participant completed surveys so we could measure their trait prosociality and Sportspersonship.

RESULTS

Condition was a significant predictor of where along the paddle participants hit the ball, which controlled ball exit angles. Specifically, during cooperation participants concentrated ball contacts on the paddle towards the center to produce more consistent rebound angles. We found a significant correlation of Sex and the average points scored by participants during cooperative games, competitive games, and across all trials. Sex was also significantly correlated with paddle kinematics during cooperative games. The overall scores on the prosociality and Sportspersonship surveys were not significantly correlated with the performance outcomes in cooperative and competitive games. The dimension of prosociality assessing empathic concern was significantly correlated with performance outcomes during cooperative video game play.

DISCUSSION

No Sportspersonship survey score was able to predict cooperative or competitive game performance, suggesting that Sportspersonship personality assessments are not reliable predictors of cooperative or competitive behaviors translated to a virtual game setting. Survey items and dimensions probing broader empathic concern may be more effective predictors of cooperative and competitive performance during interactive video game play. Further testing is encouraged to assess the efficacy of prosocial personality traits as predictors of cooperative and competitive video game behavior.

Visuo-motor interference is modulated by task interactivity: A kinematic study

Extensive evidence shows that action observation can influence action execution, a phenomenon often referred to as visuo-motor interference. Little is known about whether this effect can be modulated by the type of interaction agents are involved in, as different studies show conflicting results. In the present study, we aimed at shedding light on this question by recording and analyzing the kinematic unfolding of reach-to-grasp movements performed in interactive and noninteractive settings. Using a machine learning approach, we investigated whether the extent of visuo-motor interference would be enhanced or reduced in two different joint action settings compared with a noninteractive one. Our results reveal that the detrimental effect of visuo-motor interference is reduced when the action performed by the partner is relevant to achieve a common goal, regardless of whether this goal requires to produce a concrete sensory outcome in the environment (joint outcome condition) or only a joint movement configuration (joint movement condition). These findings support the idea that during joint actions we form dyadic motor plans, in which both our own and our partner's actions are represented in predictive terms and in light of the common goal to be achieved. The formation of a dyadic motor plan might allow agents to shift from the automatic simulation of an observed action to the active prediction of the consequences of a partner's action. Overall, our results demonstrate the unavoidable impact of others' action on our motor behavior in social contexts, and how strongly this effect can be modulated by task interactivity.

Beyond speaking: neurocognitive perspectives on language production in social interaction

The human faculty to speak has evolved, so has been argued, for communicating with others and for engaging in social interactions. Hence the human cognitive system should be equipped to address the demands that social interaction places on the language production system. These demands include the need to coordinate speaking with listening, the need to integrate own (verbal) actions with the interlocutor's actions, and the need to adapt language flexibly to the interlocutor and the social context. In order to meet these demands, core processes of language production are supported by cognitive processes that enable interpersonal coordination and social cognition. To fully understand the cognitive architecture and its neural implementation enabling humans to speak in social interaction, our understanding of how humans produce language needs to be connected to our understanding of how humans gain insights into other people's mental states and coordinate in social interaction. This article reviews theories and neurocognitive experiments that make this connection and can contribute to advancing our understanding of speaking in social interaction. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

The dopaminergic system supports flexible and rewarding dyadic motor interactive behaviour in Parkinson's Disease

Studies indicate that the dopaminergic system (DAS) supports individual flexible behaviour. While flexibility is quintessential to effective dyadic motor interactions, whether DAS mediates adaptations of one's own motor behaviour to that of a partner is not known. Here, we asked patients with Parkinson's Disease (PD) to synchronize their grasping movements with those of a virtual partner in conditions that did (Interactive) or did not (Cued) require to predict and adapt to its actions. PD performed the task during daily antiparkinsonian treatment ('On' condition) or after drug-withdrawal ('Off' condition). A group of healthy individuals also served as control group. In the Interactive condition, PDs performed better and found the interaction more enjoyable when in 'On' than in 'Off' condition. Crucially, PD performance in the 'On' condition did not differ from that of healthy controls. This pattern of results hints at the key role of the DAS in supporting the flexible adaptation of one's own actions to the partner's during motor interactions.

The performance monitoring system is attuned to others' actions during dyadic motor interactions

Interpersonal motor interactions require the simultaneous monitoring of one's own and one's partner's actions. To characterize how the action monitoring system tracks self and other behavior during synchronous interactions, we combined electroencephalography recordings and immersive virtual reality in two tasks where participants were asked to synchronize their actions with those of a virtual partner (VP). The two tasks differed in the features to be monitored: the Goal task required participants to predict and monitor the VP's reaching goal; the Spatial task required participants to predict and monitor the VP's reaching trajectory. In both tasks, the VP performed unexpected movement changes to which the participant needed to adapt. By extracting the neural activity locked to the detection of unexpected changes in the VP's action (other-monitoring) or to the participants' action-replanning (self-monitoring), we show that the monitoring system is more attuned to others' than to one's own actions. Additionally, distinctive neural responses to VP's unexpected goals and trajectory corrections were found: goal changes were reflected both in early fronto-central and later posterior neural responses while trajectory deviations were reflected only in later posterior responses. Altogether, our results indicate that the monitoring system adopts an inherent social mode to handle interpersonal motor interactions.

Collective Rhythm as an Emergent Property During Human Social Coordination

The literature on social interactions has shown that participants coordinate not only at the behavioral but also at the physiological and neural levels, and that this coordination gives a temporal structure to the individual and social dynamics. However, it has not been fully explored whether such temporal patterns emerge during interpersonal coordination beyond dyads, whether this phenomenon arises from complex cognitive mechanisms or from relatively simple rules of behavior, or which are the sociocultural processes that underlie this phenomenon. We review the evidence for the existence of group-level rhythmic patterns that result from social interactions and argue that the complexity of group dynamics can lead to temporal regularities that cannot be predicted from the individual periodicities: an emergent collective rhythm. Moreover, we use this interpretation of the literature to discuss how taking into account the sociocultural niche in which individuals develop can help explain the seemingly divergent results that have been reported on the social influences and consequences of interpersonal coordination. We make recommendations on further research to test these arguments and their relationship to the feeling of belonging and assimilation experienced during group dynamics.

Midfrontal Theta tACS Facilitates Motor Coordination in Dyadic Human-Avatar Interactions

Synchronous interpersonal motor interactions require moment-to-moment prediction and proactive monitoring of the partner's actions. Neurophysiologically, this is highlighted by an enhancement of midfrontal theta (4-7 Hz) oscillations. In this study, we explored the causal role of midfrontal theta for interpersonal motor interactions using transcranial alternating current stimulation (tACS). We implemented a realistic human-avatar interaction task in immersive virtual reality where participants controlled a virtual arm and hand to press a button synchronously with a virtual partner. Participants completed the task while receiving EEG-informed theta (Experiment 1) or beta (control frequency, Experiment 2) tACS over the frontal midline, as well as sham stimulation as a control. Results showed that midfrontal theta tACS significantly improved behavioral performance (i.e., reduced interpersonal asynchrony) and participants' motor strategies (i.e., increased movement times and reduced RTs), whereas beta tACS had no effect on these measures. These results suggest that theta tACS over frontal areas facilitates action monitoring and motor abilities supporting interpersonal interactions.

From Affordances to Abstract Words: The Flexibility of Sensorimotor Grounding

The sensorimotor system plays a critical role in several cognitive processes. Here, we review recent studies documenting this interplay at different levels. First, we concentrate on studies that have shown how the sensorimotor system is flexibly involved in interactions with objects. We report evidence demonstrating how social context and situations influence affordance activation, and then focus on tactile and kinesthetic components in body-object interactions. Then, we turn to word use, and review studies that have shown that not only concrete words, but also abstract words are grounded in the sensorimotor system. We report evidence that abstract concepts activate the mouth effector more than concrete concepts, and discuss this effect in light of studies on adults, children, and infants. Finally, we pinpoint possible sensorimotor mechanisms at play in the acquisition and use of abstract concepts. Overall, we show that the involvement of the sensorimotor system is flexibly modulated by context, and that its role can be integrated and flanked by that of other systems such as the linguistic system. We suggest that to unravel the role of the sensorimotor system in cognition, future research should fully explore the complexity of this intricate, and sometimes slippery, relation.

Inter-brain amplitude correlation differentiates cooperation from competition in a motion-sensing sports game

Cooperation and competition are two basic modes of human interaction. Their underlying neural mechanisms, especially from an interpersonal perspective, have not been fully explored. Using the electroencephalograph-based hyperscanning technique, the present study investigated the neural correlates of both cooperation and competition within the same ecological paradigm using a classic motion-sensing tennis game. Both the inter-brain coupling (the inter-brain amplitude correlation and inter-brain phase-locking) and the intra-brain spectral power were analyzed. Only the inter-brain amplitude correlation showed a significant difference between cooperation and competition, with different spatial patterns at theta, alpha and beta frequency bands. Further inspection revealed distinct inter-brain coupling patterns for cooperation and competition; cooperation elicited positive inter-brain amplitude correlation at the delta and theta bands in extensive brain regions, while competition was associated with negative occipital inter-brain amplitude correlation at the alpha and beta bands. These findings add to our knowledge of the neural mechanisms of cooperation and competition and suggest the significance of adopting an inter-brain perspective in exploring the neural underpinnings of social interaction in ecological contexts.

Abstract concepts in interaction: the need of others when guessing abstract concepts smooths dyadic motor interactions

concepts (ACs, e.g. 'justice') are more complex compared with concrete concepts (CCs) (e.g. 'table'). Indeed, they do not possess a single object as a referent, they assemble quite heterogeneous members and they are more detached from exteroceptive and more grounded in interoceptive experience. Recent views have hypothesized that interpersonal communication is particularly crucial to acquire and use ACs. The current study investigates the reliance of ACs/CCs representation on interpersonal behaviour. We asked participants to perform a motor interaction task with two avatars who embodied two real confederates. Before and after the motor interaction task, the two confederates provided participants with hints in a concept guessing task associated with visual stimuli: one helped in guessing ACs and the other, CCs. A control study we performed both with the materials employed in the main experiment and with other materials, confirmed that associating verbal concepts with visual images was more difficult with ACs than with CCs. Consistently, the results of the main experiment showed that participants asked for more hints with ACs than CCs and were more synchronous when interacting with the avatar corresponding to the AC's confederate. The results highlight an important role of sociality in grounding ACs.

Inhibitory Theta Burst Stimulation Highlights the Role of Left aIPS and Right TPJ during Complementary and Imitative Human-Avatar Interactions in Cooperative and Competitive Scenarios

Competitive and cooperative interactions are based on anticipation or synchronization with the partner's actions. Both forms of interaction may either require performing imitative or complementary movements with respect to those performed by our partner. We explored how parietal regions involved in the control of imitative behavior (temporo-parietal junction, TPJ), goal coding and visuo-motor integration (anterior intraparietal sulcus, aIPS) contribute to the execution of imitative and complementary movements during cooperative and competitive interactions. To this aim, we delivered off-line non-invasive inhibitory brain stimulation to healthy individuals' left aIPS and right TPJ before they were asked to reach and grasp an object together with a virtual partner by either performing imitative or complementary interactions. In different blocks, participants were asked to compete or cooperate with the virtual partner that varied its behavior according to cooperative or competitive contexts. Left aIPS and right TPJ inhibition impaired individuals' performance (i.e., synchrony in cooperative task and anticipation in competition) during complementary and imitative interactions, respectively, in both cooperative and competitive contexts, indicating that aIPS and TPJ inhibition affects own-other action integration and action imitation (that are different in complementary vs imitative interactions) more than action synchronization or anticipation (that are different in cooperative vs competitive contexts).

Competence-based social status and implicit preference modulate the ability to coordinate during a joint grasping task

Studies indicate that social status influences people's social perceptions. Less information is available about whether induced social status influences dyadic coordination during motor interactions. To explore this issue, we designed a study in which two confederates obtained high or low competence-based status by playing a game together with the participant, while the participant always occupied the middle position of the hierarchy. Following this status-inducing phase, participants were engaged in a joint grasping task with the high- and low-status confederates in different sessions while behavioural (i.e., interpersonal asynchrony and movement start time) indexes were measured. Participants' performance in the task (i.e., level of interpersonal asynchrony) when interacting with the low-status partner was modulated by their preference for him. The lower participants' preference for a low- relative to a high-status confederate, the worse participants' performance when interacting with the low-status confederate. Our results show that participants' performance during motor interactions changes according to the social status of the interaction partner.

Interpersonal Motor Interactions Shape Multisensory Representations of the Peripersonal Space

This perspective review focuses on the proposal that predictive multisensory integration occurring in one's peripersonal space (PPS) supports individuals' ability to efficiently interact with others, and that integrating sensorimotor signals from the interacting partners leads to the emergence of a shared representation of the PPS. To support this proposal, we first introduce the features of body and PPS representations that are relevant for interpersonal motor interactions. Then, we highlight the role of action planning and execution on the dynamic expansion of the PPS. We continue by presenting evidence of PPS modulations after tool use and review studies suggesting that PPS expansions may be accounted for by Bayesian sensory filtering through predictive coding. In the central section, we describe how this conceptual framework can be used to explain the mechanisms through which the PPS may be modulated by the actions of our interaction partner, in order to facilitate interpersonal coordination. Last, we discuss how this proposal may support recent evidence concerning PPS rigidity in Autism Spectrum Disorder (ASD) and its possible relationship with ASD individuals' difficulties during interpersonal coordination. Future studies will need to clarify the mechanisms and neural underpinning of these dynamic, interpersonal modulations of the PPS.

Haptic communication optimises joint decisions and affords implicit confidence sharing

Group decisions can outperform the choices of the best individual group members. Previous research suggested that optimal group decisions require individuals to communicate explicitly (e.g., verbally) their confidence levels. Our study addresses the untested hypothesis that implicit communication using a sensorimotor channel—haptic coupling—may afford optimal group decisions, too. We report that haptically coupled dyads solve a perceptual discrimination task more accurately than their best individual members; and five times faster than dyads using explicit communication. Furthermore, our computational analyses indicate that the haptic channel affords implicit confidence sharing. We found that dyads take leadership over the choice and communicate their confidence in it by modulating both the timing and the force of their movements. Our findings may pave the way to negotiation technologies using fast sensorimotor communication to solve problems in groups.

The Human Dynamic Clamp Reveals the Fronto-Parietal Network Linking Real-Time Social Coordination and Cognition

How does the brain allow us to interact with others? Social neuroscience has already provided some answers to these questions but has tended to treat high-level, cognitive interpretations of social behavior separately from the sensorimotor mechanisms upon which they rely. The goal here is to identify the underlying neural processes and mechanisms linking sensorimotor coordination and intention attribution. We combine the human dynamic clamp, a novel paradigm for studyingrealistic social behavior, with high-resolution electroencephalography. The collection of humanness and intention attribution reports, kinematics, and neural data affords an opportunity to relate brain activity to the ongoing social behavior. Behavioral results demonstrate that sensorimotor coordination influences the judgments of cooperativeness and humanness. Analysis of brain dynamics reveals two distinct networks related to the integration of visuo-motor information from self and other which overlap over the right parietal region. Furthermore, judgment of humanness and cooperation of others modulate the functional connectivity between this right parietal hub and the prefrontal cortex. These results reveal how distributed neural dynamics integrates information from "low-level" sensorimotor mechanisms and "high-level" social cognition to support the realistic social behaviors that play out in real time during interactive scenarios.

Social Motor Priming: when offline interference facilitates motor execution

Many daily activities involve synchronizing with other people's actions. Previous literature has revealed that a slowdown of performance occurs whenever the action to be carried out is different to the one observed (i.e., visuomotor interference). However, action execution can be facilitated by observing a different action if it calls for an interactive gesture (i.e., social motor priming). The aim of this study is to investigate the costs and benefits of spontaneously processing a social response and then executing the same or a different action. Participants performed two different types of grips, which could be either congruent or not with the socially appropriate response and with the observed action. In particular, participants performed a precision grip (PG; thumb-index fingers opposition) or a whole-hand grasp (WHG; fingers-palm opposition) after observing videos showing an actor performing a PG and addressing them (interactive condition) or not (non-interactive condition). Crucially, in the interactive condition, the most appropriate response was a WHG, but in 50 percent of trials participants were asked to perform a PG. This procedure allowed us to measure both the facilitator effect of performing an action appropriate to the social context (WHG)-but different with respect to the observed one (PG)-and the cost of inhibiting it. These effects were measured by means of 3-D kinematical analysis of movement. Results show that, in terms of reaction time and movement time, the interactive request facilitated (i.e., speeded) the socially appropriate action (WHG), whereas interfered with (i.e., delayed) a different action (PG), although observed actions were always PGs. This interference also manifested with an increase of maximum grip aperture, which seemingly reflects the concurrent representation of the socially appropriate response. Overall, these findings extend previous research by revealing that physically incongruent action representations can be integrated into a single action plan even during an offline task and without any training.