Tracking the Leader: Gaze Behavior in Group Interactions

Interpersonal eye-tracking reveals the dynamics of interacting minds

The human eye is a rich source of information about where, when, and how we attend. Our gaze paths indicate where and what captures our attention, while changes in pupil size can signal surprise, revealing our expectations. Similarly, the pattern of our blinks suggests levels of alertness and when our attention shifts between external engagement and internal thought. During interactions with others, these cues reveal how we coordinate and share our mental states. To leverage these insights effectively, we need accurate, timely methods to observe these cues as they naturally unfold. Advances in eye-tracking technology now enable real-time observation of these cues, shedding light on mutual cognitive processes that foster shared understanding, collaborative thought, and social connection. This brief review highlights these advances and the new opportunities they present for future research.

A dual mobile eye tracking study on natural eye contact during live interactions

Human eyes convey a wealth of social information, with mutual looks representing one of the hallmark gaze communication behaviors. However, it remains relatively unknown if such reciprocal communication requires eye-to-eye contact or if general face-to-face looking is sufficient. To address this question, while recording looking behavior in live interacting dyads using dual mobile eye trackers, we analyzed how often participants engaged in mutual looks as a function of looking towards the top (i.e., the Eye region) and bottom half of the face (i.e., the Mouth region). We further examined how these different types of mutual looks during an interaction connected with later gaze-following behavior elicited in an individual experimental task. The results indicated that dyads engaged in mutual looks in various looking combinations (Eye-to-eye, Eye-to-mouth, and Mouth-to-Mouth) but proportionately spent little time in direct eye-to-eye gaze contact. However, the time spent in eye-to-eye contact significantly predicted the magnitude of later gaze following response elicited by the partner's gaze direction. Thus, humans engage in looking patterns toward different face parts during interactions, with direct eye-to-eye looks occurring relatively infrequently; however, social messages relayed during eye-to-eye contact appear to carry key information that propagates to affect subsequent individual social behavior.

A novel end-to-end dual-camera system for eye gaze synchrony assessment in face-to-face interaction

Quantification of face-to-face interaction can provide highly relevant information in cognitive and psychological science research. Current commercial glint-dependent solutions suffer from several disadvantages and limitations when applied in face-to-face interaction, including data loss, parallax errors, the inconvenience and distracting effect of wearables, and/or the need for several cameras to capture each person. Here we present a novel eye-tracking solution, consisting of a dual-camera system used in conjunction with an individually optimized deep learning approach that aims to overcome some of these limitations. Our data show that this system can accurately classify gaze location within different areas of the face of two interlocutors, and capture subtle differences in interpersonal gaze synchrony between two individuals during a (semi-)naturalistic face-to-face interaction.

When a Robot Is Your Teammate

Creating effective teamwork between humans and robots involves not only addressing their performance as a team but also sustaining the quality and sense of unity among teammates, also known as cohesion. This paper explores the research problem of: how can we endow robotic teammates with social capabilities to improve the cohesive alliance with humans? By defining the concept of a human-robot cohesive alliance in the light of the multidimensional construct of cohesion from the social sciences, we propose to address this problem through the idea of multifaceted human-robot cohesion. We present our preliminary effort from previous works to examine each of the five dimensions of cohesion: social, collective, emotional, structural, and task. We finish the paper with a discussion on how human-robot cohesion contributes to the key questions and ongoing challenges of creating robotic teammates. Overall, cohesion in human-robot teams might be a key factor to propel team performance and it should be considered in the design, development, and evaluation of robotic teammates.

Bringing social interaction at the core of organizational neuroscience

Organizations are composed of individuals working together for achieving specific goals, and interpersonal dynamics do exert a strong influence on workplace behaviour. Nevertheless, the dual and multiple perspective of interactions has been scarcely considered by Organizational Neuroscience (ON), the emerging field of study that aims at incorporating findings from cognitive and brain sciences into the investigation of organizational behaviour. This perspective article aims to highlight the potential benefits of adopting experimental settings involving two or more participants (the so-called "second person" approach) for studying the neural bases of organizational behaviour. Specifically, we stress the idea that moving beyond the individual perspective and capturing the dynamical relationships occurring within dyads or groups (e.g., leaders and followers, salespersons and clients, teams) might bring novel insights into the rising field of ON. In addition, designing research paradigms that reliably recreate real work and life situations might increase the generalizability and ecological validity of its results. We start with a brief overview of the current state of ON research and we continue by describing the second-person approach to social neuroscience. In the last paragraph, we try and outline how this approach could be extended to ON. To this end, we focus on leadership, group processes and emotional contagion as potential targets of interpersonal ON research.

Close spatial distance and direct gaze bring better communication outcomes and more intertwined neural networks

Non-verbal cues tone our communication. Previous studies found that non-verbal factors, such as spatial distance and gaze direction, significantly impact interpersonal communication. However, little is known about the behind multi-brain neural correlates and whether it could affect high-level creative group communication. Here, we provided a new, scalable, and neuro-based approach to explore the effects of non-verbal factors on different communication tasks, and revealed the underlying multi-brain neural correlates using fNIRS-based hyperscanning technique. Across two experiments, we found that closer spatial distance and more direct gaze angle could promote collaborative behaviors, improve both creative and non-creative communication outcomes, and enhance inter-brain neural synchronization. Moreover, compared to the non-creative communication task, participants' inter-brain network was more intertwined when performing the creative communication task. These findings suggest that close spatial distance and direct gaze serve as positive social cues, bringing interacting brains into alignment and optimizing inter-brain information transfer, thus improving communication outcomes.

Combining Virtual Reality and Machine Learning for Leadership Styles Recognition

The aim of this study was to evaluate the viability of a new selection procedure based on machine learning (ML) and virtual reality (VR). Specifically, decision-making behaviours and eye-gaze patterns were used to classify individuals based on their leadership styles while immersed in virtual environments that represented social workplace situations. The virtual environments were designed using an evidence-centred design approach. Interaction and gaze patterns were recorded in 83 subjects, who were classified as having either high or low leadership style, which was assessed using the Multifactor leadership questionnaire. A ML model that combined behaviour outputs and eye-gaze patterns was developed to predict subjects' leadership styles (high vs low). The results indicated that the different styles could be differentiated by eye-gaze patterns and behaviours carried out during immersive VR. Eye-tracking measures contributed more significantly to this differentiation than behavioural metrics. Although the results should be taken with caution as the small sample does not allow generalization of the data, this study illustrates the potential for a future research roadmap that combines VR, implicit measures, and ML for personnel selection.

ORB Features and Isophotes Curvature Information for Eye Center Accurate Localization

Pupil center recognition and location is an essential branch of ergonomics. It can be applied to emotion analysis and attention judgment. How to get the position of the pupil center from eye photos is the core of this field. Previous studies provided a helpful method, using scale-invariant feature transform (SIFT) to extract relevant features and combine them with the K-Nearest Neighbor (KNN) classifier. However, this method’s accuracy is not satisfying, and under some conditions, it will be position drift and other problems. We put forward a new idea to solve it by using Oriented FAST and Rotated BRIEF (ORB) features and Random Forest (RF) classifies. It is proved by experiment that our method improves the robustness of localization and the use of isophotes yields low computational cost, allowing for real-time processing. Meanwhile, we found that the ORB and RF are nearly as good, yielding an accuracy of 92.88% (BioID database).

Standing out from the crowd: Both cue numerosity and social information affect attention in multi-agent contexts

Groups of people offer abundant opportunities for social interactions. We used a two-phase task to investigate how social cue numerosity and social information about an individual affected attentional allocation in such multi-agent settings. The learning phase was a standard gaze-cuing procedure in which a stimulus face could be either uninformative or informative about the upcoming target. The test phase was a group-cuing procedure in which the stimulus faces from the learning phase were presented in groups of three. The target could either be cued by the group minority (i.e., one face) or majority (i.e., two faces) or by uninformative or informative stimulus faces. Results showed an effect of cue numerosity, whereby responses were faster to targets cued by the group majority than the group minority. However, responses to targets cued by informative identities included in the group minority were as fast as responses to targets cued by the group majority. Thus, previously learned social information about an individual was able to offset the general enhancement of cue numerosity, revealing a complex interplay between cue numerosity and social information in guiding attention in multi-agent settings.

Social information rapidly prioritizes overt but not covert attention in a joint spatial cueing task

Coordinating actions with others is crucial for our survival. Our ability to see what others are seeing and to align our visual attention with them facilitates these joint actions. In the present research, we set out to increase our understanding of such joint attention by investigating the extent to which social information would be able to prioritize overt (when moving the eyes to attend) and covert (when shifting attention without eye movements) attention in a joint spatial cueing task. Participants saw a cue and detected a target at the same or a different location alongside an unseen partner of either higher or lower social rank. In a novel twist, participants were led to believe that the cue was connected to the gaze location of their partner. In Experiment 1, where participants were told to not move their eyes (covert attention), the partner's social rank did not change how quickly participants detected targets. But in Experiment 2, where participants were free to move their eyes naturally (overt attention), inhibition of return effects (slower responses to cued than uncued targets) were modulated by their partner's social rank. These social top-down effects occurred already at a short SOA of 150 ms. Our findings suggest that overt attention might provide a key tool for joint action, as it is penetrable for social information at the early stages of information processing.

Oculomotor behavior tracks the effect of ideological priming on deception

The decision to lie to another person involves a conflict between one's own and others' interest. Political ideology may foster self-promoting or self-transcending values and thus may balance or fuel self vs. other related conflicts. Here, we explored in politically non-aligned participants whether oculomotor behavior may index the influence on moral decision-making of prime stimuli related to left and right-wing ideologies. We presented pictures of Italian politicians and ideological words in a paradigm where participants could lie to opponents with high vs. low socio-economic status to obtain a monetary reward. Results show that left-wing words decreased self-gain lies and increased other-gain ones. Oculomotor behavior revealed that gazing longer at politicians' pictures led participants to look longer at opponent's status-related information than at game's outcome-related information before the decision. This, in turn, caused participants to lie less to low status opponents. Moreover, after lying, participants averted their gaze from high status opponents and maintained it towards low status ones. Our results offer novel evidence that ideological priming influences moral decision-making and suggest that oculomotor behavior may provide crucial insights on how this process takes place.