Gaze interaction: anticipation-based control of the gaze of others

Eye did this! Sense of agency in eye movements

This study investigates the sense of agency (SoA) for saccades with implicit and explicit agency measures. In two eye tracking experiments, participants moved their eyes towards on-screen stimuli that subsequently changed color. Participants then either reproduced the temporal interval between saccade and color-change (Experiment 1) or reported the time points of these events with an auditory Libet clock (Experiment 2) to measure temporal binding effects as implicit indices of SoA. Participants were either made to believe to exert control over the color change or not (agency manipulation). Explicit ratings indicated that the manipulation of causal beliefs and hence agency was successful. However, temporal binding was only evident for caused effects, and only when a sufficiently sensitive procedure was used (auditory Libet clock). This suggests a feebler connection between temporal binding and SoA than previously proposed. The results also provide evidence for a relatively fast acquisition of sense of agency for previously never experienced types of action-effect associations. This indicates that the underlying processes of action control may be rooted in more intricate and adaptable cognitive models than previously thought. Oculomotor SoA as addressed in the present study presumably represents an important cognitive foundation of gaze-based social interaction (social sense of agency) or gaze-based human-machine interaction scenarios. PUBLIC SIGNIFICANCE STATEMENT: In this study, sense of agency for eye movements in the non-social domain is investigated in detail, using both explicit and implicit measures. Therefore, it offers novel and specific insights into comprehending sense of agency concerning effects induced by eye movements, as well as broader insights into agency pertaining to entirely newly acquired types of action-effect associations. Oculomotor sense of agency presumably represents an important cognitive foundation of gaze-based social interaction (social agency) or gaze-based human-machine interaction scenarios. Due to peculiarities of the oculomotor domain such as the varying degree of volitional control, eye movements could provide new information regarding more general theories of sense of agency in future research.

The Effects of Social Processing and Role Type on Attention Networks: Insights from Team Ball Athletes

(1) Background: Several findings have shown how social stimuli can influence attentional processes. Social attention is crucial in team ball sports, in which players have to react to dynamically changing, unpredictable, and externally paced environments. Our study aimed at demonstrating the influence of social processing on team ball sports athletes’ attentional abilities. (2) Methods: A total of 103 male players divided by sport (soccer, handball, and basketball) and by role (striker, midfielder, or defender) were tested through a modified version of the Attention Network Test (ANT) in which they were exposed to both social and non-social stimuli. (3) Results: Social stimuli positively impacted the athletes’ abilities to focus on target stimuli and ignore conflicting environmental requests (t = −2.600, p = 0.011 *). We also found that the athletes’ roles impacted their performance accuracy. Specifically, differences were found in the ability to maintain a general state of reactivity between athletes (strikers vs. midfielders: t = 3.303, p = 0.004 **; striker vs. defenders: t = −2.820, p = 0.017 *; midfielders vs. defenders: t = −5.876, p < 001 ***). (4) Conclusion: These findings revealed that social stimuli are crucial for performance enhancement in team ball sports athletes. Further, we suggest that it is possible to draw specific attentional profiles for athletes in different roles.

Similar proactive effect monitoring in free and forced choice action modes

When our actions yield predictable consequences in the environment, our eyes often already saccade towards the locations we expect these consequences to appear at. Such spontaneous anticipatory saccades occur based on bi-directional associations between action and effect formed by prior experience. That is, our eye movements are guided by expectations derived from prior learning history. Anticipatory saccades presumably reflect a proactive effect monitoring process that prepares a later comparison of expected and actual effect. Here, we examined whether anticipatory saccades emerged under forced choice conditions when only actions but not target stimuli were predictive of future effects and whether action mode (forced choice vs. free choice, i.e., stimulus-based vs. stimulus-independent choice) affected proactive effect monitoring. Participants produced predictable visual effects on the left/right side via forced choice and free choice left/right key presses. Action and visual effect were spatially compatible in one half of the experiment and spatially incompatible in the other half. Irrespective of whether effects were predicted by target stimuli in addition to participants' actions, in both action modes, we observed anticipatory saccades towards the location of future effects. Importantly, neither the frequency, nor latency or amplitude of these anticipatory saccades significantly differed between forced choice and free choice action modes. Overall, our findings suggest that proactive effect monitoring of future action consequences, as reflected in anticipatory saccades, is comparable between forced choice and free choice action modes.

From eye to arrow: Attention capture by direct gaze requires more than just the eyes

Human attention is strongly attracted by direct gaze and sudden onset motion. The sudden direct-gaze effect refers to the processing advantage for targets appearing on peripheral faces that suddenly establish eye contact. Here, we investigate the necessity of social information for attention capture by (sudden onset) ostensive cues. Six experiments involving 204 participants applied (1) naturalistic faces, (2) arrows, (3) schematic eyes, (4) naturalistic eyes, or schematic facial configurations (5) without or (6) with head turn to an attention-capture paradigm. Trials started with two stimuli oriented towards the observer and two stimuli pointing into the periphery. Simultaneous to target presentation, one direct stimulus changed to averted and one averted stimulus changed to direct, yielding a 2 × 2 factorial design with direction and motion cues being absent or present. We replicated the (sudden) direct-gaze effect for photographic faces, but found no corresponding effects in Experiments 2-6. Hence, a holistic and socially meaningful facial context seems vital for attention capture by direct gaze. STATEMENT OF SIGNIFICANCE: The present study highlights the significance of context information for social attention. Our findings demonstrate that the direct-gaze effect, that is, the prioritization of direct gaze over averted gaze, critically relies on the presentation of a meaningful holistic and naturalistic facial context. This pattern of results is evidence in favor of early effects of surrounding social information on attention capture by direct gaze.

A passive BCI for monitoring the intentionality of the gaze-based moving object selection

OBJECTIVE

The use of an electroencephalogram (EEG) anticipation-related component, the expectancy wave (E-wave), in brain-machine interaction was proposed more than 50 years ago. This possibility was not explored for decades, but recently it was shown that voluntary attempts to select items using eye fixations, but not spontaneous eye fixations, are accompanied by the E-wave. Thus, the use of the E-wave detection was proposed for the enhancement of gaze interaction technology, which has a strong need for a mean to decide if a gaze behaviour is voluntary or not. Here, we attempted at estimating whether this approach can be used in the context of moving object selection through smooth pursuit eye movements.

APPROACH

18 participants selected, one by one, items which moved on a computer screen, by gazing at them. In separate runs, the participants performed tasks not related to voluntary selection but also provoking smooth pursuit. A low-cost consumer-grade eye tracker was used for item selection.

MAIN RESULTS

A component resembling the E-wave was found in the averaged EEG segments time-locked to voluntary selection events of every participant. Linear discriminant analysis with shrinkage regularization (sLDA) classified the intentional and spontaneous smooth pursuit eye movements, using single-trial 300 ms long EEG segments, significantly above chance in eight participants. When the classifier output was averaged over ten subsequent data segments, median group ROC AUC of 0.75 was achieved.

SIGNIFICANCE

The results suggest the possible usefulness of the E-wave detection in the gaze-based selection of moving items, e.g., in video games. This technique might be more effective when trial data can be averaged, thus it could be considered for use in passive interfaces, for example, in estimating the degree of the user's involvement during gaze-based interaction.

How ubiquitous is the direct-gaze advantage? Evidence for an averted-gaze advantage in a gaze-discrimination task

Human eye gaze conveys an enormous amount of socially relevant information, and the rapid assessment of gaze direction is of particular relevance in order to adapt behavior accordingly. Specifically, previous research demonstrated evidence for an advantage of processing direct (vs. averted) gaze. The present study examined discrimination performance for gaze direction (direct vs. averted) under controlled presentation conditions: Using a backward-masking gaze-discrimination task, photographs of faces with direct and averted gaze were briefly presented, followed by a mask stimulus. Additionally, effects of facial context on gaze discrimination were assessed by either presenting gaze direction in isolation (i.e., by only showing the eye region) or in the context of an upright or inverted face. Across three experiments, we consistently observed a facial context effect with highest discrimination performance for faces presented in upright position, lower performance for inverted faces, and lowest performance for eyes presented in isolation. Additionally, averted gaze was generally responded to faster and with higher accuracy than direct gaze, indicating an averted-gaze advantage. Overall, the results suggest that direct gaze is not generally associated with processing advantages, thereby highlighting the important role of presentation conditions and task demands in gaze perception.

Anticipation in sociomotor actions: Similar effects for in- and outgroup interactions

In social interactions, own actions often trigger a particular response from another person. The sociomotor framework proposes that this consistent behavior of others can become incorporated into own action control. In line with this idea, recent studies have shown that own motor actions are facilitated if they are predictably being imitated rather than counterimitated by a social interaction partner. In the present study, we investigated whether this finding is influenced by the relationship between the interacting persons. To that end, we manipulated whether a participant was being imitated and counterimitated by an ingroup or by an outgroup member. In two experiments, we found a beneficial influence of being imitated irrespective of group membership. The results suggest that, while people incorporated their partner's behavior into own action control, this was not further qualified by group membership as a higher-order social variable. This finding points to a universal account of action control for actions with social action effects and actions with inanimate action effects alike.