Social attention with real versus reel stimuli: toward an empirical approach to concerns about ecological validity

Dynamic and/or multimodal assessments for social cognition in neuropsychology: Results from a systematic literature review

Objective: Despite the prevalence of socio-cognitive disturbances, and their important diagnostic/therapeutic implications, the assessment of these disturbances remains scarce. This systematic review aims to identify available social cognition tools for adult assessment that use multimodal and/or dynamic social cues, specifying their strengths and limitations (e.g. from a methodological, psychometric, ecological, and clinical perspective). Method: An electronic search was conducted in Pubmed, PsychINFO, Embase and Scopus databases for articles published up to the 3th of January 2023 and the first 200 Google Scholar results on the same date. The PRISMA methodology was applied, 3884 studies were screened based on title and abstract and 329 full texts were screened. Articles using pseudo-dynamic methodologies (e.g. morphing), reported only subjective or self-reported measures, or investigated only physiological or brain activity responses were excluded. Results: In total, 149 works were included in this review, representing 65 assessment tools (i.e. 48% studying emotion recognition (n = 31), 32% Theory of Mind (n = 21), 5% empathy (n = 3), 1.5% moral cognition/social reasoning (n = 1), and 14% being multimodal (n = 9)). For each study, the tool's main characteristics, psychometric properties, ecological validity indicators and available norms are reported. The tools are presented according to social-cognitive process assessed and communication channels used. Conclusions: This study highlights the lack of validated and standardized tools. A few tools appear to partially meet some clinical needs. The development of methodologies using a first-person paradigm and taking into account the multidimensional nature of social cognition seems a relevant research endeavour for greater ecological validity.

Social inattentional blindness to idea stealing in meetings

Using a virtual reality social experiment, participants (N = 154) experienced being at the table during a decision-making meeting and identified the best solutions generated. During the meeting, one meeting participant repeated another participant's idea, presenting it as his own. Although this idea stealing was clearly visible and audible, only 30% of participants correctly identified who shared the idea first. Subsequent analyses suggest that the social environment affected this novel form of inattentional blindness. Although there was no experimental effect of team diversity on noticing, there was correlational evidence of an indirect effect of perceived team status on noticing via attentional engagement. In sum, this paper extends the inattentional blindness phenomenon to a realistic professional interaction and demonstrates how features of the social environment can reduce social inattention.

Don't look now! Social elements are harder to avoid during scene viewing

Regions of social importance (i.e., other people) attract attention in real world scenes, but it is unclear how automatic this bias is and how it might interact with other guidance factors. To investigate this, we recorded eye movements while participants were explicitly instructed to avoid looking at one of two objects in a scene (either a person or a non-social object). The results showed that, while participants could follow these instructions, they still made errors (especially on the first saccade). Crucially, there were about twice as many erroneous looks towards the person than there were towards the other object. This indicates that it is hard to suppress the prioritization of social information during scene viewing, with implications for how quickly and automatically this information is perceived and attended to.

Guidelines for reporting action simulation studies (GRASS): Proposals to improve reporting of research in motor imagery and action observation

Researchers from multiple disciplines have studied the simulation of actions through motor imagery, action observation, or their combination. Procedures used in these studies vary considerably between research groups, and no standardized approach to reporting experimental protocols has been proposed. This has led to under-reporting of critical details, impairing the assessment, replication, synthesis, and potential clinical translation of effects. We provide an overview of issues related to the reporting of information in action simulation studies, and discuss the benefits of standardized reporting. We propose a series of checklists that identify key details of research protocols to include when reporting action simulation studies. Each checklist comprises A) essential methodological details, B) essential details that are relevant to a specific mode of action simulation, and C) further points that may be useful on a case-by-case basis. We anticipate that the use of these guidelines will improve the understanding, reproduction, and synthesis of studies using action simulation, and enhance the translation of research using motor imagery and action observation to applied and clinical settings.

Age Differences in Gaze Following: Older Adults Follow Gaze More than Younger Adults When free-viewing Scenes

Previous research investigated age differences in gaze following with an attentional cueing paradigm where participants view a face with averted gaze, and then respond to a target appearing in a location congruent or incongruent with the gaze cue. However, this paradigm is far removed from the way we use gaze cues in everyday settings. Here we recorded the eye movements of younger and older adults while they freely viewed naturalistic scenes where a person looked at an object or location. Older adults were more likely to fixate and made more fixations to the gazed-at location, compared to younger adults. Our findings suggest that, contrary to what was observed in the traditional gaze-cueing paradigm, in a non-constrained task that uses contextualized stimuli older adults follow gaze as much as or even more than younger adults.

A Multi-task Platform for Profiling Cognitive and Motivational Constructs in Humans and Nonhuman Primates

Background

Understanding the neurobiological substrates of psychiatric disorders requires comprehensive evaluations of cognitive and motivational functions in preclinical research settings. The translational validity of such evaluations will be supported by (1) tasks with high construct validity that are engaging and easy to teach to human and nonhuman participants, (2) software that enables efficient switching between multiple tasks in single sessions, (3) software that supports tasks across a broad range of physical experimental setups, and (4) by platform architectures that are easily extendable and customizable to encourage future optimization and development.

New Method

We describe the Multi-task Universal Suite for Experiments ( M-USE ), a software platform designed to meet these requirements. It leverages the Unity video game engine and C# programming language to (1) support immersive and engaging tasks for humans and nonhuman primates, (2) allow experimenters or participants to switch between multiple tasks within-session, (3) generate builds that function across computers, tablets, and websites, and (4) is freely available online with documentation and tutorials for users and developers. M-USE includes a task library with seven pre-existing tasks assessing cognitive and motivational constructs of perception, attention, working memory, cognitive flexibility, motivational and affective self-control, relational long-term memory, and visuo-spatial problem solving.

Results

M-USE was used to test NHPs on up to six tasks per session, all available as part of the Task Library, and to extract performance metrics for all major cognitive and motivational constructs spanning the Research Domain Criteria (RDoC) of the National Institutes of Mental Health.

Comparison with Existing Methods

Other experiment design and control systems exist, but do not provide the full range of features available in M-USE, including a pre-existing task library for cross-species assessments; the ability to switch seamlessly between tasks in individual sessions; cross-platform build capabilities; license-free availability; and its leveraging of video-engine capabilities used to gamify tasks.

Conclusions

The new multi-task platform facilitates cross-species translational research for understanding the neurobiological substrates of higher cognitive and motivational functions.

Mood congruency affects physiological synchrony but not empathic accuracy in a naturalistic empathy task

Empathy is a crucial aspect of our daily lives, as it enhances our wellbeing and is a proxy for prosocial behavior. It encompasses two related but partially distinct components: cognitive and affective empathy. Both are susceptible to context, biases and an individual's physiological state. Few studies have explored the effects of a person's mood on these empathy components, and results are mixed. The current study takes advantage of an ecological, naturalistic empathy task - the empathic accuracy (EA) task - in combination with physiological measurements to examine and differentiate between the effects of one's mood on both empathy components. Participants were induced with positive or negative mood and presented videos of targets narrating autobiographical negative stories, selected from a Chinese empathy dataset that we developed (now publicly available). The stories were conveyed in audio-only, visual-only and full-video formats. Participants rated the target's emotional state while watching or listening to their stories, and physiological measures were taken throughout the process. Importantly, similar measures were taken from the targets when they narrated the stories, allowing a comparison between participants' and targets' measures. We found that in audio-only and visual-only conditions, participants whose moods were congruent with the target showed higher physiological synchrony than those with incongruent mood, implying a mood-congruency effect on affective empathy. However, there was no mood effect on empathic accuracy (reflecting cognitive empathy), suggesting a different influence of mood on the two empathy components.

Social attention patterns of autistic and non-autistic adults when viewing real versus reel people

LAY ABSTRACT

Early research shows that autistic adults do not attend to faces as much as non-autistic adults. However, some recent studies where autistic people are placed in scenarios with real people reveal that they attend to faces as much as non-autistic people. This study compares attention to faces in two situations. In one, autistic and non-autistic adults watched a pre-recorded video. In the other, they watched what they thought were two people in a room in the same building, via a life webcam, when in fact exactly the same video in two situations. We report the results of 32 autistic adults and 33 non-autistic adults. The results showed that autistic adults do not differ in any way from non-autistic adults when they watched what they believed was people interacting in real time. However, when they thought they were watching a video, non-autistic participants showed higher levels of attention to faces than non-autistic participants. We conclude that attention to social stimuli is the result of a combination of two processes. One innate, which seems to be different in autism, and one that is influenced by social norms, which works in the same way in autistic adults without learning disabilities. The results suggest that social attention is not as different in autism as first thought. Specifically, the study contributes to dispel long-standing deficit models regarding social attention in autism as it points to subtle differences in the use of social norms rather than impairments.

Attentional bias towards social interactions during viewing of naturalistic scenes

Human visual attention is readily captured by the social information in scenes. Multiple studies have shown that social areas of interest (AOIs) such as faces and bodies attract more attention than non-social AOIs (e.g., objects or background). However, whether this attentional bias is moderated by the presence (or absence) of a social interaction remains unclear. Here, the gaze of 70 young adults was tracked during the free viewing of 60 naturalistic scenes. All photographs depicted two people, who were either interacting or not. Analyses of dwell time revealed that more attention was spent on human than background AOIs in the interactive pictures. In non-interactive pictures, however, dwell time did not differ between AOI type. In the time-to-first-fixation analysis, humans always captured attention before other elements of the scene, although this difference was slightly larger in interactive than non-interactive scenes. These findings confirm the existence of a bias towards social information in attentional capture and suggest our attention values social interactions beyond the presence of two people.

Effects of emotional content on social inhibition of gaze in live social and non-social situations

In real-life interactions, it is crucial that humans adequately respond to others' emotional expressions. Emotion perception so far has mainly been studied in highly controlled laboratory tasks. However, recent research suggests that attention and gaze behaviour significantly differ between watching a person on a controlled laboratory screen compared to in real world interactions. Therefore, the current study aimed to investigate effects of emotional expression on participants' gaze in social and non-social situations. We compared looking behaviour towards a confederate showing positive, neutral or negative facial expressions between live social and non-social waiting room situations. Participants looked more often and longer to the confederate on the screen, than when physically present in the room. Expressions displayed by the confederate and individual traits (social anxiety and autistic traits) of participants did not reliably relate to gaze behaviour. Indications of covert attention also occurred more often and longer during the non-social, than during the social condition. Findings indicate that social norm is a strong factor modulating gaze behaviour in social contexts. PROTOCOL REGISTRATION: The stage 1 protocol for this Registered Report was accepted in principle on September 13, 2021. The protocol, as accepted by the journal, can be found at: https://doi.org/10.6084/m9.figshare.16628290 .

A new paradigm for investigating real-world social behavior and its neural underpinnings

Eye tracking and other behavioral measurements collected from patient-participants in their hospital rooms afford a unique opportunity to study natural behavior for basic and clinical translational research. We describe an immersive social and behavioral paradigm implemented in patients undergoing evaluation for surgical treatment of epilepsy, with electrodes implanted in the brain to determine the source of their seizures. Our studies entail collecting eye tracking with other behavioral and psychophysiological measurements from patient-participants during unscripted behavior, including social interactions with clinical staff, friends, and family in the hospital room. This approach affords a unique opportunity to study the neurobiology of natural social behavior, though it requires carefully addressing distinct logistical, technical, and ethical challenges. Collecting neurophysiological data synchronized to behavioral and psychophysiological measures helps us to study the relationship between behavior and physiology. Combining across these rich data sources while participants eat, read, converse with friends and family, etc., enables clinical-translational research aimed at understanding the participants' disorders and clinician-patient interactions, as well as basic research into natural, real-world behavior. We discuss data acquisition, quality control, annotation, and analysis pipelines that are required for our studies. We also discuss the clinical, logistical, and ethical and privacy considerations critical to working in the hospital setting.

Inferential Emotion Tracking reveals impaired context-based emotion processing in individuals with high Autism Quotient scores

Emotion perception is essential for successful social interactions and maintaining long-term relationships with friends and family. Individuals with autism spectrum disorder (ASD) experience social communication deficits and have reported difficulties in facial expression recognition. However, emotion recognition depends on more than just processing face expression; context is critically important to correctly infer the emotions of others. Whether context-based emotion processing is impacted in those with Autism remains unclear. Here, we used a recently developed context-based emotion perception task, called Inferential Emotion Tracking (IET), and investigated whether individuals who scored high on the Autism Spectrum Quotient (AQ) had deficits in context-based emotion perception. Using 34 videos (including Hollywood movies, home videos, and documentaries), we tested 102 participants as they continuously tracked the affect (valence and arousal) of a blurred-out, invisible character. We found that individual differences in Autism Quotient scores were more strongly correlated with IET task accuracy than they are with traditional face emotion perception tasks. This correlation remained significant even when controlling for potential covarying factors, general intelligence, and performance on traditional face perception tasks. These findings suggest that individuals with ASD may have impaired perception of contextual information, it reveals the importance of developing ecologically relevant emotion perception tasks in order to better assess and treat ASD, and it provides a new direction for further research on context-based emotion perception deficits in ASD.

A novel end-to-end dual-camera system for eye gaze synchrony assessment in face-to-face interaction

Quantification of face-to-face interaction can provide highly relevant information in cognitive and psychological science research. Current commercial glint-dependent solutions suffer from several disadvantages and limitations when applied in face-to-face interaction, including data loss, parallax errors, the inconvenience and distracting effect of wearables, and/or the need for several cameras to capture each person. Here we present a novel eye-tracking solution, consisting of a dual-camera system used in conjunction with an individually optimized deep learning approach that aims to overcome some of these limitations. Our data show that this system can accurately classify gaze location within different areas of the face of two interlocutors, and capture subtle differences in interpersonal gaze synchrony between two individuals during a (semi-)naturalistic face-to-face interaction.

I see you, you see me: the impact of social presence on social interaction processes in autistic and non-autistic people

Environments that require social interaction are complex, challenging and sometimes experienced as overwhelming by autistic people. However, all too often theories relating to social interaction processes are created, and interventions are proposed, on the basis of data collected from studies that do not involve genuine social encounters nor do they consider the perception of social presence to be a potentially influential factor. In this review, we begin by considering why face-to-face interaction research is important in this field. We then discuss how the perception of social agency and social presence can influence conclusions about social interaction processes. We then outline some insights gained from face-to-face interaction research conducted with both autistic and non-autistic people. We finish by considering the impact of social presence on cognitive processes more broadly, including theory of mind. Overall, we demonstrate that choice of stimuli in studies assessing social interaction processes has the potential to substantially alter conclusions drawn. Ecological validity matters and social presence, in particular, is a critical factor that fundamentally impacts social interaction processes in both autistic and non-autistic people. This article is part of a discussion meeting issue 'Face2face: advancing the science of social interaction'.

Re-visiting the 'mysterious myth of attention deficit': A systematic review of the recent evidence

Based on the inclusive and methodologically rigorous framework provided by Ed Zigler's developmental approach, we previously challenged what we called, 'the mysterious myth of attention deficit', the fallacy of attention as a universal deficit among persons with intellectual disability (ID). In this latest update, we conducted a systematic review of studies of essential components of attention among persons with ID published in the interim since the last iteration of the mysterious myth narrative was submitted for publication approximately a decade ago. We searched the databases PubMed and PsycINFO for English-language peer-reviewed studies published from 1 January 2011 through 5 February 2021. In keeping with the developmental approach, the two essential methodological criteria were that the groups of persons with ID were aetiologically homogeneous and that the comparisons with persons with average IQs (or with available norms) were based on an appropriate index of developmental level, or mental age. Stringent use of these criteria for inclusion served to control for bias in article selection. Articles were then categorised based on aetiological group studied and component of visual attention. Based on these criteria, 18 articles were selected for inclusion out of the 2837 that were identified. The included studies involved 547 participants: 201 participants with Down syndrome, 214 participants with Williams syndrome and 132 participants with fragile X syndrome. The findings from these articles call attention to the complexities and nuances in understanding attentional functioning across homogeneous aetiological groups and highlight that functioning must be considered in relation to aetiology; factors associated with the individual, such as developmental level, motivation, styles and biases; and factors associated with both the task, such as context, focus, social and emotional implications, and levels of environmental complexity.

Reading the room: Autistic traits, gaze behaviour, and the ability to infer social relationships

Individuals high in autistic traits can have difficulty understanding verbal and non-verbal cues, and may display atypical gaze behaviour during social interactions. The aim of this study was to examine differences among neurotypical individuals with high and low levels of autistic traits with regard to their gaze behaviour and their ability to assess peers' social status accurately. Fifty-four university students who completed the 10-item Autism Quotient (AQ-10) were eye-tracked as they watched six 20-second video clips of people ("targets") involved in a group decision-making task. Simulating natural, everyday social interactions, the video clips included moments of debate, humour, interruptions, and cross talk. Results showed that high-scorers on the AQ-10 (i.e., those with more autistic traits) did not differ from the low-scorers in either gaze behaviour or assessing the targets' relative social status. The results based on this neurotypical group of participants suggest that the ability of individuals high in autistic traits to read social cues may be preserved in certain tasks crucial to navigating day-to-day social relationships. These findings are discussed in terms of their implications for theory of mind, weak central coherence, and social motivation theories of autism.

Cognitive aids in the management of clinical emergencies: a systematic review

Clinical emergencies can be defined as unpredictable events that necessitate immediate intervention. Safety critical industries have acknowledged the difficulties of responding to such crises. Strategies to improve human performance and mitigate its limitations include the provision and use of cognitive aids, a family of tools that includes algorithms, checklists and decision aids. This systematic review evaluates the usefulness of cognitive aids in clinical emergencies. Following a systematic search of the electronic databases, we included 13 randomised controlled trials, reported in 16 publications. Each compared cognitive aids with usual care in the context of an anaesthetic, medical, surgical or trauma emergency involving adults. Most trials used only clinicians in the development and testing of the cognitive aids, and only some trials provided familiarisation with the cognitive aids before they were deployed. The primary outcome was the completeness of care delivered to the patient. Cognitive aids were associated with a reduction in the incidence of missed care steps from 43.3% to 11% (RR (95%CI) 0.29 (0.15-0.16); p < 0.001), and the quality of evidence was rated as moderate. The use of cognitive aids was related to decreases in the incidence of errors, increases in the rate of correctly performed steps and improvement in the clinical teamwork skills scores, non-technical skills scores, subjective conflict resolution scores and the global assessment of team performance. Cognitive aids had an inconsistent influence on the time to first intervention and time to complete care of the patient's condition. It is possible that this was a reflection of how common or rare the crisis in question was as well as the experience and expertise of the clinicians and team. Sufficient thought should be applied to the development of the content and design of cognitive aids, with consideration of the pre-existing guideline ecosystem. Cognitive aids should be tested before their deployment with adequate clinician and team training.

Effects of social complexity and gender on social and non-social attention in male and female autistic children: A comparison of four eye-tracking paradigms

Eye tracking has long been used to characterize differences in social attention between autistic and non-autistic children, but recent work has shown that these patterns may vary widely according to the biological sex of the participants and the social complexity and gender-typicality of the eye tracking stimuli (e.g., barbies vs. transformers). To better understand effects of sex, social complexity, and object gender-typicality on social and non-social gaze behavior in autism, we compared the visual attention patterns of 67 autistic (ASD) and non-autistic (NA) males (M) and females (F) (ASD M = 21; ASD F = 18; NA M = 14; NA F = 14) across four eye tracking paradigms varying in social complexity and object gender-typicality. We found consistency across paradigms in terms of overall attention and attention to social stimuli, but attention to objects varied when paradigms considered gender in their stimulus design. Children attended more to gendered objects, particularly when the gender-typicality of the object matched their assigned sex. These results demonstrate that visual social attention in autism is affected by interactions between a child's biological sex, social scene complexity, and object gender-typicality and have broad implications for the design and interpretation of eye tracking studies.

Idiosyncratic viewing patterns of social scenes reflect individual preferences

In general, humans preferentially look at conspecifics in naturalistic images. However, such group-based effects might conceal systematic individual differences concerning the preference for social information. Here, we investigated to what degree fixations on social features occur consistently within observers and whether this preference generalizes to other measures of social prioritization in the laboratory as well as the real world. Participants carried out a free viewing task, a relevance taps task that required them to actively select image regions that are crucial for understanding a given scene, and they were asked to freely take photographs outside the laboratory that were later classified regarding their social content. We observed stable individual differences in the fixation and active selection of human heads and faces that were correlated across tasks and partly predicted the social content of self-taken photographs. Such relationship was not observed for human bodies indicating that different social elements need to be dissociated. These findings suggest that idiosyncrasies in the visual exploration and interpretation of social features exist and predict real-world behavior. Future studies should further characterize these preferences and elucidate how they shape perception and interpretation of social contexts in healthy participants and patients with mental disorders that affect social functioning.

Infant temperamental fear, pupil dilation, and gaze aversion from smiling strangers

In childhood, higher levels of temperamental fear-an early-emerging proclivity to distress in the face of novelty-are associated with lower social responsivity and greater social anxiety. While the early emergence of temperamental fear in infancy is poorly understood, it is theorized to be driven by individual differences in reactivity and self-regulation to novel stimuli. The current study used eye tracking to capture infants' (N = 124) reactions to a video of a smiling stranger-a common social encounter-including infant gaze aversions from the stranger's face (indexing arousal regulation) and pupil dilation (indexing physiological reactivity), longitudinally at 2, 4, 6, and 8 months of age. Multilevel mixed-effects models indicated that more fearful infants took more time to look away from a smiling stranger's face than less fearful infants, suggesting that high-fear infants may have slower arousal regulation. At 2 and 4 months, more fearful infants also exhibited greater and faster pupil dilation before gaze aversions, consistent with greater physiological reactivity. Together, these findings suggest that individual differences in infants' gaze aversions and pupil dilation can index the development of fearful temperament in early infancy, facilitating the identification of, and interventions for, risk factors to social disruptions.

Reality in a sphere: A direct comparison of social attention in the laboratory and the real world

Humans often show reduced social attention in real situations, a finding rarely replicated in controlled laboratory studies. Virtual reality is supposed to allow for ecologically valid and at the same time highly controlled experiments. This study aimed to provide initial insights into the reliability and validity of using spherical videos viewed via a head-mounted display (HMD) to assess social attention. We chose five public places in the city of Würzburg and measured eye movements of 44 participants for 30 s at each location twice: Once in a real environment with mobile eye-tracking glasses and once in a virtual environment playing a spherical video of the location in an HMD with an integrated eye tracker. As hypothesized, participants demonstrated reduced social attention with less exploration of passengers in the real environment as compared to the virtual one. This is in line with earlier studies showing social avoidance in interactive situations. Furthermore, we only observed consistent gaze proportions on passengers across locations in virtual environments. These findings highlight that the potential for social interactions and an adherence to social norms are essential modulators of viewing behavior in social situations and cannot be easily simulated in laboratory contexts. However, spherical videos might be helpful for supplementing the range of methods in social cognition research and other fields. Data and analysis scripts are available at https://osf.io/hktdu/ .

Eye contact avoidance in crowds: A large wearable eye-tracking study

Eye contact is essential for human interactions. We investigated whether humans are able to avoid eye contact while navigating crowds. At a science festival, we fitted 62 participants with a wearable eye tracker and instructed them to walk a route. Half of the participants were further instructed to avoid eye contact. We report that humans can flexibly allocate their gaze while navigating crowds and avoid eye contact primarily by orienting their head and eyes towards the floor. We discuss implications for crowd navigation and gaze behavior. In addition, we address a number of issues encountered in such field studies with regard to data quality, control of the environment, and participant adherence to instructions. We stress that methodological innovation and scientific progress are strongly interrelated.

Small Pupils Lead to Lower Judgements of a Person’s Characteristics for Exaggerated, but Not for Realistic Pupils

Our eyes convey information about a person. The pupils may provide information regarding our emotional states when presented along with different emotional expressions. We examined the effects of pupil size and vergence on inferring other people’s characteristics in neutral expression eyes. Pupil sizes were manipulated by overlaying black disks onto the pupils of the original eye images. The disk area was then changed to create small, medium, and large pupils. Vergence was simulated by shifting the medium-sized disks nasally in one eye. Pupil sizes were exaggerated for Experiment 1 and followed values from the literature for Experiment 2. The first Purkinje image from the eye photos in Experiment 2 was kept to preserve image realism. The characteristics measured were sex, age, attractiveness, trustworthiness, intelligence, valence, and arousal. Participants completed one of two online experiments and rated eight eye pictures with differently sized pupils and with vergence eyes. Both experiments were identical except for the stimuli designs. Results from Experiment 1 revealed rating differences between pupil sizes for all characteristics except sex, age, and arousal. Specifically, eyes with extremely small pupil sizes and artificial vergence received the lowest ratings compared to medium and large pupil sizes. Results from Experiment 2 only indicated weak effects of pupil size and vergence, particularly for intelligence ratings. We conclude that the pupils can influence how characteristics of another person are perceived and may be regarded as important social signals in subconscious social interaction processes. However, the effects may be rather small for neutral expressions.

The Quality of Everyday Eye Contact in Williams Syndrome: Insights From Cross-Syndrome Comparisons

Past research shows that individuals with Williams syndrome (WS) have heightened and prolonged eye contact. Using parent report measures, we examined not only the presence of eye contact but also its qualitative features. Study 1 included individuals with WS (n = 22, ages 6.0-36.3). Study 2 included children with different neurodevelopmental (ND) conditions (WS, autism spectrum condition, fragile X syndrome, attention-deficit/hyperactivity disorder) and children with neurotypical development (NT; n = 262, ages 4.0-17.11). Unusual eye contact features, including staring, were found in approximately half of the WS samples. However, other features such as brief glances were frequently found in WS and in all ND conditions, but not NT. Future research in ND conditions should focus on qualitative as well as quantitative features of eye contact.

Deliberate control over facial expressions in motherhood. Evidence from a Stroop-like task

The deliberate control of facial expressions is an important ability in human interactions, in particular for mothers with prelinguistic infants. Because research on this topic is still scarce, we investigated the control over facial expressions in a Stroop-like paradigm. Mothers of 2-6 months old infants and nullipara women produced smiles and frowns in response to verbal commands written on distractor faces of adults or infants showing expressions of happiness or anger/distress. Analyses of video recordings with a machine classifier for facial expression revealed pronounced effects of congruency between the expressions required by the participants and those displayed by the face stimuli on the onset latencies of the deliberate facial expressions. With adult distractor faces this Stroop effect was similar whether participants smiled or frowned. With infant distractor faces mothers and non-mothers showed indistinguishable Stroop effects on smile responses; however, for frown responses, the Stroop effect in mothers was smaller than in non-mothers. We suggest that for frown responses in mothers when facing infants, the effect of mimicry or stimulus response compatibility, leading to the Stroop effect, is offset by a caregiving response or empathy.

Moral psychology from the lab to the wild: Relief registries as a paradigm for studying real-world altruism

Experimental psychology’s recent shift toward low-effort, high-volume methods (e.g., self-reports, online studies) and away from the more effortful study of naturalistic behavior raises concerns about the ecological validity of findings from these fields, concerns that have become particularly apparent in the field of moral psychology. To help address these concerns, we introduce a method allowing researchers to investigate an important, widespread form of altruistic behavior–charitable donations–in a manner balancing competing concerns about internal validity, ecological validity, and ease of implementation: relief registries, which leverage existing online gift registry platforms to allow research subjects to choose among highly needed donation items to ship directly to charitable organizations. Here, we demonstrate the use of relief registries in two experiments exploring the ecological validity of the finding from our own research that people are more willing to help others after having imagined themselves doing so. In this way, we sought to provide a blueprint for researchers seeking to enhance the ecological validity of their own research in a narrow sense (i.e., by using the relief registry method we introduce) and in broader terms by adapting methods that take advantage of modern technology to directly impact others’ lives outside the lab.

EXPRESS: Multisensory Perception of Natural Versus Unnatural Motion

Previous research has shown that visual perception is influenced by Newtonian constraints. Kominsky et al. (2017) showed humans detect unnatural motion, where objects break Newtonian constraints by moving at a faster speed after colliding with another object, faster than collisions that do not violate Newtonian constraints. These findings show that the perceptual system distinguishes between realistic and unrealistic causal events. However, real world collisions are rarely silent. The present study extends this research by including sound at the collision point between two objects to evaluate how multisensory integration influences the perception of natural versus unnatural colliding events. Participants viewed an array of three simultaneous videos, each depicting two objects moving in a horizontal back and forth motion. Two of the videos showed the objects moving at the same speed while the third video was an oddball that either moved faster before the collision and slower after (natural target), or slower before the collision and faster after (unnatural target). A brief click was presented at the collision point of one or none of the videos. Participants were asked to indicate the oddball video via keypress. Replicating Kominsky et al. (2017), participants were faster when identifying unnatural target motion events compared to natural target motion events, both with and without sound. The findings also demonstrated lower accuracy rates for unnatural events compared to natural events, especially when a sound was added. These findings suggest that the addition of a sound could be distracting to participants, possibly due to limitations in attentional resources.

The Effect of Social Presence on Mentalizing Behavior

Our behavior is frequently influenced by those around us. However, the majority of social cognition research is conducted using socially isolated paradigms, without the presence of real people (i.e., without a "social presence"). The current study aimed to test the influence of social presence upon a measure of mentalizing behavior in adults. Study 1 used a first-order theory of mind task; and study 2 used a second-order theory of mind task. Both studies included two conditions: live, where the task protagonists were physically present acting out the task, or recorded, where the same task protagonists demonstrated the task in a video recording. In both experiments, participants were affected by the social presence and demonstrated significantly different patterns of behavior in response to the presence of real people. This study, therefore, highlights the critical importance of understanding the effect of a social presence in mentalizing research, and suggests that the inclusion of a social presence needs to be given strong consideration across social cognition paradigms.

The Bidirectional Social-Cognitive Mechanisms of the Social-Attention Symptoms of Autism

Differences in social attention development begin to be apparent in the 6th to 12th month of development in children with Autism Spectrum Disorder (ASD) and theoretically reflect important elements of its neurodevelopmental endophenotype. This paper examines alternative conceptual views of these early social attention symptoms and hypotheses about the mechanisms involved in their development. One model emphasizes mechanism involved in the spontaneous allocation of attention to faces, or social orienting. Alternatively, another model emphasizes mechanisms involved in the coordination of attention with other people, or joint attention, and the socially bi-directional nature of its development. This model raises the possibility that atypical responses of children to the attention or the gaze of a social partner directed toward themselves may be as important in the development of social attention symptoms as differences in the development of social orienting. Another model holds that symptoms of social attention may be important to early development, but may not impact older individuals with ASD. The alterative model is that the social attention symptoms in infancy (social orienting and joint attention), and social cognitive symptoms in childhood and adulthood share common neurodevelopmental substrates. Therefore, differences in early social attention and later social cognition constitute a developmentally continuous axis of symptom presentation in ASD. However, symptoms in older individuals may be best measured with in vivo measures of efficiency of social attention and social cognition in social interactions rather than the accuracy of response on analog tests used in measures with younger children. Finally, a third model suggests that the social attention symptoms may not truly be a symptom of ASD. Rather, they may be best conceptualized as stemming from differences domain general attention and motivation mechanisms. The alternative argued for here that infant social attention symptoms meet all the criteria of a unique dimension of the phenotype of ASD and the bi-directional phenomena involved in social attention cannot be fully explained in terms of domain general aspects of attention development.

The transdiagnostic origins of anxiety and depression during the pediatric period: Linking NIMH research domain criteria (RDoC) constructs to ecological systems

In the last decade, an abundance of research has utilized the National Institute of Mental Health (NIMH) research domain criteria (RDoC) framework to examine mechanisms underlying anxiety and depression in youth. However, relatively little work has examined how these mechanistic intrapersonal processes intersect with context during childhood and adolescence. The current paper covers reviews and meta-analyses that have linked RDoC-relevant constructs to ecological systems in internalizing problems in youth. Specifically, cognitive, biological, and affective factors within the RDoC framework were examined. Based on these reviews and some of the original empirical research they cover, we highlight the integral role of ecological factors to the RDoC framework in predicting onset and maintenance of internalizing problems in youth. Specific recommendations are provided for researchers using the RDoC framework to inform future research integrating ecological systems and development. We advocate for future research and research funding to focus on better integration of the environment and development into the RDoC framework.

Gaze and speech behavior in parent–child interactions: The role of conflict and cooperation

A primary mode of human social behavior is face-to-face interaction. In this study, we investigated the characteristics of gaze and its relation to speech behavior during video-mediated face-to-face interactions between parents and their preadolescent children. 81 parent–child dyads engaged in conversations about cooperative and conflictive family topics. We used a dual-eye tracking setup that is capable of concurrently recording eye movements, frontal video, and audio from two conversational partners. Our results show that children spoke more in the cooperation-scenario whereas parents spoke more in the conflict-scenario. Parents gazed slightly more at the eyes of their children in the conflict-scenario compared to the cooperation-scenario. Both parents and children looked more at the other's mouth region while listening compared to while speaking. Results are discussed in terms of the role that parents and children take during cooperative and conflictive interactions and how gaze behavior may support and coordinate such interactions.

The Multiple Object Avoidance (MOA) task measures attention for action: Evidence from driving and sport

Performance in everyday tasks, such as driving and sport, requires allocation of attention to task-relevant information and the ability to inhibit task-irrelevant information. Yet there are individual differences in this attentional function ability. This research investigates a novel task for measuring attention for action, called the Multiple Object Avoidance task (MOA), in its relation to the everyday tasks of driving and sport. The aim in Study 1 was to explore the efficacy of the MOA task to predict simulated driving behaviour and hazard perception. Whilst also investigating its test-retest reliability and how it correlates to self-report driving measures. We found that superior performance in the MOA task predicted simulated driving performance in complex environments and was superior at predicting performance compared to the Useful Field of View task. We found a moderate test-retest reliability and a correlation between the attentional lapses subscale of the Driving Behaviour Questionnaire. Study 2 investigated the discriminative power of the MOA in sport by exploring performance differences in those that do and do not play sports. We also investigated if the MOA shared attentional elements with other measures of visual attention commonly attributed to sporting expertise: Multiple Object Tracking (MOT) and cognitive processing speed. We found that those that played sports exhibited superior MOA performance and found a positive relationship between MOA performance and Multiple Object Tracking performance and cognitive processing speed. Collectively, this research highlights the utility of the MOA when investigating visual attention in everyday contexts.

Graspability Modulates the Stronger Neural Signature of Motor Preparation for Real Objects vs. Pictures

The cognitive and neural bases of visual perception are typically studied using pictures rather than real-world stimuli. Unlike pictures, real objects are actionable solids that can be manipulated with the hands. Recent evidence from human brain imaging suggests that neural responses to real objects differ from responses to pictures; however, little is known about the neural mechanisms that drive these differences. Here, we tested whether brain responses to real objects versus pictures are differentially modulated by the "in-the-moment" graspability of the stimulus. In human dorsal cortex, electroencephalographic responses show a "real object advantage" in the strength and duration of mu (μ) and low beta (β) rhythm desynchronization-well-known neural signatures of visuomotor action planning. We compared desynchronization for real tools versus closely matched pictures of the same objects, when the stimuli were positioned unoccluded versus behind a large transparent barrier that prevented immediate access to the stimuli. We found that, without the barrier in place, real objects elicited stronger μ and β desynchronization compared to pictures, both during stimulus presentation and after stimulus offset, replicating previous findings. Critically, however, with the barrier in place, this real object advantage was attenuated during the period of stimulus presentation, whereas the amplification in later periods remained. These results suggest that the "real object advantage" is driven initially by immediate actionability, whereas later differences perhaps reflect other, more inherent properties of real objects. The findings showcase how the use of richer multidimensional stimuli can provide a more complete and ecologically valid understanding of object vision.

Effects of Transcranial Direct Current Stimulation on Cognitive and Affective Outcomes Using Virtual Stimuli: A Systematic Review

Transcranial direct current stimulation (tDCS) is a noninvasive form of brain stimulation used to influence neural activity. While early tDCS studies primarily used static stimuli, there is growing interest in dynamic stimulus presentations using virtual environments (VEs). This review attempts to convey the state of the field. This is not a quantitative meta-analysis as there are not yet enough studies following consistent protocols and/or reporting adequate data. In addition to reviewing the state of the literature, this review includes an exploratory analysis of the available data. Following preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines, studies were culled from several databases. Results from this review reveal differences between online and offline stimulation. While offline stimulation did not influence affective and cognitive outcomes, online stimulation led to small changes in affect and cognition. Future studies should include randomized controlled trials with larger samples. Furthermore, greater care needs to be applied to full data reporting (e.g., means, standard deviations, and data for their nonsignificant findings) to improve our understanding of the combined effects of virtual stimuli with tDCS.

Emotion Recognition and Context in Adolescents with Autism Spectrum Disorder

Emotion recognition research in autism has provided conflicting results and has ignored the role of context. We examined if autistic adolescents use context to identify displayed and felt emotion. Twenty adolescents with autism and 20 age-matched neurotypical adolescents identified emotions from a standardised set of images. The groups also viewed videos scenes with actors displaying a feigned emotion masking their true feelings. Participants identified the displayed and felt emotions. Both groups identified emotions from static images equally well. In the video condition, the autism group was unable to distinguish between the displayed and felt emotions. Emotion research is often divorced from context. Our findings suggest that autistic individuals have difficulty integrating contextual cues when processing emotions.

Tracking developmental differences in real-world social attention across adolescence, young adulthood and older adulthood

Detecting and responding appropriately to social information in one's environment is a vital part of everyday social interactions. Here, we report two preregistered experiments that examine how social attention develops across the lifespan, comparing adolescents (10-19 years old), young (20-40 years old) and older (60-80 years old) adults. In two real-world tasks, participants were immersed in different social interaction situations-a face-to-face conversation and navigating an environment-and their attention to social and non-social content was recorded using eye-tracking glasses. The results revealed that, compared with young adults, adolescents and older adults attended less to social information (that is, the face) during face-to-face conversation, and to people when navigating the real world. Thus, we provide evidence that real-world social attention undergoes age-related change, and these developmental differences might be a key mechanism that influences theory of mind among adolescents and older adults, with potential implications for predicting successful social interactions in daily life.

Temporal Behavioral Parameters of On-Going Gaze Encounters in a Virtual Environment

To navigate the social world, humans heavily rely on gaze for non-verbal communication as it conveys information in a highly dynamic and complex, yet concise manner: For instance, humans utilize gaze effortlessly to direct and infer the attention of a possible interaction partner. Many traditional paradigms in social gaze research though rely on static ways of assessing gaze interaction, e.g., by using images or prerecorded videos as stimulus material. Emerging gaze contingent paradigms, in which algorithmically controlled virtual characters can respond flexibly to the gaze behavior of humans, provide high ecological validity. Ideally, these are based on models of human behavior which allow for precise, parameterized characterization of behavior, and should include variable interactive settings and different communicative states of the interacting agents. The present study provides a complete definition and empirical description of a behavioral parameter space of human gaze behavior in extended gaze encounters. To this end, we (i) modeled a shared 2D virtual environment on a computer screen in which a human could interact via gaze with an agent and simultaneously presented objects to create instances of joint attention and (ii) determined quantitatively the free model parameters (temporal and probabilistic) of behavior within this environment to provide a first complete, detailed description of the behavioral parameter space governing joint attention. This knowledge is essential to enable the modeling of interacting agents with a high degree of ecological validity, be it for cognitive studies or applications in human-robot interaction.

Knowledge guides attention to goal-relevant information in older adults

How does viewers’ knowledge guide their attention while they watch everyday events, how does it affect their memory, and does it change with age? Older adults have diminished episodic memory for everyday events, but intact semantic knowledge. Indeed, research suggests that older adults may rely on their semantic memory to offset impairments in episodic memory, and when relevant knowledge is lacking, older adults’ memory can suffer. Yet, the mechanism by which prior knowledge guides attentional selection when watching dynamic activity is unclear. To address this, we studied the influence of knowledge on attention and memory for everyday events in young and older adults by tracking their eyes while they watched videos. The videos depicted activities that older adults perform more frequently than young adults (balancing a checkbook, planting flowers) or activities that young adults perform more frequently than older adults (installing a printer, setting up a video game). Participants completed free recall, recognition, and order memory tests after each video. We found age-related memory deficits when older adults had little knowledge of the activities, but memory did not differ between age groups when older adults had relevant knowledge and experience with the activities. Critically, results showed that knowledge influenced where viewers fixated when watching the videos. Older adults fixated less goal-relevant information compared to young adults when watching young adult activities, but they fixated goal-relevant information similarly to young adults, when watching more older adult activities. Finally, results showed that fixating goal-relevant information predicted free recall of the everyday activities for both age groups. Thus, older adults may use relevant knowledge to more effectively infer the goals of actors, which guides their attention to goal-relevant actions, thus improving their episodic memory for everyday activities.

Investigating facilitatory versus inhibitory effects of dynamic social and non-social cues on attention in a realistic space

This study aimed to investigate the facilitatory versus inhibitory effects of dynamic non-predictive central cues presented in a realistic environment. Realistic human-avatars initiated eye contact and then dynamically looked to the left, right or centre of a table. A moving stick served as a non-social control cue and participants localised (Experiment 1) or discriminated (Experiment 2) a contextually relevant target (teapot/teacup). The cues movement took 500 ms and stimulus onset asynchronies (SOA, 150 ms/300 ms/500 ms/1000 ms) were measured from movement initiation. Similar cuing effects were seen for the social avatar and non-social stick cue across tasks. Results showed facilitatory processes without inhibition, though there was some variation by SOA and task. This is the first time facilitatory versus inhibitory processes have been directly investigated where eye contact is initiated prior to gaze shift. These dynamic stimuli allow a better understanding of how attention might be cued in more realistic environments.

Subjectively different emotional schematic faces not automatically discriminated from the brain's bioelectrical responses

The present study investigates how the brain automatically discriminates emotional schematic faces, as indicated by the mismatch responses, and how reliable these brain responses are. Thirty-three healthy volunteers participated in the vMMN EEG experiment with four experimental sets differing from each other by the type of standard (object with scrambled face features) and the type of deviants (Angry, Happy and Neutral schematic faces) presented. Conscious subjective evaluations of valence, arousal and attention catching of the same stimuli showed clear differentiation of emotional expressions. Deviant faces elicited rather similar vMMN at frontal and occipital sites. Bayesian analyses suggest that vMMN does not differ between angry and happy faces. Neutral faces, however, did not yield statistically significant vMMN at occipital leads. Pearson's correlation and intra-class correlation analyses showed that the brain's reactions to the stimuli were highly stable within individuals across the experimental sets, whereas the mismatch responses were much more variable.

Gazing at Social Interactions Between Foraging and Decision Theory

Finding the underlying principles of social attention in humans seems to be essential for the design of the interaction between natural and artificial agents. Here, we focus on the computational modeling of gaze dynamics as exhibited by humans when perceiving socially relevant multimodal information. The audio-visual landscape of social interactions is distilled into a number of multimodal patches that convey different social value, and we work under the general frame of foraging as a tradeoff between local patch exploitation and landscape exploration. We show that the spatio-temporal dynamics of gaze shifts can be parsimoniously described by Langevin-type stochastic differential equations triggering a decision equation over time. In particular, value-based patch choice and handling is reduced to a simple multi-alternative perceptual decision making that relies on a race-to-threshold between independent continuous-time perceptual evidence integrators, each integrator being associated with a patch.

The interplay between gaze and consistency in scene viewing: Evidence from visual search by young and older adults

Searching for an object in a complex scene is influenced by high-level factors such as how much the item would be expected in that setting (semantic consistency). There is also evidence that a person gazing at an object directs our attention towards it. However, there has been little previous research that has helped to understand how we integrate top-down cues such as semantic consistency and gaze to direct attention when searching for an object. Also, there are separate lines of evidence to suggest that older adults may be more influenced by semantic factors and less by gaze cues compared to younger counterparts, but this has not been investigated before in an integrated task. In the current study we analysed eye-movements of 34 younger and 30 older adults as they searched for a target object in complex visual scenes. Younger adults were influenced by semantic consistency in their attention to objects, but were more influenced by gaze cues. In contrast, older adults were more guided by semantic consistency in directing their attention, and showed less influence from gaze cues. These age differences in use of high-level cues were apparent early in processing (time to first fixation and probability of immediate fixation) but not in later processing (total time looking at objects and time to make a response). Overall, this pattern of findings indicates that people are influenced by both social cues and prior expectations when processing a complex scene, and the relative importance of these factors depends on age.

Social anxiety is associated with heart rate but not gaze behavior in a real social interaction

BACKGROUND AND OBJECTIVES

Much of our current understanding of social anxiety rests on the use of highly restricted laboratory experiments. Latest technological developments now allow the investigation of eye movements and physiological measures during real social interactions. Considering the wealth of conflicting findings on gaze behavior in social anxiety, the current study aimed at elucidating the modulation of gaze patterns in a naturalistic setting.

METHODS

We introduced 71 participants with differing social anxiety symptoms to a waiting room situation while recording heart rate, electrodermal activity and eye movements using mobile technology.

RESULTS

We observed fewer fixations on the head of the confederate in the initial waiting phase of the experiment. These head fixations increased when the confederate was involved in a phone call and subsequently initiated an actual conversation. Contrary to gaze-avoidance models of social anxiety, we did not observe any correlations between social anxiety and visual attention but an elevated heart rate in participants with high social anxiety.

LIMITATIONS

Although social anxiety varied considerably in the current sample and reached clinically relevant levels in one third of participants, formal clinical diagnoses were not available.

CONCLUSIONS

The current findings suggest that gaze avoidance might only occur in specific situations or very high levels of social anxiety. Fear of eye contact could at times represent a subjectively experienced rather than an objectively measurable feature of the disorder. The observation of elevated heart rate throughout the entire experiment indicates that physiological hyperactivity might constitute a cardinal feature of social anxiety.