Investigating the impact of greenery elements in office environments on cognitive performance, visual attention and distraction: An eye-tracking pilot-study in virtual reality

The human-nature connection is one of the main aspects determining supportive and comfortable office environments. In this context, the application of eye-tracking-equipped Virtual Reality (VR) devices to support an evaluation on the effect of greenery elements indoors on individuals' efficiency and engagement is limited. A new approach to investigate visual attention, distraction, cognitive load and performance in this field is carried out via a pilot-study comparing three virtual office layouts (Indoor Green, Outdoor Green and Non-Biophilic). 63 participants completed cognitive tasks and surveys while measuring gaze behaviour. Sense of presence, immersivity and cybersickness results supported the ecological validity of VR. Visual attention was positively influenced by the proximity of users to the greenery element, while visual distraction from tasks was negatively influenced by the dimension of the greenery. In the presence of greenery elements, lower cognitive loads and more efficient information searching, resulting in improved performance, were also highlighted.

Infants' top-down perceptual modulation is specific to own-race faces

Recent studies have revealed the influence of higher-level cognitive systems in modulating perceptual processing (top-down perceptual modulation) in infancy. However, more research is needed to understand how top-down processes in infant perception contribute to early perceptual development. To this end, this study examined infants' top-down perception of own- and other-race faces to reveal whether top-down modulation is linked to the emergence of perceptual specialization. Infants first learned an association between a sound and faces, with the race of the faces manipulated between groups (own race vs. other race). We then tested infants' face perception across various levels of perceptual difficulty (manipulated by presentation duration) and indexed top-down perception by the change in perception when infants heard the sound previously associated with the face (predictive sound) versus an irrelevant sound. Infants exhibited top-down face perception for own-race faces (Experiment 1). However, we present new evidence that infants did not show evidence of top-down modulation for other-race faces (Experiment 2), suggesting an experience-based specificity of this capacity with more effective top-down modulation in familiar perceptual contexts. In addition, we ruled out the possibility that this face race effect was due to differences in infants' associative learning of the sound and faces between the two groups. This work has important implications for understanding the mechanisms supporting perceptual development and how they relate to top-down perception in infancy.

Dissociated contributions of working memory and inhibitory control to children's and adults' analogical reasoning: Analogical strategies matter

This study investigated whether and how each component of working memory (WM) and inhibitory control (IC) is related to analogical reasoning. Specifically, the mediating roles of analogical strategies were examined and compared across children and adults. In total, 79 children (50 girls; M ± SD = 8.43 ± 0.59 years old) and 77 adults (35 female; 19.44 ± 0.82 years old) were administered tests of WM, IC, and analogical reasoning. In addition, participants' eye movement data during the analogical reasoning task were collected to classify the analogical strategies. The results showed that the semantic-constraint strategy completely mediated the relationship between WM (rather than IC) and analogical reasoning for children. However, for adults, the project-first strategy partially mediated the association between IC (rather than WM) and analogical reasoning. These findings reveal the dissociated roles of WM and IC in analogical reasoning through analogical strategies for children and adults and highlight the importance of analogical strategies.

Insights into Rett Syndrome girls' receptive vocabulary through eye movements and parental perception

OBJECTIVE

This study evaluated the receptive vocabulary of girls diagnosed with Rett Syndrome (RS) by employing eye-tracking technology and examined how these objective measures compared with parents' perceptions of their daughters' language abilities.

METHOD

Fourteen girls with RS and eleven typically developing peers participated. Instruments included the Kerr Scale, a parental questionnaire on communication skills, the Peabody Picture Vocabulary Test - PPVT-4, and eye-tracking equipment. The PPVT-4's initial 12 cards, each displaying four images, were presented on screen for 5 s for the child's initial inspection. Subsequently, the same card was shown for 5 s with instructions to identify the picture matching the word, repeated three times in a randomized order.

RESULTS

Eye-tracking assessments revealed that girls with RS with less severe symptoms, performed below typically developing peers with aged 3-4 years. The number of eye fixations emerged as a reliable metric for assessing their performance. A positive correlation was found between parental reports of their daughters' vocabulary knowledge and their ability to identify the correct stimulus, suggesting comprehension and active engagement in the testing process.

CONCLUSION

This study presents a pioneering approach by combining parental perceptions with eye-tracking measures to assess receptive vocabulary in girls diagnosed with Rett Syndrome. Despite showing lower performance levels compared to significantly younger peers, the findings suggest that these individuals use less effectively eye contact as a mode of communication.

Cookie cravings - Examining the impact of sugar content information on Christmas treat preferences via mobile eye-tracking

BACKGROUND

Diets high in added sugar can promote the development of overweight. Especially during the Holiday season, when high-sugar food is abundant, people overeat and gain more weight than during other times of the year. The present study with mobile eye-tracking glasses (Pupil Labs Invisible) investigated how sugar content information affects food preference (liking/wanting) and visual attention (where and how long one is looking) in a buffet-like situation.

METHODS

Fifty-eight participants who were well acquainted with the local Christmas traditions and foods (38 female, 19 male, one diverse; mean age = 25 years, SD = 6.3 years; mean body mass index = 22.2 kg/m2, SD = 3.2 kg/m2) were presented with four cookies and two non-food items (wrapped presents) in a free viewing task. Two of the displayed cookies were 'Christmas cookies' (cookies that are traditionally eaten only during the Holiday season) and two cookies had no Christmas association. The cookies were either labeled as cookies made with or without sugar, resulting in a 3 (Category: cookies with sugar, cookies without sugar, non-food) by 2 (Christmas association: yes, no) repeated-measures design.

RESULTS

Analyses of variance indicated that participants reported higher wanting and liking for cookies with sugar, particularly Christmas cookies (interaction effect for wanting: p = .047, ηp2 = .059; interaction effect for liking: p = .017, ηp2 = .084). Sugar-free cookies were fixated more often (p = .028; d = 0.35) and shorter (p < .001; d = 0.64) than sugar cookies.

CONCLUSION

Assuming that cookies are sugar-free reduced the reported preference for this product, which was associated with a more detail-oriented (critical) viewing pattern. The study's findings have potential implications for public health and can aid in developing targeted interventions to promote healthier food choices during festive periods. The new strategies should not focus on the sugar content of foods.

Comparison of concurrent cognitive load measures during n-back tasks

The cognitive load experienced by humans is an important factor affecting their performance. Cognitive overload or underload may result in suboptimal human performance and may compromise safety in emerging human-in-the-loop systems. In driving, cognitive overload, due to various secondary tasks, such as texting, results in driver distraction. On the other hand, cognitive underload may result in fatigue. In automated manufacturing systems, a distracted operator may be prone to muscle injuries. Similar outcomes are possible in many other fields of human performance such as aviation, healthcare, and learning environments. The challenge with such human-centred applications is that the cognitive load is not directly measurable. Only the change in cognitive load is measured indirectly through various physiological, behavioural, performance-based and subjective means. A method to objectively assess the performance of such diverse measures of cognitive load is lacking in the literature. In this paper, a performance metric for the comparison of different measures to determine the cognitive workload is proposed in terms of the signal-to-noise ratio. Using this performance metric, several measures of cognitive load, that fall under the four broad groups were compared on the same scale for their ability to measure changes in cognitive load. Using the proposed metrics, the cognitive load measures were compared based on data collected from 28 participants while they underwent n-back tasks of varying difficulty. The results show that the proposed performance evaluation method can be useful to individually assess different measures of cognitive load.

Prime saliency in semantic priming with 18-month-olds

This study investigated semantic priming in 18-month-old infants using the inter-modal priming technique, focusing on the effects of prime repetition on saliency. Our findings showed that prime repetition led to longer looking times at target referents for related primes compared to unrelated primes, supporting the existence of a structured semantic system in infants as young as 18 months. The results are consistent with both Spreading Activation and Distributed models of semantic priming. Additionally, our findings highlighted the impact of prime-target stimulus onset asynchronies (SOAs) on priming effects, revealing positive, negative, or no priming effects depending on the chosen SOA. A post-hoc explanation of this finding points to negative priming as a possible mechanism. The study also demonstrated the utility of the inter-modal priming task in studying lexical-semantic structure in younger infants with its diverse measures of infant behaviour.

Modifying biased attention towards food stimuli in binge eating disorder: A multi-session training study

Individuals with binge eating disorder (BED) exhibit a biased attention towards food stimuli. Against this backdrop, the present study with pre-registered design (ID: DRKS00012984) tested whether (a) a training designed to reduce attentional food processing indeed modifies this bias, (b) this reduction is evident in several measures of food-related attention and (c) this is associated with reductions in craving, binge frequency over the past 28 days and calories eaten in a laboratory based bogus taste test. Individuals with BED were randomly allocated to four sessions of either an attentional bias modification training (ABMT; n = 39) or a comparable no-modification control training (CT; n = 27). In all measures assessed via eye-tracking - dwell time bias, dwell time bias variability and first fixation bias - food-related bias decreased in the ABMT relative to the CT. Against our hypothesis, no differential between-group effects were found for reaction time (RT) bias and its variability as well as for calories consumed in a bogus taste test. By contrast, reductions in binge frequency and subjective craving were found for both groups. Taken together, the tendency to preferentially process food seems a modifiable phenomenon in individuals with BED. However, modifying this selective viewing pattern does not seem a prerequisite for a successful reduction of binge frequency.

Age-Differential Role of Gaze Reinstatement in Recognition Memory for Negative Visual Stimuli

OBJECTIVES

Although research has shown that the replay of encoding-specific gaze patterns during retrieval, known as gaze reinstatement, facilitates memory retrieval, little is known about whether it differentially associates with the negativity preference in memory (defined as enhanced memory for negative stimuli relative to neutral stimuli in this study) among younger and older adults. The present study aims to address this research gap.

METHODS

A total of 33 older adults (16 women; aged 58-69 years, M = 63.48, SD = 2.98) and 36 younger adults (10 women; aged 18-26 years, M = 20.39, SD = 1.57) completed a remember/know recognition memory task involving negative and neutral pictures. Their eye movements were tracked during both the memory encoding and retrieval phases.

RESULTS

Younger and older adults had better memory for negative than neutral pictures. Older adults exhibited significantly stronger gaze reinstatement for negative than neutral stimuli, while this difference was nonsignificant in younger adults. Moreover, gaze reinstatement is positively linked to memory performance in both age groups.

DISCUSSION

The results suggest that gaze reinstatement may play age-differential roles in the negativity preference of memory. Negative valence may enhance gaze reinstatement, which improves subsequent recognition memory, particularly among older adults. The finding contributes to a better understanding of the mechanisms underlying the negative preference for memory in different age groups.

Open Iris - An Open Source Framework for Video-Based Eye-Tracking Research and Development

Eye-tracking is an essential tool in many fields, yet existing solutions are often limited for customized applications due to cost or lack of flexibility. We present OpenIris, an adaptable and user-friendly open-source framework for video-based eye-tracking. OpenIris is developed in C# with modular design that allows further extension and customization through plugins for different hardware systems, tracking, and calibration pipelines. It can be remotely controlled via a network interface from other devices or programs. Eye movements can be recorded online from camera stream or offline post-processing recorded videos. Example plugins have been developed to track eye motion in 3-D, including torsion. Currently implemented binocular pupil tracking pipelines can achieve frame rates of more than 500Hz. With the OpenIris framework, we aim to fill a gap in the research tools available for high-precision and high-speed eye-tracking, especially in environments that require custom solutions that are not currently well-served by commercial eye-trackers.

Differences in scanpath pattern and verbal working memory predicts efficient reading in the Cloze gap-filling test

Different tests measure text comprehension, including the cloze gap-filling test, often used for language learning. Different studies hypothesized cognitive strategies in this type of test and their relationship with working memory and performance. However, no study investigated the cloze test, working memory, and possible cognitive strategies, while performing the test. Therefore, this study aimed to identify cognitive visual strategies in the cloze test by applying an unsupervised algorithm and to analyze the relationship between these strategies with working memory and performance in the cloze test. Our sample consisted of 51 university students, the largest sample in studies of cognitive strategies with cloze tests. Participants answered an 11-item cloze test in a computer with eye-tracking, a verbal working memory test, and a visuospatial working memory test. Our analysis of participants' scanpath identified two main strategies: one with fewer toggles between text and word bank and fewer fixations than the other one, indicating the existence of a global strategy. Furthermore, a model predicting the efficiency of participants in the cloze test found that item complexity, using a global strategy, and higher scores of working memory were the most significant predictors. These results confirm the hypothesis of a global strategy being related to successfully achieving higher-order reading processes.

Early identification of autism spectrum disorder based on machine learning with eye-tracking data

BACKGROUND

Early identification of autism spectrum disorder (ASD) improves long-term outcomes, yet significant diagnostic delays persist.

METHODS

A retrospective cohort of 449 children (ASD: 246, typically developing [TD]: 203) was used for model development. Eye-movement data were collected from the participants watching videos that featured eye-tracking paradigms for assessing social and non-social cognition. Five machine learning algorithms, namely random forest, support vector machine, logistic regression, artificial neural network, and extreme gradient boosting, were trained to classify children with ASD and TD. The best-performing algorithm was selected to build the final model which was further evaluated in a prospective cohort of 80 children. The Shapley values interpreted important eye-tracking features.

RESULTS

Random forest outperformed other algorithms during model development and achieved an area under the curve of 0.849 (< 3 years: 0.832, ≥ 3 years: 0.868) on the external validation set. Of the ten most important eye-tracking features, three measured social cognition, and the rest were related to non-social cognition. A deterioration in model performance was observed using only the social or non-social cognition-related eye-tracking features.

LIMITATIONS

The sample size of this study, although larger than that of existing studies of ASD based on eye-tracking data, was still relatively small compared to the number of features.

CONCLUSIONS

Machine learning models based on eye-tracking data have the potential to be cost- and time-efficient digital tools for the early identification of ASD. Eye-tracking phenotypes related to social and non-social cognition play an important role in distinguishing children with ASD from TD children.

Free-viewing gaze patterns reveal a mood-congruency bias in MDD during an affective fMRI/eye-tracking task

Major depressive disorder (MDD) has been related to abnormal amygdala activity during emotional face processing. However, a recent large-scale study (n = 28,638) found no such correlation, which is probably due to the low precision of fMRI measurements. To address this issue, we used simultaneous fMRI and eye-tracking measurements during a commonly employed emotional face recognition task. Eye-tracking provide high-precision data, which can be used to enrich and potentially stabilize fMRI readouts. With the behavioral response, we additionally divided the active task period into a task-related and a free-viewing phase to explore the gaze patterns of MDD patients and healthy controls (HC) and compare their respective neural correlates. Our analysis showed that a mood-congruency attentional bias could be detected in MDD compared to healthy controls during the free-viewing phase but without parallel amygdala disruption. Moreover, the neural correlates of gaze patterns reflected more prefrontal fMRI activity in the free-viewing than the task-related phase. Taken together, spontaneous emotional processing in free viewing might lead to a more pronounced mood-congruency bias in MDD, which indicates that combined fMRI with eye-tracking measurement could be beneficial for our understanding of the underlying psychopathology of MDD in different emotional processing phases.Trial Registration: The BeCOME study is registered on ClinicalTrials (gov: NCT03984084) by the Max Planck Institute of Psychiatry in Munich, Germany.

Do dogs preferentially encode the identity of the target object or the location of others' actions?

The ability to make sense of and predict others' actions is foundational for many socio-cognitive abilities. Dogs (Canis familiaris) constitute interesting comparative models for the study of action perception due to their marked sensitivity to human actions. We tested companion dogs (N = 21) in two screen-based eye-tracking experiments, adopting a task previously used with human infants and apes, to assess which aspects of an agent's action dogs consider relevant to the agent's underlying intentions. An agent was shown repeatedly acting upon the same one of two objects, positioned in the same location. We then presented the objects in swapped locations and the agent approached the objects centrally (Experiment 1) or the old object in the new location or the new object in the old location (Experiment 2). Dogs' anticipatory fixations and looking times did not reflect an expectation that agents should have continued approaching the same object nor the same location as witnessed during the brief familiarization phase; this contrasts with some findings with infants and apes, but aligns with findings in younger infants before they have sufficient motor experience with the observed action. However, dogs' pupil dilation and latency to make an anticipatory fixation suggested that, if anything, dogs expected the agents to keep approaching the same location rather than the same object, and their looking times showed sensitivity to the animacy of the agents. We conclude that dogs, lacking motor experience with the observed actions of grasping or kicking performed by a human or inanimate agent, might interpret such actions as directed toward a specific location rather than a specific object. Future research will need to further probe the suitability of anticipatory looking as measure of dogs' socio-cognitive abilities given differences between the visual systems of dogs and primates.

Deficits in emotion recognition and processing in children with high callous-unemotional traits: the role of the MAOA gene

Children with high Callous-Unemotional (CU) traits show deficits in recognizing and processing facial expressions. Alterations in emotion recognition have been linked to a higher synaptic concentration of monoaminergic neurotransmitters. The current study investigated the relationship between the MAOA-Low-activity alleles and the ability to recognize and process facial expressions in 97 male children (8-12 years old) diagnosed with disruptive behavior disorder. Participants completed a computerized emotion-recognition task while an eye-tracking system recorded the number (Fixation Count, FC) and length (Fixation Duration, FD) of fixations to the eye region of the emotional stimuli. Children with high CU traits exhibited lower scores in recognition of sadness and anger, and lower FC and FD for sadness and fear than children with low CU traits. Children carrying the MAOA-Low-activity alleles displayed lower FD for sadness, and FD and FC for fear than those carrying the MAOA-High-activity alleles. These genetic effects appeared even stronger in children with CU traits. Moderation analysis revealed that CU traits were associated with lower FC and FD for fear, and lower FD for sadness, probably due to the MAOA-Low-activity alleles. Our findings, although to be replicated, suggest MAOA-Low-activity alleles as potential genetic biomarkers to identify CU children in need of training focused on emotion processing.

An examination of the effects of eye-tracking on behavior in psychology experiments

Eye-tracking is emerging as a tool for researchers to better understand cognition and behavior. However, it is possible that experiment participants adjust their behavior when they know their eyes are being tracked. This potential change would be considered a type of Hawthorne effect, in which participants alter their behavior in response to being watched and could potentially compromise the outcomes and conclusions of experimental studies that use eye tracking. We examined whether eye-tracking produced Hawthorne effects in six commonly used psychological scales and five behavioral tasks. The dependent measures were selected because they are widely used and cited and because they involved measures of sensitive topics, including gambling behavior, racial bias, undesirable personality characteristics, or because they require working memory or executive attention resources, which might be affected by Hawthorne effects. The only task where Hawthorne effects manifested was the mixed gambles task, in which participants accepted or rejected gambles involving a 50/50 chance of gaining or losing different monetary amounts. Participants in the eye-tracking condition accepted fewer gambles that were low in expected value, and they also took longer to respond for these low-value gambles. These results suggest that eye-tracking is not likely to produce Hawthorne effects in most common psychology laboratory tasks, except for those involving risky decisions where the probability of the outcomes from each choice are known.

An Eye-Tracking Study on the Processing of L2 Collocations: The Effect of Congruency, Proficiency, and Transparency

The availability of a first language translation equivalent (i.e., congruency) has repeatedly been shown to influence second-language collocation processing in decontextualized tasks. However, no study to date has examined how L2 speakers process congruent/incongruent collocations on-line in a real-world context. The present study aimed to fill this gap by examining the eye-movement behavior of 31 Arabic-English speakers and 30 native English speakers as they read 20 congruent and 20 incongruent collocations (in addition to 40 control phrases) in short contexts. The study also examined possible modulating effects of proficiency level and transparency on congruency effects. Results showed that non-natives (similar to native speakers) showed a processing advantage for collocations over control phrases. However, there was no effect of congruency (i.e., no difference between congruent and incongruent collocations) for either group, and no modulating effect of proficiency or transparency on congruency. We discuss implications of the findings for theories of L2 lexical processing.

Does the Processing Advantage of Formulaic Language Persist in Its Nonadjacent Forms? Evidence from Eye Movements of Chinese Collocations

It has been well documented that formulaic language (such as collocations; e.g., provide information) enjoys a processing advantage over novel language (e.g., compare information). In natural language use, however, many formulaic sequences are often inserted with words intervening in between the individual constituents (e.g., provided information → provide some of the information). Whether or not the processing advantage persists in nonadjacent forms remains largely unknown. The present study thus sought to address this gap by recording the eye movements of Chinese native speakers when they were reading sentences embedded with formulaic sequences (high frequency collocations) versus novel phrases (low frequency controls), in their adjacent (e.g., 'resolve difficulties' vs. 'experience difficulties'), short-insertion (e.g., 'resolve these difficulties' vs. 'experience these difficulties'), and long-insertion forms (e.g., 'resolved so many difficulties' vs. 'experienced so many difficulties'). Results suggested that the processing advantage for formulaic language over novel language existed not only in their adjacent form, but also in their short-insertion form, albeit the magnitude of the processing advantage diminished with the increase of insertion length. The persistence of FL processing advantage is in line with usage-based approach to language learning, processing, and use.

Sign-tracking and goal-tracking in humans: Utilising eye-tracking in clinical and non-clinical populations

BACKGROUND

In Pavlovian conditioning, learned behaviour varies according to the perceived value of environmental cues. For goal-trackers (GT), the cue merely predicts a reward, whilst for sign-trackers (ST), the cue holds incentive value. The sign-tracking/goal-tracking model is well-validated in animals, but translational work is lacking. Despite the model's relevance to several conditions, including attention deficit hyperactivity disorder (ADHD), we are unaware of any studies that have examined the model in clinical populations.

METHODS

The current study used an eye-tracking Pavlovian conditioning paradigm to identify ST and GT in non-clinical (N = 54) and ADHD (N = 57) participants. Eye movements were recorded whilst performing the task. Dwell time was measured for two areas of interest: sign (i.e., cue) and goal (i.e., reward), and an eye-gaze index (EGI) was computed based on the dwell time sign-to-goal ratio. Higher EGI values indicate sign-tracking behaviour. ST and GT were determined using median and tertiary split approaches in both samples.

RESULTS

Despite greater propensity for sign-tracking in those with ADHD, there was no significant difference between groups. The oculomotor conditioned response was reward-specific (CS+) and present, at least partly, from the start of the task indicating dispositional and learned components. There were no differences in externalising behaviours between ST and GT for either sample.

CONCLUSIONS

Sign-tracking is associated with CS+ trials only. There may be both dispositional and learned components to sign-tracking, potentially more common in those with ADHD. This holds translational potential for understanding individual differences in reward-learning.

Depressive symptoms and visual attention to others' eyes in healthy individuals

BACKGROUND

Eye contact is a fundamental part of social interaction. In clinical studies, it has been observed that patients suffering from depression make less eye contact during interviews than healthy individuals, which could be a factor contributing to their social functioning impairments. Similarly, results from mood induction studies with healthy persons indicate that attention to the eyes diminishes as a function of sad mood. The present screen-based eye-tracking study examined whether depressive symptoms in healthy individuals are associated with reduced visual attention to other persons' direct gaze during free viewing.

METHODS

Gaze behavior of 44 individuals with depressive symptoms and 49 individuals with no depressive symptoms was analyzed in a free viewing task. Grouping was based on the Beck Depression Inventory using the cut-off proposed by Hautzinger et al. (2006). Participants saw pairs of faces with direct gaze showing emotional or neutral expressions. One-half of the face pairs was shown without face masks, whereas the other half was presented with face masks. Participants' dwell times and first fixation durations were analyzed.

RESULTS

In case of unmasked facial expressions, participants with depressive symptoms looked shorter at the eyes compared to individuals without symptoms across all expression conditions. No group difference in first fixation duration on the eyes of masked and unmasked faces was observed. Individuals with depressive symptoms dwelled longer on the mouth region of unmasked faces. For masked faces, no significant group differences in dwell time on the eyes were found. Moreover, when specifically examining dwell time on the eyes of faces with an emotional expression there were also no significant differences between groups. Overall, participants gazed significantly longer at the eyes in masked compared to unmasked faces.

CONCLUSIONS

For faces without mask, our results suggest that depressiveness in healthy individuals goes along with less visual attention to other persons' eyes but not with less visual attention to others' faces. When factors come into play that generally amplify the attention directed to the eyes such as face masks or emotions then no relationship between depressiveness and visual attention to the eyes can be established.

Conducting head-mounted eye-tracking research with young children with autism and children with increased likelihood of later autism diagnosis

BACKGROUND

Over the past years, researchers have been using head-mounted eye-tracking systems to study young children's gaze behaviors in everyday activities through which children learn about the world. This method has great potential to further our understanding of how millisecond-level gaze behaviors create multisensory experiences and fluctuate around social environments. While this line of work can yield insight into early perceptual experiences and potential learning mechanisms, the majority of the work is exclusively conducted with typically-developing children. Sensory sensitivities, social-communication difficulties, and challenging behaviors (e.g., disruption, elopement) are common among children with developmental disorders, and they may represent potential methodological challenges for collecting high-quality data.

RESULTS

In this paper, we describe our research practices of using head-mounted eye trackers with 41 autistic children and 17 children with increased likelihood of later autism diagnosis without auditory or visual impairments, including those who are minimally or nonspeaking and/or have intellectual disabilities. The success rate in gathering data among children with autism was 92.68%. 3 of 41 children failed to complete the play-session, resulting in an 86.36% success rate among 1-4-year-olds and a 100.00% success rate among 5-8-year-olds. 1 of 17 children with increased likelihood of later autism diagnosis failed to complete the play-session, resulting in a success rate of 94.11%. There were numerous "challenging" behaviors relevant to the method. The most common challenging behaviors included taking the eye-tracking device off, elopement, and becoming distressed. Overall, among children with autism, 88.8% of 1-4-year-olds and 29.4% of 5-8-year-olds exhibited at least one challenging behavior.

CONCLUSIONS

Research capitalizing on this methodology has the potential to reveal early, socially-mediated gaze behaviors that are relevant for autism screening, diagnosis, and intervention purposes. We hope that our efforts in documenting our study methodology will help researchers and clinicians effectively study early naturally-occuring gaze behaviors of children during non-experimental contexts across the spectrum and other developmental disabilities using head-mounted eye-tracking. Ultimately, such applications may increase the generalizability of results, better reflect the diversity of individual characteristics, and offer new ways in which this method can contribute to the field.

Autistic Individuals Do Not Alter Visual Processing Strategy During Encoding Versus Recognition of Faces: A Hidden Markov Modeling Approach

PURPOSE

Visual face recognition-the ability to encode, discriminate, and recognize the faces of others-is fundamentally supported by eye movements and is a common source of difficulty for autistic individuals. We aimed to evaluate how visual processing strategies (i.e., eye movement patterns) directly support encoding and recognition of faces in autistic and neurotypical (NT) individuals.

METHODS

We used a hidden Markov modeling approach to evaluate the spatiotemporal dynamics of eye movements in autistic (n = 15) and neurotypical (NT) adolescents (n = 17) during a face identity recognition task.

RESULTS

We discovered distinct eye movement patterns among all participants, which included a focused and exploratory strategy. When evaluating change in visual processing strategy across encoding and recognition phases, autistic individuals did not shift their eye movement patterns like their NT peers, who shifted to a more exploratory visual processing strategy during recognition.

CONCLUSION

These findings suggest that autistic individuals do not modulate their visual processing strategy across encoding and recognition of faces, which may be an indicator of less efficient face processing.

Touchscreens can promote infant object-interlocutor reference switching

We re-examine whether the type of object played with influences parent-infant joint attention. A within-participants comparison of 24 parent-9-month-old dyads, used head-mounted eye-tracking to measure parental naming and infant attention during play with touchscreen apps on a touchscreen tablet or matched interactive toys. Infants engaged in sustained attention more to the toy than the tablet. Parents named objects less in toy play. Infants exhibited more gaze shifts between the object and their parent during tablet play. Contrasting previous studies, these findings suggest that joint tablet play can be more interactive than with toys, and raise questions about the recommendation that infants should not be exposed at all to such technology.

Clinical reasoning in pharmacy: What do eye movements and verbal protocols tell us about the processing of a case task?

This study investigates pharmacy students' reasoning while solving a case task concerning an acute patient counselling situation in a pharmacy. Participants' (N = 34) reasoning processes were investigated with written tasks utilizing eye-tracking in combination with verbal protocols. The case was presented in three pages, each page being followed by written questions. Eye movements were recorded during case processing. Success in the task required differentiating the relevant information from the task redundant information, and initial activation of several scripts and verification of the most likely one, when additional information became available. 2nd (n = 16) and 3rd (n = 18)-year students' and better and worse succeeding students' processes were compared. The results showed that only a few 2nd-year students solved the case correctly, whereas almost all of the 3rd-year students were successful. Generally, the average total processing times of the case material did not differ between the groups. However, better-succeeding and 3rd-year students processed the very first task-relevant sentences longer, indicating that they were able to focus on relevant information. Differences in the written answers to the 2nd and 3rd question were significant, whereas differences regarding the first question were not. Thus, eye-tracking seems to be able to capture illness script activation during case processing, but other methods are needed to depict the script verification process. Based on the results, pedagogical suggestions for advancing pharmacy education are discussed.

Comparative usability of manual defibrillators - A human factors study

Background

A manual defibrillator represents key equipment for resuscitation of cardiac arrest scenario. Improper or slow operation of a defibrillator may adversely affect acute care. A self-explanatory interface facilitates handling and decreases the risk of operating errors. Therefore, we evaluated the usability of four commercially available defibrillators.

Methods

31 medical students executed 15 consecutive tasks on each defibrillator (Physio-Control Lifepak 20e, Schiller Defigard Touch 7, Corpuls 3 and Zoll X-Series). The operators' gaze was measured via eye-tracking and frequencies of required assistances and task completion times were recorded. Additionally, subjective perception of usability was assessed by a standardized questionnaire.

Results

Least assistances (16) were required when operating the Lifepak 20e and most (63) when operating the X-Series. Cumulative task completion times were shortest in the Lifepak 20e (124 ± 31 s), followed by the Corpuls 3 (220 ± 69 s), the Defigard Touch 7 (225 ± 81 s) and the X-Series (289 ± 85 s; p < 0.001). Completion times of specific tasks differed considerably between the devices. Eye-tracking revealed associated interface issues that impeded the operators' performance. Overall standardized usability was rated best for the Lifepak 20e (81 ± 15) and worst for the X-Series (44 ± 20).

Conclusions

The usability of defibrillators differs considerably and task specifically between devices. Interface issues of tasks impaired the operators' efficiency specifically. The perceived usability and the perceived stress-level after operating the devices corresponded with objective measures of usability. Eliminating specific usability issues may improve the operator's performance and, as a consequence patient outcome.

Does gaze anxiety predict actual gaze avoidance and is it more informative than social anxiety?

BACKGROUND AND OBJECTIVES

In recent years eye-tracking studies have provided converging evidence that socially anxious individuals avoid looking at other people's faces in social situations. In addition to these objective measures, the Gaze Anxiety Rating Scale (GARS) has increasingly been used as a self-report measure of gaze avoidance. However, extant results concerning its predictive validity were inconsistent. Moreover, no study has considered social anxiety and gaze anxiety together to examine their relative contributions to actual gaze behavior.

METHODS

To address these two questions, eye-tracking data collected from 81 female students during the initial 6 min of a face-to-face conversation with a female confederate were analyzed. Gaze anxiety and social anxiety were measured via the GARS and the Leibowitz Social Anxiety Scale.

RESULTS

The results revealed that gaze anxiety was associated with reduced face gaze while speaking. Social anxiety was not only associated with decreased face gaze during speaking, but also across the initial conversation. Moreover, there was no evidence that gaze anxiety made an additional contribution to social anxiety in predicting face gaze behavior.

LIMITATIONS

This study examined face gaze instead of eye gaze. Additionally, the self-report data were not collected on the same day as the eye-tracking data.

CONCLUSIONS

The findings indicate that, in a community sample, gaze anxiety does predict actual gaze behavior during a face-to-face initial encounter, but social anxiety is a stronger predictor.

Outcome measures in Angelman syndrome

BACKGROUND

Angelman syndrome (AS) is a rare neurodevelopmental disorder characterized by severe intellectual disability, little to no expressive speech, visual and motor problems, emotional/behavioral challenges, and a tendency towards hyperphagia and weight gain. The characteristics of AS make it difficult to measure these children's functioning with standard clinical tests. Feasible outcome measures are needed to measure current functioning and change over time, in clinical practice and clinical trials.

AIM

Our first aim is to assess the feasibility of several functional tests. We target domains of neurocognitive functioning and physical growth using the following measurement methods: eye-tracking, functional Near-Infrared Spectroscopy (fNIRS), indirect calorimetry, bio-impedance analysis (BIA), and BOD POD (air-displacement plethysmography). Our second aim is to explore the results of the above measures, in order to better understand the AS phenotype.

METHODS

The study sample consisted of 28 children with AS aged 2-18 years. We defined an outcome measure as feasible when (1) at least 70% of participants successfully finished the measurement and (2) at least 60% of those participants had acceptable data quality. Adaptations to the test procedure and reasons for early termination were noted. Parents rated acceptability and importance and were invited to make recommendations to increase feasibility. The results of the measures were explored.

RESULTS

Outcome measures obtained with eye-tracking and BOD POD met the definition of feasibility, while fNIRS, indirect calorimetry, and BIA did not. The most important reasons for early termination of measurements were showing signs of protest, inability to sit still and poor/no calibration (eye-tracking specific). Post-calibration was often applied to obtain valid eye-tracking results. Parents rated the BOD POD als most acceptable and fNIRS as least acceptable for their child. All outcome measures were rated to be important. Exploratory results indicated longer reaction times to high salient visual stimuli (eye-tracking) as well as high body fat percentage (BOD POD).

CONCLUSIONS

Eye-tracking and BOD POD are feasible measurement methods for children with AS. Eye-tracking was successfully used to assess visual orienting functions in the current study and (with some practical adaptations) can potentially be used to assess other outcomes as well. BOD POD was successfully used to examine body composition.

TRIAL REGISTRATION

Registered d.d. 23-04-2020 under number 'NL8550' in the Dutch Trial Register: https://onderzoekmetmensen.nl/en/trial/23075.

Focused attention as a new sitter: How do infants balance it all?

This study investigated the impact of postural control on infants' Focused Attention (FA). Study 1 examined whether and how sitting independently versus with support impacted 6- to 8-month-old infants' ability to focus attention during object exploration. FA measures did not depend on support condition. However, sitting experience was significantly negatively correlated with FA measures in the supported condition, suggesting that infants with more sitting experience performed fewer exploratory movements, possibly due to faster information processing ability compared to infants with less sitting experience. These unexpected findings prompted an exploration of more subtle looking behaviors during FA in Study 2-a case study of three infants who wore a head-mounted eye-tracker during an FA task. The ability to rapidly shift visual attention was key to gathering environmental information useful for problem solving-an interpretation that is supported by prior findings of the relationship between fast looks and faster information processing.

Multimodal Kernel-based discriminant correlation analysis data-fusion approach: an automated autism spectrum disorder diagnostic system

Autism spectrum disorder (ASD) diagnostic systems, based on association of multimodal tools such as combination of Electroencephalogram (EEG) and eye-tracking, have emerged as an analytical to provide objective biomarkers. However, the existing feature-redundancy-based systems have lacked in providing knowledge of fusion approaches and robust feature-set. The present paper aims to reduce disorder homogeneity by proposing a multimodal diagnostic system which can incorporate multimodal data. The paper has collected simultaneous-data from three modalities (laptop-performance tool, EEG machine, and Eye-tracker) fused the recorded computational, neural and visual data. The multimodal features are analyzed via proposed multimodal Kernel-based discriminant correlation analysis (MKDCA) fusion approach and classified using state-of-the-art machine-learning classifiers. The proposed framework has considered the distinct cardinality of the feature vectors and fused the group structure among multiple samples after ranking them in increasing order. As per the results, the proposed multimodal system provided fused feature set of 11 influential features out of total 39 features. The SVM classifier has diagnosed ASD with 92% testing accuracy and 0.988 AUC(ROC). The proposed automated fusion-based system has the potential to classify disorder by reducing the disorder heterogeneity and stratifying ASD individuals into homogeneous sub-groups. In future, the correlation of reduced feature set with ASD clinical symptoms accounted by screening scales can provide clinical relevance of proposed model.

Eye-tracking analysis for situation awareness of incontinence pad changing during older adult nursing training: An observational study

AIM

This study aims to investigate eye tracking in the practical training of incontinence pad change, which is commonly required in older adult nursing.

BACKGROUND

Some competencies possessed by skilled and experienced personnel are difficult to verbalize into textbooks. However, this is crucial for education, especially nursing practice education. Eye-gaze analysis is one such tool that can aid the efficient transfer of knowledge to students. Therefore, eye-gaze analysis, a novel technology for visualizing situational awareness and decision-making, has recently gained traction in healthcare.

DESIGN

An observation study METHODS: Ten nursing faculty members and 13 nursing students with prior incontinence pad change experience participated in this study using an older adult simulator. There were two groups of students - S1 with more recent experience in older adult care and incontinence pad changing and S2 with less. Areas of interest (AOIs) during incontinence pad preparation and fitting were determined based on gaze fixation and the time spent fixating on these areas was compared.

RESULTS

Students took longer than nursing faculty members. When visualizing the eye movements between the AOIs in the network, the faculty nurses and S1 alternated their gaze between the new incontinence pad and the buttocks and between other AOIs. Simultaneously, S2 tended to gaze or stare only at the new incontinence pad.

CONCLUSION

The presented data may help interpret visual-based situational awareness and establish effective nursing education, especially in acquiring skills that are difficult to verbalize.

Exploring eye-tracking data as an indicator of situational awareness in nursing students during a cardiorespiratory arrest simulation

AIM

To examine the components of visual attention that maintain situational awareness during simulation training in undergraduate nursing students with different instruction levels.

BACKGROUND

Eye-tracking can provide deep insight into the nurses' attention during simulated practice. Knowing which gaze patterns promote situational awareness can significantly improve nurse instruction.

DESIGN

A comparative observational study investigated the role of visual attention on the performance quality, psychophysiological parameters (vital signs, anxiety and stress) and socioemotional competencies (cognitive workload, motivation and self-efficacy) of nursing students with various experience levels.

METHODS

Thirty nursing students divided into two groups according to their academic level: first cycle (n=14) and second-cycle (n=16) faced a clinical simulation scenario to resolve a cardiorespiratory arrest event. Eye tracking-based analysis required the selection of six areas of interest. The monitorization of vital signs included measuring blood pressure, heart rate, respiratory rate and oxygen saturation before and after the simulation practice. Participants completed the socioemotional questionnaire (NASA-TLX). They answered the state subscale of the State-Trait Anxiety Inventory (STAI), the Visual Analogue Scale (VAS) of stress, the Situational Motivation Scale (SIMS) and the Baessler and Schwarzer General Self-Efficacy Scale.

RESULTS

The first-cycle group displayed higher vital sign scores than the second cycle, apart from the post-simulation respiratory rate. All physiological parameters increased in mean value after the clinical simulation, except oxygen saturation. Anxiety was the only parameter in the socioemotional domain to present a statistically significant difference between the groups. First-year nursing students showed greater anxiety, stress, mental workload, identified regulation and intrinsic motivation, while second-year students showed higher levels of amotivation, external regulation and perceived self-efficacy. Eye-tracking data (revisits, gaze and duration of fixations) exhibited statistically significant differences depending on the area of interest in both groups (p =. 05). The performance outcomes showed a negative and moderate association with gaze the total number of gazes in the second-cycle group (rho = -0.640, p = 0.010).

CONCLUSION

Eye-tracking-based analysis can help to predict performance quality while maintaining situational awareness during nursing instruction.

Behavioral pain scale may not be reliable in awake non-verbal intensive care patients: a case control study

BACKGROUND

The evaluation of pain in patients, unable of oral communication, often relies on behavioral assessment. However, some critically ill patients, while non-verbal, are awake and have some potential for self-reporting. The objective was to compare the results of a behavioral pain assessment with self-reporting in awake, non-verbal, critically ill patients unable to use low-tech augmentative and alternative communication tools.

METHODS

Prospective cohort study of intubated or tracheotomized adult, ventilated patients with a RASS (Richmond Agitation Sedation Scale) of -1 to + 1 and inadequate non-verbal communication skills in a surgical intensive care unit of a tertiary care university hospital. For pain assessment, the Behavioral Pain Scale (BPS) was used. Self-reporting of pain was achieved by using an eye tracking device to evaluate the Numeric Rating Scale (NRS) and the pain/discomfort item of the EuroQol EQ-5D-5 L (EQ-Pain). All measurements were taken at rest.

RESULTS

Data was collected from 75 patients. Neither the NRS nor the EQ-Pain (r < .15) correlated with the BPS. However, NRS and EQ-Pain were significantly correlated (r = .78, p = < 0.001), indicating the reliability of the self-reporting by these patients. Neither the duration of intubation/tracheostomy, nor cause for ICU treatment, nor BPS subcategories had an influence on these results.

CONCLUSIONS

Behavioral pain assessment tools in non-verbal patients who are awake and not in delirium appear unreliable in estimating pain during rest. Before a behavioral assessment tool such as the BPS is used, the application of high-tech AACs should be strongly considered.

TRIAL REGISTRATION

German Clinical Trials Register, Registration number: DRKS00021233. Registered 23 April 2020 - Retrospectively registered, https://drks.de/search/en/trial/DRKS00021233 .

Coregistration of EEG and eye-tracking in infants and developing populations

Infants cannot be instructed where to look; therefore, infant researchers rely on observation of their participant's gaze to make inferences about their cognitive processes. They therefore started studying infant attention in the real world from early on. Developmental researchers were early adopters of methods combining observations of gaze and behaviour with electroencephalography (EEG) to study attention and other cognitive functions. However, the direct combination of eye-tracking methods and EEG to test infants is still rare, as it includes specific challenges. The current article reviews the development of co-registration research in infancy. It points out specific challenges of co-registration in infant research and suggests ways to overcome them. It ends with recommendations for implementing the co-registration of EEG and eye-tracking in infant research to maximise the benefits of the two measures and their combination and to orient on Open Science principles while doing so. In summary, this work shows that the co-registration of EEG and eye-tracking in infant research can be beneficial to studying natural and real-world behaviour despite its challenges.

Exploring the 'mood congruency' hypothesis of attention allocation - An eye-tracking study

BACKGROUND

The 'mood-congruency' hypothesis of attention allocation postulates that individuals' current emotional states affect their attention allocation, such that mood-congruent stimuli take precedence over non-congruent ones. This hypothesis has been further suggested as an underlying mechanism of biased attention allocation in depression.

METHODS

The present research explored the mood-congruency hypothesis using a novel video-based mood elicitation procedure (MEP) and an established eye-tracking attention allocation assessment task, elaborating prior research in the field. Specifically, in Study 1 (n = 91), a video-based MEP was developed and rigorously validated. In study 2 (n = 60), participants' attention allocation to sad and happy face stimuli, each presented separately alongside neutral faces, was assessed before and after the video-based MEP, with happiness induced in one group (n = 30) while inducing sadness in the other (n = 30).

RESULTS

In Study 1, the MEP yielded the intended modification of participants' current mood states (eliciting either sadness or happiness). Study 2 showed that while the MEP modified mood in the intended direction in both groups, replicating the results of Study 1, corresponding changes in attention allocation did not ensue in either group. A Bayesian analysis of pre-to-post mood elicitation changes in attention allocation supported this null finding. Moreover, results revealed an attention bias to happy faces across both groups and assessment points, suggestive of a trait-like positive bias in attention allocation among non-selected participants.

CONCLUSION

Current results provide no evidence supporting the mood-congruency hypothesis, which suggests that (biased) attention allocation may be better conceptualized as a depressive trait, rather than a mood-congruent state.

Überachiever or Developerin: Eye movements during the processing of translingual hybrid noun-formations

This eye tracking experiment tests how the brain recognizes and processes hybrid German-English word-formations and how this process compares to monolingual items. Thirty bilingual German-English adults from the Oxford area (23 females; mean age = 28.0, SD = 9.3) who were familiar with the meaning and underlying structure of the individual components had no comprehension difficulties. After fitting linear mixed effects models (95 % CI), the results showed an effect of word length and previous exposure to hybrid forms on processing times, indicated by longer fixation times and increased regressions, particularly in later stages of lexical processing. This indicates that bilingual readers have no trouble recognizing hybrid words, but may have difficulty with semantic and syntactic integration due to lack of exposure.

Examining how information presentation methods and a chatbot impact the use and effectiveness of electronic health record patient portals: An exploratory study

OBJECTIVES

Examining information presentation strategies that may facilitate patient education through patient portals is important for effective health education.

METHODS

A randomized exploratory study evaluated information presentation (text or videos) and a chatbot in patient education and examined several performance and outcome variables (e.g., search duration, Decisional Conflict Scale, and eye-tracking measures), along with a simple descriptive qualitative content analysis of the transcript of chatbot.

RESULTS

Of the 92 participants, those within the text conditions (n = 46, p < 0.001), had chatbot experiences (B =-74.85, p = 0.046), knew someone with IBD (B =-98.66, p = 0.039), and preferred to engage in medical decision-making (B =102.32, p = 0.006) were more efficient in information-searching. Participants with videos spent longer in information-searching (mean=666.5 (SD=171.6) VS 480.3 (SD=159.5) seconds, p < 0.001) but felt more informed (mean score=18.8 (SD=17.6) VS 27.4 (SD=18.9), p = 0.027). The participants' average eye fixation duration with videos was significantly higher (mean= 473.8 ms, SD=52.9, p < 0.001).

CONCLUSIONS

Participants in video conditions were less efficient but more effective in information seeking. Exploring the trade-offs between efficiency and effectiveness for user interface designs is important to appropriately deliver education within patient portals.

PRACTICE IMPLICATIONS

This study suggests that user interface designs and chatbots impact health information's efficiency and effectiveness.

Evaluation of bicyclist physiological response and visual attention in commercial vehicle loading zones

INTRODUCTION

With growing freight operations throughout the world, there is a push for transportation systems to accommodate trucks during loading and unloading operations. Currently, many urban locations do not provide loading and unloading zones, which results in trucks parking in places that obstruct bicyclist's roadway infrastructure (e.g., bicycle lanes).

METHOD

To understand the implications of these truck operations, a bicycle simulation experiment was designed to evaluate the impact of commercial vehicle loading and unloading activities on safe and efficient bicycle operations in a shared urban roadway environment. A fully counterbalanced, partially randomized, factorial design was chosen to explore three independent variables: commercial vehicle loading zone (CVLZ) sizes with three levels (i.e., no CVLZ, Min CVLZ, and Max CVLZ), courier position with three levels (i.e., no courier, behind the truck, beside the truck), and with and without loading accessories. Bicyclist's physiological response and eye tracking were used as performance measures. Data were obtained from 48 participants, resulting in 864 observations in 18 experimental scenarios using linear mixed-effects models (LMM).

RESULTS

Results from the LMMs suggest that loading zone size and courier position had the greatest effect on bicyclist's physiological responses. Bicyclists had approximately two peaks-per-minute higher when riding in the condition that included no CVLZ and courier on the side compared to the base conditions (i.e., Max CVLZ and no courier). Additionally, when the courier was beside the truck, bicyclist's eye fixation durations (sec) were one (s) greater than when the courier was located behind the truck, indicating that bicyclists were more alert as they passed by the courier. The presence of accessories had the lowest influence on both bicyclists' physiological response and eye tracking measures.

PRACTICAL APPLICATIONS

These findings could support better roadway and CVLZ design guidelines, which will allow our urban street system to operate more efficiently, safely, and reliable for all users.

As easy as cake or a piece of pie? Processing idiom variation and the contribution of individual cognitive differences

Language users routinely use canonical, familiar idioms in everyday communication without difficulty. However, creativity in idiom use is more widespread than sometimes assumed, and little is known about how we process creative uses of idioms, and how individual differences in cognitive skills contribute to this. We used eye-tracking while reading and cross-modal priming to investigate the processing of idioms (e.g., play with fire) compared with creative variants (play with acid) and literal controls (play with toys), amongst a group of 47 university-level native speakers of English. We also conducted a series of tests to measure cognitive abilities (working memory capacity, inhibitory control, and processing speed). Eye-tracking results showed that in early reading behaviour, variants were read no differently to literal phrases or idioms but showed significantly longer overall reading times, with more rereading required compared with other conditions. Idiom variables (familiarity, decomposability, literal plausibility) and individual cognitive variables had limited effects throughout, although more decomposable phrases of all kinds required less overall reading time. Cross-modal priming-which has often shown a robust idiom advantage in past studies-demonstrated no difference between conditions, but decomposability again led to faster processing. Overall, results suggest that variants were treated more like literal phrases than novel metaphors, with subsequent effort required to make sense of these in the way that was consistent with the context provided.

Short-time AOIs-based representative scanpath identification and scanpath aggregation

A new algorithm to identify a representative scanpath in a sample is presented and evaluated with eye-tracking data. According to Gestalt theory, each fixation of the scanpath should be on an area of interest (AOI) of the stimuli. As with existing methods, we first identify the AOIs and then extract the fixations of the representative scanpath from the AOIs. In contrast to existing methods, we propose a new concept of short-time AOI and extract the fixations of representative scanpath from the short-time AOIs. Our method outperforms the existing methods on two publicly available datasets. Our method can be applied to arbitrary visual stimuli, including static stimuli without natural segmentation, as well as dynamic stimuli. Our method also provides a solution for issues caused by the selection of scanpath similarity.

Maternal anxiety during pregnancy predicts infant attention to affective faces

BACKGROUND

Prenatal maternal anxiety is a known influence on offspring development. General anxiety and pregnancy-related anxiety (a distinct type of anxiety encompassing fears associated with pregnancy) are associated with offspring socioemotional development, with potential consequences for later emotional and behavioral problems. This study examines whether maternal pregnancy-related and general anxiety relate to infant attention to affective faces, a process which plays an integral role in early socioemotional development.

METHODS

Participants included 86 mothers and their 6-month-old infants (56.3 % female). Mothers completed measures of pregnancy-related and general anxiety three times through gestation. Infants' attention to affective faces was assessed with an eye-tracking task during which a series of face pairs were presented (happy, angry, or sad face paired with a neutral face). Overall attention measures included attention-holding (total looking time) and attention-orienting (latency to faces); affect-biased attention measures included proportion of total looking time to emotional faces and latency difference score.

RESULTS

Higher maternal pregnancy-related anxiety across gestation predicted decreased infant attention-holding to affective faces [F(1,80) = 7.232, p = .009, partial η2 = 0.083]. No differences were found in infant attention-orienting or affect-biased attention.

LIMITATIONS

Reliance on a correlational study design precludes the ability to make causal inferences.

CONCLUSIONS

Maternal pregnancy-related anxiety is an important predictor of child outcomes. We provide novel evidence that pregnancy-related anxiety predicts infant attention to emotional faces, behaviors which have important implications for socioemotional development. Providers may consider pregnancy-related anxiety as a target for screening and treatment that may benefit both pregnant individual and offspring.

Pupillometry as a new window to player fatigue? A glimpse inside the eyes of a Euro Cup Women's Basketball team

A rapidly emerging area of interest in high-pressure environments is that of pupillometry, where handheld quantitative infrared pupillometers (HQIPs) are able to track psycho-physiological fatigue in a fast, objective, valid, reliable, and non-invasive manner. However, the application of HQIPs in the context of athlete monitoring is yet to be determined. Therefore, the main aim of this pilot study was to examine the potential usefulness of a HQIP to monitor game-induced fatigue inside a professional female basketball setting by determining its (1) test-retest repeatability, (2) relationship with other biomarkers of game-induced fatigue, and (3) time-course from rested to fatigued states. A non-ophthalmologic practitioner performed a standardized Pupil Light Reflex (PLR) test using a medically graded HQIP among 9 professional female basketball players (2020-2021 Euro Cup) at baseline, 24-h pre-game (GD-1), 24-h post-game (GD+1) and 48-h post-game (GD+2). This was repeated over four subsequent games, equalling a total of 351 observations per eye. Two out of seven pupillometrics displayed good ICCs (0.95-0.99) (MinD and MaxD). Strong significant relationships were found between MaxD, MinD, and all registered biomarkers of game-induced fatigue (r = 0.69-0.82, p < 0.05), as well as between CV, MCV, and cognitive, lower-extremity muscle, and physiological fatigue markers (r = 0.74-0.76, p < 0.05). Three pupillometrics were able to detect a significant difference between rested and fatigued states. In particular, PC (right) (F = 5.173, η2 = 0.115 p = 0.028) and MCV (right) (F = 3.976, η2 = 0.090 p = 0.049) significantly decreased from baseline to GD+2, and LAT (left) (F = 4.023, η2 = 0.109 p = 0.009) significantly increased from GD-1 to GD+2. HQIPs have opened a new window of opportunity for monitoring game-induced fatigue in professional female basketball players. However, future research initiatives across larger and heterogenous samples, and longer investigation periods, are required to expand upon these preliminary findings.

The impact of co-pilot displays use on driver workload and driving performance exploring the impact of co-pilot display on drivers' workload and driving performance

New production vehicles equipped with multiple screens have various functions and technologies at the user's fingertips that create informative and immersive cockpits not only for the driver but also for the passenger. Despite the growing popularity of the co-pilot display, surprisingly little is known about the impact of its engagement on drivers. Engagement, in the context of this paper, is defined as visual, auditory, and mental involvement but no manual involvement. The present study sought to investigate the effects of co-pilot display engagement on drivers' visual workload, cognitive workload, and driving performance and offered a deeper insight into the design factors and task involvement of the co-pilot display. The study involved a driving simulator testing of 25 participants in five automobiles with a co-pilot display. Our analysis found increased driver visual workload and cognitive workload in the conditions of co-pilot display engagement. Participants exhibited more erratic driving behavior (standard deviation of speed and standard deviation of lane position) while the front passenger was watching a video. Furthermore, five linear mixed models were built to further analyze the effects of task type, screen size, screen layout, and task involvement on dependent measures. Potential applications of this research include refinements to the co-pilot display and workload estimation of co-pilot display engagement.

Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle

EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.

Computer-aided autism diagnosis using visual attention models and eye-tracking: replication and improvement proposal

BACKGROUND

Autism Spectrum Disorder (ASD) diagnosis can be aided by approaches based on eye-tracking signals. Recently, the feasibility of building Visual Attention Models (VAMs) from features extracted from visual stimuli and their use for classifying cases and controls has been demonstrated using Neural Networks and Support Vector Machines. The present work has three aims: 1) to evaluate whether the trained classifier from the previous study was generalist enough to classify new samples with a new stimulus; 2) to replicate the previously approach to train a new classifier with a new dataset; 3) to evaluate the performance of classifiers obtained by a new classification algorithm (Random Forest) using the previous and the current datasets.

METHODS

The previously approach was replicated with a new stimulus and new sample, 44 from the Typical Development group and 33 from the ASD group. After the replication, Random Forest classifier was tested to substitute Neural Networks algorithm.

RESULTS

The test with the trained classifier reached an AUC of 0.56, suggesting that the trained classifier requires retraining of the VAMs when changing the stimulus. The replication results reached an AUC of 0.71, indicating the potential of generalization of the approach for aiding ASD diagnosis, as long as the stimulus is similar to the originally proposed. The results achieved with Random Forest were superior to those achieved with the original approach, with an average AUC of 0.95 for the previous dataset and 0.74 for the new dataset.

CONCLUSION

In summary, the results of the replication experiment were satisfactory, which suggests the robustness of the approach and the VAM-based approaches feasibility to aid in ASD diagnosis. The proposed method change improved the classification performance. Some limitations are discussed and additional studies are encouraged to test other conditions and scenarios.

Assessing receptive verb knowledge in late talkers and autistic children: advances and cautionary tales

PURPOSE

Using eye-tracking, we assessed the receptive verb vocabularies of age-matched late talkers and typically developing children (experiment 1) and autistic preschoolers (experiment 2). We evaluated how many verbs participants knew and how quickly they processed the linguistic prompt. Our goal is to explore how these eye-gaze measures can be operationalized to capture verb knowledge in late talkers and autistic children.

METHOD

Participants previewed two dynamic scenes side-by-side (e.g., "stretching" and "clapping") and were then prompted to find the target verb's referent. Children's eye-gaze behaviors were operationalized using established approaches in the field with modifications in consideration for the type of stimuli (dynamic scenes versus static images) and the populations included. Accuracy was calculated as a proportion of time spent looking to the target, and linguistic processing was operationalized as latency of children's first look to the target.

RESULTS

In experiment 1, there were no group differences in the proportion of verbs known, but late talkers required longer to demonstrate their knowledge than typically developing children. Latency was predicted by age but not language abilities. In experiment 2, autistic children's accuracy and latency were both predicted by receptive language abilities.

CONCLUSION

Eye gaze can be used to assess receptive verb vocabulary in a variety of populations, but in operationalizing gaze behavior, we must account for between- and within-group differences. Bootstrapped cluster-permutation analysis is one way to create individualized measures of children's gaze behavior, but more research is warranted using an individual differences approach with this type of analysis.

The use of eye-tracking technology as a tool to evaluate social cognition in people with an intellectual disability: a systematic review and meta-analysis

BACKGROUND

Relatively little is known about social cognition in people with intellectual disability (ID), and how this may support understanding of co-occurring autism. A limitation of previous research is that traditional social-cognitive tasks place a demand on domain-general cognition and language abilities. These tasks are not suitable for people with ID and lack the sensitivity to detect subtle social-cognitive processes. In autism research, eye-tracking technology has offered an effective method of evaluating social cognition-indicating associations between visual social attention and autism characteristics. The present systematic review synthesised research which has used eye-tracking technology to study social cognition in ID. A meta-analysis was used to explore whether visual attention on socially salient regions (SSRs) of stimuli during these tasks correlated with degree of autism characteristics presented on clinical assessment tools.

METHOD

Searches were conducted using four databases, research mailing lists, and citation tracking. Following in-depth screening and exclusion of studies with low methodological quality, 49 articles were included in the review. A correlational meta-analysis was run on Pearson's r values obtained from twelve studies, reporting the relationship between visual attention on SSRs and autism characteristics.

RESULTS AND CONCLUSIONS

Eye-tracking technology was used to measure different social-cognitive abilities across a range of syndromic and non-syndromic ID groups. Restricted scan paths and eye-region avoidance appeared to impact people's ability to make explicit inferences about mental states and social cues. Readiness to attend to social stimuli also varied depending on social content and degree of familiarity. A meta-analysis using a random effects model revealed a significant negative correlation (r = -.28, [95% CI -.47, -.08]) between visual attention on SSRs and autism characteristics across ID groups. Together, these findings highlight how eye-tracking can be used as an accessible tool to measure more subtle social-cognitive processes, which appear to reflect variability in observable behaviour. Further research is needed to be able to explore additional covariates (e.g. ID severity, ADHD, anxiety) which may be related to visual attention on SSRs, to different degrees within syndromic and non-syndromic ID groups, in order to determine the specificity of the association with autism characteristics.

Feasibility of self-reported health related quality of life assessment with older people in residential care: insights from the application of eye tracking technology

PURPOSE

Increasingly there are calls to routinely assess the health-related quality of life (HRQoL) of older people receiving aged care services, however the high prevalence of dementia and cognitive impairment remains a challenge to implementation. Eye-tracking technology facilitates detailed assessment of engagement and comprehension of visual stimuli, and may be useful in flagging individuals and populations who cannot reliably self-complete HRQoL instruments. The aim of this study was to apply eye-tracking technology to provide insights into self-reporting of HRQoL among older people in residential care with and without cognitive impairment.

METHODS

Residents (n = 41), recruited based on one of three cognition subgroups (no, mild, or moderate cognitive impairment), completed the EQ-5D-5L on a computer with eye tracking technology embedded. Number and length of fixations (i.e., eye gaze in seconds) for key components of the EQ-5D-5L descriptive system were calculated.

RESULTS

For all dimensions, participants with no cognitive impairment fixated for longer on the Area of Interest (AOI) for the response option they finally chose, relative to those with mild or moderate cognitive impairment. Participants with cognitive impairment followed similar fixation patterns to those without. There was some evidence that participants with cognitive impairment took longer to complete and spent relatively less time attending to the relevant AOIs, but these differences did not reach statistical significance generally.

CONCLUSIONS

This exploratory study applying eye tracking technology provides novel insights and evidence of the feasibility of self-reported HRQoL assessments in older people in aged care settings where cognitive impairment and dementia are highly prevalent.

The free-viewing matrix task: A reliable measure of attention allocation in psychopathology

Aberrant attention allocation has been implicated in the etiology and maintenance of a range of psychopathologies. However, three decades of research, relying primarily on manual response-time tasks, have been challenged on the grounds of poor reliability of its attention bias indices. Here, in a large, multisite, international study we provide reliability information for a new eye-tracking-based measure of attention allocation and its relation to psychopathology and age. Data from 1567 participants, across a wide range of psychiatric diagnoses and ages, were aggregated from nine sites around the world. Of these, 213 participants also provided retest data. Acceptable overall internal consistency and test-retest reliability were observed among adult participants (Cronbach's alpha = 0.86 and r(213) = 0.89, respectively), as well as across all examined psychopathologies. Youth demonstrated lower internal consistency scores (Cronbach's alpha = 0.65). Finally, the percent dwell time index derived from the task statistically differentiated between healthy participants and participants diagnosed with social anxiety disorder, major depression, and post-traumatic stress disorder. These results potentially address a long-standing reliability crisis in this research field. Aberrant attention allocation patterns in a variety of psychiatric disorders may be targeted with the hope of affecting symptoms. The attention allocation index derived from the matrix task offers reliable means to measure such cognitive target engagement in clinical contexts.

Cognitive-attentional mechanisms of cooperation-with implications for attention-deficit hyperactivity disorder and cognitive neuroscience

People's cooperativeness depends on many factors, such as their motives, cognition, experiences, and the situation they are in. To date, it is unclear how these factors interact and shape the decision to cooperate. We present a computational account of cooperation that not only provides insights for the design of effective incentive structures but also redefines neglected social-cognitive characteristics associated with attention-deficit hyperactivity disorder (ADHD). Leveraging game theory, we demonstrate that the source and magnitude of conflict between different motives affected the speed and frequency of cooperation. Integrating eye-tracking to measure motivation-based information processing during decision-making shows that participants' visual fixations on the gains of cooperation rather than its costs and risks predicted their cooperativeness on a trial-by-trial basis. Using Bayesian hierarchical modeling, we find that a situation's prosociality and participants' past experience each bias the decision-making process distinctively. ADHD characteristics explain individual differences in responsiveness across contexts, highlighting the clinical importance of experimentally studying reactivity in social interactions. We demonstrate how the use of eye-tracking and computational modeling can be used to experimentally investigate social-cognitive characteristics in clinical populations. We also discuss possible underlying neural mechanisms to be investigated in future studies.

Longer looks for language: Novel labels lengthen fixation duration for 2-year-old children

The language infants hear guides their visual attention; infants look more to objects when they are labeled. However, it is unclear whether labels also change the way infants attend to and encode those objects-that is, whether hearing an object label changes infants' online visual processing of that object. Here, we examined this question in the context of novel word learning, asking whether nuanced measures of visual attention, specifically fixation durations, change when 2-year-olds hear a label for a novel object (e.g., "Look at the dax") compared with when they hear a non-labeling phrase (e.g., "Look at that"). Results confirmed that children visually process objects differently when they are labeled, using longer fixations to examine labeled objects versus unlabeled objects. Children also showed robust retention of these labels on a subsequent test trial, suggesting that these longer fixations accompanied successful word learning. Moreover, when children were presented with the same objects again in a silent re-exposure phase, children's fixations were again longer when looking at the previously labeled objects. Finally, fixation duration at first exposure and silent re-exposure were correlated, indicating a persistent effect of language on visual processing. These effects of hearing labels on visual attention point to the critical interactions involved in cross-modal learning and emphasize the benefits of looking beyond aggregate measures of attention to identify cognitive learning mechanisms during infancy.