Neural mechanisms of attention become more specialised during infancy: Insights from combined eye tracking and EEG

Coregistration of EEG and eye-tracking in infants and developing populations

Infants cannot be instructed where to look; therefore, infant researchers rely on observation of their participant's gaze to make inferences about their cognitive processes. They therefore started studying infant attention in the real world from early on. Developmental researchers were early adopters of methods combining observations of gaze and behaviour with electroencephalography (EEG) to study attention and other cognitive functions. However, the direct combination of eye-tracking methods and EEG to test infants is still rare, as it includes specific challenges. The current article reviews the development of co-registration research in infancy. It points out specific challenges of co-registration in infant research and suggests ways to overcome them. It ends with recommendations for implementing the co-registration of EEG and eye-tracking in infant research to maximise the benefits of the two measures and their combination and to orient on Open Science principles while doing so. In summary, this work shows that the co-registration of EEG and eye-tracking in infant research can be beneficial to studying natural and real-world behaviour despite its challenges.

Uncomfortable staring? Gaze to other people in social situations is inhibited in both infants and adults

People attract infants' and adults' gaze when presented on a computer screen. However, in live social situations, adults inhibit their gaze at strangers to avoid sending inappropriate social signals. Such inhibition of gaze has never been directly investigated in infants. The current preregistered study measured gaze and neural responses (EEG alpha power) to a confederate in a live social situation compared to a video of this confederate. Adults looked less at the live confederate than at the video of the confederate, although their neural responses suggest that they were overall equally attentive in both situations. Infants also looked less at the live confederate than at the video of the confederate, with similar neural response patterns. The gaze difference between live social and video situations increased with age. The study shows that young infants are already sensitive to social context and show decreased gaze to strangers in social situations. RESEARCH HIGHLIGHTS: This study shows that infants and adults look more at a video of a stranger than at a stranger that is present live in a social situation. Neural responses suggest that adults are equally attentive in both live and video situations but inhibit their gaze at the stranger in live social situations. Infants show a similar pattern of shorter gaze at a stranger who is present in person than at a video of this stranger. The study shows that gaze in infants and adults may diverge from cognitive processes measured through EEG, highlighting the importance of combining behavioural and neural measures in natural interactions.

Neural correlates of attentional orienting with neutral and fearful gaze cues in 12-month-olds

Infants use information on gaze direction and facial expressions for social referencing when encountering various objects in their environment. However, it remains unclear how these social cues influence attentional orienting in infants. Using event-related potentials (ERPs), we investigated the neural correlates of attentional orienting cued by an averted gaze with neutral and fearful expressions in 12-month-olds. We focused on the ERPs in response to a face (N290, P400, and Nc) as well as a saccade toward the target (the presaccadic spike potential: SP) and found that the amplitudes of the face-sensitive ERPs (N290 and P400) were larger for directed than averted gaze direction irrespective of facial expression. Furthermore, the amplitude of the SP involved in overt orienting was larger for fearful expressions than for neutral expressions, irrespective of gaze congruency. These results suggest that information on gaze direction and facial expression, specifically neutral and fearful expressions, may be processed independently, and that fearful expressions dominantly influence the neural correlates of attentional orienting in infants around 12 months of age.

Challenges and new perspectives of developmental cognitive EEG studies

Despite shared procedures with adults, electroencephalography (EEG) in early development presents many specificities that need to be considered for good quality data collection. In this paper, we provide an overview of the most representative early cognitive developmental EEG studies focusing on the specificities of this neuroimaging technique in young participants, such as attrition and artifacts. We also summarize the most representative results in developmental EEG research obtained in the time and time-frequency domains and use more advanced signal processing methods. Finally, we briefly introduce three recent standardized pipelines that will help promote replicability and comparability across experiments and ages. While this paper does not claim to be exhaustive, it aims to give a sufficiently large overview of the challenges and solutions available to conduct robust cognitive developmental EEG studies.

Visual competition attenuates emotion effects during overt attention shifts

Numerous different objects are simultaneously visible in a person's visual field, competing for attention. This competition has been shown to affect eye-movements and early neural responses toward stimuli, while the role of a stimulus' emotional meaning for mechanisms of overt attention shifts under competition is unclear. The current study combined EEG and eye-tracking to investigate effects of competition and emotional content on overt shifts of attention to human face stimuli. Competition prolonged the latency of the P1 component and of saccades, while faces showing emotional expressions elicited an early posterior negativity (EPN). Remarkably, the emotion-related modulation of the EPN was attenuated when two stimuli were competing for attention compared to non-competition. In contrast, no interaction effects of emotional expression and competition were observed on other event-related potentials. This finding indicates that competition can decelerate attention shifts in general and also diminish the emotion-driven attention capture, measured through the smaller effects of emotional expression on EPN amplitude. Reduction of the brain's responsiveness to emotional content in the presence of distractors contradicts models that postulate fully automatic processing of emotions.

Oscillatory entrainment to our early social or physical environment and the emergence of volitional control

An individual's early interactions with their environment are thought to be largely passive; through the early years, the capacity for volitional control develops. Here, we consider: how is the emergence of volitional control characterised by changes in the entrainment observed between internal activity (behaviour, physiology and brain activity) and the sights and sounds in our everyday environment (physical and social)? We differentiate between contingent responsiveness (entrainment driven by evoked responses to external events) and oscillatory entrainment (driven by internal oscillators becoming temporally aligned with external oscillators). We conclude that ample evidence suggests that children show behavioural, physiological and neural entrainment to their physical and social environment, irrespective of volitional attention control; however, evidence for oscillatory entrainment beyond contingent responsiveness is currently lacking. Evidence for how oscillatory entrainment changes over developmental time is also lacking. Finally, we suggest a mechanism through which periodic environmental rhythms might facilitate both sensory processing and the development of volitional control even in the absence of oscillatory entrainment.

Testing predictions of a neural process model of visual attention in infancy across competitive and non-competitive contexts

A key question in early development is how changes in neural systems give rise to changes in infants' behavior. We examine this question by testing predictions of a dynamic field (DF) model of infant spatial attention. We tested 5‐, 7‐, and 10‐month‐old infants in the Infant Orienting With Attention (IOWA) task containing the original non‐competitive cue conditions (when a central stimulus disappeared before a cue onset) and new competitive cue conditions (when a central stimulus remained visible throughout the trial). This allowed testing of five model predictions: (1) that orienting accuracy would be higher and (2) reaction times would be slower for all competitive conditions; (3) that all infants would be slower to orient in the competitive conditions, though (4) older infants would show the strongest competition costs; and (5) that reaction times would be particularly slow for un‐cued competitive conditions. Four of these five predictions were supported, and the remaining prediction was supported in part. We next examined fits of the model to the expanded task. New simulation results reveal close fits to the present findings after parameter modification. Critically, developmental parameters of the model were not altered, providing support for the DF model's account of neuro‐developmental change.

Scaffolding layered control architectures through constraint closure: insights into brain evolution and development

The functional organization of the mammalian brain can be considered to form a layered control architecture, but how this complex system has emerged through evolution and is constructed during development remains a puzzle. Here we consider brain organization through the framework of constraint closure, viewed as a general characteristic of living systems, that they are composed of multiple sub-systems that constrain each other at different timescales. We do so by developing a new formalism for constraint closure, inspired by a previous model showing how within-lifetime dynamics can constrain between-lifetime dynamics, and we demonstrate how this interaction can be generalized to multi-layered systems. Through this model, we consider brain organization in the context of two major examples of constraint closure-physiological regulation and visual orienting. Our analysis draws attention to the capacity of layered brain architectures to scaffold themselves across multiple timescales, including the ability of cortical processes to constrain the evolution of sub-cortical processes, and of the latter to constrain the space in which cortical systems self-organize and refine themselves. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Infant precursors of executive function in Down syndrome

BACKGROUND

Although early features of infant cognition are predictive of executive function (EF) in typically developing (TD) children, there is little information regarding the developmental origins of EF in neurogenetic conditions, such as Down syndrome (DS).

METHODS

The current study compared the performance of infants with and without DS on three dimensions that are hypothesised EF precursors: visual engagement, attention shifting and action planning. Additionally, the relationship between these EF precursors at Time 1 and EF performance at Time 2 (6 months later) was examined in the DS group. Participants were 36 infants with DS, M chronological age = 12.65 months, SD = 2.11; M developmental age = 8.84 months, SD = 2.22, and 36 TD infants, M chronological age = 8.62, SD = 3.06; M developmental age = 8.64 months, SD = 3.40.

RESULTS

Infants with DS visually engaged with objects for longer durations and demonstrated challenges with action planning compared with TD infants at Time 1. Attention shifting at Time 1 significantly predicted EF performance at Time 2 in the DS group.

CONCLUSIONS

This study provides evidence that an early atypical presentation of EF precursors is detectable during infancy in DS and is predictive of subsequent EF performance. These findings contribute to the identification of areas of early cognitive risk in DS and can inform future interventions in this population.

Emotional content influences eye-movements under natural but not under instructed conditions

ABSTRACTIn everyday life, people can freely decide if and where they would like to move their attention and gaze, often influenced by physical and emotional salience of stimuli. However, many laboratory paradigms explicitly instruct participants when and how to move their eyes, leading to unnatural instructed eye-movements. The current preregistered study compared eye-movements to peripherally appearing faces with happy, angry and neutral expressions under natural and instructed conditions. Participants reliably moved their eyes towards peripheral faces, even when they were not instructed to do so; however, eye-movements were significantly slower under natural than under instructed conditions. Competing central stimuli decelerated eye-movements independently of instructions. Unexpectedly, the emotional salience only affected eye-movements under natural conditions, with faster saccades towards emotional than towards neutral faces. No effects of emotional expression occurred when participants were instructed to move their eyes. The study shows that natural eye-movements significantly differ from instructed eye-movements and emotion-driven attention effects are reduced when participants are artificially instructed to move their eyes, suggesting that research should investigate eye-movements under natural conditions.

Overt and covert attention shifts to emotional faces: Combining EEG, eye tracking, and a go/no-go paradigm

In everyday life, faces with emotional expressions quickly attract attention and eye movements. To study the neural mechanisms of such emotion-driven attention by means of event-related brain potentials (ERPs), tasks that employ covert shifts of attention are commonly used, in which participants need to inhibit natural eye movements towards stimuli. It remains, however, unclear how shifts of attention to emotional faces with and without eye movements differ from each other. The current preregistered study aimed to investigate neural differences between covert and overt emotion-driven attention. We combined eye tracking with measurements of ERPs to compare shifts of attention to faces with happy, angry, or neutral expressions when eye movements were either executed (go conditions) or withheld (no-go conditions). Happy and angry faces led to larger EPN amplitudes, shorter latencies of the P1 component, and faster saccades, suggesting that emotional expressions significantly affected shifts of attention. Several ERPs (N170, EPN, LPC) were augmented in amplitude when attention was shifted with an eye movement, indicating an enhanced neural processing of faces if eye movements had to be executed together with a reallocation of attention. However, the modulation of ERPs by facial expressions did not differ between the go and no-go conditions, suggesting that emotional content enhances both covert and overt shifts of attention. In summary, our results indicate that overt and covert attention shifts differ but are comparably affected by emotional content.

Joint Analysis of Eye Blinks and Brain Activity to Investigate Attentional Demand during a Visual Search Task

In several fields, the need for a joint analysis of brain activity and eye activity to investigate the association between brain mechanisms and manifest behavior has been felt. In this work, two levels of attentional demand, elicited through a conjunction search task, have been modelled in terms of eye blinks, brain activity, and brain network features. Moreover, the association between endogenous neural mechanisms underlying attentional demand and eye blinks, without imposing a time-locked structure to the analysis, has been investigated. The analysis revealed statistically significant spatial and spectral modulations of the recorded brain activity according to the different levels of attentional demand, and a significant reduction in the number of eye blinks when a higher amount of attentional investment was required. Besides, the integration of information coming from high-density electroencephalography (EEG), brain source localization, and connectivity estimation allowed us to merge spectral and causal information between brain areas, characterizing a comprehensive model of neurophysiological processes behind attentional demand. The analysis of the association between eye and brain-related parameters revealed a statistically significant high correlation (R > 0.7) of eye blink rate with anterofrontal brain activity at 8 Hz, centroparietal brain activity at 12 Hz, and a significant moderate correlation with the participation of right Intra Parietal Sulcus in alpha band (R = -0.62). Due to these findings, this work suggests the possibility of using eye blinks measured from one sensor placed on the forehead as an unobtrusive measure correlating with neural mechanisms underpinning attentional demand.

Evidence for Attentional Phenotypes in Infancy and Their Role in Visual Cognitive Performance

Infant visual attention rapidly develops during the first year of life, playing a pivotal role in the way infants process, learn, and respond to their visual world. It is possible that individual differences in eye movement patterns shape early experience and thus subsequent cognitive development. If this is the case, then it may be possible to identify sub-optimal attentional behaviors in infancy, before the emergence of cognitive deficit. In Experiment 1, a latent profile analysis was conducted on scores derived from the Infant Orienting with Attention (IOWA) task, a cued-attention task that measures individual differences in spatial attention and orienting proficiency. This analysis identified three profiles that varied substantially in terms of attentional efficiency. The largest of these profiles (“high flexible”, 55%) demonstrated functionally optimal patterns of attentional functioning with relatively rapid, selective, and adaptive orienting responses. The next largest group (“low reactive”, 39.6%) demonstrated low attentional sensitivity with slow, insensitive orienting responses. The smallest group (“high reactive”, 5.4%) demonstrated attentional over-sensitivity, with rapid, unselective and inaccurate orienting responses. A linear mixed effect model and growth curve analysis conducted on 5- to 11-month-old eye tracking data revealed significant stable differences in growth trajectory for each phenotype group. Results from Experiment 2 demonstrated the ability of attentional phenotypes to explain individual differences in general cognitive functioning, revealing significant between-phenotype group differences in performance on a visual short-term memory task. Taken together, results presented here demonstrate that attentional phenotypes are present early in life and predict unique patterns of growth from 5 to 11 months, and may be useful in understanding the origin of individual differences in general visuo-cognitive functioning.

Relation Between Event-Related Potential Latency and Saccade Latency in Overt Shifts of Attention

Controlled shifts of attention between competing stimuli are crucial for effective everyday visual behaviour. While these typically involve overt shifts of fixation, many past studies used covert attention shifts in which fixation is unchanged, meaning that some response components may result from the inhibition of eye movements. In this study, the neural events in the human brain when making overt shifts of attention are studied through the combination of event-related potential recording with simultaneous eye tracking. Fixation shifts under competition (central target remains visible when a peripheral target appears) were compared with noncompetition (central target disappears). A longer latency for competition compared with noncompetition, which is found in the saccadic response, is already present in the early occipital positivity when a single target is presented for the fixation shift. These results indicate that the requirement to disengage from a current target affects the time course of neural processing at an early level. However, the relation is more complex when the participant is required to choose which of two targets to fixate.

Visual development

The developing visual brain is an integrated system, linking analysis of the visual input to visuomotor control, visual cognition, and attention. Major points in human visual development are the presence of rudimentary pathways present at birth which can control fixation behavior, with subsequent development of specific functions. These functions include the emergence of cortical selectivity; the integration of local signals to provide global representations of motion, shape, and space; the development of visuomotor modules for eye movements, manual reaching, and locomotion; and the development of distinct attentional systems. Measures of these processes in infancy and early childhood can provide indicators of broader brain development in the at-risk child. A key system in development is the dorsal cortical stream. Measures of global motion processing, visuomotor actions, and attention suggest that this system is particularly vulnerable in children with a wide range of neurodevelopmental disorders. Early disorders of the eye (strabismus, cataract) reveal the level of plasticity in the developing visual system and the ways in which early experience can affect the course of functional development.

Neural Mechanisms of Overt Attention Shifts to Emotional Faces

Emotional faces draw attention and eye-movements towards them. However, the neural mechanisms of attention have mainly been investigated during fixation, which is uncommon in everyday life where people move their eyes to shift attention to faces. Therefore, the current study combined eye-tracking and Electroencephalography (EEG) to measure neural mechanisms of overt attention shifts to faces with happy, neutral and angry expressions, allowing participants to move their eyes freely towards the stimuli. Saccade latencies towards peripheral faces did not differ depending on expression and early neural response (P1) amplitudes and latencies were unaffected. However, the later occurring Early Posterior Negativity (EPN) was significantly larger for emotional than for neutral faces. This response appears after saccades towards the faces. Therefore, emotion modulations only occurred after an overt shift of gaze towards the stimulus had already been completed. Visual saliency rather than emotional content may therefore drive early saccades, while later top-down processes reflect emotion processing.

Impaired Attention Orienting in Young Children With Fragile X Syndrome

Fragile X syndrome (FXS) is a genetic disorder caused by a trinucleotide CGG expansion within the FMR1 gene located on the X chromosome. Children with FXS have been shown to be impaired in dynamic visual attention processing. A key component of dynamic processing is orienting—a perceptual ability that requires disengagement and engagement of attention from one stimulus to fixate on a second. Orienting, specifically the disengagement and engagement of attention, has previously not been studied in young children with FXS. Using an eye tracking gap-overlap task, the present study investigated visual disengagement and engagement in young children with FXS, compared to mental age (MA)- and chronological age (CA)-matched typically developing children. On gap trials, the central stimulus elicited fixation, but then disappeared before the peripheral target appeared, imposing a visual gap between stimuli. On overlap trials, the central stimulus elicited fixation, and remained present when the peripheral target appeared, creating visual competition. A gap effect emerges when latencies to shift to the peripheral target are longer in overlap versus gap conditions, reflecting the recruitment of cortical and subcortical disengagement and engagement mechanisms. The gap effect was measured as the latency to orient attention to the peripheral target during gap versus overlap conditions. Both MA and CA groups showed the expected gap effect, where children were slower to orient to peripheral targets on overlap trials than on gap trials. In contrast, in the FXS group, saccadic latencies between gap and overlap trials were not significantly different, indicating no significant gap effect. These findings suggest disrupted attentional engagement patterns in FXS that may be underlying impairments in attention orienting, and suggest potential targets for attention training in this population.

Correlates of early cognition in infants with Down syndrome

BACKGROUND

While delays in cognitive development are detectable during early development in Down syndrome, the neuropsychological and biomedical underpinnings of cognitive skill acquisition in this population remain poorly understood.

METHOD

To explore this issue, 38 infants with Down syndrome [mean chronological age = 9.65 months; SD = 3.64] completed the Bayley Scales of Infant Development-III and a set of laboratory tasks that measured sustained attention (duration of visual attention during a 1-min object exploration task), attention shifting (mean latency to shift attention on an alternating object presentation task) and visual short-term memory (dishabituation to a novel object on a change preference task).

RESULTS

Latency to shift attention was negatively associated with Bayley Cognitive Scale raw scores, even when controlling for the effects of chronological age, r (33) = -.41, P = .02. In addition, prematurity status was associated with latency to shift attention.

CONCLUSIONS

Early attention shifting may be an important factor that facilitates overall cognitive skill acquisition in infants with Down syndrome, and premature birth may be a risk factor for difficulties on this dimension.

The Effect of Stimulus Size and Eccentricity on Attention Shift Latencies

The ability to shift attention between relevant stimuli is crucial in everyday life and allows us to focus on relevant events. It develops during early childhood and is often impaired in clinical populations, as can be investigated in the fixation shift paradigm and the gap-overlap paradigm. Different tests use stimuli of different sizes presented at different eccentricities, making it difficult to compare them. This study systematically investigates the effect of eccentricity and target size on refixation latencies towards target stimuli. Eccentricity and target size affected attention shift latencies with greatest latencies to big targets that were presented at a small eccentricity. Slowed responses to large parafoveal targets are in line with the idea that specific areas in the superior colliculus can lead to inhibition of eye movements. Findings suggest that the two different paradigms are generally comparable, as long as the target is scaled in proportion to the eccentricity.

The Davida Teller Award Lecture, 2016: Visual Brain Development: A review of "Dorsal Stream Vulnerability"-motion, mathematics, amblyopia, actions, and attention

Research in the Visual Development Unit on "dorsal stream vulnerability' (DSV) arose from research in two somewhat different areas. In the first, using cortical milestones for local and global processing from our neurobiological model, we identified cerebral visual impairment in infants in the first year of life. In the second, using photo/videorefraction in population refractive screening programs, we showed that infant spectacle wear could reduce the incidence of strabismus and amblyopia, but many preschool children, who had been significantly hyperopic earlier, showed visuo-motor and attentional deficits. This led us to compare developing dorsal and ventral streams, using sensitivity to global motion and form as signatures, finding deficits in motion sensitivity relative to form in children with Williams syndrome, or perinatal brain injury in hemiplegia or preterm birth. Later research showed that this "DSV" was common across many disorders, both genetic and acquired, from autism to amblyopia. Here, we extend DSV to be a cluster of problems, common to many disorders, including poor motion sensitivity, visuo-motor spatial integration for planning actions, attention, and number skills. In current research, we find that individual differences in motion coherence sensitivity in typically developing children are correlated with MRI measures of area variations in parietal lobe, fractional anisotropy (from TBSS) of the superior longitudinal fasciculus, and performance on tasks of mathematics and visuo-motor integration. These findings suggest that individual differences in motion sensitivity reflect decision making and attentional control rather than integration in MT/V5 or V3A. Its neural underpinnings may be related to Duncan's "multiple-demand" (MD) system.