Disentangling the mechanisms underlying infant fixation durations in scene perception: A computational account

Endogenous oscillatory rhythms and interactive contingencies jointly influence infant attention during early infant-caregiver interaction

Almost all early cognitive development takes place in social contexts. At the moment, however, we know little about the neural and micro-interactive mechanisms that support infants' attention during social interactions. Recording EEG during naturalistic caregiver-infant interactions (N=66), we compare two different accounts. Traditional, didactic perspectives emphasise the role of the caregiver in structuring the interaction, whilst active learning models focus on motivational factors, endogenous to the infant, that guide their attention. Our results show that, already by 12 months, intrinsic cognitive processes control infants' attention: fluctuations in endogenous oscillatory neural activity associated with changes in infant attentiveness. In comparison, infant attention was not forwards-predicted by caregiver gaze or vocal behaviours. Instead, caregivers rapidly modulated their behaviours in response to changes in infant attention and cognitive engagement, and greater reactive changes associated with longer infant attention. Our findings suggest that shared attention develops through interactive but asymmetric, infant-led processes that operate across the caregiver-child dyad.

Toward Dynamical Modeling of Infants' Looking Times

Analyzing looking times is among the most important behavioral approaches to studying problems such as infant cognition, perception, or language development. However, process-based approaches to the dynamics of infants' looking times are lacking. Here, we propose a new dynamical framework for modeling infant gaze behavior with full account of the microstructure (i.e., saccades and fixations). Our process-based model is illustrated by reproducing inter-individual differences in a developmental study of noun comprehension (Garrison et al. 2020). In our modeling framework, numerical values of model parameters map onto specific cognitive processes (e.g., attention or working memory) involved in gaze control. Because of the general architecture of the mathematical model and our robust procedures in model inference via Bayesian data assimilation, our framework may find applications in other fields of developmental and cognitive sciences.

Dissociable genetic influences on eye movements during abstract versus naturalistic social scene viewing in infancy

Eye-movement metrics like fixation location and duration are increasingly being used in infancy research. We tested whether fixation durations during meaningful social stimulus viewing involve common or different familial influences than fixation durations during viewing of abstract stimulus. We analysed the duration of fixations, and the allocation of fixations to face and motion, from 536 dizygotic and monozygotic 5-month-old twins in: naturalistic scenes including low- and high-level social features, and abstract scenes only having low-level features. We observed significant genetic influences in both conditions (h2naturalistic = 0.30, 95% confidence interval (CI) 0.14 to 0.44; h2abstract = 0.25, 95% CI 0.09 to 0.39), while shared environmental influences were negligible. Although some genetic influences were shared between the two conditions, unique genetic factors were linked to naturalistic scene viewing, indicating that fixation durations index different phenomena dependent on the context. Heritability for face looking was moderate (h2 = 0.19, 95% CI 0.03 to 0.34), and no familial influences were found for motion looking. Exploratory polygenic score analyses revealed no significant associations with fixation measures. This study underscores the dissociable genetic influences on infants' visual exploration of abstract versus naturalistic stimuli and the importance of considering context when interpreting eye-tracking data.

The Brain Imaging for Global Health (BRIGHT) Project: Longitudinal cohort study protocol

There is a scarcity of prospective longitudinal research targeted at early postnatal life which maps developmental pathways of early-stage processing and brain specialisation in the context of early adversity. Follow up from infancy into the one-five year age range is key, as it constitutes a critical gap between infant and early childhood studies. Availability of portable neuroimaging (functional near infrared spectroscopy (fNIRS) and electroencephalography (EEG)) has enabled access to rural settings increasing the diversity of our sampling and broadening developmental research to include previously underrepresented ethnic-racial and geographical groups in low- and middle- income countries (LMICs). The primary objective of the Brain Imaging for Global Health (BRIGHT) project was to establish brain function - using longitudinal data from mother - for-age reference curves infant dyads living in the UK and rural Gambia and investigate the association between context-associated moderators and developmental trajectories across the first two years of life in The Gambia. In total, 265 participating families were seen during pregnancy, at 7-14 days, 1-, 5-, 8-, 12-, 18- and 24-months post-partum. An additional visit is now underway at 3-5 years to assess pre-school outcomes. The majority of our Gambian cohort live in poverty, but while resource-poor in many factors they commonly experience a rich and beneficial family and caregiving context with multigenerational care and a close-knit supportive community. Understanding the impact of different factors at play in such an environment ( i.e., detrimental undernutrition versus beneficial multigenerational family support) will (i) improve the representativeness of models of general cognitive developmental pathways from birth, (ii) identify causal pathways of altered trajectories associated with early adversity at both individual and group level, and (iii) identify the context-associated moderators ( i.e. social context) that protect development despite the presence of poverty-associated challenges. This will in turn contribute to the development of targeted interventions.

A computational modeling approach to investigating mind wandering-related adjustments to gaze behavior during scene viewing

Research on gaze control has long shown that increased visual-cognitive processing demands in scene viewing are associated with longer fixation durations. More recently, though, longer durations have also been linked to mind wandering, a perceptually decoupled state of attention marked by decreased visual-cognitive processing. Toward better understanding the relationship between fixation durations and visual-cognitive processing, we ran simulations using an established random-walk model for saccade timing and programming and assessed which model parameters best predicted modulations in fixation durations associated with mind wandering compared to attentive viewing. Mind wandering-related fixation durations were best described as an increase in the variability of the fixation-generating process, leading to more variable-sometimes very long-durations. In contrast, past research showed that increased processing demands increased the mean duration of the fixation-generating process. The findings thus illustrate that mind wandering and processing demands modulate fixation durations through different mechanisms in scene viewing. This suggests that processing demands cannot be inferred from changes in fixation durations without understanding the underlying mechanism by which these changes were generated.

Intra-individual variation in the songs of humpback whales suggests they are sonically searching for conspecifics

Observations of animals' vocal actions can provide important clues about how they communicate and about how they perceive and react to changing situations. Here, analyses of consecutive songs produced by singing humpback whales recorded off the coast of Hawaii revealed that singers constantly vary the acoustic qualities of their songs within prolonged song sessions. Unlike the progressive changes in song structure that singing humpback whales make across months and years, intra-individual acoustic variations within song sessions appear to be largely stochastic. Additionally, four sequentially produced song components (or "themes") were each found to vary in unique ways. The most extensively used theme was highly variable in overall duration within and across song sessions, but varied relatively little in frequency content. In contrast, the remaining themes varied greatly in frequency content, but showed less variation in duration. Analyses of variations in the amount of time singers spent producing the four themes suggest that the mechanisms that determine when singers transition between themes may be comparable to those that control when terrestrial animals move their eyes to fixate on different positions as they examine visual scenes. The dynamic changes that individual whales make to songs within song sessions are counterproductive if songs serve mainly to provide conspecifics with indications of a singer's fitness. Instead, within-session changes to the acoustic features of songs may serve to enhance a singer's capacity to echoically detect, localize, and track conspecifics from long distances.

Difference in gaze control ability between low and high skill players of a real-time strategy game in esports

This research investigated the difference in aspects of gaze control between esports experts (Expert) and players with lower skills (Low Skill) while playing the real-time strategy game called StarCraft. Three versions of this game at different difficulty levels were made with the StarCraft Editor, and the gaze movements of seven Expert and nine Low Skill players were analyzed while they played the games. The gaze of Expert players covered a significantly larger area in the horizontal direction than the gaze of Low Skill players. Furthermore, the magnitude and number of saccadic eye movements were greater, and saccade velocity was faster in the Expert than in the Low Skill players. In conclusion, StarCraft experts have a specific gaze control ability that enables them to quickly and widely take visual information from all over the monitor. This could be one of the factors enabling StarCraft experts to perform better than players with lower skills when playing games that require task-switching ability.

Testing predictions of a neural process model of visual attention in infancy across competitive and non-competitive contexts

A key question in early development is how changes in neural systems give rise to changes in infants' behavior. We examine this question by testing predictions of a dynamic field (DF) model of infant spatial attention. We tested 5‐, 7‐, and 10‐month‐old infants in the Infant Orienting With Attention (IOWA) task containing the original non‐competitive cue conditions (when a central stimulus disappeared before a cue onset) and new competitive cue conditions (when a central stimulus remained visible throughout the trial). This allowed testing of five model predictions: (1) that orienting accuracy would be higher and (2) reaction times would be slower for all competitive conditions; (3) that all infants would be slower to orient in the competitive conditions, though (4) older infants would show the strongest competition costs; and (5) that reaction times would be particularly slow for un‐cued competitive conditions. Four of these five predictions were supported, and the remaining prediction was supported in part. We next examined fits of the model to the expanded task. New simulation results reveal close fits to the present findings after parameter modification. Critically, developmental parameters of the model were not altered, providing support for the DF model's account of neuro‐developmental change.

The Babytwins Study Sweden (BATSS): A Multi-Method Infant Twin Study of Genetic and Environmental Factors Influencing Infant Brain and Behavioral Development

Twin studies can help us understand the relative contributions of genes and environment to phenotypic trait variation, including attentional and brain activation measures. In terms of applying methodologies such as electroencephalography (EEG) and eye tracking, which are key methods in developmental neuroscience, infant twin studies are almost nonexistent. Here, we describe the Babytwins Study Sweden (BATSS), a multi-method longitudinal twin study of 177 MZ and 134 DZ twin pairs (i.e., 622 individual infants) covering the 5-36 month time period. The study includes EEG, eye tracking and genetics, together with more traditional measures based on in-person testing, direct observation and questionnaires. The results show that interest in participation in research among twin parents is high, despite the comprehensive protocol. DNA analysis from saliva samples was possible in virtually all participants, allowing for both zygosity confirmation and polygenic score analyses. Combining a longitudinal twin design with advanced technologies in developmental cognitive neuroscience and genomics, BATSS represents a new approach in infancy research, which we hope to have impact across multiple disciplines in the coming years.

Fixation durations in natural scene viewing are guided by peripheral scene content

Fixation durations provide insights into processing demands. We investigated factors controlling fixation durations during scene viewing in two experiments. In Experiment 1, we tested the degree to which fixation durations adapt to global scene processing difficulty by manipulating the contrast (from original contrast to isoluminant) and saturation (original vs. grayscale) of the entire scene. We observed longer fixation durations for lower levels of contrast, and longer fixation durations for grayscale than for color scenes. Thus fixation durations were globally slowed as visual information became more and more degraded, making scene processing increasingly more difficult. In Experiment 2, we investigated two possible sources for this slow-down. We used "checkerboard" stimuli in which unmodified patches alternated with patches from which luminance information had been removed (isoluminant patches). Fixation durations showed an inverted immediacy effect (longer, rather than shorter, fixation durations on unmodified patches) along with a parafoveal-on-foveal effect (shorter fixation durations, when an unmodified patch was fixated next). This effect was stronger when the currently fixated patch was isoluminant as opposed to unmodified. Our results suggest that peripheral scene information substantially affects fixation durations and are consistent with the notion of competition among the current and potential future fixation locations.

Infants' gaze exhibits a fractal structure that varies by age and stimulus salience

The development of selective visual attention is critical for effectively engaging with an ever-changing world. Its optimal deployment depends upon interactions between neural, motor, and sensory systems across multiple timescales and neurocognitive loci. Previous work illustrates the spatio-temporal dynamics of these processes in adults, but less is known about this emergent phenomenon early in life. Using data (n = 190; 421 visits) collected between 3 and 35 months of age, we examined the spatio-temporal complexity of young children's gaze patterns as they viewed stimuli varying in semantic salience. Specifically, we used detrended fluctuation analysis (DFA) to quantify the extent to which infants' gaze patterns exhibited scale invariant patterns of nested variability, an organizational feature thought to reflect self-organized and optimally flexible system dynamics that are not overly rigid or random. Results indicated that gaze patterns of even the youngest infants exhibited fractal organization that increased with age. Further, fractal organization was greater when children (a) viewed social stimuli compared to stimuli with degraded social information and (b) when they spontaneously gazed at faces. These findings suggest that selective attention is well-organized in infancy, particularly toward social information, and indicate noteworthy growth in these processes across the first years of life.

Early Development of Visual Attention: Change, Stability, and Longitudinal Associations

Visual attention is a basic mechanism of information gathering and environment selection and consequently plays a fundamental role in influencing developmental trajectories. Here, we highlight evidence for predictive associations from early visual attention to emotion regulation, executive function, language and broader cognitive ability, mathematics and literacy skills, and neurodevelopmental conditions. Development of visual attention is also multifaceted and nonlinear. In daily life, core functions such as orienting, selective filtering, and processing of visual inputs are intertwined and influenced by many other cognitive components. Furthermore, the demands of an attention task vary according to the experience, motivation, and cognitive and physical constraints of participants, while the mechanisms underlying performance may change with development. Thus, markers of attention may need to be interpreted differently across development and between populations. We summarize research that has combined multiple measurements and techniques to further our understanding of visual attention development and highlight possibilities for the future.

The Effects of Calibration Target, Screen Location, and Movement Type on Infant Eye-Tracking Data Quality

During infant eye-tracking, fussiness caused by the repetition of calibration stimuli and body movements during testing are frequent constraints on measurement quality. Here, we systematically investigated these constraints with infants and adults using EyeLink 1000 Plus. We compared looking time and dispersion of gaze points elicited by stimuli resembling commonly used calibration animations. The adult group additionally performed body movements during gaze recording that were equivalent to movements infants spontaneously produce during testing. In our results, infants' preference for a particular calibration target did not predict data quality elicited by that stimulus, but targets exhibiting the strongest contrasts in their center or targets with globally distributed complexity resulted in the highest accuracy. Our gaze measures from the adult movement tasks were differentially affected by the type of movement as well as the location where the target appeared on the screen. These heterogeneous effects of movement on measures should be taken into account when planning infant eye-tracking experiments. Additionally, to improve data quality, infants' tolerance for repeated calibrations can be facilitated by alternating between precise calibration targets.

Beyond fixation durations: Recurrence quantification analysis reveals spatiotemporal dynamics of infant visual scanning

Standard looking-duration measures in eye-tracking data provide only general quantitative indices, while details of the spatiotemporal structuring of fixation sequences are lost. To overcome this, various tools have been developed to measure the dynamics of fixations. However, these analyses are only useful when stimuli have high perceptual similarity and they require the previous definition of areas of interest (AOIs). Although these methods have been widely applied in adult studies, relatively little is known about the temporal structuring of infant gaze-foraging behaviors such as variability of scanning over time or individual scanning patterns. Thus, to shed more light on the spatiotemporal characteristics of infant fixation sequences we apply for the first time a new methodology for nonlinear time-series analysis-the recurrence quantification analysis (RQA). We present how the dynamics of infant scanning varies depending on the scene content during a "pop-out" search task. Moreover, we show how the normalization of RQA measures with average fixation durations provides a more detailed account of the dynamics of fixation sequences. Finally, we link the RQA measures of temporal dynamics of scanning with the spatial information about the stimuli using heat maps of recurrences without the need for defining a priori AOIs and present how infants' foraging strategies are driven by the image content. We conclude from our findings that the RQA methodology has potential applications in the analysis of the temporal dynamics of infant visual foraging offering advantages over existing methods.