Development of perceptual completion originates in information acquisition

Active vision in sight recovery individuals with a history of long-lasting congenital blindness

What we see is intimately linked to how we actively and systematically explore the world through eye movements. However, it is unknown to what degree visual experience during early development is necessary for such systematic visual exploration to emerge. The present study investigated visual exploration behavior in ten human participants whose sight had been restored only in childhood or adulthood, after a period of congenital blindness due to dense bilateral congenital cataracts. Participants freely explored real-world images while their eye movements were recorded. Despite severe residual visual impairments and gaze instability (nystagmus), visual exploration patterns were preserved in individuals with reversed congenital cataract. Modelling analyses indicated that similar to healthy controls, visual exploration in individuals with reversed congenital cataract was based on the low-level (luminance contrast) and high-level (object components) visual content of the images. Moreover, participants used visual short-term memory representations for narrowing down the exploration space. More systematic visual exploration in individuals with reversed congenital cataract was associated with better object recognition, suggesting that active vision might be a driving force for visual system development and recovery. The present results argue against a sensitive period for the development of neural mechanisms associated with visual exploration.SIGNIFICANCE STATEMENTHumans explore the visual world with systematic patterns of eye movements, but it is unknown whether early visual experience is necessary for the acquisition of visual exploration. Here, we show that sight recovery individuals who had been born blind demonstrate highly systematic eye movements while exploring real-world images, despite visual impairments and pervasive gaze instability. In fact, their eye movement patterns were predicted by those of normally sighted controls and models calculating eye movements based on low- and high-level visual features, and they moreover took memory information into account. Since object recognition performance was associated with systematic visual exploration it was concluded that eye movements might be a driving factor for the development of the visual system.

Home-based early stimulation program targeting visual and motor functions for preterm infants with delayed tracking: Feasibility of a Randomized Clinical Trial

AIMS

To verify the feasibility of a home-based early stimulation program targeting visual and motor functions in preterm infants with delayed visual tracking.

METHOD

We applied a randomized controlled trial. We included thirty low-risk preterm infants, from both genders, with delayed visual tracking, gestational between 28-37 weeks, and age at entrance between 1-2 months of corrected age, and absence of visual impairments. Infants were divided into two groups as follows: a) standard care group (SC) that received general orientation about sensory and motor development (16 infants); b) experimental group, that received a four-week home-based early stimulation program targeting visual and motor functions (ESPVM) applied by the caregivers (14 infants). The feasibility outcomes were retention and loss rates, adherence, adverse events, and stress signals. We obtained preliminary data by comparing visual tracking, motor development, and sensory behavior between groups at the end of the intervention.

RESULTS

Retention rate was high, 90 % of the caregivers provided ESPVM at least 22 days, and 70 % provided SC at least 17 days. No adverse events were reported. At the end of intervention, the ESPVM group presented higher frequencies of complete visual tracking for cards 7 (ESPVM = 57.3 %, SC = 6.3 %, p = 0.006) and 8 (ESPVM = 64.3 %, SC = 12.2 %, p = 0.013), and lower scores for total sensory profile (ESPVM: median = 58, range = 46-69; SC: median = 71, range = 54-90; p = 0.016). The groups were similar for motor development.

CONCLUSIONS

The protocol was feasible, and the results encourage a larger randomized controlled trial.

Infants' identification of gender in biological motion displays

Infants' knowledge of social categories, including gender-typed characteristics, is a vital aspect of social cognitive development. In the current study, we examined 9- to 12-month-old infants' understanding of the categories "male" and "female" by testing for gender matching in voices or faces with biological motion depicted in point light displays (PLDs). Infants did not show voice-PLD gender matching spontaneously (Experiment 1) or after "training" with gender-matching voice-PLD pairs (Experiment 2). In Experiment 3, however, infants were trained with gender-matching face-PLD pairs and we found that patterns of visual attention to top regions of PLD stimuli during training predicted gender matching of female faces and PLDs. Prior to the end of the first postnatal year, therefore, infants may begin to identify gender in human walk motions, and perhaps form social categories from biological motion.

Development of Visual-Spatial Attention

This chapter reviews literature on development of visual-spatial attention. A brief overview of brain mechanisms of visual perception is provided, followed by discussion of neural maturation in the prenatal period, infancy, and childhood. This is followed by sections on gaze control, eye movement systems, and orienting. The chapter concludes with consideration of development of space, objects, and scenes. Visual-spatial attention reflects an intricate set of motor, perceptual, and cognitive systems that work jointly and all develop in tandem.

How Perception and Action Fosters Exploration and Selection in Infant Skill Acquisition

In this chapter, we discuss how perception and action are intimately linked to the processes of exploration and selection. Exploration, which we define as trying several variations of the behavior, and selection, which involves attempting to reproduce the behaviors that work, are essential for learning about the environment, discovering the properties of objects, and for acquiring skills in relation to goals. Exploration and selection happen in the moment and over time as behaviors are repeated, hence leading to their fine-tuning to the goal. We illustrate this time-dependent developmental process using several examples from infants reaching for objects, to discovering object properties, to learning about the functionality of tool use, and even to word learning. As we present those examples, we introduce a more detailed perception-action loop to illustrate those moment-to-moment behaviors and show how they contribute to the acquisition of perceptual, motor, and cognitive skills in infancy.

Visual scanning of male and female bodies in infancy

This study addressed the development of attention to information that is socially relevant to adults by examining infants' (N=64) scanning patterns of male and female bodies. Infants exhibited systematic attention to regions associated with sex-related scanning by adults, with 3.5- and 6.5-month-olds looking longer at the torsos of females than of males and looking longer at the legs of males than of females. However, this pattern of looking was not found when infants were tested on headless bodies in Experiment 2, suggesting that infants' differential gaze pattern in Experiment 1 was not due to low-level stimulus features, such as clothing, and also indicating that facial/head information is necessary for infants to exhibit sex-specific scanning. We discuss implications for models of face and body knowledge development.

Cortical responses to shape-from-motion stimuli in the infant

Our ability to extract three-dimensional (3-D) object structure from motion-carried information is a basic visual capacity that is fundamental to object perception. Despite a rich body of behavioral work demonstrating that infants are sensitive to motion-carried information from the early months of life, little is known about the cortical networks that support infants' use of motion-carried information to extract 3-D object structure. This study assessed patterns of cortical activation in infants aged 4 to 6 months as they viewed two types of visual stimuli: (a) shape-from-motion (SFM) displays, where coherent motion of randomly distributed dots gave rise to the percept of 3-D shape and (b) random motion (RM) displays, where dots' motions lacked a coherent structure and gave rise to the percept of randomly moving dots. Functional near-infrared spectroscopy was used to assess activation in occipital, inferior parietal, and posterior temporal cortex. The optical imaging data revealed differential responding to SFM and RM in lower level object processing areas than typically observed in the adult. Possible explanations for this pattern of results are considered.

A crucial temporal accuracy test of combining EEG and Tobii eye tracker

Eye tracking and event-related potentials have been widely used in the field of cognitive psychology and neuroscience. Both techniques have the ability to refine cognitive models through a precise timeline description; nevertheless, they also have severe limitations. Combining measures of event-related potentials and eye movements can contribute to cognitive process capture, which provides the possibility to determine precisely when and in which order different cognitive operations occur. Combining of event-related potentials and eye movements has been recently conducted by synchronizing measures from an infrared eye tracker with an electroencephalograph to allow simultaneous data recording. Here, we describe in detail 4 types of co-registration methods for event-related potentials and eye movements on the Tobii platform. Moreover, the present investigation was designed to evaluate the temporal accuracy of data obtained using the 4 methods. We found that the method based on the Tobii Pro Analytics software development kit had a higher degree of temporal accuracy than the other co-registration methods. Furthermore, the reasons for the different temporal accuracies were assessed, and potential measures to correct clock drift were taken. General suggestions are made regarding timing in the co-registration of the electroencephalograph and eye tracker.

Emotional experience in music fosters 18-month-olds' emotion-action understanding: a training study

We examine whether emotional experiences induced via music-making promote infants' use of emotional cues to predict others' action. Fifteen-month-olds were randomly assigned to participate in interactive emotion training either with or without musical engagement for three months. Both groups were then re-tested with two violation-of-expectation paradigms respectively assessing their sensitivity to some expressive features in music and understanding of the link between emotion and behaviour in simple action sequences. The infants who had participated in music, but not those who had not, were surprised by music-face inconsistent displays and were able to interpret an agent's action as guided by her expressed emotion. The findings suggest a privileged role of musical experience in prompting infants to form emotional representations, which support their understanding of the association between affective states and action.

A new system for quantitative evaluation of infant gaze capabilities in a wide visual field

BACKGROUND

The visual assessment of infants poses specific challenges: many techniques that are used on adults are based on the patient's response, and are not suitable for infants. Significant advances in the eye-tracking have made this assessment of infant visual capabilities easier, however, eye-tracking still requires the subject's collaboration, in most cases and thus limiting the application in infant research. Moreover, there is a lack of transferability to clinical practice, and thus it emerges the need for a new tool to measure the paradigms and explore the most common visual competences in a wide visual field. This work presents the design, development and preliminary testing of a new system for measuring infant's gaze in the wide visual field called CareToy C: CareToy for Clinics.

METHODS

The system is based on a commercial eye tracker (SmartEye) with six cameras running at 60 Hz, suitable for measuring an infant's gaze. In order to stimulate the infant visually and audibly, a mechanical structure has been designed to support five speakers and five screens at a specific distance (60 cm) and angle: one in the centre, two on the right-hand side and two on the left (at 30° and 60° respectively). Different tasks have been designed in order to evaluate the system capability to assess the infant's gaze movements during different conditions (such as gap, overlap or audio-visual paradigms). Nine healthy infants aged 4-10 months were assessed as they performed the visual tasks at random.

RESULTS

We developed a system able to measure infant's gaze in a wide visual field covering a total visual range of ±60° from the centre with an intermediate evaluation at ±30°. Moreover, the same system, thanks to different integrated software, was able to provide different visual paradigms (as gap, overlap and audio-visual) assessing and comparing different visual and multisensory sub-competencies. The proposed system endowed the integration of a commercial eye-tracker into a purposive setup in a smart and innovative way.

CONCLUSIONS

The proposed system is suitable for measuring and evaluating infant's gaze capabilities in a wide visual field, in order to provide quantitative data that can enrich the clinical assessment.

From local to global processing: the development of illusory contour perception

Global visual processing is important for segmenting scenes, extracting form from background, and recognizing objects. Local processing involves attention to the local elements, contrast, and boundaries of an image at the expense of extracting a global percept. Previous work is inconclusive regarding the relative development of local and global processing. Some studies suggest that global perception is already present by 8 months of age, whereas others suggest that the ability arises during childhood and continues to develop during adolescence. We used a novel method to assess the development of global processing in 3- to 10-year-old children and an adult comparison group. We used Kanizsa illusory contours as an assay of global perception and measured responses on a touch-sensitive screen while monitoring eye position with a head-mounted eye tracker. Participants were tested using a similarity match-to-sample paradigm. Using converging measures, we found a clear developmental progression with age such that the youngest children performed near chance on the illusory contour discrimination, whereas 7- and 8-year-olds performed nearly perfectly, as did adults. There was clear evidence of a gradual shift from a local processing strategy to a global one; young children looked predominantly at and touched the "pacman" inducers of the illusory form, whereas older children and adults looked predominantly at and touched the middle of the form. These data show a prolonged developmental trajectory in appreciation of global form, with a transition from local to global visual processing between 4 and 7 years of age.

Visual search and attention to faces during early infancy

Newborn babies look preferentially at faces and face-like displays, yet over the course of their first year much changes about both the way infants process visual stimuli and how they allocate their attention to the social world. Despite this initial preference for faces in restricted contexts, the amount that infants look at faces increases considerably during the first year. Is this development related to changes in attentional orienting abilities? We explored this possibility by showing 3-, 6-, and 9-month-olds engaging animated and live-action videos of social stimuli and also measuring their visual search performance with both moving and static search displays. Replicating previous findings, looking at faces increased with age; in addition, the amount of looking at faces was strongly related to the youngest infants' performance in visual search. These results suggest that infants' attentional abilities may be an important factor in facilitating their social attention early in development.

Infants' ability to extract three-dimensional shape from coherent motion

Our capacity to perceive three-dimensional (3D) object structure from two-dimensional (2D) retinal input is fundamental to object perception. The present research examined infants' ability to extract 3D form from structure-from-motion (SFM) displays using a familiarization/visual-paired-comparison paradigm. In SFM displays dots are projected onto the surfaces of a shape that rotates around a 3D axis and it is the coherent structure of the dots' motion that gives rise to the percept of shape. Infants mean age 4.5 and 9 months were familiarized to a SFM display (e.g., cylinder); in test they were presented the familiar SFM display paired with a novel SFM display (e.g., cube). Infants in both age groups displayed a significant preference for the novel SFM test display. These results are consistent with those obtained previously using habituation paradigms and provide converging evidence for infants' early emerging capacity to use coherent motion - in the absence of figural information - as a cue to depth structure. In addition, these results demonstrate that infants' ability to extract 3D shape from coherent motion can be successfully assessed with a neuroimaging-friendly protocol, which was one of the goals of this study.

Oculomotor Exploration of Impossible Figures in Early Infancy

Previous studies with young infants revealed that young infants can distinguish between displays of possible or impossible figures, which may require detection of inconsistent depth relations among local line junctions that disrupt global object configurations. Here, we used an eye-tracking paradigm to record eye movements in young infants during an object discrimination task with matched pairs of possible and impossible figures. Our goal was to identify differential patterns of oculomotor activity as infants viewed pictures of possible and impossible objects. We predicted that infants would actively attend to specific pictorial depth cues that denote shape (e.g., T-junctions), and in the context of an impossible figure that they would fixate to a greater extent in anomalous regions of the display relative to other parts. By the age of 4 months, infants fixated reliably longer overall on displays of impossible vs. possible cubes, specifically within the critical region where the incompatible lines and irreconcilable depth relations were located, implying an early capacity for selective attention to critical line junction information and integration of local depth cues necessary to perceive object coherence.

Simulating the role of visual selective attention during the development of perceptual completion

We recently proposed a multi-channel, image-filtering model for simulating the development of visual selective attention in young infants (Schlesinger, Amso & Johnson, 2007). The model not only captures the performance of 3-month-olds on a visual search task, but also implicates two cortical regions that may play a role in the development of visual selective attention. In the current simulation study, we used the same model to simulate 3-month-olds' performance on a second measure, the perceptual unity task. Two parameters in the model - corresponding to areas in the occipital and parietal cortices - were systematically varied while the gaze patterns produced by the model were recorded and subsequently analyzed. Three key findings emerged from the simulation study. First, the model successfully replicated the performance of 3-month-olds on the unity perception task. Second, the model also helps to explain the improved performance of 2-month-olds when the size of the occluder in the unity perception task is reduced. Third, in contrast to our previous simulation results, variation in only one of the two cortical regions simulated (i.e. recurrent activity in posterior parietal cortex) resulted in a performance pattern that matched 3-month-olds. These findings provide additional support for our hypothesis that the development of perceptual completion in early infancy is promoted by progressive improvements in visual selective attention and oculomotor skill.

Selective attention in cross-situational statistical learning: evidence from eye tracking

A growing set of data show that adults are quite good at accumulating statistical evidence across individually ambiguous learning contexts with multiple novel words and multiple novel objects (Yu and Smith, 2007; Fitneva and Christiansen, 2011; Kachergis et al., 2012; Yurovsky et al., under resubmission); experimental studies also indicate that infants and young children do this kind of learning as well (Smith and Yu, 2008; Vouloumanos and Werker, 2009). The present study provides evidence for the operation of selective attention in the course of cross-situational learning with two main goals. The first was to show that selective attention is critical for the underlying mechanisms that support successful cross-situational learning. The second one was to test whether an associative mechanism with selective attention can explain momentary gaze data in cross-situational learning. Toward these goals, we collected eye movement data from participants when they engaged in a cross-situational statistical learning task. Various gaze patterns were extracted, analyzed and compared between strong learners who acquired more word-referent pairs through training, and average and weak learners who learned fewer pairs. Fine-grained behavioral patterns from gaze data reveal how learners control their attention after hearing a word, how they selectively attend to individual objects which compete for attention within a learning trial, and how statistical evidence is accumulated trial by trial, and integrated across words, across objects, and across word-object mappings. Taken together, those findings from eye movements provide new evidence on the real-time statistical learning mechanisms operating in the human cognitive system.

Visual Data Mining: An Exploratory Approach to Analyzing Temporal Patterns of Eye Movements

Infant eye movements are an important behavioral resource to understand early human development and learning. But the complexity and amount of gaze data recorded from state-of-the-art eye-tracking systems also pose a challenge: how does one make sense of such dense data? Toward this goal, this article describes an interactive approach based on integrating top-down domain knowledge with bottom-up information visualization and visual data mining. The key idea behind this method is to leverage the computational power of the human visual system. Thus, we propose an approach in which scientists iteratively examine and identify underlying patterns through data visualization and link those discovered patterns with top-down knowledge/hypotheses. Combining bottom-up data visualization with top-down human theoretical knowledge through visual data mining is an effective and efficient way to make discoveries from gaze data. We first provide an overview of the underlying principles of this new approach of human-in-the-loop knowledge discovery and then show several examples illustrating how this interactive exploratory approach can lead to new findings.

Volume completion in 4.5-month-old infants

In this study, we examined 4.5-month-old infants' visual completion of self-occluding three-dimensional objects. A previous study on this topic reported that 6-month-old, but not 4-month-old infants extrapolate a convex, symmetric prism from a limited view of its surfaces (Soska & Johnson, 2008). As of yet, studies on the development of amodal completion of three-dimensional, self-occluding objects are scarce. Given 4-month-old infants' abilities to derive three-dimensional shape from a variety of visual cues, three-dimensional amodal completion may well depend on the perceptual strength of three-dimensionality in the stimulus displays. The first experiments (1A and 1B) tested this hypothesis by means of a habituation paradigm and showed that 4.5-month-old infants are indeed able to amodally complete the back of a self-occluding object when sufficient three-dimensional cues are available. Further support for volume completion in 4.5-month-old infants was found in a second experiment, again using a habituation paradigm, that measured perceived connectedness between two visually separated, self-occluding, three-dimensional objects.

A Critical Test of Temporal and Spatial Accuracy of the Tobii T60XL Eye Tracker

Infant eye tracking is becoming increasingly popular for its presumed precision relative to traditional looking time paradigms and potential to yield new insights into developmental processes. However, there is strong reason to suspect that the temporal and spatial resolution of popular eye tracking systems is not entirely accurate, potentially compromising any data from an infant eye tracking experiment. Moreover, "best practices" for infant eye tracking, such as knowing which software tool enhances experimental flexibility, remain to be determined. The present investigation was designed to evaluate the temporal and spatial accuracy of data from the Tobii T60XL eye tracker through the use of visual latency and spatial accuracy tasks involving adults and infants. Systematic delays and drifts were revealed in oculomotor response times, and the system's spatial accuracy was observed to deviate somewhat in excess of the manufacturer's estimates; the experimental flexibility of the system appears dependent on the chosen software.

Visual statistical learning in the newborn infant

Statistical learning - implicit learning of statistical regularities within sensory input - is a way of acquiring structure within continuous sensory environments. Statistics computation, initially shown to be involved in word segmentation, has been demonstrated to be a general mechanism that operates across domains, across time and space, and across species. Recently, statistical leaning has been reported to be present even at birth when newborns were tested with a speech stream. The aim of the present study was to extend this finding, by investigating whether newborns' ability to extract statistics operates in multiple modalities, as found for older infants and adults. Using the habituation procedure, two experiments were carried out in which visual sequences were presented. Results demonstrate that statistical learning is a general mechanism that extracts statistics across domain since the onset of sensory experience. Intriguingly, present data reveal that newborn learner's limited cognitive resources constrain the functioning of statistical learning, narrowing the range of what can be learned.

Development of visual perception

Processes of visual development that yield a view of the world as coherent and stable begin well before birth and extend over the first several years after the onset of visual experience. Infants are born capable of seeing and with specific preferences that guide the point of gaze to relevant portions of the visual scene to support learning about objects and faces. Visual development after birth is characterized by critical periods in many notable visual functions, and by extensive learning from experience and increasing control over eye movement systems. WIREs Cogni Sci 2011 2 515-528 DOI: 10.1002/wcs.128 For further resources related to this article, please visit the WIREs website.

How Infants Learn About the Visual World

The visual world of adults consists of objects at various distances, partly occluding one another, substantial and stable across space and time. The visual world of young infants, in contrast, is often fragmented and unstable, consisting not of coherent objects but rather surfaces that move in unpredictable ways. Evidence from computational modeling and from experiments with human infants highlights three kinds of learning that contribute to infants' knowledge of the visual world: learning via association, learning via active assembly, and learning via visual-manual exploration. Infants acquire knowledge by observing objects move in and out of sight, forming associations of these different views. In addition, the infant's own self-produced behavior-oculomotor patterns and manual experience, in particular-are important means by which infants discover and construct their visual world.

How infants view natural scenes gathered from a head-mounted camera

The role of early visual experience in human infant development has been inferred primarily by studies of visual deprivation (e.g., cataracts). Another approach, described here, is to provide a detailed description of the visual input gathered by normal infants in their natural environment. Recently, several labs have begun the laborious process of obtaining video images from a head-mounted camera to provide an infant's eye-view of their visual world. Preliminary findings from one such study are reviewed and discussed in the context of the power and limitations of this approach for revealing important insights about the role of early visual experience, as well as the broader implications for studies of cognitive, language, and social development.

Development of infants' attention to faces during the first year

In simple tests of preference, infants as young as newborns prefer faces and face-like stimuli over distractors. Little is known, however, about the development of attention to faces in complex scenes. We recorded eye-movements of 3-, 6-, and 9-month-old infants and adults during free-viewing of clips from A Charlie Brown Christmas (an animated film). The tendency to look at faces increased with age. Using novel computational tools, we found that 3-month-olds were less consistent (across individuals) in where they looked than were older infants. Moreover, younger infants' fixations were best predicted by low-level image salience, rather than the locations of faces. Between 3 and 9 months of age, infants gradually focused their attention on faces. We discuss several possible interpretations of this shift in terms of social development, cross-modal integration, and attentional/executive control.

The emergence of intention attribution in infancy

Perception of the social world in terms of agents and their intentional relations is fundamental to human experience. In this chapter, we review recent investigations into the origins of this fundamental ability that trace its roots to the first year of life. These studies show that infants represent others' actions not as purely physical motions, but rather as actions directed at goals and objects of attention. Infants are able to recover intentional relations at varying levels of analysis, including concrete action goals, higher-order plans, acts of attention, and collaborative goals. There is mounting evidence that these early competencies are strongly influenced by infants' own experience as intentional agents. Action experience shapes infants' action perception.

New perspectives on the effects of action on perceptual and cognitive development

This special section was motivated by a resurgence in the view that it is impossible to investigate perceptual and cognitive development without considering how it is affected by, and intertwined with, infants' and children's action in the world. This view has long been foundational to the field, yet contemporary investigations of the effects of acting on cognition and perception have been limited. The research showcased in this section indicates that this trend is changing as researchers consider anew the ways in which cognition derives structure from action. The work presented here illustrates the breadth of these potential effects across ages and domains of development, and it highlights the breadth of methods that can be recruited to investigate them. This new research focus provides insight for the mechanisms by which action affects perception and cognition and at the same time reveals that much remains to be learned.