How to Compare Apples and Oranges: Infants' Object Identification Tested With Equally Salient Shape, Luminance and Color Changes

Visual stimulus structure, visual system neural activity, and visual behavior in young human infants

In visual perception and information processing, a cascade of associations is hypothesized to flow from the structure of the visual stimulus to neural activity along the retinogeniculostriate visual system to behavior and action. Do visual perception and information processing adhere to this cascade near the beginning of life? To date, this three-stage hypothetical cascade has not been comprehensively tested in infants. In two related experiments, we attempted to expose this cascade in 6-month-old infants. Specifically, we presented infants with two levels of visual stimulus intensity, we measured electrical activity at the infant cortex, and we assessed infants' preferential looking behavior. Chromatic saturation provided a convenient stimulus dimension to test the cascade because greater saturation is known to excite increased activity in the primate visual system and is generally hypothesized to stimulate visual preference. Experiment 1 revealed that infants prefer (look longer) at the more saturated of two colors otherwise matched in hue and brightness. Experiment 2 showed increased aggregate neural cortical excitation in infants (and adults) to the more saturated of the same pair of colors. Thus, experiments 1 and 2 taken together confirm a cascade: Visual stimulation of relatively greater intensity evokes relatively greater levels of bioelectrical cortical activity which in turn is associated with relatively greater visual attention. As this cascade obtains near the beginning of life, it helps to account for early visual preferences and visual information processing.

The Development of Color Perception and Cognition

Color is a pervasive feature of our psychological experience, having a role in many aspects of human mind and behavior such as basic vision, scene perception, object recognition, aesthetics, and communication. Understanding how humans encode, perceive, talk about, and use color has been a major interdisciplinary effort. Here, we present the current state of knowledge on how color perception and cognition develop. We cover the development of various aspects of the psychological experience of color, ranging from low-level color vision to perceptual mechanisms such as color constancy to phenomena such as color naming and color preference. We also identify neurodiversity in the development of color perception and cognition and implications for clinical and educational contexts. We discuss the theoretical implications of the research for understanding mature color perception and cognition, for identifying the principles of perceptual and cognitive development, and for fostering a broader debate in the psychological sciences.

Coding of featural information in visual working memory in 2.5-year-old toddlers

The number of objects that infants can remember in visual working memory (VWM) increases rapidly during the first few years of life (Kaldy & Leslie, 2005; Ross-Sheehy, Oakes, & Luck, 2003). However, less is understood about the representational format of VWM: whether storage is determined by fixed-precision memory slots, or the allocation of a limited continuous resource. In the current study, we adapted the Delayed Match Retrieval eye-tracking paradigm (Kaldy, Guillory, & Blaser, 2016), to test 2.5-year-old toddlers' ability to remember three object-location bindings when the to-be-remembered objects were all unique (Experiment 1) versus when they shared features such as color or shape (Experiment 2). 2.5-year-olds succeeded in Experiment 1, but only performed marginally better than chance in Experiment 2. Interestingly, when incorrect, participants in Experiment 2 were no more likely to select a decoy item that shared a feature with the target item. It seems that the increased similarity of to-be-remembered objects did not impair memory for the objects directly, but instead increased the likelihood of catastrophic forgetting.

Visual short-term memory for overtly attended objects during infancy

We investigated limitations in young infants' visual short-term memory (VSTM). We used a one-shot change detection task to ask whether 4- and 8.5-month-old infants (N = 59) automatically encode fixated items in VSTM. Our task included trials that consisted of the following sequence: first a brief (500 ms) presentation with a sample array of two items, next a brief (300 ms) delay period with a blank screen, and finally a test array (2,000 ms) identical to the sample array except that the color of one of the two items is changed. In Experiment 1, we induced infants to fixate one item by rotating it during the sample (the other item remained stationary). In Experiment 2, none of the items rotated. In both experiments, 4-month-old infants looked equally at the fixated item when it did and did not change color, providing no evidence that they encoded in VSTM the fixated item. In contrast, 8.5-month-old infants in Experiment 1 preferred the fixated item when it changed color from sample to test. Thus, 4-month-old infants do not appear to automatically encode fixated items in VSTM.

The Role of Saliency in Learning First Words

In word learning, one key accomplishment is the reference, that is, the linking of a word to its referent. According to classical theories, the term reference captures a mental event: A person uses a word to mentally recall a concept of an entity (an object or event) in order to bring it into the mental focus of an interaction. The developmental literature proposes different approaches regarding how children accomplish this link. Although researchers agree that multiple processes (within and across phonological, lexical, and semantic areas) are responsible for word learning, recent research has highlighted the role of saliency and perception as crucial factors in the early phases of word learning. Generally speaking, whereas some approaches to solving the reference problem attribute a greater role to the referent's properties being salient, others emphasize the social context that is needed to select the appropriate referent. In this review, we aim to systematize terminology and propose that the reason why assessments of the impact of saliency on word learning are controversial is that definitions of the term saliency reveal different weightings of the importance that either perceptual or social stimuli have for the learning process. We propose that defining early word learning in terms of paying attention to salient stimuli is too narrow. Instead, we emphasize that a new link between a word and its referent will succeed if a stimulus is relevant for the child.

Rules infants look by: Testing the assumption of transitivity in visual salience

What drives infants' attention in complex visual scenes? Early models of infant attention suggested that the degree to which different visual features were detectable determines their attentional priority. Here, we tested this by asking whether two targets - defined by different features, but each equally salient when evaluated independently - would drive attention equally when pitted head-to-head. In Experiment 1, we presented 6-month-old infants with an array of gabor patches in which a target region varied either in color or spatial frequency from the background. Using a forced-choice preferential-looking method, we measured how readily infants fixated the target as its featural difference from the background was parametrically increased. Then, in Experiment 2, we used these psychometric preference functions to choose values for color and spatial frequency targets that were equally salient (preferred), and pitted them against each other within the same display. We reasoned that, if salience is transitive, then the stimuli should be iso-salient and infants should therefore show no systematic preference for either stimulus. On the contrary, we found that infants consistently preferred the color-defined stimulus. This suggests that computing visual salience in more complex scenes needs to include factors above and beyond local salience values.

Infants Actively Construct and Update Their Representations of Physical Events: Evidence from Change Detection by 12-Month-Olds

The present research investigates the effects of top-down information on 12-month-olds’ representations of physical events, focusing on their ability to detect an object change across different events. Infants this age typically fail to detect height changes in events with tubes even though they successfully do so in events with covers. In Experiment  1, infants who saw a tube event in which objects did not interact successfully detected a change in an object’s height, suggesting that object interaction affects infants’ categorization of physical events. Experiments 2 and 3 examined the fine-grained process of event representation. In Experiment  2, infants detected the change in the tube event if they were led by pretest exposure to believe that the event was conducted with a cover. In Experiment  3, infants who initially believed so updated their representation if shown a tube before object interaction occurred (but not after). Together, these findings provide new evidence that infants, like older children and adults, actively construct physical events. Whether they notice a change depends on their existing knowledge and the current representation of the event.

Delayed Match Retrieval: a novel anticipation-based visual working memory paradigm

We tested 8- and 10-month-old infants' visual working memory (VWM) for object-location bindings - what is where - with a novel paradigm, Delayed Match Retrieval, that measured infants' anticipatory gaze responses (using a Tobii T120 eye tracker). In an inversion of Delayed-Match-to-Sample tasks and with inspiration from the game Memory, in test trials, three face-down virtual 'cards' were presented. Two flipped over sequentially (revealing, e.g. a swirl pattern and then a star), and then flipped back face-down. Next, the third card was flipped to reveal a match (e.g. a star) to one of the previously seen, now face-down cards. If infants looked to the location where the (now face-down) matching card had been shown, this was coded as a correct response. To encourage anticipatory looks, infants subsequently received a reward (a brief, engaging animation) presented at that location. Ten-month-old infants performed significantly above chance, showing that their VWM could hold object-location information for the two cards. Overall, 8-month-olds' performance was at chance, but they showed a robust learning trend. These results corroborate previous findings (Kaldy & Leslie, 2005; Oakes, Ross-Sheehy & Luck, 2006) and point to rapid development of VWM for object-location bindings. However, compared to previous paradigms that measure passive gaze responses to novelty, this paradigm presents a more challenging, ecologically relevant test of VWM, as it measures the ability to make online predictions and actively localize objects based on VWM. In addition, this paradigm can be readily scaled up to test toddlers or older children without significant modification.

Dissociating Attention Effects from Categorical Perception with ERP Functional Microstates

When faces appear in our visual environment we naturally attend to them, possibly to the detriment of other visual information. Evidence from behavioural studies suggests that faces capture attention because they are more salient than other types of visual stimuli, reflecting a category-dependent modulation of attention. By contrast, neuroimaging data has led to a domain-specific account of face perception that rules out the direct contribution of attention, suggesting a dedicated neural network for face perception. Here we sought to dissociate effects of attention from categorical perception using Event Related Potentials. Participants viewed physically matched face and butterfly images, with each category acting as a target stimulus during different blocks in an oddball paradigm. Using a data-driven approach based on functional microstates, we show that the locus of endogenous attention effects with ERPs occurs in the N1 time range. Earlier categorical effects were also found around the level of the P1, reflecting either an exogenous increase in attention towards face stimuli, or a putative face-selective measure. Both category and attention effects were dissociable from one another hinting at the role that faces may play in early capturing of attention before top-down control of attention is observed. Our data support the conclusion that certain object categories, in this experiment, faces, may capture attention before top-down voluntary control of attention is initiated.

Experience with malleable objects influences shape-based object individuation by infants

Infants' ability to accurately represent and later recognize previously viewed objects, and conversely, to discriminate novel objects from those previously seen improves remarkably over the first two years of life. During this time, infants acquire extensive experience viewing and manipulating objects and these experiences influence their physical reasoning. Here we posited that infants' observations of object feature stability (rigid versus malleable) can influence the use of those features to individuate two successively viewed objects. We showed 8.5-month-olds a series of objects that could or could not change shape, then assessed their use of shape as a basis for object individuation. Infants who explored rigid objects later used shape differences to individuate objects; however, infants who explored malleable objects did not. This outcome suggests that the latter infants did not take into account shape differences during the physical reasoning task and provides further evidence that infants' attention to object features can be readily modified based on recent experiences.

Red to green or fast to slow? Infants' visual working memory for "just salient differences"

In this study, 6-month-old infants' visual working memory for a static feature (color) and a dynamic feature (rotational motion) was compared. Comparing infants' use of different features can only be done properly if experimental manipulations to those features are equally salient (Kaldy & Blaser, 2009; Kaldy, Blaser, & Leslie, 2006). The interdimensional salience mapping method was used to find two objects that each were one Just Salient Difference from a common baseline object (N = 16). These calibrated stimuli were then used in a subsequent two-alternative forced-choice preferential looking memory test (N = 28). Results showed that infants noted the color change, but not the equally salient change in rotation speed.

Trajectory perception and object continuity: effects of shape and color change on 4-month-olds' perception of object identity

Previous work has demonstrated that infants use object trajectory continuity as a cue to the constant identity of an object, but results are equivocal regarding the role of object features, with some work suggesting that a change in the appearance of an object does not cue a change in identity. In an experiment involving 72 participants, we investigated the effects of changing object shape and color, singly and in combination, on 4-month-olds' perception of object continuity. A change in the shape of an object while it passed behind an occluder had no effect on perception of continuity, whereas a change in shape and color led to perception of discontinuity, and a change in color led to no clear percept regarding continuity or discontinuity. These results are discussed in terms of a perceptual learning model of development of object identity.

What Do Infants Remember When They Forget? Location and Identity in 6-Month-Olds’ Memory for Objects

What does an infant remember about a forgotten object? Although at age 6 months, infants can keep track of up to three hidden objects, they can remember the featural identity of only one. When infants forget the identity of an object, do they forget the object entirely, or do they retain an inkling of it? In a looking-time study, we familiarized 6-month-olds with a disk and a triangle placed on opposite sides of a stage. During test trials, we hid the objects one at a time behind different screens, and after hiding the second object, we removed the screen where the first object had been hidden. Infants then saw the expected object, the unexpected other object, or the empty stage. Bayes factor analysis showed that although the infants did not notice when the object changed shape, they were surprised when it vanished. This finding indicates that infants can represent an object without its features.

Toddlers with Autism Spectrum Disorder are more successful at visual search than typically developing toddlers

Plaisted, O'Riordan and colleagues (Plaisted, O'Riordan & Baron-Cohen, 1998; O'Riordan, 2004) showed that school-age children and adults with Autism Spectrum Disorder (ASD) are faster at finding targets in certain types of visual search tasks than typical controls. Currently though, there is very little known about the visual search skills of very young children (1-3-year-olds) - either typically developing or with ASD. We used an eye-tracker to measure looking behavior, providing fine-grained measures of visual search in 2.5-year-old toddlers with and without ASD (this representing the age by which many children may first receive a diagnosis of ASD). Importantly, our paradigm required no verbal instructions or feedback, making the task appropriate for toddlers who are pre- or nonverbal. We found that toddlers with ASD were more successful at finding the target than typically developing, age-matched controls. Further, our paradigm allowed us to estimate the number of items scrutinized per trial, revealing that for large set size conjunctive search, toddlers with ASD scrutinized as many as twice the number of items as typically developing toddlers, in the same amount of time.