Infants parse dynamic action

Visual statistical learning in preverbal infants at a higher likelihood of autism and its association with later social communication skills

Visual statistical Learning (SL) allows infants to extract the statistical relationships embedded in a sequence of elements. SL plays a crucial role in language and communication competencies and has been found to be impacted in Autism Spectrum Disorder (ASD). This study aims to investigate visual SL in infants at higher likelihood of developing ASD (HL-ASD) and its predictive value on autistic-related traits at 24-36 months. At 6 months of age, SL was tested using a visual habituation task in HL-ASD and neurotypical (NT) infants. All infants were habituated to a visual sequence of shapes containing statistically predictable patterns. In the test phase, infants viewed the statistically structured, familiar sequence in alternation with a novel sequence that did not contain any statistical information. HL-ASD infants were then evaluated at 24-36 months to investigate the associations between visual SL and ASD-related traits. Our results showed that NT infants were able to learn the statistical structure embedded in the visual sequences, while HL-ASD infants showed different learning patterns. A regression analysis revealed that SL ability in 6-month-old HL-ASD infants was related to social communication and interaction abilities at 24-36 months of age. These findings indicate that early differences in learning visual statistical patterns might contribute to later social communication skills.

People can reliably detect action changes and goal changes during naturalistic perception

As a part of ongoing perception, the human cognitive system segments others' activities into discrete episodes (event segmentation). Although prior research has shown that this process is likely related to changes in an actor's actions and goals, it has not yet been determined whether untrained observers can reliably identify action and goal changes as naturalistic activities unfold, or whether the changes they identify are tied to visual features of the activity (e.g., the beginnings and ends of object interactions). This study addressed these questions by examining untrained participants' identification of action changes, goal changes, and event boundaries while watching videos of everyday activities that were presented in both first-person and third-person perspectives. We found that untrained observers can identify goal changes and action changes consistently, and these changes are not explained by visual change and the onsets or offsets of contact with objects. Moreover, the action and goal changes identified by untrained observers were associated with event boundaries, even after accounting for objective visual features of the videos. These findings suggest that people can identify action and goal changes consistently and with high agreement, that they do so by using sensory information flexibly, and that the action and goal changes they identify may contribute to event segmentation.

Beyond Mentalizing: Epistemic Trust and the Transmission of Culture

We explore the interpersonal origins of human culture, arguing that culture emerges as a necessary consequence of our helplessness in infancy, which in turn requires a greater degree of collaboration and social organization than is necessary for other mammals. We propose a model of cultural transmission that depends on a dyadic interpersonal process whose vicissitudes can have a lifelong impact. We explore the role played by imagining subjectively experienced psychological states and processes in others, which we have defined as mentalizing, in the process of cultural transmission, and propose that mentalizing is key to the establishment of epistemic trust-that is to say, an experience of trust that enables the individual to absorb and use the knowledge they are being offered. We suggest that psychoanalysis can be viewed as a paradigmatic example of a process of transferring knowledge from one human being (the teacher, the caregiver, the analyst) to another (the learner, the young person, the patient) and argue that the mechanisms of psychic change in analysis cannot be fully understood without appreciating this aspect of the biological/evolutionary origins of our essential humanity. Finally, we discuss the clinical implications of the model we are proposing for the psychoanalytic process.

More than a moment: What does it mean to call something an 'event'?

Experiences are stored in the mind as discrete mental units, or 'events,' which influence-and are influenced by-attention, learning, and memory. In this way, the notion of an 'event' is foundational to cognitive science. However, despite tremendous progress in understanding the behavioral and neural signatures of events, there is no agreed-upon definition of an event. Here, we discuss different theoretical frameworks of event perception and memory, noting what they can and cannot account for in the literature. We then highlight key aspects of events that we believe should be accounted for in theories of event processing--in particular, we argue that the structure and substance of events should be better reflected in our theories and paradigms. Finally, we discuss empirical gaps in the event cognition literature and what the future of event cognition research may look like.

Reading minds or reading scripts? De-intellectualising theory of mind

Understanding the origins of human social cognition is a central challenge in contemporary science. In recent decades, the idea of a 'Theory of Mind' (ToM) has emerged as the most popular way of explaining unique features of human social cognition. This default view has been progressively undermined by research on 'implicit' ToM, which suggests that relevant precursor abilities may already be present in preverbal human infants and great apes. However, this area of research suffers from conceptual difficulties and empirical limitations, including explanatory circularity, over-intellectualisation, and inconsistent empirical replication. Our article breaks new ground by adapting 'script theory' for application to both linguistic and non-linguistic agents. It thereby provides a new theoretical framework able to resolve the aforementioned issues, generate novel predictions, and provide a plausible account of how individuals make sense of the behaviour of others. Script theory is based on the premise that pre-verbal infants and great apes are capable of basic forms of agency-detection and non-mentalistic goal understanding, allowing individuals to form event-schemata that are then used to make sense of the behaviour of others. We show how script theory circumvents fundamental problems created by ToM-based frameworks, explains patterns of inconsistent replication, and offers important novel predictions regarding how humans and other animals understand and predict the behaviour of others.

The Development of Flexible Problem Solving: An Integrative Approach

Flexible problem solving, the ability to deal with currently goal-irrelevant information that may have been goal-relevant in previous, similar situations, plays a prominent role in cognitive development and has been repeatedly investigated in developmental research. However, this research, spanning from infancy to the school years, lacks a unifying framework, obscuring the developmental timing of flexible problem solving. Therefore, in this review paper, previous findings are gathered, organized, and integrated under a common framework to unveil how and when flexible problem solving develops. It is showed that the development of flexible problem solving coincides with increases in executive functions, that is, inhibition, working memory and task switching. The analysis of previous findings shows that dealing with goal-irrelevant, non-salient information received far more attention than generalizing in the presence of goal-irrelevant, salient information. The developmental timing of the latter can only be inferred from few transfer studies, as well as executive functions, planning and theory of mind research, to highlight gaps in knowledge and sketch out future research directions. Understanding how transfer in the presence of seemingly relevant but truly irrelevant information develops has implications for well-balanced participation in information societies, early and lifespan education, and investigating the evolutionary trajectory of flexible problem solving.

6-, 10-, and 12-month-olds remember complex dynamic events across 2 weeks

Whereas infants' ability to remember simple static material (e.g., pictures) has been documented extensively, we know surprisingly little about infants' memory of dynamic events (i.e., events unfolding in time) in the first year after birth. Although there is evidence to suggest that infants show some kind of sensitivity toward complex dynamic events (i.e., events involving agents and a storyline) as indicated by visual engagement in the first year after birth, 16- to 18-month-olds are hitherto the youngest infants documented to remember such material. Using a visual paired-comparison (VPC) task, in Experiment 1 we examined 6-, 10-, and 12-month-olds' (N = 108) ability to encode and remember cartoons involving complex dynamic events across 2 weeks. Results showed that all age groups remembered these cartoons. To investigate further the role of a complex storyline, in Experiment 2 we assessed the memory of 107 infants of the same age groups for similar cartoons but without coherent storyline information by scrambling the temporal presentation of the information in the cartoons. The results showed that the two youngest age groups did not remember this version. To our knowledge, this is the first experiment to document memory for such complex material in young infants using VPC.

How infant-directed actions enhance infants' attention, learning, and exploration: Evidence from EEG and computational modeling

When teaching infants new actions, parents tend to modify their movements. Infants prefer these infant-directed actions (IDAs) over adult-directed actions and learn well from them. Yet, it remains unclear how parents' action modulations capture infants' attention. Typically, making movements larger than usual is thought to draw attention. Recent findings, however, suggest that parents might exploit movement variability to highlight actions. We hypothesized that variability in movement amplitude rather than higher amplitude is capturing infants' attention during IDAs. Using EEG, we measured 15-month-olds' brain activity while they were observing action demonstrations with normal, high, or variable amplitude movements. Infants' theta power (4-5 Hz) in fronto-central channels was compared between conditions. Frontal theta was significantly higher, indicating stronger attentional engagement, in the variable compared to the other conditions. Computational modelling showed that infants' frontal theta power was predicted best by how surprising each movement was. Thus, surprise induced by variability in movements rather than large movements alone engages infants' attention during IDAs. Infants with higher theta power for variable movements were more likely to perform actions successfully and to explore objects novel in the context of the given goal. This highlights the brain mechanisms by which IDAs enhance infants' attention, learning, and exploration.

Linguistic and non-linguistic cues in motion event endpoint description: The selection between English to and towards

The current study aims to explore the factors that could affect people’s description of a motion event endpoint. The study conducted by Liao, Dijkstra, and Zwaan (2021, Language and Cognition, 13[2], 161–190) found that two non-linguistic factors (i.e., the actor’s goal and the interlocutor’s social status) affect people’s choice between two Dutch directional prepositions (i.e., naar and richting) during event description tasks. The current study aims to extend these findings by examining the choice between a similar pair of directional prepositions in English (i.e., to and towards). Moreover, we aim to study whether grammatical aspect (i.e., the English simple present and the English progressive aspect) affects the sensitivity to the two non-linguistic factors and consequently also affects how people describe a motion event endpoint. In Experiment 1, we used the English simple present for all sentence stimuli (e.g., he walks (?) the trash bin). We found a significant effect of Interlocutor (the interlocutor’s social status) on preposition choice, but no significant effect of Intention (the actor’s goal). In Experiment 2, we replaced the English simple present with the English progressive aspect (e.g., he is walking (?) the trash bin). We found significant main effects of both Interlocutor and Intention on preposition choice. These findings extend those reported in Liao et al. (2021) Language, Cognition and Neuroscience, 35(4), 498–520 in that protagonist intention and interlocutor status were found to indeed affect motion event endpoint description. The current findings furthermore show that grammatical aspect affects people’s sensitivity to these factors, thus also affecting how a motion event endpoint is described.

Neural event segmentation of continuous experience in human infants

How infants experience the world is fundamental to understanding their cognition and development. A key principle of adult experience is that, despite receiving continuous sensory input, we perceive this input as discrete events. Here we investigate such event segmentation in infants and how it differs from adults. Research on event cognition in infants often uses simplified tasks in which (adult) experimenters help solve the segmentation problem for infants by defining event boundaries or presenting discrete actions/vignettes. This presupposes which events are experienced by infants and leaves open questions about the principles governing infant segmentation. We take a different, data-driven approach by studying infant event segmentation of continuous input. We collected whole-brain functional MRI (fMRI) data from awake infants (and adults, for comparison) watching a cartoon and used a hidden Markov model to identify event states in the brain. We quantified the existence, timescale, and organization of multiple-event representations across brain regions. The adult brain exhibited a known hierarchical gradient of event timescales, from shorter events in early visual regions to longer events in later visual and associative regions. In contrast, the infant brain represented only longer events, even in early visual regions, with no timescale hierarchy. The boundaries defining these infant events only partially overlapped with boundaries defined from adult brain activity and behavioral judgments. These findings suggest that events are organized differently in infants, with longer timescales and more stable neural patterns, even in sensory regions. This may indicate greater temporal integration and reduced temporal precision during dynamic, naturalistic perception.

Language level predicts perceptual categorization of complex reversible events in children

Language plays a well-documented role in perceptual object categorization, but little is known about its role in the categorization of complex events. We explored this here with a perspective from age or developmentally appropriate language capacities in neurotypical children between the ages of two and four years (N = 21), and from delayed language development in a clinical group of children (N = 20), whose verbal mental ages (VMA) often fell far below their chronological ages (CAs). All participants watched two demonstrations of a series of transitive events (e.g. tiger jumps over a girl). The toy agents were then moved out of sight, and participants had to act out the same event type, based on a different tiger and girl that were selected among two distractors. We aimed to determine how mastery of this task relates to CA in the neurotypical group, and whether task performance in the clinical group was predicted by VMA and a standardized measure of grammatical comprehension. Results from a series of logistic mixed-effect regression models showed that neurotypical children start to perform correctly on this task with a chance of around 50% during their third year of CA but reach ceiling performance only during their fourth. A similar pattern emerged for VMA in the clinical group, despite a wide range of CAs and diagnoses. In addition, grammatical comprehension predicted performance. These patterns suggest that language competence plays a role in the perceptual categorization and encoding of complex reversible events.

•

Mental representations of complex event types were investigated.

•

An event imitation task was used in children with and without language disorders.

•

Chronological age and verbal mental age both predicted performance.

•

Grammatical comprehension in the clinical group did as well.

•

Cognizing complex events may be linguistically conditioned.

The role of social signals in segmenting observed actions in 18-month-old children

Learning about actions requires children to identify the boundaries of an action and its units. Whereas some action units are easily identified, parents can support children's action learning by adjusting the presentation and using social signals. However, currently, little is understood regarding how children use these signals to learn actions. In the current study, we investigate the possibility that communicative signals are a particularly suitable cue for segmenting events. We investigated this hypothesis by presenting 18-month-old children (N = 60) with short action sequences consisting of toy animals either hopping or sliding across a board into a house, but interrupting this two-step sequence either (a) using an ostensive signal as a segmentation cue, (b) using a non-ostensive segmentation cue and (c) without additional segmentation information between the actions. Marking the boundary using communicative signals increased children's imitation of the less salient sliding action. Imitation of the hopping action remained unaffected. Crucially, marking the boundary of both actions using a non-communicative control condition did not increase imitation of either action. Communicative signals might be particularly suitable in segmenting non-salient actions that would otherwise be perceived as part of another action or as non-intentional. These results provide evidence of the importance of ostensive signals at event boundaries in scaffolding children's learning.

Can the early visual processing of others' actions be related to social power and dominance?

Although goals often drive action understanding, this ability is also prone to important variability among individuals, which may have its origin in individual social characteristics. The present study aimed at evaluating the relationship between the tendency to prioritize goal information over grip information during early visual processing of action and several social dimensions. Visual processing of grip and goal information during action recognition was evaluated in 64 participants using the priming protocol developed by Decroix and Kalénine (Exp Brain Res 236(8):2411-2426, 2018). Object-directed action photographs were primed by photographs sharing the same goal and/or the same grip. The effects of goal and grip priming on action recognition were evaluated for different prime durations. The same participants further fulfilled questionnaires characterizing the way individuals deal with their social environment, namely their sense of social power, dominance, perspective taking, and construal level. At the group level, results confirmed greater goal than grip priming effects on action recognition for the shortest prime duration. Regression analyses between the pattern of response times in the action priming protocol and scores at the questionnaires further showed that the advantage of goal over grip priming was associated with higher sense of social power, and possibly to lower dominance. Overall, data confirm that observers tend to prioritize goal-related information when processing visual actions but further indicate that this tendency is sensitive to individual social characteristics. Results suggest that goal information may not always drive action understanding and point out the connection between low-level processing of observed actions and more general individual characteristics.

The extended present: an informational context for perception

Several previous authors have proposed a kind of specious or subjective present moment that covers a few seconds of recent information. This article proposes a new hypothesis about the subjective present, renamed the extended present, defined not in terms of time covered but as a thematically connected information structure held in working memory and in transiently accessible form in long-term memory. The three key features of the extended present are that information in it is thematically connected, both internally and to current attended perceptual input, it is organised in a hierarchical structure, and all information in it is marked with temporal information, specifically ordinal and duration information. Temporal boundaries to the information structure are determined by hierarchical structure processing and by limits on processing and storage capacity. Supporting evidence for the importance of hierarchical structure analysis is found in the domains of music perception, speech and language processing, perception and production of goal-directed action, and exact arithmetical calculation. Temporal information marking is also discussed and a possible mechanism for representing ordinal and duration information on the time scale of the extended present is proposed. It is hypothesised that the extended present functions primarily as an informational context for making sense of current perceptual input, and as an enabler for perception and generation of complex structures and operations in language, action, music, exact calculation, and other domains.

The Origins of Social Knowledge in Altricial Species

Human infants are altricial, born relatively helpless and dependent on parental care for an extended period of time. This protracted time to maturity is typically regarded as a necessary epiphenomenon of evolving and developing large brains. We argue that extended altriciality is itself adaptive, as a prolonged necessity for parental care allows extensive social learning to take place. Human adults possess a suite of complex social skills, such as language, empathy, morality, and theory of mind. Rather than requiring hardwired, innate knowledge of social abilities, evolution has outsourced the necessary information to parents. Critical information for species-typical development, such as species recognition, may originate from adults rather than from genes, aided by underlying perceptual biases for attending to social stimuli and capacities for statistical learning of social actions. We draw on extensive comparative findings to illustrate that, across species, altriciality functions as an adaptation for social learning from caregivers.

Events structure information accessibility less in children than adults

To manage the onslaught of continuously unfolding information in our complex environments, we adults are known to carve up our continuous experience into meaningful events, a process referred to as event segmentation. This segmentation directly shapes how our everyday experiences are construed: content experienced within an event is held mentally in an accessible state, which is then dropped after an event boundary. The greater accessibility of event-specific information has been shown to influence-at its most basic level-how information is processed and remembered. However, it is as yet unknown if accessibility is similarly influenced by event boundaries in children, who are still developing the working memory capacity and semantic knowledge thought to support event segmentation. Here, we tested seven- to nine-year-old children's and adults' recognition of objects experienced either within or across event boundaries of two cartoons. We found that children and adults were both more accurate and faster to correctly recognize objects that last occurred within events versus across event boundaries. We, however, additionally observed an interaction such that children's access to recent experience was less influenced by event boundaries than adults'. Thus, while the spontaneous segmentation of complex events emerges by middle childhood, event structure shapes the active contents of children's minds less reliably than adults'.

Kinematic boundary cues modulate 12-month-old infants' segmentation of action sequences: An ERP study

Human infants can segment action sequences into their constituent actions already during the first year of life. However, work to date has almost exclusively examined the role of infants' conceptual knowledge of actions and their outcomes in driving this segmentation. The present study examined electrophysiological correlates of infants' processing of lower-level perceptual cues that signal a boundary between two actions of an action sequence. Specifically, we tested the effect of kinematic boundary cues (pre-boundary lengthening and pause) on 12-month-old infants' (N = 27) processing of a sequence of three arbitrary actions, performed by an animated figure. Using the Event-Related Potential (ERP) approach, evidence of a positivity following the onset of the boundary cues was found, in line with previous work that has found an ERP positivity (Closure Positive Shift, CPS) related to boundary processing in auditory stimuli and action sequences in adults. Moreover, an ERP negativity (Negative Central, Nc) indicated that infants' encoding of the post-boundary action was modulated by the presence or absence of prior boundary cues. We therefore conclude that 12-month-old infants are sensitive to lower-level perceptual kinematic boundary cues, which can support segmentation of a continuous stream of movement into individual action units.

Representing agents, patients, goals and instruments in causative events: A cross-linguistic investigation of early language and cognition

Although it is widely assumed that the linguistic description of events is based on a structured representation of event components at the perceptual/conceptual level, little empirical work has tested this assumption directly. Here, we test the connection between language and perception/cognition cross-linguistically, focusing on the relative salience of causative event components in language and cognition. We draw on evidence from preschoolers speaking English or Turkish. In a picture description task, Turkish-speaking 3-5-year-olds mentioned Agents less than their English-speaking peers (Turkish allows subject drop); furthermore, both language groups mentioned Patients more frequently than Goals, and Instruments less frequently than either Patients or Goals. In a change blindness task, both language groups were equally accurate at detecting changes to Agents (despite surface differences in Agent mentions). The remaining components also behaved similarly: both language groups were less accurate in detecting changes to Instruments than either Patients or Goals (even though Turkish-speaking preschoolers were less accurate overall than their English-speaking peers). To our knowledge, this is the first study offering evidence for a strong-even though not strict-homology between linguistic and conceptual event roles in young learners cross-linguistically.

People accurately predict the transition probabilities between actions

Social life is a complex dance. To coordinate gracefully with one's partners, one must predict their actions. Here, we investigated how people predict others' actions. We hypothesized that people can accurately predict others' future actions based on knowledge of their current actions, coupled with knowledge of action transitions. To test whether people have accurate knowledge of the transition probabilities between actions, we compared actual rates of action transitions-calculated from four large naturalistic datasets-to participants' ratings of the transition probabilities between corresponding sets of actions. In five preregistered studies, participants demonstrated accurate mental models of action transitions. Furthermore, we found that people drew upon conceptual knowledge of actions-described by the six-dimensional ACT-FASTaxonomy-to guide their accurate predictions. Together, these results indicate that people can accurately anticipate other people's moves in the dance of social life and that the structure of action knowledge may be tailored to making these predictions.

Influences of domain knowledge on segmentation and memory

Much research has shown that experts possess superior memory in their domain of expertise. This memory benefit has been proposed to be the result of various encoding mechanisms, such as chunking and differentiation. Another potential encoding mechanism that is associated with memory is event segmentation, which is the process by which people parse continuous information into meaningful, discrete units. Previous research has found evidence that segmentation, to some extent, is affected by top-down processing. To date, few studies have investigated the influence of expertise on segmentation, and questions about expertise, segmentation ability, and their impact on memory remain. The goal of the current study was to investigate the influence of expertise on segmentation and memory ability for two different domains: basketball and Overwatch. Participants with high and low knowledge for basketball and with low knowledge for Overwatch viewed and segmented videos at coarse and fine grains, then completed memory tests. Differences in segmentation ability and memory were present between experts and control novices, specifically for the basketball videos; however, experts' segmentation only predicted memory for activities for which knowledge was lacking. Overall, this research suggests that experts' superior memory is not due to their segmentation ability and contributes to a growing body of literature showing evidence supporting conceptual effects on segmentation.

Dogs accurately track a moving object on a screen and anticipate its destination

The prediction of upcoming events is of importance not only to humans and non-human primates but also to other animals that live in complex environments with lurking threats or moving prey. In this study, we examined motion tracking and anticipatory looking in dogs in two eye-tracking experiments. In Experiment 1, we presented pet dogs (N = 14) with a video depicting how two players threw a Frisbee back and forth multiple times. The horizontal movement of the Frisbee explained a substantial amount of variance of the dogs' horizontal eye movements. With increasing duration of the video, the dogs looked at the catcher before the Frisbee arrived. In Experiment 2, we showed the dogs (N = 12) the same video recording. This time, however, we froze and rewound parts of the video to examine how the dogs would react to surprising events (i.e., the Frisbee hovering in midair and reversing its direction). The Frisbee again captured the dogs' attention, particularly when the video was frozen and rewound for the first time. Additionally, the dogs looked faster at the catcher when the video moved forward compared to when it was rewound. We conclude that motion tracking and anticipatory looking paradigms provide promising tools for future cognitive research with canids.

Getting a grip on early intention understanding: The role of motor, cognitive, and social factors

This chapter considers various factors that facilitate infants' understanding of other people's intentions. As adults, we view the actions people perform around us as intentional, to achieve a goal, rather than idle movements. For example, when observing another person perform a simple grasping action, such as picking up a slice of pizza, we perceive this action as goal-directed. Due to our understanding of the person's intention, we focus more so on the relation between the person and their goal, rather than the motion involved in the action. Infants develop an understanding of intentional agents and their goals within the first year of life. This chapter reviews multiple factors that are at play in facilitating infants' learning about the intentions of others' actions. We consider this from various perspectives, including the role of active experience, sensitivity to behavioral cues, cognitive factors, and social factors. We first review evidence concerning infants' learning of intentional actions from active experience. We then go on to evaluate how this learning could also come about via comparison processes, statistical learning, and use of behavioral cues such as object labeling and action effects. We also review social factors such as infant-directed actions and triadic engagement within social interactions that emerging evidence suggests are helpful in facilitating infants' understanding of other people's actions. Finally, we consider the extent to which these factors interact with one another in different contexts, as well as implications and future directions.

Young Children's Representation of Locations in a Series: A Front-Back Representation or an Ordinal Representation?

Previous research has found that 3–5-year-old children could encode and retrieve a target location in a two-location series. In a paradigm of running two symmetrical railcars on a circular track, the study suggested that children used front-back array to help coding. That is, children at this age code the railcar running in the front of another as “the location in the front” and the railcar running in the back of another as “the location in the back.” However, the children’s success could be attributed to an alternative interpretation; using an ordinal representation to encode the location in front as the first with the other as the second. The current study used a four-location series to examine the children’s mental representation. Three- to five-year-old children participated in a hide-and-seek game to remember a target location out of four locations that moved in a series. The results showed salient individual differences in children’s representation, and their performance improved as the representation progressed. An ordinal representation supported the precise encoding of each location, while a vague front-back representation and a clearer front-middle-back representation led to different performance.

Learning From Others: The Effects of Agency on Event Memory in Young Children

Little is known about the influence of social context on children's event memory. Across four studies, we examined whether learning that could occur in the absence of a person was more robust when a person was present. Three-year-old children (N = 125) viewed sequential events that either included or excluded an acting agent. In Experiment 1, children who viewed an agent recalled more than children who did not. Experiments 2a and 2b utilized an eye tracker to demonstrate this effect was not due to differences in attention. Experiment 3 used a combined behavioral and event-related potential paradigm to show that condition effects were present in memory-related components. These converging results indicate a particular role for social knowledge in supporting memory for events.

Neural dynamics of grip and goal integration during the processing of others' actions with objects: An ERP study

Recent behavioural evidence suggests that when processing others’ actions, motor acts and goal-related information both contribute to action recognition. Yet the neuronal mechanisms underlying the dynamic integration of the two action dimensions remain unclear. This study aims to elucidate the ERP components underlying the processing and integration of grip and goal-related information. The electrophysiological activity of 28 adults was recorded during the processing of object-directed action photographs (e.g., writing with pencil) containing either grip violations (e.g. upright pencil grasped with atypical-grip), goal violations (e.g., upside-down pencil grasped with typical-grip), both grip and goal violations (e.g., upside-down pencil grasped with atypical-grip), or no violations. Participants judged whether actions were overall typical or not according to object typical use. Brain activity was sensitive to the congruency between grip and goal information on the N400, reflecting the semantic integration between the two dimensions. On earlier components, brain activity was affected by grip and goal typicality independently. Critically, goal typicality but not grip typicality affected brain activity on the N300, supporting an earlier role of goal-related representations in action recognition. Findings provide new insights on the neural temporal dynamics of the integration of motor acts and goal-related information during the processing of others’ actions.

Development of Clause Chaining in Korean

Korean is a language with the verb at the end of a clause/sentence. In chaining several clauses [each consisting of a subject and a verb] in a sentence, a conjunction (e.g., -ko “and then,” -ese “because, and so”) is suffixed to the verb of a non-final clause. Korean has an extensive set of conjunctions that connect to the next clause, expressing temporal, causal, and contrastive relations among others. In this paper, I lay out a developmental trajectory of clause chaining construction in Korean based on longitudinal and cross-sectional data samples, focusing on conjunctive forms and functions as well as morphological and syntactic properties of connected clauses in a sentence. The database comes from longitudinal naturalistic speech data of five children collected regularly over different time periods between 2 and 5 years of age, and from elicited descriptions of short video events from children - aged 3, 4, 6, 8, and 10 years - and adults. The results show that, at least from 2 years of age, the Korean children in the sample start connecting clauses using appropriate conjunctions. Within 6 months, they acquire several major conjunctions that express temporal, causal, conditional, and contrastive relations between events. By 4 years of age, the children’s clause chains are quite adult-like in terms of the repertoire of conjunctive forms and functions, and of the morphological and syntactic features of the clauses that connect to the main clause. In particular they learn to express temporal relations that have some disjuncture between events. However, 4-year-olds still lack the ability to appropriately refer to differential subjects of the chained clauses and also to connect multiple clauses in a sentence. The elicitation data reveal that further development in clause chaining occurs over several years – with a milestone at 10 years – and through adulthood, particularly in relation to appropriate referential marking, conjunction frequency, and segmentation of a macro event into sub-events for clause-chaining construction. These developmental processes are presented from a cognitive perspective, in particular with regard to concept of temporal relation, reference specification involving two or more entities, and perceptual saliency of event type.

What first drives visual attention during the recognition of object-directed actions? The role of kinematics and goal information

The recognition of others' object-directed actions is known to involve the decoding of both the visual kinematics of the action and the action goal. Yet whether action recognition is first guided by the processing of visual kinematics or by a prediction about the goal of the actor remains debated. In order to provide experimental evidence to this issue, the present study aimed at investigating whether visual attention would be preferentially captured by visual kinematics or by action goal information when processing others' actions. In a visual search task, participants were asked to find correct actions (e.g., drinking from glass) among distractor actions. Distractors actions contained grip and/or goal violations and could therefore share the correct goal and/or the correct grip with the target. The time course of fixation proportion on each distractor action has been taken as an indicator of visual attention allocation. Results show that visual attention is first captured by the distractor action with similar goal. Then the withdrawal of visual attention from the action distractor with similar goal suggests a later attentional capture by the action distractor with similar grip. Overall, results are in line with predictive approaches of action understanding, which assume that observers first make a prediction about the actor's goal before verifying this prediction using the visual kinematics of the action.

Developmental differences in temporal schema acquisition impact reasoning decisions

Schemas capture patterns across multiple experiences, accumulating information about common event structures that guide decision making in new contexts. Schemas are an important principle of leading theories of cognitive development; yet, we know little about how children and adolescents form schemas and use schematic knowledge to guide decisions. Here, we show that the ability to acquire schematic knowledge based on the temporal regularities of events increases during childhood and adolescence. Furthermore, we show that temporally mediated schematic knowledge biases reasoning decisions in an age-dependent manner. Participants with greater temporal schematic knowledge were more likely to infer that temporally related items shared other, non-temporal properties, with adults showing the greatest relationship between schema knowledge and reasoning choices. These data indicate that the mechanisms underlying schema formation and expression are not fully developed until adulthood and may reflect the ongoing maturation of hippocampus and prefrontal cortex through adolescence.

Event Perception and Memory

Events make up much of our lived experience, and the perceptual mechanisms that represent events in experience have pervasive effects on action control, language use, and remembering. Event representations in both perception and memory have rich internal structure and connections one to another, and both are heavily informed by knowledge accumulated from previous experiences. Event perception and memory have been identified with specific computational and neural mechanisms, which show protracted development in childhood and are affected by language use, expertise, and brain disorders and injuries. Current theoretical approaches focus on the mechanisms by which events are segmented from ongoing experience, and emphasize the common coding of events for perception, action, and memory. Abetted by developments in eye-tracking, neuroimaging, and computer science, research on event perception and memory is moving from small-scale laboratory analogs to the complexity of events in the wild.

Stacking the evidence: Parents' use of acoustic packaging with preschoolers

Segmenting continuous events into discrete actions is critical for understanding the world. As infants may lack top-down knowledge of event structure, caregivers provide audiovisual cues to guide the process, aligning action descriptions with event boundaries to increase their salience. This acoustic packaging may be specific to infant-directed speech, but little is known about when and why the use of this cue wanes. We explore whether acoustic packaging persists in parents' teaching of 2.5-5.5-year-old children about various toys. Parents produced a smaller percentage of action speech relative to studies with infants. However, action speech largely remained more aligned to action boundaries relative to non-action speech. Further, for the more challenging novel toys, parents modulated their use of acoustic packaging, providing it more for those children with lower vocabularies. Our findings suggest that acoustic packaging persists beyond interactions with infants, underscoring the utility of multimodal cues for learning, particularly for less knowledgeable learners in challenging learning environments.

Syllable as a unit of information transfer in linguistic communication: The entropy syllable parsing model

To understand human language-both spoken and signed-the listener or viewer has to parse the continuous external signal into components. The question of what those components are (e.g., phrases, words, sounds, phonemes?) has been a subject of long-standing debate. We re-frame this question to ask: What properties of the incoming visual or auditory signal are indispensable to eliciting language comprehension? In this review, we assess the phenomenon of language parsing from modality-independent viewpoint. We show that the interplay between dynamic changes in the entropy of the signal and between neural entrainment to the signal at syllable level (4-5 Hz range) is causally related to language comprehension in both speech and sign language. This modality-independent Entropy Syllable Parsing model for the linguistic signal offers insight into the mechanisms of language processing, suggesting common neurocomputational bases for syllables in speech and sign language. This article is categorized under: Linguistics > Linguistic Theory Linguistics > Language in Mind and Brain Linguistics > Computational Models of Language Psychology > Language.

The Ontogenesis of Action Syntax

Language and action share similar organizational principles. Both are thought to be hierarchical and recursive in nature. Here we address the relationship between language and action from developmental and neurophysiological perspectives. We discuss three major aspects: The extent of the analogy between language and action; the necessity to extend research on the yet largely neglected aspect of action syntax; the positive contribution of a developmental approach to this topic. We elaborate on the claim that adding an ontogenetic approach will help to obtain a comprehensive picture about both the interplay between language and action and its development, and to answer the question whether the underlying mechanisms of detecting syntactic violations of action sequences are similar to or different from the processing of language syntactic violations.

Does semantic knowledge influence event segmentation and recall of text?

Knowledge benefits episodic memory, particularly when provided before encoding (Anderson & Pichert in Journal of Verbal Learning and Verbal Behavior, 17(1), 1-12, 1978; Bransford & Johnson in Journal of Verbal Learning and Verbal Behavior, 11(6), 717-726, 1972). These benefits can occur through several encoding mechanisms, one of which may be event segmentation. Event segmentation is one's ability to parse information into meaningful units as an activity unfolds. The current experiment evaluated whether two top-down manipulations-providing context or perspective taking-influence the segmentation and memory of text. For the ambiguous texts in Experiment 1, half the participants received context in the form of a title, whereas the other half received no context. For the text in Experiment 2, half the participants read from the perspective of a burglar and the other half read from the perspective of a home buyer. In both experiments, participants read the passages, recalled the information, and then segmented the passages into meaningful units. Consistent with previous findings, participants who received context recalled more information compared with those who received no context, and participants in one perspective were more likely to recall information relevant to their perspective. Most importantly, we found that context and perspective facilitated more normative segmentation; however, the differences were small and suggest that effects of top-down processing on the segmentation of text may be modest at best. Thus, event segmentation processes that operate during text comprehension are influenced by semantic knowledge but may be more heavily driven by other factors (e.g., perceptual cues).

Superior learning in synesthetes: Consistent grapheme-color associations facilitate statistical learning

In synesthesia activation in one sensory domain, such as smell or sound, triggers an involuntary and unusual secondary sensory or cognitive experience. In the present study, we ask whether the added sensory experience of synesthesia can aid statistical learning-the ability to track environmental regularities in order to segment continuous information. To investigate this, we measured statistical learning outcomes, using an aurally presented artificial language, in two groups of synesthetes alongside controls and simulated the multimodal experience of synesthesia in non-synesthetes. One group of synesthetes exclusively had grapheme-color (GC) synesthesia, in which the experience of color is automatically triggered by exposure to written or spoken graphemes. The other group had both grapheme-color and sound-color (SC+) synesthesia, in which the experience of color is also triggered by the waveform properties of a voice, such as pitch, timbre, and/or musical chords. Unlike GC-only synesthetes, the experience of color in the SC+ group is not perfectly consistent with the statistics that signal word boundaries. We showed that GC-only synesthetes outperformed both non-synesthetes and SC+ synesthetes, likely because the visual concurrents for GC-only synesthetes are highly consistent with the artificial language. We further observed that our simulations of GC synesthesia, but not SC+ synesthesia produced superior statistical learning, showing that synesthesia likely boosts learning outcomes by providing a consistent secondary cue. Findings are discussed with regard to how multimodal experience can improve learning, with the present data indicating that this boost is more likely to occur through explicit, as opposed to implicit, learning systems.

Can Young Children Ignore Irrelevant Events, or Subevents, During Verb Learning?

Children learning a verb may benefit from hearing it across situations (e.g., Behrend, 1995; Childers, 2011; Fisher et al, 1994; Pinker, 1989). At the same time, in everyday contexts, situations in which a verb is heard will be interrupted by distracting events. Using Structural Alignment theory as a framework (e.g., Gentner & Namy, 2006), Study 1 asks whether children can learn a verb when irrelevant, interleaved events are present. Two½- and 3½-year-old children saw dynamic events and were randomly assigned to one of three experimental conditions (differing in orders of events), or one of two control conditions. They extended the verbs in the experimental conditions, and not the control conditions. Three ½-year-olds were more successful than 2½-year-olds, though the younger children could extend verbs. A more difficult task is segmenting dynamic action into subevents that could be relevant for a verb (e.g., finding "chopping" in a cooking scene). In Study 2, 2½-, 3½- and 4½-year-old children were assigned to experimental conditions in which relevant events flowed into irrelevant events (or vice versa), or to a control. Two½-year-olds failed to extend the verbs at test, differing from the older children; children in experimental conditions extended the verbs while children in the control condition did not. Altogether, these results show children can ignore irrelevant events (and subevents), and extend new verbs by 3½ years. Results are important to understand learning in everyday contexts in which verbs are heard in varied situations over time.

Speaking Your Mind: Language and Narrative in Young Children's Theory of Mind Development

Research consistently finds that language and theory of mind are interrelated. The content and qualities of language that specifically predict theory of mind remain under investigation and the question of why language might impact theory of mind development is open. In this chapter we analyze and highlight current findings and theory addressing theory of mind and language. The principal focus is upon typically developing children between ages 2 and 5, a period characterized by extensive development in language and social understanding. We propose that the study of young children's narrative development can inform how and why language and theory of mind are connected. False belief understanding and narrative comprehension share many similarities and this association provides a promising avenue for future work.

Meaningful Memory? Eighteen-Month-Olds Only Remember Cartoons With a Meaningful Storyline

In two studies we investigated the importance of a storyline for remembering cartoons across a delay of 2 weeks in 18-month-old infants by means of the visual paired-comparison (VPC) paradigm. In Study 1 seventy-one 18-month-olds were tested using similar cartoons as in a recent study from our lab while varying the richness of the storyline information. In a VPC task half of the infants watched uncompromised versions of the cartoons used in the recent study (Storyline Condition), whereas the other half watched Pixelized versions of the cartoons (number of pixels reduced by 98% covering up the narrative, but leaving perceptual details, e.g., colors, movements, the same, and Pixelized Condition). Two weeks later they were presented with the familiar cartoon and a novel cartoon from the same version (Storyline or Pixelized) simultaneously, while being eye-tracked. Results showed that only the infants in the Storyline Condition remembered the target cartoon, thus suggesting that the storyline is important for memory. However, an alternative interpretation of the results could be that what made the infants in the Storyline Condition remember the target cartoon was not the storyline, but the static conceptual information of the objects and agents present in the cartoon (which was not visible in the Pixelized version). To test this possibility, a control study was created. In Study 2 thirty-six infants were therefore presented with a version of the cartoon in which we broke down the temporal presentation into 1 s segments and presented these out of order. This was done to preserve the static conceptual information (e.g., objects and agents) while still disturbing the storyline. Results showed that the infants in this condition still did not remember the target cartoon, suggesting that the meaningfulness of the storyline - and not only static conceptual information - is important for later memory.