Dissociable event-related potential modulations of intrinsic and extrinsic factors in temporal integration

We investigated visual temporal integration, by which multiple stimuli appearing in rapid succession are perceived as a single event. Temporal integration not only depends intrinsically on the passage of time but also, extrinsically, on the number and distribution of successive stimuli that are presented across that time interval. Here, we used a missing element task to investigate intrinsic and extrinsic factors in temporal integration, by manipulating stimulus duration and number, respectively. We found that both contributed interactively to integration performance and that varying the information rate over time did not further modulate this pattern. Intrinsic and extrinsic factors had dissociable effects on the N1, N2, N2pc, and P3 components of the event-related potential, implicating unique contributions to perceptual discrimination, spatio-temporal grouping, attention, and response decision-making. Stimulus number-induced effects on the event-related potential also generally arose later than those of stimulus duration. The latter already modulated the amplitude of the N1 and the early phase of the N2pc, while the former did not. The collective results suggest that while both intrinsic and extrinsic factors drive temporal integration, they do so in different ways. This difference during integration may eventually be reflected in the way in which we perceive longer, episodic events.

The Role of Agentive and Physical Forces in the Neural Representation of Motion Events

How does the brain represent information about motion events in relation to agentive and physical forces? In this study, we investigated the neural activity patterns associated with observing animated actions of agents (e.g., an agent hitting a chair) in comparison to similar movements of inanimate objects that were either shaped solely by the physics of the scene (e.g., gravity causing an object to fall down a hill and hit a chair) or initiated by agents (e.g., a visible agent causing an object to hit a chair). Using an fMRI-based multivariate pattern analysis (MVPA), this design allowed testing where in the brain the neural activity patterns associated with motion events change as a function of, or are invariant to, agentive versus physical forces behind them. A total of 29 human participants (nine male) participated in the study. Cross-decoding revealed a shared neural representation of animate and inanimate motion events that is invariant to agentive or physical forces in regions spanning frontoparietal and posterior temporal cortices. In contrast, the right lateral occipitotemporal cortex showed a higher sensitivity to agentive events, while the left dorsal premotor cortex was more sensitive to information about inanimate object events that were solely shaped by the physics of the scene.

Visual event boundaries restrict anchoring effects in decision-making

Research on higher-level thought has revealed many principles of reasoning and decision-making but has rarely made contact with how we perceive the world in the first place. Here we show how a lower-level property of perception-the spontaneous and task-irrelevant segmentation of continuous visual stimulation into discrete events-can restrict one of the most notorious biases in decision-making: numerical anchoring. Subjects walked down a long room in an immersive three dimensional (3D) animation and then made a numerical judgment (e.g., of how much a suitcase is worth, or of how many hours of community service a minor crime deserved). Critically, some subjects passed through a doorway (a visual event boundary) during their virtual walk, while others did not-equating time, distance traveled, and visual complexity. The anchoring manipulation was especially innocuous, not appearing to be part of the experiment at all. Before the online trial began, subjects reported the two-digit numerical value from a visually distorted "CAPTCHA" ("to verify that you are human")-where this task-irrelevant anchor was either low (e.g., 29) or high (e.g., 92). With no doorway, we observed reliable anchoring effects: Higher CAPTCHA values produced higher estimates. With the doorway, however, such effects were attenuated or even eliminated. This generalized across tasks involving item valuations, factual questions, and legal judgments and in tests of both incidental and explicit anchoring. This demonstrates how spontaneous visual event segmentation can have profound consequences for higher-level thought.

Event Perception and Social Skills in Undergraduates with ADHD Symptoms

BACKGROUND

Event perception provides a promising, novel approach for investigating underlying cognitive mechanisms of the social impairment associated with symptoms of ADHD.

AIMS

The goal of this study was to establish the relationship among event perception, symptoms of ADHD, and social skills.

METHODOLOGY

Eighty-three undergraduates were recruited from the University of Ottawa first year psychology courses (38 with ADHD, 45 without ADHD). They performed an event perception task and completed self-report questionnaires assessing social functioning and symptoms of ADHD (The Social Skills-Improvement System and the Conner's CBRS-SR).

RESULTS

Bootstrapping mediation analyses revealed that symptoms of inattention and hyperactivity mediated the relationship between event perception and social skills. A model with predictor and mediator reversed was also tested, and was not significant, providing strength to the directionality of the relationships. Results highlight the applicability of event perception to understanding the association between social impairment and symptoms of ADHD.

Transition to language: From agent perception to event representation

Spoken language, as we have it, requires specific capacities-at its most basic advanced vocal control and complex social cognition. In humans, vocal control is the basis for speech, achieved through coordinated interactions of larynx activity and rapid changes in vocal tract configurations. Most likely, speech evolved in response to early humans perceiving reality in increasingly complex ways, to the effect that primate-like signaling became unsustainable as a sole communication device. However, in what ways did and do humans see the world in more complex ways compared to other species? Although animal signals can refer to external events, in contrast to humans, they usually refer to the agents only, sometimes in compositional ways, but never together with patients. It may be difficult for animals to comprehend events as part of larger social scripts, with antecedent causes and future consequences, which are more typically tie the patient into the event. Human brain enlargement over the last million years probably has provided the cognitive resources to represent social interactions as part of bigger social scripts, which enabled humans to go beyond an agent-focus to refer to agent-patient relations, the likely foundation for the evolution of grammar. This article is categorized under: Cognitive Biology > Evolutionary Roots of Cognition Linguistics > Evolution of Language Psychology > Comparative.

Representing agents, patients, goals and instruments in causative events: A cross-linguistic investigation of early language and cognition

Although it is widely assumed that the linguistic description of events is based on a structured representation of event components at the perceptual/conceptual level, little empirical work has tested this assumption directly. Here, we test the connection between language and perception/cognition cross-linguistically, focusing on the relative salience of causative event components in language and cognition. We draw on evidence from preschoolers speaking English or Turkish. In a picture description task, Turkish-speaking 3-5-year-olds mentioned Agents less than their English-speaking peers (Turkish allows subject drop); furthermore, both language groups mentioned Patients more frequently than Goals, and Instruments less frequently than either Patients or Goals. In a change blindness task, both language groups were equally accurate at detecting changes to Agents (despite surface differences in Agent mentions). The remaining components also behaved similarly: both language groups were less accurate in detecting changes to Instruments than either Patients or Goals (even though Turkish-speaking preschoolers were less accurate overall than their English-speaking peers). To our knowledge, this is the first study offering evidence for a strong-even though not strict-homology between linguistic and conceptual event roles in young learners cross-linguistically.

Behavioral, Physiological, and Neural Signatures of Surprise during Naturalistic Sports Viewing

Surprise signals a discrepancy between past and current beliefs. It is theorized to be linked to affective experiences, the creation of particularly resilient memories, and segmentation of the flow of experience into discrete perceived events. However, the ability to precisely measure naturalistic surprise has remained elusive. We used advanced basketball analytics to derive a quantitative measure of surprise and characterized its behavioral, physiological, and neural correlates in human subjects observing basketball games. We found that surprise was associated with segmentation of ongoing experiences, as reflected by subjectively perceived event boundaries and shifts in neocortical patterns underlying belief states. Interestingly, these effects differed by whether surprising moments contradicted or bolstered current predominant beliefs. Surprise also positively correlated with pupil dilation, activation in subcortical regions associated with dopamine, game enjoyment, and long-term memory. These investigations support key predictions from event segmentation theory and extend theoretical conceptualizations of surprise to real-world contexts.

Event Perception and Memory

Events make up much of our lived experience, and the perceptual mechanisms that represent events in experience have pervasive effects on action control, language use, and remembering. Event representations in both perception and memory have rich internal structure and connections one to another, and both are heavily informed by knowledge accumulated from previous experiences. Event perception and memory have been identified with specific computational and neural mechanisms, which show protracted development in childhood and are affected by language use, expertise, and brain disorders and injuries. Current theoretical approaches focus on the mechanisms by which events are segmented from ongoing experience, and emphasize the common coding of events for perception, action, and memory. Abetted by developments in eye-tracking, neuroimaging, and computer science, research on event perception and memory is moving from small-scale laboratory analogs to the complexity of events in the wild.

Perceiving Natural Speed in Natural Movies

The visual system uses the physical laws of nature as constraints for perceiving objects and events. Images violating natural laws would therefore tend to be perceived as unnatural. To understand vision's implicit knowledge of natural speed in the real world, we examined visual tolerance to artificial speed deviations in 22 natural movies. For most movies, perception could tolerate deviations from original speed by as much as a factor 2×. However, for movies including human body movements or falling objects, perception only tolerated a significantly narrower range of speed deviations. In general, human observers are poor at judging the naturalness of speed in natural scenes except for events involving gravitational or biological motions.

Event perception: Translations and applications

Event segmentation is the parsing of ongoing activity into meaningful events. Segmenting in a normative fashion-identifying event boundaries similar to others' boundaries-is associated with better memory for and better performance of naturalistic actions. Given this, a reasonable hypothesis is that interventions that improve memory and attention for everyday events could lead to improvement in domains that are important for independent living, particularly in older populations. Event segmentation and memory measures may also be effective diagnostic tools for estimating people's ability to carry out tasks of daily living. Such measures preserve the rich, naturalistic character of everyday activity, but are easy to quantify in a laboratory or clinical setting. Therefore, event segmentation and memory measures may be a useful proxy for clinicians to assess everyday functioning in patient populations and an appropriate target for interventions aimed at improving everyday memory and tasks of daily living.

The embodied dynamics of perceptual causality: a slippery slope?

In Michotte's launching displays, while the launcher (object A) seems to move autonomously, the target (object B) seems to be displaced passively. However, the impression of A actively launching B does not persist beyond a certain distance identified as the "radius of action" of A over B. If the target keeps moving beyond the radius of action, it loses its passivity and seems to move autonomously. Here, we manipulated implied friction by drawing (or not) a surface upon which A and B are traveling, and by varying the inclination of this surface in screen- and earth-centered reference frames. Among 72 participants (n = 52 in Experiment 1; n = 20 in Experiment 2), we show that both physical embodiment of the event (looking straight ahead at a screen displaying the event on a vertical plane vs. looking downwards at the event displayed on a horizontal plane) and contextual information (objects moving along a depicted surface or in isolation) affect interpretation of the event and modulate the radius of action of the launcher. Using classical mechanics equations, we show that representational consistency of friction from radius of action responses emphasizes the embodied nature of frictional force in our cognitive architecture.

Events and children's sense of time: a perspective on the origins of everyday time-keeping

In this article I discuss abstract or pure time versus the content of time, (i.e., events, activities, and other goings-on). Or, more specifically, the utility of these two sorts of time in time-keeping or temporal organization. It is often assumed that abstract, uniform, and objective time is a universal physical entity out there, which humans may perceive of. However, this sort of evenly flowing time was only recently introduced to the human community, together with the mechanical clock. Before the introduction of mechanical clock-time, there were only events available to denote the extent of time. Events defined time, unlike the way time may define events in our present day culture. It is therefore conceivable that our primeval or natural mode of time-keeping involves the perception, estimation, and coordination of events. I find it likely that events continues to subserve our sense of time and time-keeping efforts, especially for children who have not yet mastered the use of clock-time. Instead of seeing events as a distraction to our perception of time, I suggest that our experience and understanding of time emerges from our perception of events.

IBES: a tool for creating instructions based on event segmentation

Receiving informative, well-structured, and well-designed instructions supports performance and memory in assembly tasks. We describe IBES, a tool with which users can quickly and easily create multimedia, step-by-step instructions by segmenting a video of a task into segments. In a validation study we demonstrate that the step-by-step structure of the visual instructions created by the tool corresponds to the natural event boundaries, which are assessed by event segmentation and are known to play an important role in memory processes. In one part of the study, 20 participants created instructions based on videos of two different scenarios by using the proposed tool. In the other part of the study, 10 and 12 participants respectively segmented videos of the same scenarios yielding event boundaries for coarse and fine events. We found that the visual steps chosen by the participants for creating the instruction manual had corresponding events in the event segmentation. The number of instructional steps was a compromise between the number of fine and coarse events. Our interpretation of results is that the tool picks up on natural human event perception processes of segmenting an ongoing activity into events and enables the convenient transfer into meaningful multimedia instructions for assembly tasks. We discuss the practical application of IBES, for example, creating manuals for differing expertise levels, and give suggestions for research on user-oriented instructional design based on this tool.

Infant categorization of path relations during dynamic events

Fundamental to amassing a lexicon of relational terms (i.e., verbs, prepositions) is the ability to abstract and categorize spatial relations such as a figure (e.g., boy) moving along a path (e.g., around the barn). Three studies examine how infants learn to categorize path over changes in manner, or how an action is performed (e.g., running vs. crawling). Experiment 1 (n = 60) finds that 10- to 12-month-old English-learning infants categorize a figure's path. In Experiment 2 (n = 27) categorization is disrupted when the ground object is removed, suggesting the relation between figure and ground defines the path. Experiment 3 (n = 24) shows that language may be a mechanism guiding category formation. These studies suggest that English-learning infants can categorize path, a component lexicalized in the world's languages.

Event completion: event based inferences distort memory in a matter of seconds

We present novel evidence that implicit causal inferences distort memory for events only seconds after viewing. Adults watched videos of someone launching (or throwing) an object. However, the videos omitted the moment of contact (or release). Subjects falsely reported seeing the moment of contact when it was implied by subsequent footage but did not do so when the contact was not implied. Causal implications were disrupted either by replacing the resulting flight of the ball with irrelevant video or by scrambling event segments. Subjects in the different causal implication conditions did not differ on false alarms for other moments of the event, nor did they differ in general recognition accuracy. These results suggest that as people perceive events, they generate rapid conceptual interpretations that can have a powerful effect on how events are remembered.

Who is crossing where? Infants' discrimination of figures and grounds in events

To learn relational terms such as verbs and prepositions, children must first dissect and process dynamic event components. This paper investigates the way in which 8- to 14-month-old English-reared infants notice the event components, figure (i.e., the moving entity) and ground (i.e., stationary setting), in both dynamic (Experiment 1) and static representations of events (Experiment 2) for categorical ground distinctions expressed in Japanese, but not in English. We then compare both 14- and 19-month-old English- and Japanese-reared infants' processing of grounds to understand how language learning interacts with the conceptualization of these constructs (Experiment 3). Results suggest that (1) infants distinguish between figures and grounds in events; (2) they do so differently for static vs. dynamic displays; (3) early in the second year, children from diverse language environments form nonnative - perhaps universal - event categories; and (4) these event categories shift over time as children have more exposure to their native tongue.

Changes in events alter how people remember recent information

Observers spontaneously segment larger activities into smaller events. For example, "washing a car" might be segmented into "scrubbing," "rinsing," and "drying" the car. This process, called event segmentation, separates "what is happening now? from "what just happened." In this study, we show that event segmentation predicts activity in the hippocampus when people access recent information. Participants watched narrative film and occasionally attempted to retrieve from memory objects that recently appeared in the film. The delay between object presentation and test was always 5 sec. Critically, for some of the objects, the event changed during the delay whereas for others the event continued. Using fMRI, we examined whether retrieval-related brain activity differed when the event changed during the delay. Brain regions involved in remembering past experiences over long periods, including the hippocampus, were more active during retrieval when the event changed during the delay. Thus, the way an object encountered just 5 sec ago is retrieved from memory appears to depend in part on what happened in those 5 sec. These data strongly suggest that the segmentation of ongoing activity into events is a control process that regulates when memory for events is updated.

The Brain's Cutting-Room Floor: Segmentation of Narrative Cinema

Observers segment ongoing activity into meaningful events. Segmentation is a core component of perception that helps determine memory and guide planning. The current study tested the hypotheses that event segmentation is an automatic component of the perception of extended naturalistic activity, and that the identification of event boundaries in such activities results in part from processing changes in the perceived situation. Observers may identify boundaries between events as a result of processing changes in the observed situation. To test this hypothesis and study this potential mechanism, we measured brain activity while participants viewed an extended narrative film. Large transient responses were observed when the activity was segmented, and these responses were mediated by changes in the observed activity, including characters and their interactions, interactions with objects, spatial location, goals, and causes. These results support accounts that propose event segmentation is automatic and depends on processing meaningful changes in the perceived situation; they are the first to show such effects for extended naturalistic human activity.