Not all narrative shifts function equally

Situation updating during discourse comprehension recruits right posterior portion of the multiple-demand network

Discourse comprehension involves the construction of a mental representation of the situation model as well as a continuous update of this representation. This mental update is cognitively demanding and likely engages the multiple-demand network. However, there is little evidence for the involvement of the multiple-demand network during situation updating. In this study, we used fMRI to test whether situation updating based on the change of spatial location activated the multiple-demand network. In a discourse comprehension task, readers read two-sentence discourses in which the second sentence either continues or introduces a shift of the spatial location information presented in the first sentence. Compared to situation continuation, situation updating reliably activated the right superior parietal lobule. This area is a part of the multiple-demand network as defined by a digit N-back localizer task and locates within the dorsal attention network as defined in the previous study by Yeo et al. in 2011. Our results provide evidence for the reliable involvement of a specific area of the multiple-demand network in situation updating during high-level discourse processing.

Explicit (Not Implicit) Attitudes Mediate the Focus of Attention During Sentence Processing

Many studies showed that comprehenders monitor changes in protagonists' emotions and actions. This article reports two experiments that explored how focusing comprehenders' attention on a particular property of the protagonist dimension (e.g., emotional or action state) affects the accessibility of information about target objects mentioned in the sentence. Furthermore, the present research examined whether participants' attitudes toward the issues described in the sentence can modulate comprehension processes. To this end, we asked participants to read sentences about environmental issues that focused comprehenders' attention on different mental and physical attributes of the same entities (protagonists and objects) and then self-report their own thoughts on the topic of environment by responding to the items assessing their environmental awareness. Importantly, we manipulated the task requirements across two experiments by administering a self-report task (Experiment 1), which required the participants to rate the seriousness and the frequency of the problem mentioned in a sentence; and administering a sentence-picture verification paradigm (Experiment 2), which required the participants to merely indicate if the object depicted in the picture (related to a certain environmental problem) was mentioned in the preceding sentence. The results of these experiments suggest that the focus of a sentence on the environmental problem (rather than the protagonist's emotion and action) enhances the accessibility of information about environmental issues (e.g., plastic garbage); that the comprehender's level of environmental awareness influences one's attention during sentence processing; and that comprehender characteristics significantly modulate comprehension processes only when the measures tap into explicit (and not implicit) processes.

Person-based organisation in working memory

Working memory (WM) helps maintain information during a variety of cognitive activities in scholastic and social situations. This study focused on a social aspect of WM, specifically, how it maintains information related to people. We investigated person-based organisation of information across four experiments using the reading span task (RST). Person information (i.e., an occupational title) was provided with sentences manipulated across conditions. In Experiment 1, consistent with the assumption that person-based organisation exists in WM, participants performed better when they could easily organise target items in a person-based manner (person-based organisation) than when they were prevented from using such information. Experiments 2 and 3 investigated the process of person-based organisation using alphabetical letters as targets (unlike words in Experiment 1), which prevented possible semantic associations between person information and target items. Experiment 2 replicated Experiment 1, suggesting that contextual retrieval is critical in person-based organisation. Experiment 3 showed the person-based organisation effect even after controlling for the difficulty of the process component in the RST. The results of Experiments 2 and 3 suggest that person information could serve as contextual retrieval cues in WM. Experiment 4, which did not show the organisation effect based on information about an object (i.e., a fruit name), suggests along with Experiments 1 to 3 that the observed organisation effect in Experiments 1 to 3 was specific to person information. In addition to showing the enhanced WM performance by person-based organisation, we have suggested contextual cue-dependent retrieval as the underlying cognitive process.

The Interplay between Topic Shift and Focus in the Dynamic Construction of Discourse Representations

Previous studies have suggested that focusing an element can enhance the activation of the focused element and bring about a number of processing benefits. However, whether and how this local prominence of information interacts with global discourse organization remains unclear. In the present study, we addressed this issue in two experiments. Readers were presented with four-sentence discourses. The first sentence of each discourse contained a critical word that was either focused or unfocused in relation to a wh-question preceding the discourse. The second sentence either maintained or shifted the topic of the first sentence. Participants were told to read for comprehension and for a probe recognition task in which the memory of the critical words was tested. In Experiment 1, when the probe words were tested immediately after the point of topic shift, we found shorter response times for the focused critical words than the unfocused ones regardless of topic manipulation. However, in Experiment 2, when the probe words were tested two sentences away from the point of topic shift, we found the facilitation effect of focus only in the topic-maintained discourses, but not in the topic-shifted discourses. This suggests that the facilitation effect of focus was not immediately suppressed at the point of topic shifting, but when additional information was added to the new topic. Our findings provide evidence for the dynamic interplay between global topic structure and local salience of information and have important implications on how activation of information fluctuates in mental representation.

Re-presentations of space in Hollywood movies: an event-indexing analysis

Popular movies present chunk-like events (scenes and subscenes) that promote episodic, serial updating of viewers' representations of the ongoing narrative. Event-indexing theory would suggest that the beginnings of new scenes trigger these updates, which in turn require more cognitive processing. Typically, a new movie event is signaled by an establishing shot, one providing more background information and a longer look than the average shot. Our analysis of 24 films reconfirms this. More important, we show that, when returning to a previously shown location, the re-establishing shot reduces both context and duration while remaining greater than the average shot. In general, location shifts dominate character and time shifts in event segmentation of movies. In addition, over the last 70 years re-establishing shots have become more like the noninitial shots of a scene. Establishing shots have also approached noninitial shot scales, but not their durations. Such results suggest that film form is evolving, perhaps to suit more rapid encoding of narrative events.

Starting from scratch and building brick by brick in comprehension

During narrative comprehension, readers construct representations of the situation described by a text, called situation models. Theories of situation model construction and event comprehension posit two distinct types of situation model updating: incremental updating of individual situational dimensions, and global updates in which an old model is abandoned and a new one created. No research to date has directly tested whether readers update their situation models incrementally, globally, or both. We investigated whether both incremental and global updating occur during narrative comprehension. Participants typed what they were thinking while reading an extended narrative, and then segmented the narrative into meaningful events. Each typed think-aloud response was coded for whether it mentioned characters, objects, space, time, goals, or causes. There was evidence for both incremental and global updating: Readers mentioned situation dimensions more when those dimensions changed, controlling for the onset of a new event. Readers also mentioned situation dimensions more at points when a new event began than during event middles, controlling for the presence of situational change. These results support theories that claim that readers engage in both incremental and global updating during extended narrative comprehension.

Processing and memory of information presented in narrative or expository texts

BACKGROUND

Previous research suggests that narrative and expository texts differ in the extent to which they prompt students to integrate to-be-learned content with relevant prior knowledge during comprehension.

AIMS

We expand on previous research by examining on-line processing and representation in memory of to-be-learned content that is embedded in narrative or expository texts. We are particularly interested in how differences in the use of relevant prior knowledge leads to differences in terms of levels of discourse representation (textbase vs. situation model).

SAMPLES

A total of 61 university undergraduates in Expt 1, and 160 in Expt 2.

METHODS

In Expt 1, subjects thought out loud while comprehending circulatory system content embedded in a narrative or expository text, followed by free recall of text content. In Expt 2, subjects read silently and completed a sentence recognition task to assess memory.

RESULTS

In Expt 1, subjects made more associations to prior knowledge while reading the expository text, and recalled more content. Content recall was also correlated with amount of relevant prior knowledge for subjects who read the expository text but not the narrative text. In Expt 2, subjects reading the expository text (compared to the narrative text) had a weaker textbase representation of the to-be-learned content, but a marginally stronger situation model.

CONCLUSIONS

Results suggest that in terms of to-be-learned content, expository texts trigger students to utilize relevant prior knowledge more than narrative texts.

Neural correlates of narrative shifts during auditory story comprehension

The ability to segment continuous linguistic information online into larger, meaningful units is a key element in narrative comprehension. Narrative shifts, i.e. transitions between individual units, are postulated to continuously update the mental situation model. Their cerebral correlates, however, have hardly been investigated. Under highly naturalistic conditions this study seeks to identify the neural correlates of implicit processing of narrative shifts during continuous speech comprehension. 16 male native German speakers listened passively to a German novella for 23 min while BOLD signal was recorded with fMRI. Text comprehension was tested in a short post-scan interview asking for critical episodes of the story. Narrative shifts were defined on the basis of a macropropositional analysis. Compared to listening to text passages of the narrative that neither contained narrative shifts nor structurally similar linguistic control events (i.e., sentence boundaries), narrative shifts evoked increased BOLD signal changes in the right temporal gyrus, precuneus and posterior/middle cingulate cortex bilaterally. When narrative shifts were contrasted with sentence boundaries, activation in the right precuneus and cingulate cortex remained significant. The results strengthen the relevance of medial parietal structures for natural language comprehension. More precisely, the precuneus and posterior cingulate appear to be the neural substrate for updating mental story representations and can be regarded as critical parts of a more complex, distributed neural network underlying story comprehension.

Using temporal cohesion to predict temporal coherence in narrative and expository texts

We investigated the linguistic features of temporal cohesion that distinguish variations in temporal coherence. In an analysis of 150 texts, experts rated temporal coherence on three continuous scale measures designed to capture unique representations of time. Coh-Metrix, a computational tool that assesses textual cohesion, correctly predicted the human ratings with five features of temporal cohesion. The correlations between predicted and actual scores were all statistically significant. In a complementary study, we explored the importance of temporal cohesion in characterizing genre. A discriminant function analysis, using Coh-Metrix temporal indices, successfully distinguished the genres of science, history, and narrative texts. The results suggested that history texts are more similar to narrative texts than to science texts in terms of temporal cohesion.

What do you want? How perceivers use cues to make goal inferences about others

Variables influencing inferences about a stranger's goal during an unsolicited social interaction were explored. Experiment 1 developed a procedure for identifying cues. Experiments 2 and 3 assessed the relative importance of various cues (space, time, characteristics of oneself, characteristics of the stranger, and the stranger's behavior) for goal judgments. Results indicated that situational context cues informed goal judgments in ways that were consistent with diagnosticity ratings and typicality ratings of those cues. Stranger characteristics and stranger behaviors affected goal judgments more than would be expected from these quantitative measures of their informativeness. Nonetheless, the results are consistent with a mental model view that assumes perceivers monitor situational cues present during interactions and that goal inferences are guided by the informativeness of these cues.

Character movement and the representation of space during narrative comprehension

Traditional research on situation models has examined the accessibility of locations and objects during narrative experiences. These studies have described a ubiquitous gradient effect: Spatial locations and objects in reader focus are more accessible than locations farther from this focus, with accessibility decreasing as a function of distance. How might readers' expectations about character movement, beyond information about spatial locations, additionally affect this accessibility gradient? In two experiments, we investigated whether reader expectations for character movement impact the accessibility of spatial information from memory. In Experiment 1, participants read stories that described characters moving in either a unidirectional or a random pattern through a learned environment. In Experiment 2, characters moved forward in a unidirectional way or backtracked through previously explored rooms. The results suggest that reader expectations for character movement can influence the accessibility of spatial information. Such expectations play a critical role in processes of narrative comprehension.

When goals collide: monitoring the goals of multiple characters

Most story plots contain multiple characters who are independent, interact, and often have conflicting goals. One would expect that narrative understanding would require monitoring of the goals, concerns, and situations of multiple agents. There is considerable evidence that understanders monitor the primary protagonist's goal plans (e.g., Suh & Trabasso, 1993). However, there is relatively little research on the extent to which understanders monitor the goals of multiple agents. We investigated the impact of characters' roles and prominence on the extent to which understanders monitor the goal plans of multiple characters in a feature length film. In Experiment 1, participants made situation change judgments, and in Experiment 2, they verbally described scenes. Both types of judgments indicated that viewers monitor the goals and plans of multiple agents but do so to a greater extent for characters more prominent to the plotline.

Assessing the influence of dimensional focus during situation model construction

According to Zwaan, Langston, and Graesser's (1995) event-indexing model, when comprehending text, readers monitor changes in a series of critical dimensions: space, time, protagonist, causality, and intentionality. In this study, the influence of dimensional focus was assessed during situation-model construction. Participants read narratives and were instructed to specifically monitor a single dimension while their sentence reading times were recorded. Critical sentence reading times were then analyzed for all shift types. Results support the general prediction that at least the time and protagonist dimensions are resistant to task demands, demonstrating that comprehenders routinely perform dimensional updating processes that are context independent. These results are discussed in the context of the event-indexing model.

Representing a described sequence of events: a dynamic view of narrative comprehension

This study explored the representation that readers construct when advancing through the description of an unfolding occurrence. In 3 experiments, participants read narratives describing a sequence of events and at a certain moment were tested for the accessibility of an entity from a past event. Entities were less accessible when the temporal distance between that past event and the current now point in the described world was relatively long than when it was shorter. This effect occurred when temporal distance was varied in terms of the duration of an intervening event but not when it was varied in terms of a temporal shift. The results suggest that the representation constructed for the description of an unfolding occurrence mimics its temporal structure. This is consistent with a dynamic view of narrative comprehension.

Interactive Dimensions in the Construction of Mental Representations for Text

To detail the structure and format of memory for texts, researchers have examined whether readers monitor separate text dimensions for space, time, and characters. The authors proposed that the interactivity between these individual dimensions may be as critical to the construction of complex mental models as the discrete dimensions themselves. In the present experiments, participants read stories in which characters were described as traveling from a start to a final location. During movement between locations, characters engaged in activities that could take either a long or short amount of time to complete. Results indicate that accessibility for the spatial locations was a function of the passage of time. The authors interpret this as evidence that the interactive nature of text dimensions affects the structure of representations in memory.

Who when where: An experimental test of the event-indexing model

We tested the event-indexing model proposed by Zwaan, Langston, and Graesser (1995). Participants read narratives containing target sentences that involved situational shifts. Independently of each other, continuity and shifting of the protagonist, time, and location dimensions were varied. In Experiment 1, reading times of the target sentences increased for protagonist shifts and temporal shifts, whereas the effect of spatial shifts was weak. Moreover, an interaction of protagonist shifts and spatial shifts was found. These results were replicated in Experiment 2, which also revealed strong effects of these situational shifts on coherence ratings that participants gave immediately after reading each target sentence. Experiment 3 addressed the interaction of protagonist shifts and spatial shifts, showing that it may be due to the differential involvement of unexplained protagonist motions. These experimental results support the processing load predictions of the event-indexing model and extend previous correlational results.

Readers' reality-driven and plot-driven analyses in narrative comprehension

We suggest that when readers experience narratives, their expectations about the likelihood of narrative events are informed by two types of analyses. Reality-driven analyses incorporate real-world constraints involving, for example, time and space; plot-driven analyses incorporate concerns about outcomes that emerge from the plot. We explored the interaction of these two types of analyses in the application of temporal situation models. Participants read stories in which the final episode occurred after a minute time shift (i.e., "A minute later...") or hour time shift (i.e., "An hour later..."). Our experiments assessed participants' judgments and reading times for statements describing the state of events (e.g., the possibility that characters could carry out particular behaviors) following each type of time shift. Experiments 1A and 1B demonstrated that readers are appropriately sensitive to the real concomitants of time shifts. Experiments 2A and 2B demonstrated, even so, that plot-driven preferences modify judgments and reading times away from reality-driven expectations. Our results have implications for the role of the reader in theories of narrative comprehension.