A predictive coding model of the N400

The N400 event-related component has been widely used to investigate the neural mechanisms underlying real-time language comprehension. However, despite decades of research, there is still no unifying theory that can explain both its temporal dynamics and functional properties. In this work, we show that predictive coding - a biologically plausible algorithm for approximating Bayesian inference - offers a promising framework for characterizing the N400. Using an implemented predictive coding computational model, we demonstrate how the N400 can be formalized as the lexico-semantic prediction error produced as the brain infers meaning from the linguistic form of incoming words. We show that the magnitude of lexico-semantic prediction error mirrors the functional sensitivity of the N400 to various lexical variables, priming, contextual effects, as well as their higher-order interactions. We further show that the dynamics of the predictive coding algorithm provides a natural explanation for the temporal dynamics of the N400, and a biologically plausible link to neural activity. Together, these findings directly situate the N400 within the broader context of predictive coding research. More generally, they raise the possibility that the brain may use the same computational mechanism for inference across linguistic and non-linguistic domains.

Brain responses to a lab-evolved artificial language with space-time metaphors

What is the connection between the cultural evolution of a language and the rapid processing response to that language in the brains of individual learners? In an iterated communication study that was conducted previously, participants were asked to communicate temporal concepts such as "tomorrow," "day after," "year," and "past" using vertical movements recorded on a touch screen. Over time, participants developed simple artificial 'languages' that used space metaphorically to communicate in nuanced ways about time. Some conventions appeared rapidly and universally (e.g., using larger vertical movements to convey greater temporal durations). Other conventions required extensive social interaction and exhibited idiosyncratic variation (e.g., using vertical location to convey past or future). Here we investigate whether the brain's response during acquisition of such a language reflects the process by which the language's conventions originally evolved. We recorded participants' EEG as they learned one of these artificial space-time languages. Overall, the brain response to this artificial communication system was language-like, with, for instance, violations to the system's conventions eliciting an N400-like component. Over the course of learning, participants' brain responses developed in ways that paralleled the process by which the language had originally evolved, with early neural sensitivity to violations of a rapidly-evolving universal convention, and slowly developing neural sensitivity to an idiosyncratic convention that required slow social negotiation to emerge. This study opens up exciting avenues of future work to disentangle how neural biases influence learning and transmission in the emergence of structure in language.

No support for a causal role of primary motor cortex in construing meaning from language: An rTMS study

Embodied cognition theories predict a functional involvement of sensorimotor processes in language understanding. In a preregistered experiment, we tested this idea by investigating whether interfering with primary motor cortex (M1) activation can change how people construe meaning from action language. Participants were presented with sentences describing actions (e.g., "turning off the light") and asked to choose between two interpretations of their meaning, one more concrete (e.g., "flipping a switch") and another more abstract (e.g., "going to sleep"). Prior to this task, participants' M1 was disrupted using repetitive transcranial magnetic stimulation (rTMS). The results yielded strong evidence against the idea that M1-rTMS affects meaning construction (BF01 > 30). Additional analyses and control experiments suggest that the absence of effect cannot be accounted for by failure to inhibit M1, lack of construct validity of the task, or lack of power to detect a small effect. In sum, these results do not support a causal role for primary motor cortex in building meaning from action language.

Information entropy facilitates (not impedes) lexical processing during language comprehension

It is well known that contextual predictability facilitates word identification, but it is less clear whether the uncertainty associated with the current context (i.e., its lexical entropy) influences sentence processing. On the one hand, high entropy contexts may lead to interference due to greater number of lexical competitors. On the other hand, predicting multiple lexical competitors may facilitate processing through the preactivation of shared semantic features. In this study, we examined whether entropy measured at the trial level (i.e., for each participant, for each item) corresponds to facilitatory or inhibitory effects. Trial-level entropy captures each individual's knowledge about specific contexts and is therefore a more valid and sensitive measure of entropy (relative to the commonly employed item-level entropy). Participants (N = 112) completed two experimental sessions (with counterbalanced orders) that were separated by a 3- to 14-day interval. In one session, they produced up to 10 completions for sentence fragments (N = 647). In another session, they read the same sentences including a target word (whose entropy value was calculated based on the produced completions) while reading times were measured. We observed a facilitatory (not inhibitory) effect of trial-level entropy on lexical processing over and above item-level measures of lexical predictability (including cloze probability, surprisal, and semantic constraint). Extra analyses revealed that greater semantic overlap between the target and the produced responses facilitated target processing. Thus, the results lend support to theories of lexical prediction maintaining that prediction involves broad activation of semantic features rather than activation of full lexical forms.

CompreTAP: Feasibility and reliability of a new language comprehension mapping task via preoperative navigated transcranial magnetic stimulation

OBJECTIVE

Stimulation-based language mapping approaches that are used pre- and intraoperatively employ predominantly overt language tasks requiring sufficient language production abilities. Yet, these production-based setups are often not feasible in brain tumor patients with severe expressive aphasia. This pilot study evaluated the feasibility and reliability of a newly developed language comprehension task with preoperative navigated transcranial magnetic stimulation (nTMS).

METHODS

Fifteen healthy subjects and six brain tumor patients with severe expressive aphasia unable to perform classic overt naming tasks underwent preoperative nTMS language mapping based on an auditory single-word Comprehension TAsk for Perioperative mapping (CompreTAP). Comprehension was probed by button-press responses to auditory stimuli, hence not requiring overt language responses. Positive comprehension areas were identified when stimulation elicited an incorrect or delayed button press. Error categories, case-wise cortical error rate distribution and inter-rater reliability between two experienced specialists were examined.

RESULTS

Overall, the new setup showed to be feasible. Comprehension-disruptions induced by nTMS manifested in no responses, delayed or hesitant responses, searching behavior or selection of wrong target items across all patients and controls and could be performed even in patients with severe expressive aphasia. The analysis agreement between both specialists was substantial for classifying comprehension-positive and -negative sites. Extensive left-hemispheric individual cortical comprehension sites were identified for all patients. Apart from one case presenting with transient worsening of aphasic symptoms, pre-existing language deficits did not aggravate if results were used for subsequent surgical planning.

CONCLUSION

Employing this new comprehension-based nTMS setup allowed to identify language relevant cortical sites in all healthy subjects and severely aphasic patients who were thus far precluded from classic production-based mapping. This pilot study, moreover, provides first indications that the CompreTAP mapping results may support the preservation of residual language function if used for subsequent surgical planning.

Parsing the late-closure ambiguity: While Schrödinger measured the cat escaped from the box

An experiment investigated the "good-enough" processing account regarding how people parse sentences with late-closure ambiguity, such as While Anna dressed the baby who was cute and cuddly spit up on the bed. One possible result of an initial misparse of the sentence (thinking that Anna dressed the baby) is that the correct parse then cannot be created. The alternative is that, although the misparse may linger in the comprehender's mind, the correct parse is eventually established and coexists with the misparse. This study approached this issue through an analogy to quantum physics. When photons are directed toward two small slits, it appears as if each photon passes through both slits ("bothness"). If particles not subject to quantum effects are directed at the slits, they pass through one or the other ("oneness"). Participants read sentences containing the late-closure ambiguity and afterward answered two questions about each sentence. These could query the potential misparse (Did Anna dress the baby?), correct-parse (Did Anna dress herself?), or the main clause (Did the baby spit up on the bed?), and the order of the question types was varied to test for quantum measurement context effects. The results supported "oneness," that is, the correct-parse and misparse of the subordinate clause do not coexist. Participants rarely said "yes" to both the misparse and correct-parse questions, and the "yes" response proportions for these two questions invariably added up to around 1.0. Furthermore, no quantum-like measurement-order effect between misparse and correct-parse questions was found.

The influence of sentence focus on motor system activity in language comprehension and its temporal dynamics: Preliminary evidence from sEMG

Previous research has shown that individual experiences and experimental tasks can influence the occurrence of mental simulation during sentence comprehension. However, little research has focused on the effect of sentence focus on mental simulation and its temporal dynamics. Sentence focus refers to the hierarchical structure of information within a sentence, where focused information represents the most prominent and essential information. In contrast, nonfocused information provides a background for the focused information. The present study investigated whether sentence focus would affect the activity of the motor system in language comprehension and at which stage the effect of sentence focus occurred. We measured spontaneous arm muscle electrical activity by surface electromyography (sEMG) while participants read action-focused, nonaction-focused, and control sentences. We observed greater spontaneous muscle electrical activity in the flexor common muscle of the fingers when participants read action-focused sentences compared to nonaction-focused and control sentences. Additionally, there was an interactive trend between sentence type and time, spontaneous muscle electrical activity while reading action-focused sentences was observed in both early (1 ms to 300 ms after the presentation of the action phrase) and late time windows (901 ms to 1500 ms after the action phrase). The findings suggest that the motor system exhibits flexible engagement during language comprehension and the impact of sentence focus on motor system activity may be throughout both the lexical-semantic retrieval and sentence-meaning integration stages.

Online revision process in clause-boundary garden-path sentences

A long-standing question in sentence processing research concerns the online parsing process in clause-boundary garden-path sentences, such as After Mary dressed John bathed. In this sentence, "John" must be parsed as the matrix subject DP but can be locally analysed as the object of the embedded verb. There is considerable evidence that the parser misanalyses these garden-path sentences. However, the controversy lies in whether the parser revises them during the online parsing process. The present study investigated this revision process through two self-paced reading experiments utilising grammatical constraints on reflexives and subject or object relative clauses embedded within the locally ambiguous DP. The results provided evidence of revision when a subject relative clause was embedded but not when an object relative clause was embedded. These findings suggest that the parser assigns grammatical structures that correspond to input strings during the revision of clause-boundary ambiguities but that object relative clauses affect the online revision process.

Graded and ungraded expectation patterns: Prediction dynamics during active comprehension

Language comprehension can be facilitated by the accurate prediction of upcoming words, but prediction effects are not ubiquitous, and comprehenders likely use predictive processing to varying degrees depending on task demands. To ascertain the processing consequences of prioritizing prediction, we here compared ERPs elicited when young adult participants simply read for comprehension with those collected in a subsequent block that required active prediction. We were particularly interested in frontally-distributed post-N400 effects for expected and unexpected words in strongly constraining contexts, which have previously been documented as two distinct patterns: an enhanced positivity ("anterior positivity") observed for prediction violations compared to words that are merely unpredictable (because they occur in weakly constraining sentences) and a distinction between expected endings in more constraining contexts and those same weakly constrained words ("frontal negativity" to the strongly predicted words). We found that the size of the anterior positivity effect was unchanged between passive comprehension and active prediction, suggesting that some processes related to prediction may engage state-like networks. On the other hand, the frontal negativity showed graded patterns from the interaction of task and sentence type. These differing patterns support the hypothesis that there are two separate effects with frontal scalp distributions that occur after the N400 and further suggest that the impact of violating predictions (as long as prediction is engaged at all) is largely stable across varying levels of effort/attention directed toward prediction, whereas other comprehension processes can be modulated by task demands.

Combining EEG and 3D-eye-tracking to study the prediction of upcoming speech in naturalistic virtual environments: A proof of principle

EEG and eye-tracking provide complementary information when investigating language comprehension. Evidence that speech processing may be facilitated by speech prediction comes from the observation that a listener's eye gaze moves towards a referent before it is mentioned if the remainder of the spoken sentence is predictable. However, changes to the trajectory of anticipatory fixations could result from a change in prediction or an attention shift. Conversely, N400 amplitudes and concurrent spectral power provide information about the ease of word processing the moment the word is perceived. In a proof-of-principle investigation, we combined EEG and eye-tracking to study linguistic prediction in naturalistic, virtual environments. We observed increased processing, reflected in theta band power, either during verb processing - when the verb was predictive of the noun - or during noun processing - when the verb was not predictive of the noun. Alpha power was higher in response to the predictive verb and unpredictable nouns. We replicated typical effects of noun congruence but not predictability on the N400 in response to the noun. Thus, the rich visual context that accompanied speech in virtual reality influenced language processing compared to previous reports, where the visual context may have facilitated processing of unpredictable nouns. Finally, anticipatory fixations were predictive of spectral power during noun processing and the length of time fixating the target could be predicted by spectral power at verb onset, conditional on the object having been fixated. Overall, we show that combining EEG and eye-tracking provides a promising new method to answer novel research questions about the prediction of upcoming linguistic input, for example, regarding the role of extralinguistic cues in prediction during language comprehension.

Inconsistency in perspective-taking during comprehension

In order to successfully comprehend referring expressions, a listener must often consider how the speaker's perspective differs from their own. Such consideration of others' perspective is effortful and not always employed. Previous studies disagree about whether executive function predicts perspective-taking use in language comprehension. Furthermore, it is unclear whether or not there are consistent individual differences of perspective-taking ability in comprehension. This study tested participants in three perspective-taking in comprehension tasks and two measures of executive function to determine whether participants show consistency in their perspective-taking ability and whether this ability is predicted by measures of executive function. We found that (1) some but not all perspective-taking in comprehension tasks correlate with one another, and (2) inhibition control and working memory are not linked with any of the three perspective-taking measures. Based on these findings, we conclude that perspective-taking in comprehension may not be a unitary ability.

Tracking meaning evolution in the brain: Processing consequences of conventionalization

Language users employ creative and innovative means to refer to novel concepts. One example is place-for-event metonymy as in "How many bands played at Woodstock?" where the place name is used to refer to an event. We capitalize on the observation that place-for-event metonymy can on the one hand result in the conventionalization of the event reading (as is the case for "Woodstock") but on the other hand can also be relatively short-lived as a function of the socio-cultural or historical impact of the respective event (e.g., "Egypt" to refer to one of the sites of the Arab Spring). We use place-for-event metonymy as a test case to tap into discrete stages of conventionalization and compare the processing of the place and the event reading of particular expressions, with ratings of the degree of conventionalization as predictors. In an event-related potential (ERP) reading study, we observed a modulation of the Late Positivity between 500 and 750 ms post-onset by condition (event vs. place reading) and degree of conventionalization. The amplitude of the positivity was most pronounced for event readings with a low degree of conventionalization (similar to previous findings from ad-hoc metonymy). Interestingly, place readings with a high degree of (event) conventionalization also evoked a pronounced positivity. The Late Positivity is viewed to reflect processing demands during reconceptualization required for proper utterance interpretation. Overall, the data suggest that stages of meaning evolution are reflected in the underlying neurophysiological processes.

Moving visual world experiments online? A web-based replication of Dijkgraaf, Hartsuiker, and Duyck (2017) using PCIbex and WebGazer.js

The visual world paradigm is one of the most influential paradigms to study real-time language processing. The present study tested whether visual world studies can be moved online, using PCIbex software (Zehr & Schwarz, 2018) and the WebGazer.js algorithm (Papoutsaki et al., 2016) to collect eye-movement data. Experiment 1 was a fixation task in which the participants looked at a fixation cross in multiple positions on the computer screen. Experiment 2 was a web-based replication of a visual world experiment by Dijkgraaf et al. (2017). Firstly, both experiments revealed that the spatial accuracy of the data allowed us to distinguish looks across the four quadrants of the computer screen. This suggest that the spatial resolution of WebGazer.js is fine-grained enough for most visual world experiments (which typically involve a two-by-two quadrant-based set-up of the visual display). Secondly, both experiments revealed a delay of roughly 300 ms in the time course of the eye movements, possibly caused by the internal processing speed of the browser or WebGazer.js. This delay can be problematic in studying questions that require a fine-grained temporal resolution and requires further investigation.

Dietary Factors Impact Developmental Trajectories in Young Autistic Children

PURPOSE

The purpose of this research was to investigate the impact of dietary factors on developmental trajectories in young autistic children.

METHODS

A gluten-free and casein-free diets, as well as six types of food (meat and eggs, vegetables, uncooked vegetables, sweets, bread, and "white soft bread that never molds") were investigated observationally for up to three years in 5,553 children 2 to 5 years of age via parent-report measures completed within a mobile application. Children had a parent-reported diagnosis of Autism Spectrum Disorder (ASD); 78% were males; the majority of participants resided in the USA. Outcome was monitored on five orthogonal subscales: Language Comprehension, Expressive Language, Sociability, Sensory Awareness, and Health, assessed by the Autism Treatment Evaluation Checklist (ATEC) (Rimland & Edelson, 1999) and Mental Synthesis Evaluation Checklist (MSEC) (Arnold & Vyshedskiy, 2022; Braverman et al., 2018).

RESULTS

Consumption of fast-acting carbohydrates - sweets, bread, and "white soft bread that never molds" - was associated with a significant and a consistent Health subscale score decline. On the contrary, a gluten-free diet, as well as consumption of meat, eggs, and vegetables were associated with a significant and consistent improvement in the Language Comprehension score. Consumption of meat and eggs was also associated with a significant and consistent improvement in the Sensory Awareness score.

CONCLUSION

The results of this study demonstrate a strong correlation between a diet and developmental trajectories and suggest possible dietary interventions for young autistic children.

Even young children make multiple predictions in the complex visual world

Children can anticipate upcoming input in sentences with semantically constraining verbs. In the visual world, the sentence context is used to anticipatorily fixate the only object matching potential sentence continuations. Adults can process even multiple visual objects in parallel when predicting language. This study examined whether young children can also maintain multiple prediction options in parallel during language processing. In addition, we aimed at replicating the finding that children's receptive vocabulary size modulates their prediction. German children (5-6 years, n = 26) and adults (19-40 years, n = 37) listened to 32 subject-verb-object sentences with semantically constraining verbs (e.g., "The father eats the waffle") while looking at visual scenes of four objects. The number of objects being consistent with the verb constraints (e.g., being edible) varied among 0, 1, 3, and 4. A linear mixed effects model on the proportion of target fixations with the effect coded factors condition (i.e., the number of consistent objects), time window, and age group revealed that upon hearing the verb, children and adults anticipatorily fixated the single visual object, or even multiple visual objects, being consistent with the verb constraints, whereas inconsistent objects were fixated less. This provides first evidence that, comparable to adults, young children maintain multiple prediction options in parallel. Moreover, children with larger receptive vocabulary sizes (Peabody Picture Vocabulary Test) anticipatorily fixated potential targets more often than those with smaller ones, showing that verbal abilities affect children's prediction in the complex visual world.

Cognitive Science Progresses Toward Interactive Frameworks

Despite its many twists and turns, the arc of cognitive science generally bends toward progress, thanks to its interdisciplinary nature. By glancing at the last few decades of experimental and computational advances, it can be argued that-far from failing to converge on a shared set of conceptual assumptions-the field is indeed making steady consensual progress toward what can broadly be referred to as interactive frameworks. This inclination is apparent in the subfields of psycholinguistics, visual perception, embodied cognition, extended cognition, neural networks, dynamical systems theory, and more. This pictorial essay briefly documents this steady progress both from a bird's eye view and from the trenches. The conclusion is one of optimism that cognitive science is getting there, albeit slowly and arduously, like any good science should.

Predictive Sentence Processing at Speed: Evidence from Online Mouse Cursor Tracking

Three online mouse cursor-tracking experiments investigated predictive sentence processing at speed. Participants viewed visual arrays with objects like a bike and kite while hearing predictive sentences like, "What the man will ride, which is shown on this page, is the bike," or non-predictive sentences like, "What the man will spot, which is shown on this page, is the bike." Based on the selectional restrictions of "ride" (i.e., vs. "spot"), participants made mouse cursor movements to the bike before hearing the noun "bike." Compellingly, this effect was observed at speech rates of ∼3 (Experiment 1), ∼6 (Experiment 2), and ∼9 (Experiment 3) syllables/s. While prior research suggests striking limits on prediction, these results highlight temporal dynamics that may impact comprehenders' ability to preactivate information when hearing impressively rapid speech. Implications for theories of sentence processing are discussed.

Cross-clause planning in Nungon (Papua New Guinea): Eye-tracking evidence

Hundreds of languages worldwide use a sentence structure known as the "clause chain," in which 20 or more clauses can be stacked to form a sentence. The Papuan language Nungon is among a subset of clause chaining languages that require "switch-reference" suffixes on nonfinal verbs in chains. These suffixes announce whether the subject of each upcoming clause will differ from the subject of the previous clause. We examine two major issues in psycholinguistics: predictive processing in comprehension, and advance planning in production. Whereas previous work on other languages has demonstrated that sentence planning can be incremental, switch-reference marking would seem to prohibit strictly incremental planning, as it requires speakers to plan the next clause before they can finish producing the current one. This suggests an intriguing possibility: planning strategies may be fundamentally different in Nungon. We used a mobile eye-tracker and solar-powered laptops in a remote village in Papua, New Guinea, to track Nungon speakers' gaze in two experiments: comprehension and production. Curiously, during comprehension, fixation data failed to find evidence that switch-reference marking is used for predictive processing. However, during production, we found evidence for advance planning of switch-reference markers, and, by extension, the subjects they presage. We propose that this degree of advance syntactic planning pushes the boundaries of what is known about sentence planning, drawing on data from a novel morpheme type in an understudied language.

Predictive structure building in language comprehension: a large sample study on incremental licensing and parallelism

In online language comprehension, the parser incrementally builds hierarchical syntactic structures. The predictive nature of this structure-building process has been the subject of extensive debate. A previous study observed that when a wh-phrase indicates parallelism between the upcoming wh-clause and a preceding clause (e.g., John told some stories, but we couldn't remember which stories…), the parser predictively constructs the wh-clause. This observation demonstrates predictive structure building. However, the study also suggests that the parser does not make a prediction when the wh-phrase indicates that parallelism does not hold (e.g., John told some stories … with which stories…), a potential limit to the prediction of syntactic structures. Crucially, these findings are controversial because the study did not observe processing difficulty when disambiguating input indicated that the predicted continuation was inconsistent with the globally grammatical structure (garden-path effects). The controversial results may be due to a lack of statistical power. Therefore, the present study conducted a large-scale replication study (324 participants and 24 sets of materials). The results revealed that the parser predicts the clausal structure, irrespective of the type of wh-phrase. There was also evidence of garden-path effects, supporting the finding that the parser makes a prediction. These observations suggest that the prediction algorithm inherent in the human parser is more powerful than assumed by the previous study and that the parser attempts to construct globally grammatical structures during revision.

A noisy-channel approach to depth-charge illusions

The "depth-charge" sentence, No head injury is too trivial to be ignored, is often interpreted as "no matter how trivial head injuries are, we should not ignore them" while the literal meaning is the opposite - "we should ignore them". Four decades of research have failed to resolve the source of this entrenched semantic illusion. Here we adopt the noisy-channel framework for language comprehension to provide a potential explanation. We hypothesize that depth-charge sentences result from inferences whereby comprehenders derive the interpretation by weighing the plausibility of possible readings of the depth-charge sentences against the likelihood of plausible sentences being produced with errors. In four experiments, we find that (1) the more plausible the intended meaning of the depth-charge sentence is, the more likely the sentence is to be misinterpreted; and (2) the higher the likelihood of our hypothesized noise operations, the more likely depth-charge sentences are to be misinterpreted. These results suggest that misinterpretation is affected by both world knowledge and the distance between the depth-charge sentence and a plausible alternative, which is consistent with the noisy-channel framework.

Electrophysiological evidence for the enhancement of gesture-speech integration by linguistic predictability during multimodal discourse comprehension

In face-to-face discourse, listeners exploit cues in the input to generate predictions about upcoming words. Moreover, in addition to speech, speakers produce a multitude of visual signals, such as iconic gestures, which listeners readily integrate with incoming words. Previous studies have shown that processing of target words is facilitated when these are embedded in predictable compared to non-predictable discourses and when accompanied by iconic compared to meaningless gestures. In the present study, we investigated the interaction of both factors. We recorded electroencephalogram from 60 Dutch adults while they were watching videos of an actress producing short discourses. The stimuli consisted of an introductory and a target sentence; the latter contained a target noun. Depending on the preceding discourse, the target noun was either predictable or not. Each target noun was paired with an iconic gesture and a gesture that did not convey meaning. In both conditions, gesture presentation in the video was timed such that the gesture stroke slightly preceded the onset of the spoken target by 130 ms. Our ERP analyses revealed independent facilitatory effects for predictable discourses and iconic gestures. However, the interactive effect of both factors demonstrated that target processing (i.e., gesture-speech integration) was facilitated most when targets were part of predictable discourses and accompanied by an iconic gesture. Our results thus suggest a strong intertwinement of linguistic predictability and non-verbal gesture processing where listeners exploit predictive discourse cues to pre-activate verbal and non-verbal representations of upcoming target words.

Text validation: Overlooking consistency effect discrepancies

The consistency effect, prevalent in the text comprehension literature, comprises longer reading times for inconsistent than equivalent consistent text continuations. It is widely interpreted as reflecting readers' effective "validation" of text coherence. However, there are also numerous phenomena of readers' deficient validation, sometimes collectively labelled "misinformation effects." This study asked whether readers become consciously aware of the text discrepancies diagnosed by the consistency effect. Experiment 1 scrutinized (a) conspicuous conceptual inconsistencies and (b) character-trait inconsistencies. It replicated the consistency effect both at a critical target sentence and at a subsequent sentence (spillover). Experiment 2 replaced self-paced reading with consistency judgments about the target sentences. The subjects overlooked almost half of the inconsistencies, thus denying that readers reliably become aware of consistency-effect discrepancies. In Experiment 3, the former target sentences were reframed as explicit questions. Accuracy for inconsistencies was statistically indistinguishable from accuracy for consistent targets, favoring the interpretation that Experiment 2 subjects overlooked known, encoded discrepancies. The results are interpreted with reference to Kintsch's (Psychological Review, 95, 163-182, Kintsch, 1988; Comprehension. New York: Cambridge University Press, Kintsch, 1998) construction-integration model, a refinement of which adds an immediate, passive stage of validation processing to construction and integration. It is proposed that passive validation affords the detection of text inconsistencies that do not reach the level of readers' conscious awareness.

The Binding Problem 2.0: Beyond Perceptual Features

The "binding problem" has been a central question in vision science for some 30 years: When encoding multiple objects or maintaining them in working memory, how are we able to represent the correspondence between a specific feature and its corresponding object correctly? In this letter we argue that the boundaries of this research program in fact extend far beyond vision, and we call for coordinated pursuit across the broader cognitive science community of this central question for cognition, which we dub "Binding Problem 2.0".

Neural circuits underlying language control and modality control in bilinguals: An fMRI study

Human communication not only involves the need to switch between the modalities of speaking and listening, but for bilinguals, it can also involve switching between languages. It is unknown as to whether modality and language switching share underlying control mechanisms or whether one type of switching affects control processes involved in the other. The present study uses behavioral and fMRI measures to examine neural circuits of control during communicative situations that required Chinese-English bilinguals to switch between modalities and their two languages according to associated color cues. The results showed that for both language and modality control, similar brain regions were recruited during speech production and comprehension. For modality control, the specific control processes partly depended on the corresponding modality. Finally, switching between modalities appears to exert more influence on language control in production compared to comprehension. These findings offer a first detailed characterization of the neural bases involved in control mechanisms in bilingual communication.

Increased reliance on world knowledge during language comprehension in healthy aging: evidence from verb-argument prediction

Cognitive aging negatively impacts language comprehension performance. . However, there is evidence that older adults skillfully use linguistic context and their crystallized world knowledge to offset age-related changes that negatively impact comprehension. Two visual-world paradigm experiments examined how aging changes verb-argument prediction, a comprehension process that relies on world knowledge but has rarely been examined in the cognitive-aging literature. Older adults did not differ from younger adults in their activation of an upcoming likely verb argument, particularly when cued by a semantically-rich agent+verb combination (Experiment 1). However, older adults showed elevated activation of previously-mentioned agents (Experiment 1) and of unlikely but verb-congruent referents (Experiment 2). This is novel evidence that older adults exploit semantic context and world knowledge during comprehension to successfully activate upcoming referents. However, older adults also show elevated activation of irrelevant information, consistent with previous findings demonstrating that older adults may experience greater proactive interference and competition from task-irrelevant information.

Learning about the meanings of ambiguous words: evidence from a word-meaning priming paradigm with short narratives

Fluent language comprehension requires people to rapidly activate and integrate context-appropriate word meanings. This process is challenging for meanings of ambiguous words that are comparatively lower in frequency (e.g., the "bird" meaning of "crane"). Priming experiments have shown that recent experience makes such subordinate (less frequent) word meanings more readily available at the next encounter. These experiments used lists of unconnected sentences in which each ambiguity was disambiguated locally by neighbouring words. In natural language, however, disambiguation may occur via more distant contextual cues, embedded in longer, connected communicative contexts. In the present experiment, participants (N = 51) listened to 3-sentence narratives that ended in an ambiguous prime. Cues to disambiguation were relatively distant from the prime; the first sentence of each narrative established a situational context congruent with the subordinate meaning of the prime, but the remainder of the narrative did not provide disambiguating information. Following a short delay, primed subordinate meanings were more readily available (compared with an unprimed control), as assessed by responses in a word association task related to the primed meaning. This work confirms that listeners reliably disambiguate spoken ambiguous words on the basis of cues from wider narrative contexts, and that they retain information about the outcome of these disambiguation processes to inform subsequent encounters of the same word form.

The action-sentence compatibility effect (ACE): Meta-analysis of a benchmark finding for embodiment

The embodied account of language comprehension has been one of the most influential theoretical developments in the recent decades addressing the question how humans comprehend and represent language. To examine its assumptions, many studies have made use of behavioral paradigms involving basic compatibility effects. The action-sentence compatibility effect (ACE) is one of the most influential of these compatibility effects and is the most widely cited evidence for the embodied account of language comprehension. However, recently there have been difficulties in extending or even in reliably replicating the ACE. The conflicting findings concerning the ACE and its extensions lead to the discussion of whether the ACE is indeed a reliable effect. In a first step we conducted a meta-analysis using a random-effects model. This analysis revealed a small but significant effect size of the ACE. Furthermore, the task-parameter Delay occurred as a factor of interest in whether the ACE appears with positive or negative effect direction. A second meta-analytic approach (Fisher's method) supports these findings. Additionally, an analysis of publication bias suggests that there is bias in the ACE literature. In post-hoc analyses of the recent multi-lab investigation of the ACE (Morey et al., 2021), evidence for individual differences in the ACE was found. However, further analyses indicate that these differences are likely due to item-specific variability and the specific way in which items were assigned to conditions in the counterbalancing lists.

Does the involvement of motor cortex in embodied language comprehension stand on solid ground? A p-curve analysis and test for excess significance of the TMS and tDCS evidence

According to the embodied cognition view, comprehending action-related language requires the participation of sensorimotor processes. A now sizeable literature has tested this proposal by stimulating (with TMS or tDCS) motor brain areas during the comprehension of action language. To assess the evidential value of this body of research, we exhaustively searched the literature and submitted the relevant studies (N = 43) to p-curve analysis. While most published studies concluded in support of the embodiment hypothesis, our results suggest that we cannot yet assert beyond reasonable doubt that they explore real effects. We also found that these studies are quite underpowered (estimated power < 30%), which means that a large percentage of them would not replicate if repeated identically. Additional tests for excess significance show signs of publication bias within this literature. In sum, extant brain stimulation studies testing the grounding of action language in the motor cortex do not stand on solid ground. We provide recommendations that will be important for future research on this topic.

The Role of Language Switching During Cross-Talk Between Bilingual Language Control and Domain-General Conflict Monitoring

The relationship between bilingual language control and executive control is debated. The present study investigated the effect of short-term language switching in a comprehension task on executive control performance in unbalanced bilinguals. Participants were required to perform a context task and an executive control task (i.e., flanker task) in sequence. A picture-word matching task created different language contexts in Experiment 1 (i.e., L1, L2, and dual-language contexts). By modifying the color-shape switching task, we created different contexts that do not involve language processing in Experiment 2 (i.e., color, shape, and dual context). Experiment 1 showed overall faster responses (in both congruent and incongruent trials) in the flanker task after a language switching context than after single (L1 or L2) contexts. This suggests that the language switching in a comprehension task affected general monitoring performance. By contrast, the nonlinguistic contexts in Experiment 2 did not affect flanker performance. This provides further evidence for the crucial role of language processing during switching to elicit short-term adaptions on domain-general conflict monitoring. Overall, our findings add to the previous studies by showing cross-talk between bilingual language control and domain-general conflict monitoring when language switching occurs in a comprehension task.

Just give it time: Differential effects of disruption and delay on perceptual learning

Speech perception and production are critical skills when acquiring a new language. However, the nature of the relationship between these two processes is unclear, particularly for non-native speech sound contrasts. Although it has been assumed that perception and production are supportive, recent evidence has demonstrated that, under some circumstances, production can disrupt perceptual learning. Specifically, producing the to-be-learned contrast on each trial can disrupt perceptual learning of that contrast. Here, we treat speech perception and speech production as separate tasks. From this perspective, perceptual learning studies that include a production component on each trial create a task switch. We report two experiments that test how task switching can disrupt perceptual learning. One experiment demonstrates that the disruption caused by switching to production is sensitive to time delays: Increasing the delay between perception and production on a trial can reduce and even eliminate disruption of perceptual learning. The second experiment shows that if a task other than producing the to-be-learned contrast is imposed, the task-switching component of disruption is not influenced by a delay. These experiments provide a new understanding of the relationship between speech perception and speech production, and clarify conditions under which the two cooperate or compete.

Lesion correlates of auditory sentence comprehension deficits in post-stroke aphasia

Auditory sentence comprehension requires coordination of multiple levels of processing: auditory-phonological perception, lexical-semantic comprehension, syntactic parsing and discourse construction, as well as executive functions such as verbal working memory (WM) and cognitive control. This study examined the lesion correlates of sentence comprehension deficits in post-stroke aphasia, building on prior work on this topic by using a different and clinically-relevant measure of sentence comprehension (the Token Test) and multivariate (SCCAN) and connectome-based lesion-symptom mapping methods. The key findings were that lesions in the posterior superior temporal lobe and inferior frontal gyrus (pars triangularis) were associated with sentence comprehension deficits, which was observed in both mass univariate and multivariate lesion-symptom mapping. Graph theoretic measures of connectome disruption were not statistically significantly associated with sentence comprehension deficits after accounting for overall lesion size.

Language comprehension in toddlers with significant developmental delays: An IRT approach

PURPOSE

Language comprehension, or the ability to understand spoken language, is critical to a variety of child outcomes. Effective early intervention relies on valid, reliable language comprehension assessment. The purpose of this study was to explore language comprehension in a sample of toddlers with significant developmental delays associated with varied medical conditions.

METHOD

We investigated language comprehension in a sample of 112 toddlers by applying Item Response Theory (IRT) methods to two measures; one standardized and one flexible.

RESULTS

Data from a standardized measure fit the unidimensional model, whereas the flexible measure did not. The overall pattern of results suggested that items related to early social/contextual comprehension are distinct from linguistic comprehension items.

CONCLUSION

Our findings inform clinical practice by underscoring the importance of comprehensive assessment of language comprehension and considering strengths and weaknesses across social/contextual and linguistic comprehension among toddlers with developmental delays.

The interplay between respectfulness and lexical-semantic in reading Chinese: evidence from ERPs

Language comprehension requires the processing of both linguistic and extra-linguistic information, such as syntax, semantics, and pragmatic information. Previous studies have systematically examined the interplay between syntactic and semantic processing. However, there is a lack of data on how pragmatic processing proceeds and its interaction with semantic processing. Using event-related potentials (ERPs), the present study manipulated the semantic coherence of a verb phrase (VP) and the respect consistency of the object noun phrase in the VP, resulting in four types of critical sentences. Participants read 160 critical Chinese sentences and 220 filler sentences. After electroencephalogram recordings, they completed the Autism Quotient Communication (AQ-Comm) subscale and a sentence acceptability rating task. The ERP results showed that respect violation elicited a larger N400 response and a late negative activity in the pragmatically less-skilled subgroup (as indexed by higher scores on the AQ-Comm subscale). In contrast, respect violation elicited a P600 response in the pragmatically skilled subgroup (as indexed by lower scores on the AQ-Comm subscale). The double violation condition elicited an ERP pattern that was similar to that of the semantic violation condition in both subgroups, suggesting that respect violation effects were present only when the VP was semantically coherent. These results suggest that semantic violation can preclude readers from engaging in pragmatic inferencing, regardless of the participants' pragmatic skills. Strategies for resolving respect violation and corresponding brain activities vary according to participants' pragmatic abilities.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s11571-021-09700-2.

Neural correlates of syntactic comprehension: A longitudinal study

Broca's area is frequently implicated in sentence comprehension but its specific role is debated. Most lesion studies have investigated deficits at the chronic stage. We aimed (1) to use acute imaging to predict which left hemisphere stroke patients will recover sentence comprehension; and (2) to better understand the role of Broca's area in sentence comprehension by investigating acute deficits prior to functional reorganization. We assessed comprehension of canonical and noncanonical sentences in 15 patients with left hemisphere stroke at acute and chronic stages. LASSO regression was used to conduct lesion symptom mapping analyses. Patients with more severe word-level comprehension deficits and a greater proportion of damage to supramarginal gyrus and superior longitudinal fasciculus were likely to experience acute deficits prior to functional reorganization. Broca's area was only implicated in chronic deficits. We propose that when temporoparietal regions are damaged, intact Broca's area can support syntactic processing after functional reorganization occurs.

Speech-related auditory salience detection in the posterior superior temporal region

Processing auditory human speech requires both detection (early and transient) and analysis (sustained). We analyzed high gamma (70-110 Hz) activity of intracranial electroencephalography waveforms acquired during an auditory task that paired forward speech, reverse speech, and signal correlated noise. We identified widespread superior temporal sites with sustained activity responding only to forward and reverse speech regardless of paired order. More localized superior temporal auditory onset sites responded to all stimulus types when presented first in a pair and responded in recurrent fashion to the second paired stimulus in select conditions even in the absence of interstimulus silence; a novel finding. Auditory onset activity to a second paired sound recurred according to relative salience, with evidence of partial suppression during linguistic processing. We propose that temporal lobe auditory onset sites facilitate a salience detector function with hysteresis of 200 ms and are influenced by cortico-cortical feedback loops involving linguistic processing and articulation.

The contribution of form repetition to listeners' expectation of givenness in online reference resolution

Although it is clear that unaccented referring expressions are associated with given information in a discourse (Dahan et al., 2002), it is less clear what aspects of givenness are relevant. We examine whether listeners' expectation of givenness depends on repetition of a referring expression or on contextual evocation of a referent. The results from two visual world eye-tracking experiments suggest that for interpretation, listeners associated reduced prominence with a repeated referring expression. Listeners expect previously evoked referents to be candidates for reduced referring expressions only when they are referred to with the exact same referential form. The data also suggest that when referents are referred to with different referential forms across utterances, accenting facilitates linking those forms for co-reference.

Conceptual expansion via novel metaphor processing: An ERP replication and extension study examining individual differences in creativity

The aims of the present ERP study were twofold. First, to determine whether a previous study on creative cognition could be replicated, and second, to extend these findings by examining individual differences in creativity. Conceptual expansion, a capacity that is central to creativity, was induced via the processing of novel metaphors. Brain activity patterns in relation to these were compared to the processing of literal and nonsense phrases. The previous findings were replicated in that the N400, known for its sensitivity to semantic anomalies, indexed the originality of the phrases, while a post-N400 late component (LC), which is linked to semantic integration processes, indexed the appropriateness of the phrases. Moreover, only the LC was significantly sensitive to individual differences in creativity in the processing of these phrases. Differences at the level of semantic integration processes as well as the structure of knowledge organization are thereby implicated in individual differences in creativity.

The privileging of 'Support-From-Below' in early spatial language acquisition

Spatial terms that encode support (e.g., "on", in English) are among the first to be understood by children across languages (e.g., Bloom, 1973; Johnston & Slobin, 1979). Such terms apply to a wide variety of support configurations, including Support-From-Below (SFB; cup on table) and Mechanical Support, such as stamps on envelopes, coats on hooks, etc. Research has yet to delineate infants' semantic space for the term "on" when considering its full range of usage. Do infants initially map "on" to a very broad, highly abstract category - one including cups on tables, stamps on envelopes, etc.? Or do infants begin with a much more restricted interpretation - mapping "on" to certain configurations over others? Much infant cognition research suggests that SFB is an event category that infants learn about early - by five months of age (Baillargeon & DeJong, 2017) - raising the possibility that they may also begin by interpreting the word "on" as referring to configurations like cups on tables, rather than stamps on envelopes. Further, studies examining language production suggests that children and adults map the basic locative expression (BE on, in English) to SFB over Mechanical Support (Landau et al., 2016). We tested the hypothesis that this 'privileging' of SFB in early infant cognition and child and adult language also characterizes infants' language comprehension. Using the Intermodal-Preferential-Looking-Paradigm in combination with infant eye-tracking, 20-month-olds were presented with two support configurations: SFB and Mechanical, Support-Via-Adhesion (henceforth, SVA). Infants preferentially mapped "is on" to SFB (rather than SVA) suggesting that infants differentiate between two quite different kinds of support configurations when mapping spatial language to these two configurations and more so, that SFB is privileged in early language understanding of the English spatial term "on".

Can you mend a broken heart? Awakening conventional metaphors in the maze

Conventional metaphors such as broken heart are interpreted rather fast and efficiently. This is because they might be stored as lexicalized, noncompositional expressions. If so, they require sense retrieval rather than sense creation. But can their literal meanings be recovered or "awakened"? We examined whether the literal meaning of a conventional metaphor could be triggered by a later cue. In a maze task, participants (N = 40) read sentences word by word (e.g., John is an early bird so he can . . .) and were presented with a two-word choice. Participants took longer and were less accurate when the correct word (attend) was paired with a literally-related distractor (fly) rather than an unrelated one (cry). This suggests that the literal meaning of a conventional metaphor is not circumvented, nor that metaphors simply involve sense retrieval. The metaphor awakening effect suggests that the mechanisms employed to process conventional metaphors are dynamic with both metaphorical sense and literal meaning being available.

The state of the onion: Grammatical aspect modulates object representation during event comprehension

The present ERP study assessed whether grammatical aspect is used as a cue in online event comprehension, in particular when reading about events in which an object is visually changed. While perfective aspect cues holistic event representations, including an event's endpoint, progressive aspect highlights intermediate phases of an event. In a 2 × 3 design, participants read SVO sentences describing a change-of-state event (e.g., to chop an onion), with grammatical Aspect manipulated (perfective "chopped" vs progressive "was chopping"). Thereafter, they saw a Picture of an object either having undergone substantial state-change (SC; a chopped onion), no state-change (NSC; an onion in its original state) or an unrelated object (U; a cactus, acting as control condition). Their task was to decide whether the object in the Picture was mentioned in the sentence. We focused on N400 modulation, with ERPs time-locked to picture onset. U pictures elicited an N400 response as expected, suggesting detection of categorical mismatches in object type. For SC and NSC pictures, a whole-head follow-up analysis revealed a P300, implying people were engaged in detailed evaluation of pictures of matching objects. SC pictures received most positive responses overall. Crucially, there was an interaction of Aspect and Picture: SC pictures resulted in a higher amplitude P300 after sentences in the perfective compared to the progressive. Thus, while the perfective cued for a holistic event representation, including the resultant state of the affected object (i.e., the chopped onion) constraining object representations online, the progressive defocused event completion and object-state change. Grammatical aspect thus guided online event comprehension by cueing the visual representation(s) of an object's state.

When components collide: Spatiotemporal overlap of the N400 and P600 in language comprehension

The problem of spatiotemporal overlap between event-related potential (ERP) components is generally acknowledged in language research. However, its implications for the interpretation of experimental results are often overlooked. In a previous experiment on the functional interpretation of the N400 and P600, it was argued that a P600 effect to implausible words was largely obscured - in one of two implausible conditions - by an overlapping N400 effect of semantic association. In the present ERP study, we show that the P600 effect of implausibility is uncovered when the critical condition is tested against a proper baseline condition which elicits a similar N400 amplitude, while it is obscured when tested against a baseline condition producing an N400 effect. Our findings reveal that component overlap can result in the apparent absence or presence of an effect in the surface signal and should therefore be carefully considered when interpreting ERP patterns. Importantly, we show that, by factoring in the effects of spatiotemporal overlap between the N400 and P600 on the surface signal, which we reveal using rERP analysis, apparent inconsistencies in previous findings are easily reconciled, enabling us to draw unambiguous conclusions about the functional interpretation of the N400 and P600 components. Overall, our results provide compelling evidence that the N400 reflects lexical retrieval processes, while the P600 indexes compositional integration of word meaning into the unfolding utterance interpretation.

Should I focus on self-language actions or should I follow others? Cross-language interference effects in voluntary and cued language switching

We examined whether and how language produced by others influences self-language processes. This study addressed this issue by looking at effects of comprehension on language switching in cued and voluntary switching contexts. During voluntary language switching, Chinese-English bilinguals were more likely to repeat the language they previously used themselves than to repeat the language produced by others. Furthermore, during both voluntary and cued language switching, bilinguals showed larger switch costs when switching between languages themselves than when switching after hearing another language. This suggests that cross-language interference may primarily stem from the self-language system rather than from language produced by others.

The fate of the unexpected: Consequences of misprediction assessed using ERP repetition effects

Amid increasing interest in the role of prediction in language comprehension, there remains a gap in our understanding of what happens when predictions are disconfirmed. Are unexpected words harder to process and encode because of interference from the original prediction? Or, because of their relevance for learning, do expectation violations strengthen the representations of unexpected words? In two experiments, we used event-related potentials to probe the downstream consequences of prediction violations. Critical words were unexpected but plausible completions of either strongly constraining sentences, wherein they constituted a prediction violation, or weakly constraining sentences that did not afford a clear prediction. Three sentences later the critical word was repeated at the end of a different, weakly constraining sentence. In Experiment 1, repeated words elicited a reduced N400 and an enhanced late positive complex (LPC) compared to words seen for the first time. Critically, there was no effect of initial sentence constraint on the size of the repetition effect in either time window. Thus, prediction violations did not accrue either costs or benefits for later processing. Experiment 2 used the same critical items and added strongly constraining filler sentences with expected endings to further promote prediction. Again, there was no effect of initial sentence constraint on either the N400 or the LPC to repeated critical words. When taken with prior findings, the results suggest that prediction is both powerful and flexible: It can facilitate processing of predictable information by reducing encoding effort without causing processing difficulties for unexpected inputs.

Language Abilities of Russian Primary-School-Aged Children with Autism Spectrum Disorder: Evidence from Comprehensive Assessment

The purpose of the present research was to comprehensively assess the language abilities of Russian primary-school-aged children with Autism Spectrum Disorder (ASD), varying in non-verbal IQ, at all linguistic levels (phonology, lexicon, morphosyntax, and discourse) in production and comprehension. Yet, the influence of such non-language factors as children's age, the severity of autistic traits, and non-verbal IQ on language functioning was studied. Our results indicate a high variability of language skills in children with ASD (from normal to impaired) which is in line with the previous studies. Interestingly, the number of children with normal language abilities was related to the linguistic levels: according to more complex morphosyntax and discourse tests, fewer children with ASD were within the normal range unlike the results in simpler phonological and lexical tests. Importantly, we found that language abilities were best predicted by non-verbal IQ but were independent from age and the severity of autistic traits. The findings support the claim that formal language assessment of children with ASD needs to include all linguistic levels, from phonology to discourse, for helping speech-language therapists to choose an appropriate therapy target.

Autistic Adults are Not Impaired at Maintaining or Switching Between Counterfactual and Factual Worlds: An ERP Study

We report an event-related brain potential (ERP) experiment that tests whether autistic adults are able to maintain and switch between counterfactual and factual worlds. Participants (N = 48) read scenarios that set up a factual or counterfactual scenario, then either maintained the counterfactual world or switched back to the factual world. When the context maintained the world, participants showed appropriate detection of the inconsistent critical word. In contrast, when participants had to switch from a counterfactual to factual world, they initially experienced interference from the counterfactual context, then favoured the factual interpretation of events. None of these effects were modulated by group, despite group-level impairments in Theory of Mind and cognitive flexibility among the autistic adults. These results demonstrate that autistic adults can appropriately use complex contextual cues to maintain and/or update mental representations of counterfactual and factual events.

What's new? A comprehension bias in favor of informativity

Language is used as a channel by which speakers convey, among other things, newsworthy and informative messages, i.e., content that is otherwise unpredictable to the comprehender. We therefore might expect comprehenders to show a preference for such messages. However, comprehension studies tend to emphasize the opposite: i.e., processing ease for situation-predictable content (e.g., chopping carrots with a knife). Comprehenders are known to deploy knowledge about situation plausibility during processing in fine-grained context-sensitive ways. Using self-paced reading, we test whether comprehenders can also deploy this knowledge in favor of newsworthy content to yield informativity-driven effects alongside, or instead of, plausibility-driven effects. We manipulate semantic context (unusual protagonists), syntactic construction (wh- clefts), and the communicative environment (text messages). Reading times (primarily sentence-finally) show facilitation for sentences containing newsworthy content (e.g., chopping carrots with a shovel), where the content is both unpredictable at the situation level because of its atypicality and also unpredictable at the word level because of the large number of atypical elements a speaker could potentially mention. Our studies are the first to show that informativity-driven effects are observable at all, and the results highlight the need for models that distinguish between comprehenders' estimate of content plausibility and their estimate of a speaker's decision to talk about that content.

A second chance for a first impression: Sensitivity to cumulative input statistics for lexically guided perceptual learning

Listeners use lexical knowledge to modify the mapping from acoustics to speech sounds, but the timecourse of experience that informs lexically guided perceptual learning is unknown. Some data suggest that learning is contingent on initial exposure to atypical productions, while other data suggest that learning reflects only the most recent exposure. Here we seek to reconcile these findings by assessing the type and timecourse of exposure that promote robust lexcially guided perceptual learning. In three experiments, listeners (n = 560) heard 20 critical productions interspersed among 200 trials during an exposure phase and then categorized items from an ashi-asi continuum in a test phase. In Experiment 1, critical productions consisted of ambiguous fricatives embedded in either /s/- or /ʃ/-biasing contexts. Learning was observed; the /s/-bias group showed more asi responses compared to the /ʃ/-bias group. In Experiment 2, listeners heard ambiguous and clear productions in a consistent context. Order and lexical bias were manipulated between-subjects, and perceptual learning occurred regardless of the order in which the clear and ambiguous productions were heard. In Experiment 3, listeners heard ambiguous fricatives in both /s/- and /ʃ/-biasing contexts. Order differed between two exposure groups, and no difference between groups was observed at test. Moreover, the results showed a monotonic decrease in learning across experiments, in line with decreasing exposure to stable lexically biasing contexts, and were replicated across novel stimulus sets. In contrast to previous findings showing that either initial or most recent experience are critical for lexically guided perceptual learning, the current results suggest that perceptual learning reflects cumulative experience with a talker's input over time.

How quantifiers influence the conceptual representation of plurals

This paper reports the results of two experiments that investigate the nature of plural conceptual representations that are created during sentence comprehension. Previous work has found that comprehenders seem to represent both a singular object and a plural set of objects during the comprehension of plural nouns. The activation of the singular object has been attributed to the pragmatic processing involved in understanding the plural (Patson, Journal of Experimental Psychology: Learning, Memory and Cognition, 42, 1140-1153, 2016a). The goal of the current study was to further investigate this hypothesis. Experiment 1 used a picture-matching paradigm to investigate how comprehenders conceptualize plural nouns quantified with many, which renders the scalar implicature unnecessary. Consistent with the pragmatic processing hypothesis, comprehenders did not activate a singular form when the plural was quantified with many. Experiment 2 was designed to further investigate whether all quantifiers block activation of the singular form. The same picture-matching paradigm was used with numerical quantifiers that specify numbers either within or above the subitization range. When the number was within the subitization range, comprehenders' conceptual representations contained exactly that number of objects, and importantly did not contain a singular object. When number was above the subitization range, comprehenders' conceptual representations did not contain an exact number of objects and seemed to activate a singular object. These data are consistent with constraints on how many objects can be represented in visual working memory. Taken together, the results of these two experiments suggest that the plural's conceptual representation emerged as a result of grammatical processing as well as limits on the visual processing system.

Construing events first-hand: Gesture viewpoints interact with speech to shape the attribution and memory of agency

Beyond conveying objective content about objects and actions, what can co-speech iconic gestures reveal about a speaker's subjective relationship to that content? The present study explores this question by investigating how gesture viewpoints can inform a listener's construal of a speaker's agency. Forty native English speakers watched videos of an actor uttering sentences with different viewpoints-that of low agency or high agency-conveyed through both speech and gesture. Participants were asked to (1) rate the speaker's responsibility for the action described in each video (encoding task) and (2) complete a surprise memory test of the spoken sentences (recall task). For the encoding task, participants rated responsibility near ceiling when agency in speech was high, with a slight dip when accompanied by gestures of low agency. When agency in speech was low, responsibility ratings were raised markedly when accompanied by gestures of high agency. In the recall task, participants produced more incorrect recall of spoken agency when the viewpoints expressed through speech and gesture were inconsistent with one another. Our findings suggest that, beyond conveying objective content, co-speech iconic gestures can also guide listeners in gauging a speaker's agentic relationship to actions and events.