Semantic diversity accounts for the "missing" word frequency effect in stroke aphasia: insights using a novel method to quantify contextual variability in meaning

Differing contributions of inferior prefrontal and anterior temporal cortex to concrete and abstract conceptual knowledge

Semantic cognition is underpinned by regions involved in representing conceptual knowledge and executive control areas that provide regulation of this information according to current task requirements. Using distortion-corrected fMRI, we investigated the contributions of these two systems to abstract and concrete word comprehension. We contrasted semantic decisions made either with coherent contextual support, which encouraged retrieval of a rich conceptual representation, or with irrelevant contextual information, which instead maximised demands on control processes. Inferior prefrontal cortex was activated more when decisions were made in the presence of irrelevant context, suggesting that this region is crucial for the semantic control functions required to select appropriate aspects of meaning in the face of competing information. It also exhibited greater activation for abstract words, which reflects the fact that abstract words tend to have variable, context-dependent meanings that place higher demands on control processes. In contrast, anterior temporal regions (ATL) were most active when decisions were made with the benefit of a coherent context, suggesting a representational role. There was a graded shift in concreteness effects in this region, with dorsolateral areas particularly active for abstract words and ventromedial areas preferentially activated by concrete words. This supports the idea that concrete concepts are closely associated with visual experience and abstract concepts with auditory-verbal information; and that sub-regions of the ATL display graded specialisation for these two types of knowledge. Between these two extremes, we identified significant activations for both word types in ventrolateral ATL. This area is known to be involved in representing knowledge for concrete concepts; here we established that it is also activated by abstract concepts. These results converge with data from rTMS and neuropsychological investigations in demonstrating that representational content and task demands influence recruitment of different areas in the semantic network.

Semantic variability predicts neural variability of object concepts

The prevailing approach to the neuroscientific study of concepts is to characterize the neural pattern evoked by a given concept, averaging over any variation that might occur upon multiple retrieval attempts (e.g., across time, tasks, or people). This approach-which diverges substantially from approaches to studying conceptual processing with other methods-treats all variation as noise. Here, our goal is to determine whether variation in neural patterns evoked by semantic retrieval of a given concept is more than just measurement error, and instead reflects variation arising from contextual variability. We measured each concept's diversity of semantic contexts ("SV") by analyzing its word frequency and co-occurrence statistics in large text corpora. To measure neural variability, we conducted an fMRI study and sampled neural activity associated with each concept when it appeared in three separate, randomized contexts. We predicted that concepts with low SV would exhibit uniform activation patterns across stimulus presentations, whereas concepts with high SV would exhibit more dynamic representations over time. We observed that a concept's SV score predicted its corresponding neural variability. This finding supports a flexible, distributed organization of semantic memory, where a concept's meaning and its neural activity patterns both continuously vary across contexts.

Deregulated semantic cognition contributes to object-use deficits in Alzheimer's disease: A comparison with semantic aphasia and semantic dementia

Executive control is impaired from the early stages of Alzheimer's Disease (AD) and this produces deregulated semantic cognition (Corbett, Jefferies, Burns, & Lambon Ralph, ; Perry, Watson, & Hodges, ). While control deficits should affect semantic retrieval across all modalities, previous studies have typically focused on verbal semantic tasks. Even when non-verbal semantic tasks have been used, these have typically employed simple picture-matching tasks, which may be influenced by abnormalities in covert naming. Therefore, in the present study, we examined 10 patients with AD on a battery of object-use tasks, in order to advance our understanding of the origins of non-verbal semantic deficits in this population. The AD patients' deficits were contrasted with previously published performance on the same tasks within two additional groups of patients, displaying either semantic degradation (semantic dementia) or deregulation of semantic retrieval (semantic aphasia; Corbett, Jefferies, Ehsan, & Lambon Ralph, ). While overall accuracy was comparable to the scores in both other groups, the AD patients' object-use impairment most closely resembled that observed in SA; they exhibited poorer performance on comprehension tasks that placed strong demands on executive control. A similar pattern was observed in the expressive domain: the AD and SA groups were relatively good at straightforward object use compared to executively demanding, mechanical puzzles. Error types also differed: while all patients omitted essential actions, the SA and AD groups' demonstrations also featured unrelated intrusions. An association between AD patients' object use and their scores on standard executive measures suggested that control deficits contributed to their non-verbal semantic deficits. Moreover, in a task specifically designed to manipulate executive demand, patients with AD (and SA) exhibited difficulty in thinking flexibly about the non-canonical uses of everyday objects, especially when distracted by semantically related objects. This study provides converging evidence for the notion that a failure of regulatory control contributes to multimodal semantic impairment in AD and uniquely demonstrates this pattern for the highly non-verbal domain of object use.

The influence of contextual diversity on eye movements in reading

Recent research has shown contextual diversity (i.e., the number of passages in which a given word appears) to be a reliable predictor of word processing difficulty. It has also been demonstrated that word-frequency has little or no effect on word recognition speed when accounting for contextual diversity in isolated word processing tasks. An eye-movement experiment was conducted wherein the effects of word-frequency and contextual diversity were directly contrasted in a normal sentence reading scenario. Subjects read sentences with embedded target words that varied in word-frequency and contextual diversity. All 1st-pass and later reading times were significantly longer for words with lower contextual diversity compared to words with higher contextual diversity when controlling for word-frequency and other important lexical properties. Furthermore, there was no difference in reading times for higher frequency and lower frequency words when controlling for contextual diversity. The results confirm prior findings regarding contextual diversity and word-frequency effects and demonstrate that contextual diversity is a more accurate predictor of word processing speed than word-frequency within a normal reading task. (PsycINFO Database Record (c) 2013 APA, all rights reserved).

What we talk about when we talk about access deficits

Semantic impairments have been divided into storage deficits, in which the semantic representations themselves are damaged, and access deficits, in which the representations are intact but access to them is impaired. The behavioural phenomena that have been associated with access deficits include sensitivity to cueing, sensitivity to presentation rate, performance inconsistency, negative serial position effects, sensitivity to number and strength of competitors, semantic blocking effects, disordered selection between strong and weak competitors, correlation between semantic deficits and executive function deficits and reduced word frequency effects. Four general accounts have been proposed for different subsets of these phenomena: abnormal refractoriness, too much activation, impaired competitive selection and deficits of semantic control. A combination of abnormal refractoriness and impaired competitive selection can account for most of the behavioural phenomena, but there remain several open questions. In particular, it remains unclear whether access deficits represent a single syndrome, a syndrome with multiple subtypes or a variable collection of phenomena, whether the underlying deficit is domain-general or domain-specific, whether it is owing to disorders of inhibition, activation or selection, and the nature of the connection (if any) between access phenomena in aphasia and in neurologically intact controls. Computational models offer a promising approach to answering these questions.

Semantic diversity: a measure of semantic ambiguity based on variability in the contextual usage of words

Semantic ambiguity is typically measured by summing the number of senses or dictionary definitions that a word has. Such measures are somewhat subjective and may not adequately capture the full extent of variation in word meaning, particularly for polysemous words that can be used in many different ways, with subtle shifts in meaning. Here, we describe an alternative, computationally derived measure of ambiguity based on the proposal that the meanings of words vary continuously as a function of their contexts. On this view, words that appear in a wide range of contexts on diverse topics are more variable in meaning than those that appear in a restricted set of similar contexts. To quantify this variation, we performed latent semantic analysis on a large text corpus to estimate the semantic similarities of different linguistic contexts. From these estimates, we calculated the degree to which the different contexts associated with a given word vary in their meanings. We term this quantity a word's semantic diversity (SemD). We suggest that this approach provides an objective way of quantifying the subtle, context-dependent variations in word meaning that are often present in language. We demonstrate that SemD is correlated with other measures of ambiguity and contextual variability, as well as with frequency and imageability. We also show that SemD is a strong predictor of performance in semantic judgments in healthy individuals and in patients with semantic deficits, accounting for unique variance beyond that of other predictors. SemD values for over 30,000 English words are provided as supplementary materials.

Parkinson's disease disrupts both automatic and controlled processing of action verbs

The problem of how word meaning is processed in the brain has been a topic of intense investigation in cognitive neuroscience. While considerable correlational evidence exists for the involvement of sensory-motor systems in conceptual processing, it is still unclear whether they play a causal role. We investigated this issue by comparing the performance of patients with Parkinson's disease (PD) with that of age-matched controls when processing action and abstract verbs. To examine the effects of task demands, we used tasks in which semantic demands were either implicit (lexical decision and priming) or explicit (semantic similarity judgment). In both tasks, PD patients' performance was selectively impaired for action verbs (relative to controls), indicating that the motor system plays a more central role in the processing of action verbs than in the processing of abstract verbs. These results argue for a causal role of sensory-motor systems in semantic processing.

A modular approach to language production: models and facts

Numerous cortical disorders affect language. We explore the connection between the observed language behavior and the underlying substrates by adopting a neurocomputational approach. To represent the observed trajectories of the discourse in patients with disorganized speech and in healthy participants, we design a graphical representation for the discourse as a trajectory that allows us to visualize and measure the degree of order in the discourse as a function of the disorder of the trajectories. Our work assumes that many of the properties of language production and comprehension can be understood in terms of the dynamics of modular networks of neural associative memories. Based upon this assumption, we connect three theoretical and empirical domains: (1) neural models of language processing and production, (2) statistical methods used in the construction of functional brain images, and (3) corpus linguistic tools, such as Latent Semantic Analysis (henceforth LSA), that are used to discover the topic organization of language. We show how the neurocomputational models intertwine with LSA and the mathematical basis of functional neuroimaging. Within this framework we describe the properties of a context-dependent neural model, based on matrix associative memories, that performs goal-oriented linguistic behavior. We link these matrix associative memory models with the mathematics that underlie functional neuroimaging techniques and present the "functional brain images" emerging from the model. This provides us with a completely "transparent box" with which to analyze the implication of some statistical images. Finally, we use these models to explore the possibility that functional synaptic disconnection can lead to an increase in connectivity between the representations of concepts that could explain some of the alterations in discourse displayed by patients with schizophrenia.

Contextual diversity is a main determinant of word identification times in young readers

Recent research with college-aged skilled readers by Adelman and colleagues revealed that contextual diversity (i.e., the number of contexts in which a word appears) is a more critical determinant of visual word recognition than mere repeated exposure (i.e., word frequency) (Psychological Science, 2006, Vol. 17, pp. 814-823). Given that contextual diversity has been claimed to be a relevant factor to word acquisition in developing readers, the effects of contextual diversity should also be a main determinant of word identification times in developing readers. A lexical decision experiment was conducted to examine the effects of contextual diversity and word frequency in young readers (children in fourth grade). Results revealed a sizable effect of contextual diversity, but not of word frequency, thereby generalizing Adelman and colleagues' data to a child population. These findings call for the implementation of dynamic developmental models of visual word recognition that go beyond a learning rule by mere exposure.

Conceptual Structure within and between Modalities

Current views of semantic memory share the assumption that conceptual representations are based on multimodal experience, which activates distinct modality-specific brain regions. This proposition is widely accepted, yet little is known about how each modality contributes to conceptual knowledge and how the structure of this contribution varies across these multiple information sources. We used verbal feature lists, features from drawings, and verbal co-occurrence statistics from latent semantic analysis to examine the informational structure in four domains of knowledge: perceptual, functional, encyclopedic, and verbal. The goals of the analysis were three-fold: (1) to assess the structure within individual modalities; (2) to compare structures between modalities; and (3) to assess the degree to which concepts organize categorically or randomly. Our results indicated significant and unique structure in all four modalities: perceptually, concepts organize based on prominent features such as shape, size, color, and parts; functionally, they group based on use and interaction; encyclopedically, they arrange based on commonality in location or behavior; and verbally, they group associatively or relationally. Visual/perceptual knowledge gives rise to the strongest hierarchical organization and is closest to classic taxonomic structure. Information is organized somewhat similarly in the perceptual and encyclopedic domains, which differs significantly from the structure in the functional and verbal domains. Notably, the verbal modality has the most unique organization, which is not at all categorical but also not random. The idiosyncrasy and complexity of conceptual structure across modalities raise the question of how all of these modality-specific experiences are fused together into coherent, multifaceted yet unified concepts. Accordingly, both methodological and theoretical implications of the present findings are discussed.

Effects of word frequency and modality on sentence comprehension impairments in people with aphasia

PURPOSE

It is well known that people with aphasia have sentence comprehension impairments. The present study investigated whether lexical factors contribute to sentence comprehension impairments in both the auditory and written modalities using online measures of sentence processing.

METHOD

People with aphasia and non brain-damaged controls participated in the experiment (n = 8 per group). Twenty-one sentence pairs containing high- and low-frequency words were presented in self-paced listening and reading tasks. The sentences were syntactically simple and differed only in the critical words. The dependent variables were response times for critical segments of the sentence and accuracy on the comprehension questions.

RESULTS

The results showed that word frequency influences performance on measures of sentence comprehension in people with aphasia. The accuracy data on the comprehension questions suggested that people with aphasia have more difficulty understanding sentences containing low-frequency words in the written compared to auditory modality. Both group and single-case analyses of the response time data also indicated that people with aphasia experience more difficulty with reading than listening.

CONCLUSION

Sentence comprehension in people with aphasia is influenced by word frequency and presentation modality.

An abundance of riches: cross-task comparisons of semantic richness effects in visual word recognition

There is considerable evidence (e.g., Pexman et al., 2008) that semantically rich words, which are associated with relatively more semantic information, are recognized faster across different lexical processing tasks. The present study extends this earlier work by providing the most comprehensive evaluation to date of semantic richness effects on visual word recognition performance. Specifically, using mixed effects analyses to control for the influence of correlated lexical variables, we considered the impact of number of features, number of senses, semantic neighborhood density, imageability, and body-object interaction across five visual word recognition tasks: standard lexical decision, go/no-go lexical decision, speeded pronunciation, progressive demasking, and semantic classification. Semantic richness effects could be reliably detected in all tasks of lexical processing, indicating that semantic representations, particularly their imaginal and featural aspects, play a fundamental role in visual word recognition. However, there was also evidence that the strength of certain richness effects could be flexibly and adaptively modulated by task demands, consistent with an intriguing interplay between task-specific mechanisms and differentiated semantic processing.

The differential contributions of pFC and temporo-parietal cortex to multimodal semantic control: exploring refractory effects in semantic aphasia

Aphasic patients with multimodal semantic impairment following pFC or temporo-parietal (TP) cortex damage (semantic aphasia [SA]) have deficits characterized by poor control of semantic activation/retrieval, as opposed to loss of semantic knowledge per se. In line with this, SA patients show "refractory effects"; that is, declining accuracy in cyclical word-picture matching tasks when semantically related sets are presented rapidly and repeatedly. This is argued to follow a build-up of competition between targets and distractors. However, the link between poor semantic control and refractory effects is still controversial for two reasons. (1) Some theories propose that refractory effects are specific to verbal or auditory tasks, yet SA patients show poor control over semantic processing in both word and picture semantic tasks. (2) SA can result from lesions to either the left pFC or TP cortex, yet previous work suggests that refractory effects are specifically linked to the left inferior frontal cortex. For the first time, verbal, visual, and nonverbal auditory refractory effects were explored in nine SA patients who had pFC (pFC+) or TP cortex (TP-only) lesions. In all modalities, patient accuracy declined significantly over repetitions. This refractory effect at the group level was driven by pFC+ patients and was not shown by individuals with TP-only lesions. These findings support the theory that SA patients have reduced control over multimodal semantic retrieval and, additionally, suggest there may be functional specialization within the posterior versus pFC elements of the semantic control network.

The generalized polymorphous concept account of graded structure in abstract categories

Abstract categories present with graded structure. The extent to which feature commonality between exemplars and category provides a satisfying account of this graded structure varies from one abstract category to the other (Hampton, 1981). We investigate whether the incorporation of features that exemplars share with external categories yields an improved account of abstract categories' graded structures. In doing so, we follow the suggestion that abstract categories are relational in nature (Goldstone, 1996; Wiemer-Hastings & Xu, 2005). The generalized polymorphous concept model, which incorporates both types of features, is found to improve the account of typicality and category membership in three of seven studied abstract categories. These three categories are found to be the most abstract, suggesting that it is appropriate to think of abstract categories as varying along a continuum of abstractness/interrelatedness rather than as a distinct type of category altogether.

On domain differences in categorization and context variety

Membership in many natural categories is considered all-or-none, while membership in most artifact categories is found to be graded. We introduce an alternative for the prevailing view that this domain difference in categorization results from representational differences. The context variety account posits that an item's gradedness reflects the variety of contexts it appears in. Items that feature in a variety of contexts are assumed to be more likely to elicit a graded categorization response, since the suggested target category only provides one of many solutions to the question of the item's identity. We review earlier work that suggested a domain difference in context variety, with artifactual items appearing in a greater variety of contexts than natural ones. The context variety domain difference is established in two separate experiments but is shown not to explain the domain difference in categorization. A selection of artifactual and natural items, for which the domain difference in context variety is reversed, is presented for categorization in a third experiment. This selection, too, fails to provide evidence for the context variety account of categorization differences. The domain difference in categorization is shown to be robust against this manipulation. Context variety appears to have no bearing on categorization, so the context variety account is not a sustainable alternative to accounts that posit representational differences between natural and artifact categories.

Remembering 'zeal' but not 'thing': reverse frequency effects as a consequence of deregulated semantic processing

More efficient processing of high frequency (HF) words is a ubiquitous finding in healthy individuals, yet frequency effects are often small or absent in stroke aphasia. We propose that some patients fail to show the expected frequency effect because processing of HF words places strong demands on semantic control and regulation processes, counteracting the usual effect. This may occur because HF words appear in a wide range of linguistic contexts, each associated with distinct semantic information. This theory predicts that in extreme circumstances, patients with impaired semantic control should show an outright reversal of the normal frequency effect. To test this prediction, we tested two patients with impaired semantic control with a delayed repetition task that emphasised activation of semantic representations. By alternating HF and low frequency (LF) trials, we demonstrated a significant repetition advantage for LF words, principally because of perseverative errors in which patients produced the previous LF response in place of the HF target. These errors indicated that HF words were more weakly activated than LF words. We suggest that when presented with no contextual information, patients generate a weak and unstable pattern of semantic activation for HF words because information relating to many possible contexts and interpretations is activated. In contrast, LF words are associated with more stable patterns of activation because similar semantic information is activated whenever they are encountered.

Ventrolateral prefrontal cortex plays an executive regulation role in comprehension of abstract words: convergent neuropsychological and repetitive TMS evidence

Neuroimaging studies reliably reveal ventrolateral prefrontal cortex (VLPFC) activation for processing of abstract relative to concrete words, but the cause of this effect is unclear. Here, in a convergent neuropsychological and repetitive transcranial magnetic stimulation (rTMS) investigation, we tested the hypothesis that abstract words require VLPFC because they depend heavily on the semantic-executive control processes mediated by this region. Specifically, we hypothesized that accessing the meanings of abstract words require more executive regulation because they have variable, context-dependent meanings. In the neuropsychology component of the study, aphasic patients with multimodal semantic deficits following VLPFC lesions had impaired comprehension of abstract words, but this deficit was ameliorated by providing a sentence cue that placed the word in a specific context. Concrete words were better comprehended and showed more limited benefit from the cues. In the second part of the study, rTMS applied to left VLPFC in healthy subjects slowed reaction times to abstract but not concrete words, but only when words were presented out of context. TMS had no effect when words were preceded by a contextual cue. These converging results indicate that VLPFC plays an executive regulation role in the processing of abstract words. This role is less critical when words are presented with a context that guides the system toward a particular meaning or interpretation. Regulation is less important for concrete words because their meanings are constrained by their physical referents and do not tend to vary with context.