The neural bases of taxonomic and thematic conceptual relations: an MEG study

Phase synchronization during the processing of taxonomic and thematic relations

Semantic relations include "taxonomic" relations based on shared features and "thematic" relations based on co-occurrence in events. The "dual-hub" account proposes that the anterior temporal lobe (ATL) is functionally specialized for taxonomic relations and the inferior parietal lobule (IPL) for thematic relations. This study examined this claim by analyzing the intra- and inter-region phase synchronization of intracranial EEG data from electrodes in the ATL, IPL, and two subregions of the semantic control network: left inferior frontal gyrus (IFG) and posterior middle temporal gyrus (pMTG). Ten participants with epilepsy completed a semantic relatedness judgment task during intracranial EEG recording and had electrodes in at least one hub and at least one semantic control region. Theta band phase synchronization was partially consistent with the dual-hub account: synchronization between the ATL and IFG/pMTG increased when processing taxonomic relations, and synchronization within the IPL and between IPL and pMTG increased when processing thematic relations.

Disruption of Anterior Temporal Lobe Reduces Distortions in Memory From Category Knowledge

Memory retrieval does not provide a perfect recapitulation of past events, but instead an imperfect reconstruction of event-specific details and general knowledge. However, it remains unclear whether this reconstruction relies on mixtures of signals from different memory systems, including one supporting general knowledge. Here, we investigate whether the anterior temporal lobe (ATL) distorts new memories because of prior category knowledge. In this preregistered experiment (n = 36), participants encoded and retrieved image-location associations. Most images' locations were clustered according to their category, but some were in random locations. With this protocol, we previously demonstrated that randomly located images were retrieved closer to their category cluster relative to their encoded locations, suggesting an influence of category knowledge. We combined this procedure with TMS delivered to the left ATL before retrieval. We separately examined event-specific details (error) and category knowledge (bias) to identify distinct signals attributable to different memory systems. We found that TMS to ATL attenuated bias in location memory, but this effect was limited to exploratory analyses of atypical category members of animal categories. The magnitude of error was not impacted, suggesting that a memory's fidelity can be decoupled from its distortion by category knowledge. This raises the intriguing possibility that retrieval is jointly supported by separable memory systems.

The language network is not engaged in object categorization

The relationship between language and thought is the subject of long-standing debate. One claim states that language facilitates categorization of objects based on a certain feature (e.g. color) through the use of category labels that reduce interference from other, irrelevant features. Therefore, language impairment is expected to affect categorization of items grouped by a single feature (low-dimensional categories, e.g. "Yellow Things") more than categorization of items that share many features (high-dimensional categories, e.g. "Animals"). To test this account, we conducted two behavioral studies with individuals with aphasia and an fMRI experiment with healthy adults. The aphasia studies showed that selective low-dimensional categorization impairment was present in some, but not all, individuals with severe anomia and was not characteristic of aphasia in general. fMRI results revealed little activity in language-responsive brain regions during both low- and high-dimensional categorization; instead, categorization recruited the domain-general multiple-demand network (involved in wide-ranging cognitive tasks). Combined, results demonstrate that the language system is not implicated in object categorization. Instead, selective low-dimensional categorization impairment might be caused by damage to brain regions responsible for cognitive control. Our work adds to the growing evidence of the dissociation between the language system and many cognitive tasks in adults.

Transcranial Direct Current Stimulation Effects on the Neural Substrate of Conceptual Representations

The aim of this study was to shed light on the neural substrate of conceptual representations starting from the construct of higher-order convergence zones and trying to evaluate the unitary or non-unitary nature of this construct. We used the 'Thematic and Taxonomic Semantic (TTS) task' to investigate (a) the neural substrate of stimuli belonging to biological and artifact categories, (b) the format of stimuli presentation, i.e., verbal or pictorial, and (c) the relation between stimuli, i.e., categorial or contextual. We administered anodal transcranial direct current stimulation (tDCS) to different brain structures during the execution of the TTS task. Twenty healthy participants were enrolled and divided into two groups, one investigating the role of the anterior temporal lobes (ATL) and the other the temporo-parietal junctions (TPJ). Each participant underwent three sessions of stimulation to facilitate a control condition and to investigate the role of both hemispheres. Results showed that ATL stimulation influenced all conceptual representations in relation to the format of presentation (i.e., left-verbal and right-pictorial). Moreover, ATL stimulation modulated living categories and taxonomic relations specifically, whereas TPJ stimulation did not influence semantic task performances.

Taxonomic and thematic relations rely on different types of semantic features: Evidence from an fMRI meta-analysis and a semantic priming study

Taxonomic and thematic relations are major components of semantic representation but their neurocognitive underpinnings are still debated. We hypothesised that taxonomic relations preferentially activate parts of anterior temporal lobe (ATL) because they rely more on colour and shape features, while thematic relations preferentially activate temporoparietal cortex (TPC) because they rely more on action and location knowledge. We first conducted activation likelihood estimation (ALE) meta-analysis to assess evidence for neural specialisation in the existing fMRI literature (Study 1), then used a primed semantic judgement task to examine if the two relations are primed by different feature types (Study 2). We find that taxonomic relations show minimal feature-based specialisation but preferentially activate the lingual gyrus. Thematic relations are more dependent on action and location features and preferentially engage TPC. The meta-analysis also showed that lateral ATL is preferentially engaged by Thematic relations, which may reflect their greater reliance on verbal associations.

Differentiation of the Contribution of Familiarity and Recollection to the Old/New Effects in Associative Recognition: Insight from Semantic Relation

Previous research has revealed two different old/new effects, the early mid-frontal old/new effect (a.k.a., FN400) and the late parietal old/new effect (a.k.a., LPC), which relate to familiarity and recollection processes, respectively. Although associative recognition is thought to be more based on recollection, recent studies have confirmed that familiarity can make a great contribution when the items of a pair are unitized. However, it remains unclear whether the old/new effects are sensitive to the nature of different semantic relations. The current ERP (event-related potentials) study aimed to address this, where picture pairs of thematic, taxonomic, and unrelated relations served as stimuli and participants were required to discriminate the pair type: intact, rearranged, “old + new”, or new. We confirmed both FN400 and LPC. Our findings, by comparing the occurrence and the amplitudes of these two components, implicate that the neural activity of associative recognition is sensitive to the semantic relation of stimuli and depends more on stimulus properties, that the familiarity of a single item can impact the neural activities in discriminating associative pairs, and that the interval length between encoding and test modulates the familiarity of unrelated pairs. In addition, the dissociation between FN400 and LPC reinforces the dual-process models.

Semantic cognition in healthy ageing: Neural signatures of representation and control mechanisms in naming typical and atypical objects

Effective use of conceptual knowledge engages semantic representation and control processes to access information in a goal-driven manner. Neuropsychological findings of patients presenting either degraded knowledge (e.g., semantic dementia) or disrupted control (e.g., semantic aphasia) converge with neuroimaging evidence from young adults, and delineate the neural segregation of representation and control mechanisms. However, there is still scarce research on the neurofunctional underpinnings of such mechanisms in healthy ageing. To address this, we conducted an fMRI study, wherein young and older adults performed a covert naming task of typical and atypical objects. Three main age-related differences were found. As shown by age group and typicality interactions, older adults exhibited overactivation during naming of atypical (e.g., avocado) relative to typical concepts in brain regions associated to semantic representation, including anterior and medial portions of left temporal lobe (respectively, ATL and MTG). This provides evidence for the reorganization of neural activity in these brain regions contingent to the enrichment of semantic repositories in older ages. The medial orbitofrontal gyrus was also overactivated, indicating that the processing of atypical concepts (relative to typical items) taxes additional control resources in the elderly. Increased activation in the inferior frontal gyrus (IFG) was observed in naming typical items (relative to atypical ones), but only for young adults. This suggests that naming typical items (e.g., strawberry) taxes more on control processes in younger ages, presumably due to the semantic competition set by other items that share multiple features with the target (e.g., raspberry, blackberry, cherry). Together, these results reveal the dynamic nature of semantic control interplaying with conceptual representations as people grow older, by indicating that distinct neural bases uphold semantic performance from young to older ages. These findings may be explained by neural compensation mechanisms coming into play to support neurocognitive changes in healthy ageing.

Temporopolar regions of the human brain

Following prolonged neglect during the formative decades of behavioural neurology, the temporopolar region has become a site of vibrant research on the neurobiology of cognition and conduct. This turnaround can be attributed to increasing recognition of neurodegenerative diseases that target temporopolar regions for peak destruction. The resultant syndromes include behavioural dementia, associative agnosia, semantic forms of primary progressive aphasia and semantic dementia. Clinicopathological correlations show that object naming and word comprehension are critically dependent on the language-dominant (usually left) temporopolar region, whereas behavioural control and non-verbal object recognition display a more bilateral representation with a rightward bias. Neuroanatomical experiments in macaques and neuroimaging in humans show that the temporoparietal region sits at the confluence of auditory, visual and limbic streams of processing at the downstream (deep) pole of the 'what' pathway. The functional neuroanatomy of this region revolves around three axes, an anterograde horizontal axis from unimodal to heteromodal and paralimbic cortex; a radial axis where visual (ventral), auditory (dorsal) and paralimbic (medial) territories encircle temporopolar cortex and display hemispheric asymmetry; and a vertical depth-of-processing axis for the associative elaboration of words, objects and interoceptive states. One function of this neural matrix is to support the transformation of object and word representations from unimodal percepts to multimodal concepts. The underlying process is likely to start at canonical gateways that successively lead to generic (superordinate), specific (basic) and unique levels of recognition. A first sign of left temporopolar dysfunction takes the form of taxonomic blurring where boundaries among categories are preserved but not boundaries among exemplars of a category. Semantic paraphasias and coordinate errors in word-picture verification tests are consequences of this phenomenon. Eventually, boundaries among categories are also blurred and comprehension impairments become more profound. The medial temporopolar region belongs to the amygdalocentric component of the limbic system and stands to integrate exteroceptive information with interoceptive states underlying social interactions. Review of the pertinent literature shows that word comprehension and conduct impairments caused by temporopolar strokes and temporal lobectomy are far less severe than those seen in temporopolar atrophies. One explanation for this unexpected discrepancy invokes the miswiring of residual temporopolar neurons during the many years of indolently progressive neurodegeneration. According to this hypothesis, the temporopolar regions become not only dysfunctional but also sources of aberrant outputs that interfere with the function of areas elsewhere in the language and paralimbic networks, a juxtaposition not seen in lobectomy or stroke.

Multiple functions of the angular gyrus at high temporal resolution

Here, the functions of the angular gyrus (AG) are evaluated in the light of current evidence from transcranial magnetic/electric stimulation (TMS/TES) and EEG/MEG studies. 65 TMS/TES and 52 EEG/MEG studies were examined in this review. TMS/TES literature points to a causal role in semantic processing, word and number processing, attention and visual search, self-guided movement, memory, and self-processing. EEG/MEG studies reported AG effects at latencies varying between 32 and 800 ms in a wide range of domains, with a high probability to detect an effect at 300-350 ms post-stimulus onset. A three-phase unifying model revolving around the process of sensemaking is then suggested: (1) early AG involvement in defining the current context, within the first 200 ms, with a bias toward the right hemisphere; (2) attention re-orientation and retrieval of relevant information within 200-500 ms; and (3) cross-modal integration at late latencies with a bias toward the left hemisphere. This sensemaking process can favour accuracy (e.g. for word and number processing) or plausibility (e.g. for comprehension and social cognition). Such functions of the AG depend on the status of other connected regions. The much-debated semantic role is also discussed as follows: (1) there is a strong TMS/TES evidence for a causal semantic role, (2) current EEG/MEG evidence is however weak, but (3) the existing arguments against a semantic role for the AG are not strong. Some outstanding questions for future research are proposed. This review recognizes that cracking the role(s) of the AG in cognition is possible only when its exact contributions within the default mode network are teased apart.

Nonspecific Effects of Normal Aging on Taxonomic and Thematic Semantic Processing

OBJECTIVE

This study aimed to assess the effect of normal aging on the processing of taxonomic and thematic semantic relations.

METHOD

We used the Visual-World-Paradigm coupled with eye-movement recording. We compared performance of healthy younger and older adults on a word-to-picture matching task in which participants had to identify each target among semantically related (taxonomic or thematic) and unrelated distractors.

RESULTS

Younger and older participants exhibited similar patterns of gaze fixations in the two semantic conditions. The effect of aging took the form of an overall reduction in sensitivity to semantic competitors, with no difference between the taxonomic and thematic conditions. Moreover, comparison of the proportions of fixations between the younger and older participants indicated that targets were identified equally quickly in both age groups. This was not the case when mouse-click reaction times were analyzed.

CONCLUSIONS

Findings argue in favor of nonspecific effects of normal aging on semantic processing that similarly affect taxonomic and thematic processing. There are important clinical implications, as pathological aging has been repeatedly shown to selectively affect either taxonomic or thematic relations. Measuring eye-movements in a semantic task is also an interesting approach in the elderly, as these seem to be less impacted by aging than other motor responses.

Neural network bases of thematic semantic processing in language production

Semantic processing is a central component of language and cognition. The anterior temporal lobe is postulated to be a key hub for semantic processing, but the posterior temporoparietal cortex is also involved in thematic associations during language. It is possible that these regions act in concert and depend on an anteroposterior network linking the temporal pole with posterior structures to support thematic semantic processing during language production. We employed connectome-based lesion-symptom mapping to examine the causal relationship between lesioned white matter pathways and thematic processing language deficits among individuals with post-stroke aphasia. Seventy-nine adults with chronic aphasia completed the Philadelphia Naming Test, and semantic errors were coded as either thematic or taxonomic to control for taxonomic errors. Controlling for nonverbal conceptual-semantic knowledge as measured by the Pyramids and Palm Trees Test, lesion size, and the taxonomic error rate, thematic error rate was associated with loss of white matter connections from the temporal pole traversing in peri-Sylvian regions to the posterior cingulate and the insula. These findings support the existence of a distributed network underlying thematic relationship processing in language as opposed to discrete cortical areas.

Tracking the associative boost in infancy

Do words that are both associatively and taxonomically related prime each other in the infant mental lexicon? We explore the impact of these semantic relations in the emerging lexicon. Using the head-turn preference procedure, we show that 18-month-old infants have begun to construct a semantic network of associatively and taxonomically related words, such as dog-cat or apple-cheese. We demonstrate that priming between words is longer-lasting when the relationship is both taxonomic and associative, as opposed to purely taxonomic, reflecting the associative boost reported in the adult priming literature. Our results demonstrate that 18-month-old infants are able to construct a lexical-semantic network based on associative and taxonomic relations between words in the network, and that lexical-semantic links are more robust when they are both associative and taxonomic in character. Furthermore, the manner in which activation is propagated through the emerging lexical-semantic network appears to depend upon the type of semantic relation between words. We argue that 18-month-old infants have a mental lexicon that shares important structural and processing properties with that of the adult system.

Semantic flow and its relation to controlled semantic retrieval deficits in the narrative production of people with aphasia

Aphasia has had a profound influence on our understanding of how language is instantiated within the human brain. Historically, aphasia has yielded an in vivo model for elucidating the effects of impaired lexical-semantic access on language comprehension and production. Aphasiology has focused intensively on single word dissociations. Yet, less is known about the integrity of combinatorial semantic processes required to construct well-formed narratives. Here we addressed the question of how controlled lexical-semantic retrieval deficits (a hallmark of aphasia) might compound over the course of longer narratives. We specifically examined word-by-word flow of taxonomic vs. thematic semantic distance in the storytelling narratives of individuals with chronic post-stroke aphasia (n = 259) relative to age-matched controls (n = 203). We first parsed raw transcribed narratives into content words and computed inter-word semantic distances for every running pair of words in each narrative (N = 232,490 word transitions). The narratives of people with aphasia showed significant reductions in taxonomic and thematic semantic distance relative to controls. Both distance metrics were strongly predictive of offline measures of semantic impairment and aphasia severity. Since individuals with aphasia often exhibit perseverative language output (i.e., repetitions), we performed additional analyses with repetitions excluded. When repetitions were excluded, group differences in semantic distances persisted and thematic distance was still predictive of semantic impairment, although some findings changed. These results demonstrate the cumulative impact of deficits in controlled word retrieval over the course of narrative production. We discuss the nature of semantic flow between words as a novel metric of characterizing discourse and elucidating the nature of lexical-semantic access impairment in aphasia at multiword levels.

Electrocorticographic evidence of a common neurocognitive sequence for mentalizing about the self and others

Neuroimaging studies of mentalizing (i.e., theory of mind) consistently implicate the default mode network (DMN). Nevertheless, the social cognitive functions of individual DMN regions remain unclear, perhaps due to limited spatiotemporal resolution in neuroimaging. Here we use electrocorticography (ECoG) to directly record neuronal population activity while 16 human participants judge the psychological traits of themselves and others. Self- and other-mentalizing recruit near-identical cortical sites in a common spatiotemporal sequence. Activations begin in the visual cortex, followed by temporoparietal DMN regions, then finally in medial prefrontal regions. Moreover, regions with later activations exhibit stronger functional specificity for mentalizing, stronger associations with behavioral responses, and stronger self/other differentiation. Specifically, other-mentalizing evokes slower and longer activations than self-mentalizing across successive DMN regions, implying lengthier processing at higher levels of representation. Our results suggest a common neurocognitive pathway for self- and other-mentalizing that follows a complex spatiotemporal gradient of functional specialization across DMN and beyond.

Analogy-Related Information Can Be Accessed by Simple Addition and Subtraction of fMRI Activation Patterns, Without Participants Performing any Analogy Task

Analogical reasoning, for example, inferring that teacher is to chalk as mechanic is to wrench, plays a fundamental role in human cognition. However, whether brain activity patterns of individual words are encoded in a way that could facilitate analogical reasoning is unclear. Recent advances in computational linguistics have shown that information about analogical problems can be accessed by simple addition and subtraction of word embeddings (e.g., wrench = mechanic + chalk - teacher). Critically, this property emerges in artificial neural networks that were not trained to produce analogies but instead were trained to produce general-purpose semantic representations. Here, we test whether such emergent property can be observed in representations in human brains, as well as in artificial neural networks. fMRI activation patterns were recorded while participants viewed isolated words but did not perform analogical reasoning tasks. Analogy relations were constructed from word pairs that were categorically or thematically related, and we tested whether the predicted fMRI pattern calculated with simple arithmetic was more correlated with the pattern of the target word than other words. We observed that the predicted fMRI patterns contain information about not only the identity of the target word but also its category and theme (e.g., teaching-related). In summary, this study demonstrated that information about analogy questions can be reliably accessed with the addition and subtraction of fMRI patterns, and that, similar to word embeddings, this property holds for task-general patterns elicited when participants were not explicitly told to perform analogical reasoning.

Task modulation of spatiotemporal dynamics in semantic brain networks: An EEG/MEG study

How does brain activity in distributed semantic brain networks evolve over time, and how do these regions interact to retrieve the meaning of words? We compared spatiotemporal brain dynamics between visual lexical and semantic decision tasks (LD and SD), analysing whole-cortex evoked responses and spectral functional connectivity (coherence) in source-estimated electroencephalography and magnetoencephalography (EEG and MEG) recordings. Our evoked analysis revealed generally larger activation for SD compared to LD, starting in primary visual area (PVA) and angular gyrus (AG), followed by left posterior temporal cortex (PTC) and left anterior temporal lobe (ATL). The earliest activation effects in ATL were significantly left-lateralised. Our functional connectivity results showed significant connectivity between left and right ATL, PTC and right ATL in an early time window, as well as between left ATL and IFG in a later time window. The connectivity of AG was comparatively sparse. We quantified the limited spatial resolution of our source estimates via a leakage index for careful interpretation of our results. Our findings suggest that the different demands on semantic information retrieval in lexical and semantic decision tasks first modulate visual and attentional processes, then multimodal semantic information retrieval in the ATLs and finally control regions (PTC and IFG) in order to extract task-relevant semantic features for response selection. Whilst our evoked analysis suggests a dominance of left ATL for semantic processing, our functional connectivity analysis also revealed significant involvement of right ATL in the more demanding semantic task. Our findings demonstrate the complementarity of evoked and functional connectivity analysis, as well as the importance of dynamic information for both types of analyses.

Functional differentiation in the language network revealed by lesion-symptom mapping

Theories of language organization in the brain commonly posit that different regions underlie distinct linguistic mechanisms. However, such theories have been criticized on the grounds that many neuroimaging studies of language processing find similar effects across regions. Moreover, condition by region interaction effects, which provide the strongest evidence of functional differentiation between regions, have rarely been offered in support of these theories. Here we address this by using lesion-symptom mapping in three large, partially-overlapping groups of aphasia patients with left hemisphere brain damage due to stroke (N = 121, N = 92, N = 218). We identified multiple measure by region interaction effects, associating damage to the posterior middle temporal gyrus with syntactic comprehension deficits, damage to posterior inferior frontal gyrus with expressive agrammatism, and damage to inferior angular gyrus with semantic category word fluency deficits. Our results are inconsistent with recent hypotheses that regions of the language network are undifferentiated with respect to high-level linguistic processing.

How Processing Fluency Contributes to the Old/New Effects of Familiarity and Recollection: Evidence From the Remember/Know Paradigm

Previous investigations have demonstrated FN400 and LPC, 2 event-related potential old/new effects that respectively reflect familiarity- and recollection-based processes in memory. However, it is unclear whether these effects are susceptible to processing fluency, particularly different types of processing fluency. To address this issue, applying a masked priming paradigm, we conducted an event-related potential experiment by manipulating semantic relations between the prime and the target as identical (reflecting perceptual fluency), thematically and taxonomically related (referring to conceptual fluency), and unrelated. A remember/know (R/K) judgment task in the test phase was used to distinguish familiarity- and recollection-based processes. Behaviorally, both task performance and response speed were modulated by the variables of priming condition, item type, and response type. All 4 priming conditions elicited significant FN400 and LPC. Compared with the K response, the R response was more relevant to the recollection-based processes reflected by LPC. Both FN400 and LPC were modulated by whether there was a response of R, K, or new. The former was susceptible only to conceptual fluency, and the latter was sensitive to both perceptual fluency and conceptual fluency, which offered telling evidence for the dual process model. Considerations for future investigations are proposed. See supplemental materials here: https://www.press.uillinois.edu/journals/ajp/media/evidence_in_remember_know_paradigm/

Asymmetric Underlying Mechanisms of Relation-Based and Property-Based Noun-Noun Conceptual Combination

Conceptual combination is a fundamental human cognitive ability by which people can experience infinite thinking by artfully combining finite knowledge. For example, one can instantly combine “cactus” and “fish” together as “prickly fish” even if one has never previously heard of a “cactus fish.” Although two major combinatorial types—property and relational combinations—have been identified, the underlying processes of each remain elusive. This study investigates the asymmetric processing mechanisms underlying property and relational combinations by examining differential semantic activation during noun–noun conceptual combination. Across two experiments utilizing each combinatorial process as semantic priming and implementing a lexical decision task immediately after combination, we measure and compare the semantic activation patterns of intrinsic and extrinsic semantic features in these two combinatorial types. We found converging evidence that property and relational combinations involve asymmetric semantic information and entail distinct processing mechanisms. In property combination, the intrinsic feature in the modifier concept showed greater activation than the semantic feature of the same dimension in the head concept. In contrast, in relational combination, the extrinsic semantic feature in the head concept and the whole modifier concept showed similar levels of activation. Moreover, our findings also showed that these patterns of semantic activation occurred only when the combinatorial process was complete, indicating that accessing the same lexical-semantic information is not sufficient to observe asymmetric patterns. These findings demonstrate that property combination involves replacing a specific semantic feature of the head noun with that of the modifier noun, whereas relational combination involves completing the semantic feature of the head noun with the whole modifier concept. We discuss the implications of these findings, research limitations, and future research directions.

The Cortical Organization of Syntax

Syntax, the structure of sentences, enables humans to express an infinite range of meanings through finite means. The neurobiology of syntax has been intensely studied but with little consensus. Two main candidate regions have been identified: the posterior inferior frontal gyrus (pIFG) and the posterior middle temporal gyrus (pMTG). Integrating research in linguistics, psycholinguistics, and neuroscience, we propose a neuroanatomical framework for syntax that attributes distinct syntactic computations to these regions in a unified model. The key theoretical advances are adopting a modern lexicalized view of syntax in which the lexicon and syntactic rules are intertwined, and recognizing a computational asymmetry in the role of syntax during comprehension and production. Our model postulates a hierarchical lexical-syntactic function to the pMTG, which interconnects previously identified speech perception and conceptual-semantic systems in the temporal and inferior parietal lobes, crucial for both sentence production and comprehension. These relational hierarchies are transformed via the pIFG into morpho-syntactic sequences, primarily tied to production. We show how this architecture provides a better account of the full range of data and is consistent with recent proposals regarding the organization of phonological processes in the brain.

The Language Network Is Recruited but Not Required for Nonverbal Event Semantics

The ability to combine individual concepts of objects, properties, and actions into complex representations of the world is often associated with language. Yet combinatorial event-level representations can also be constructed from nonverbal input, such as visual scenes. Here, we test whether the language network in the human brain is involved in and necessary for semantic processing of events presented nonverbally. In Experiment 1, we scanned participants with fMRI while they performed a semantic plausibility judgment task versus a difficult perceptual control task on sentences and line drawings that describe/depict simple agent-patient interactions. We found that the language network responded robustly during the semantic task performed on both sentences and pictures (although its response to sentences was stronger). Thus, language regions in healthy adults are engaged during a semantic task performed on pictorial depictions of events. But is this engagement necessary? In Experiment 2, we tested two individuals with global aphasia, who have sustained massive damage to perisylvian language areas and display severe language difficulties, against a group of age-matched control participants. Individuals with aphasia were severely impaired on the task of matching sentences to pictures. However, they performed close to controls in assessing the plausibility of pictorial depictions of agent-patient interactions. Overall, our results indicate that the left frontotemporal language network is recruited but not necessary for semantic processing of nonverbally presented events.

Common and distinct neural substrates of sentence production and comprehension

Functional neuroimaging and lesion-symptom mapping investigations implicate a left frontal-temporal-parietal network for sentence processing. The majority of studies have focused on sentence comprehension, with fewer in the domain of sentence production, which have not fully elucidated overlapping and/or unique brain structures associated with the two domains, particularly for sentences with noncanonical word order. Using voxel-based lesion symptom mapping (VLSM) we examined the relationship between lesions within the left hemisphere language network and both sentence comprehension and production of simple and complex syntactic structures in 76 participants with chronic stroke-induced aphasia. Results revealed shared regions across domains in the anterior and posterior superior temporal gyri (aSTG, pSTG), and the temporal pole (adjusted for verb production/comprehension). Additionally, comprehension was associated with lesions in the anterior and posterior middle temporal gyri (aMTG, pMTG), the MTG temporooccipital regions, SMG/AG, central and parietal operculum, and the insula. Subsequent VLSM analyses (production versus comprehension) revealed critical regions associated with each domain: anterior temporal lesions were associated with production; posterior temporo-parietal lesions were associated with comprehension, implicating important roles for regions within the ventral and dorsal stream processing routes, respectively. Processing of syntactically complex, noncanonical (adjusted for canonical), sentences was associated with damage to the pSTG across domains, with additional damage to the pMTG and IPL associated with impaired sentence comprehension, suggesting that the pSTG is crucial for computing noncanonical sentences across domains and that the pMTG, and IPL are necessary for re-analysis of thematic roles as required for resolution of long-distance dependencies. These findings converge with previous studies and extend our knowledge of the neural mechanisms of sentence comprehension to production, highlighting critical regions associated with both domains, and further address the mechanism engaged for syntactic computation, controlled for the contribution of verb processing.

Knowing what you need to know in advance: The neural processes underpinning flexible semantic retrieval of thematic and taxonomic relations

Semantic retrieval is flexible, allowing us to focus on subsets of features and associations that are relevant to the current task or context: for example, we use taxonomic relations to locate items in the supermarket (carrots are a vegetable), but thematic associations to decide which tools we need when cooking (carrot goes with peeler). We used fMRI to investigate the neural basis of this form of semantic flexibility; in particular, we asked how retrieval unfolds differently when participants have advanced knowledge of the type of link to retrieve between concepts (taxonomic or thematic). Participants performed a semantic relatedness judgement task: on half the trials, they were cued to search for a taxonomic or thematic link, while on the remaining trials, they judged relatedness without knowing which type of semantic relationship would be relevant. Left inferior frontal gyrus showed greater activation when participants knew the trial type in advance. An overlapping region showed a stronger response when the semantic relationship between the items was weaker, suggesting this structure supports both top-down and bottom-up forms of semantic control. Multivariate pattern analysis further revealed that the neural response in left inferior frontal gyrus reflects goal information related to different conceptual relationships. Top-down control specifically modulated the response in visual cortex: when the goal was unknown, there was greater deactivation to the first word, and greater activation to the second word. We conclude that top-down control of semantic retrieval is primarily achieved through the gating of task-relevant 'spoke' regions.

Recognition-induced forgetting of schematically related pictures

Recognition-induced forgetting is the category-specific forgetting of pictures that occurs when a subset of a category of pictures is recognized, leading to forgetting of the remaining pictures. We have previously shown that recognition-induced forgetting does not operate over categories created by temporal relationships, suggesting that this effect does not operate over episodic memory representations. Here we systematically tested whether schematically related categories of pictures are immune to recognition-induced forgetting. We found that sufficiently weak schematically related memories are vulnerable to recognition-induced forgetting. These results offer an alternative interpretation for evidence that recognition-induced forgetting does not operate over episodic memory representations. Evidence that the strength of schematic grouping modulates forgetting supports a model of recognition-induced forgetting in which the key determinant of forgetting is moderate activation. This is the first demonstration that recognition-induced forgetting operates over perceptually distinct objects, demonstrating the ubiquity of such forgetting.

Contrasting Semantic versus Inhibitory Processing in the Angular Gyrus: An fMRI Study

Recent studies of semantic memory have focused on dissociating the neural bases of two foundational components of human thought: taxonomic categories, which group similar objects like dogs and seals based on features, and thematic categories, which group dissimilar objects like dogs and leashes based on events. While there is emerging consensus that taxonomic concepts are represented in the anterior temporal lobe, there is disagreement over whether thematic concepts are represented in the angular gyrus (AG). We previously found AG sensitivity to both kinds of concepts; however, some accounts suggest that such activity reflects inhibition of irrelevant information rather than thematic activation. To test these possibilities, an fMRI experiment investigated both types of conceptual relations in the AG during two semantic judgment tasks. Each task trained participants to give negative responses (inhibition) or positive responses (activation) to word pairs based on taxonomic and thematic criteria of relatedness. Results showed AG engagement during both negative judgments and thematic judgments, but not during positive judgments about taxonomic pairs. Together, the results suggest that activity in the AG reflects functions that include both thematic (but not taxonomic) processing and inhibiting irrelevant semantic information.

A Case of Right Temporal Lobectomy for Brain Tumor With Selective Semantic Pictorial Disorder

Disagreement exists regarding representational and connectionist interpretations of semantic knowledge subserved by the right versus left anterior temporal lobes (ATLs). These interpretations predict a different pattern of impairment in patients with a right unilateral ATL lesion. We conducted a neuropsychological study of a selective semantic pictorial defect exhibited by a 57-year-old man who had undergone a right temporal lobectomy due to the presence of a glioblastoma. The patient was given the Thematic and Taxonomic Semantic task, in which individuals must select, within triplets of words or pictures, the best associates of living or nonliving stimuli, related by thematic or taxonomic links, and presented in the verbal or pictorial modality. The selectivity of the defect was documented by a comparison between the results obtained by our patient and those obtained by healthy controls on living items and on pictures with a thematic relation. The selectivity of the defect was confirmed by a within-subject analysis of the results obtained on all of the task's triplets and those obtained on the stimuli representing living entities with a taxonomic relation. The selectivity of this semantic pictorial defect mainly concerning living entities is consistent with the representational account of semantic defects observed in our patient. In the present case report, a right temporal lobectomy resulted in a selective semantic pictorial defect with the qualitative features predicted by the representational account of semantic defects observed after a unilateral ATL lesion.

Relaciones conceptuales: comparación entre Niños, Adultos Jóvenes y Adultos Mayores

El estudio de la organización del conocimiento en la memoria semántica suscita gran interés en Psicología Cognitiva y Neuropsicología. El conocimiento semántico está representado por conceptos que comparten características y forman una jerarquía inclusiva -organización taxonómica-, o que se vinculan en tiempo y espacio -organización temática o situacional-. Se considera que a lo largo del desarrollo cambia la preferencia por estos tipos de organización, pero son pocos los estudios que comparan las organizaciones conceptuales de niños en edad escolar, adultos jóvenes y mayores, y sus resultados son divergentes. Asimismo, la organización conceptual también varía en función del dominio al que pertenece el concepto (vivo vs no vivo). Por lo tanto, el objetivo general de este estudio fue estudiar qué tipos de organización conceptual empleaban esos grupos en una tarea de producción de atributos para conceptos de seres vivos y no vivos. Los resultados indican que la producción de atributos taxonómicos fue significativamente mayor para los adultos jóvenes que para los adultos mayores y los niños, en tanto la producción taxonómica de estos dos últimos grupos fue pareja. En cuanto a la producción temática, fue alta y homogénea en los tres grupos de edad. Por último, para el dominio de los seres no vivos los atributos resultaron en su mayoría temáticos y perceptivos, y para el dominio de los seres vivos, mayormente perceptivos.

Memory: Normative development of memory systems

During the past decades, abundant behavioral, clinical, and neuroimaging data have shown several memory systems in the brain. A memory system is a type of memory that processes a particular type of information, using specific mechanisms, with distinct neural correlates. What we call memory is therefore not a unitary capacity but a collection of distinct systems. From a developmental perspective, each memory system has its own developmental course. This explains the heterogeneity of children's mnemonic competencies: for example, 3-year-olds learn many new words and concepts every day but have trouble recalling in detail an event that happened the week before. In this chapter, we sum up major findings regarding the development from infancy to early adulthood of the main memory systems. Specifically, we report recent data regarding the development of declarative memory (i.e., episodic and semantic memory), and the relationship between the maturation of their neural correlates and the phenomena of infantile and childhood amnesia. We conclude by indicating some of the possible avenues for future research.

Inductive Reasoning Differs Between Taxonomic and Thematic Contexts: Electrophysiological Evidence

Inductive reasoning can be performed in different contexts, but it is unclear whether the neural mechanism of reasoning performed in a thematic context (e.g., bee has x, so honey has x) is the same as that performed in a taxonomic context (e.g., bee has x, so butterfly has x). In the present study, participants were required to judge whether a conclusion was acceptable or not based on its premise, for which the taxonomic or thematic distances between premise and conclusion objects were either far or near. The Event related potential (ERP) results indicated that the effect of context (taxonomic vs. thematic) was initially observed in the P2 component; while the distance effect (far vs. near) was observed in N400 and late components. Moreover, the distance effect on thematic-based inductive reasoning was found in the anterior regions, while the distance effect on taxonomic-based inductive reasoning conditions was found in the posterior regions. These results support the view that inductive reasoning is performed differently under different semantic contexts.

Identification of taxonomic and thematic relationships: Do the two semantic systems have the same status in semantic dementia?

Introduction: Disequilibrium between the taxonomic and thematic semantic systems was previously hypothesized in participants with semantic dementia (SD), without rigorously assessing their ability to identify the two types of semantic relationships. Therefore, the aim of the present study was to directly compare the ability of 10 participants with SD, 10 participants with Alzheimer's disease (AD), and 20 controls to identify thematic versus taxonomic relationships. Methods: Participants performed an explicit forced-choice picture-matching task in which they had to determine which of two pictures of choice was semantically related to the target picture. Target pictures could display natural or artifact objects. Each target was presented once with a taxonomically related picture and once with a thematically related picture. Results: Analyses of correct thematic and taxonomic matches as a function of target domain showed that the performance of the two groups of patients differed in the taxonomic conditions but not in the thematic conditions, demonstrating a relative preservation of thematic knowledge in SD. Additional correlation analyses further indicated that the particular status of thematic relationships in SD was even stronger for artifact concepts. Conclusions: Results provide evidence of the heterogeneous nature of semantic knowledge disruption in SD, and could be regarded as being consistent with the existence of two neuroanatomically and functionally distinct semantic systems. Results further stress the relevance of performing a more detailed and complete assessment of semantic performance in participants with SD, in order to capture the impaired but also preserved aspects of their knowledge.

Dissociations in semantic cognition: Oscillatory evidence for opposing effects of semantic control and type of semantic relation in anterior and posterior temporal cortex

How does the brain represent and process different types of knowledge? The Dual Hub account postulates that anterior temporal lobes (ATL) support taxonomic relationships based on shared physical features (mole – cat), while temporoparietal regions, including posterior middle temporal gyrus (pMTG), support thematic associations (mole – earth). Conversely, the Controlled Semantic Cognition account proposes that ATL supports both aspects of knowledge, while left pMTG contributes to controlled retrieval. This study used magnetoencephalography to test these contrasting predictions of functional dissociations within the temporal lobe. ATL and pMTG responded more strongly to taxonomic and thematic trials respectively, matched for behavioural performance, in line with predictions of the Dual Hub account. In addition, ATL showed a greater response to strong than weak thematic associations, while pMTG showed the opposite pattern, supporting a key prediction of the Controlled Semantic Cognition account. ATL showed a stronger response for word pairs that were more semantically coherent, either because they shared physical features (in taxonomic trials) or a strong thematic association. These effects largely coincided in time and frequency (although an early oscillatory response in ATL was specific to taxonomic trials). In contrast, pMTG showed non-overlapping effects of semantic control demands and thematic judgements: this site showed a larger oscillatory response to weak associations, when ongoing retrieval needed to be shaped to suit the task demands, and also a larger response to thematic judgements contrasted with taxonomic trials (which was reduced but not eliminated when the thematic trials were easier). Consequently, time-sensitive neuroimaging supports a complex pattern of functional dissociations within the left temporal lobe, which reflects both coherence versus control and distinctive oscillatory responses for taxonomic overlap (in ATL) and thematic relations (in pMTG).

Neural Connectivity in Syntactic Movement Processing

Linguistic theory suggests non-canonical sentences subvert the dominant agent-verb-theme order in English via displacement of sentence constituents to argument (NP-movement) or non-argument positions (wh-movement). Both processes have been associated with the left inferior frontal gyrus and posterior superior temporal gyrus, but differences in neural activity and connectivity between movement types have not been investigated. In the current study, functional magnetic resonance imaging data were acquired from 21 adult participants during an auditory sentence-picture verification task using passive and active sentences contrasted to isolate NP-movement, and object- and subject-cleft sentences contrasted to isolate wh-movement. Then, functional magnetic resonance imaging data from regions common to both movement types were entered into a dynamic causal modeling analysis to examine effective connectivity for wh-movement and NP-movement. Results showed greater left inferior frontal gyrus activation for Wh > NP-movement, but no activation for NP > Wh-movement. Both types of movement elicited activity in the opercular part of the left inferior frontal gyrus, left posterior superior temporal gyrus, and left medial superior frontal gyrus. The dynamic causal modeling analyses indicated that neither movement type significantly modulated the connection from the left inferior frontal gyrus to the left posterior superior temporal gyrus, nor vice-versa, suggesting no connectivity differences between wh- and NP-movement. These findings support the idea that increased complexity of wh-structures, compared to sentences with NP-movement, requires greater engagement of cognitive resources via increased neural activity in the left inferior frontal gyrus, but both movement types engage similar neural networks.

Neural networks for sentence comprehension and production: An ALE-based meta-analysis of neuroimaging studies

Comprehending and producing sentences is a complex endeavor requiring the coordinated activity of multiple brain regions. We examined three issues related to the brain networks underlying sentence comprehension and production in healthy individuals: First, which regions are recruited for sentence comprehension and sentence production? Second, are there differences for auditory sentence comprehension vs. visual sentence comprehension? Third, which regions are specifically recruited for the comprehension of syntactically complex sentences? Results from activation likelihood estimation (ALE) analyses (from 45 studies) implicated a sentence comprehension network occupying bilateral frontal and temporal lobe regions. Regions implicated in production (from 15 studies) overlapped with the set of regions associated with sentence comprehension in the left hemisphere, but did not include inferior frontal cortex, and did not extend to the right hemisphere. Modality differences between auditory and visual sentence comprehension were found principally in the temporal lobes. Results from the analysis of complex syntax (from 37 studies) showed engagement of left inferior frontal and posterior temporal regions, as well as the right insula. The involvement of the right hemisphere in the comprehension of these structures has potentially important implications for language treatment and recovery in individuals with agrammatic aphasia following left hemisphere brain damage.

Doctor, Teacher, and Stethoscope: Neural Representation of Different Types of Semantic Relations

Concepts can be related in many ways. They can belong to the same taxonomic category (e.g., "doctor" and "teacher," both in the category of people) or be associated with the same event context (e.g., "doctor" and "stethoscope," both associated with medical scenarios). How are these two major types of semantic relations coded in the brain? We constructed stimuli from three taxonomic categories (people, manmade objects, and locations) and three thematic categories (school, medicine, and sports) and investigated the neural representations of these two dimensions using representational similarity analyses in human participants (10 men and nine women). In specific regions of interest, the left anterior temporal lobe (ATL) and the left temporoparietal junction (TPJ), we found that, whereas both areas had significant effects of taxonomic information, the taxonomic relations had stronger effects in the ATL than in the TPJ ("doctor" and "teacher" closer in ATL neural activity), with the reverse being true for thematic relations ("doctor" and "stethoscope" closer in TPJ neural activity). A whole-brain searchlight analysis revealed that widely distributed regions, mainly in the left hemisphere, represented the taxonomic dimension. Interestingly, the significant effects of the thematic relations were only observed after the taxonomic differences were controlled for in the left TPJ, the right superior lateral occipital cortex, and other frontal, temporal, and parietal regions. In summary, taxonomic grouping is a primary organizational dimension across distributed brain regions, with thematic grouping further embedded within such taxonomic structures.SIGNIFICANCE STATEMENT How are concepts organized in the brain? It is well established that concepts belonging to the same taxonomic categories (e.g., "doctor" and "teacher") share neural representations in specific brain regions. How concepts are associated in other manners (e.g., "doctor" and "stethoscope," which are thematically related) remains poorly understood. We used representational similarity analyses to unravel the neural representations of these different types of semantic relations by testing the same set of words that could be differently grouped by taxonomic categories or by thematic categories. We found that widely distributed brain areas primarily represented taxonomic categories, with the thematic categories further embedded within the taxonomic structure.

The parietal lobe and language

Although the parietal lobe was considered by many of the earliest investigators of disordered language to be a major component of the neural systems instantiating language, most views of the anatomic substrate of language emphasize the role of temporal and frontal lobes in language processing. We review evidence from lesion studies as well as functional neuroimaging, demonstrating that the left parietal lobe is also crucial for several aspects of language. First, we argue that the parietal lobe plays a major role in semantic processing, particularly for "thematic" relationships in which information from multiple sensory and motor domains is integrated. Additionally, we review a number of accounts that emphasize the role of the left parietal lobe in phonologic processing. Although the accounts differ somewhat with respect to the nature of the linguistic computations subserved by the parietal lobe, they share the view that the parietal lobe is essential for the processes by which sound-based representations are transcoded into a format that can drive action systems. We suggest that investigations of the linguistic capacities of the parietal lobe constrained by the understanding of the parietal lobe in action and multimodal sensory integration may serve to enhance not only our understanding of language, but also the relationship between language and more basic brain functions.

Learning, remembering, and predicting how to use tools: Distributed neurocognitive mechanisms: Comment on Osiurak and Badets (2016)

The reasoning-based approach championed by Francois Osiurak and Arnaud Badets (Osiurak & Badets, 2016) denies the existence of sensory-motor memories of tool use except in limited circumstances, and suggests instead that most tool use is subserved solely by online technical reasoning about tool properties. In this commentary, I highlight the strengths and limitations of the reasoning-based approach and review a number of lines of evidence that manipulation knowledge is in fact used in tool action tasks. In addition, I present a "two route" neurocognitive model of tool use called the "Two Action Systems Plus (2AS+)" framework that posits a complementary role for online and stored information and specifies the neurocognitive substrates of task-relevant action selection. This framework, unlike the reasoning based approach, has the potential to integrate the existing psychological and functional neuroanatomic data in the tool use domain. (PsycINFO Database Record

Relational vs. attributive interpretation of nominal compounds differentially engages angular gyrus and anterior temporal lobe

The angular gyrus (AG) and anterior temporal lobe (ATL) have been found to respond to a number of tasks involving combinatorial processing. In this study, we investigate the conceptual combination of nominal compounds, and ask whether ATL/AG activity is modulated by the type of combinatorial operation applied to a nominal compound. We compare relational and attributive interpretations of nominal compounds and find that ATL and AG both discriminate these two types, but in distinct ways. While right AG demonstrated greater positive task-responsive activity for relational compounds, there was a greater negative deflection in the BOLD response in left AG for relational compounds. In left ATL, we found an earlier peak in subjects' BOLD response curves for attributive interpretations. In other words, we observed dissociations in both AG and ATL between relational and attributive nominal compounds, with regard to magnitude in the former and to timing in the latter. These findings expand on prior studies that posit roles for both AG and ATL in conceptual processing generally, and in conceptual combination specifically, by indicating possible functional specializations of these two regions within a larger conceptual knowledge network.

Taxonomic and thematic semantic systems

Object concepts are critical for nearly all aspects of human cognition, from perception tasks like object recognition, to understanding and producing language, to making meaningful actions. Concepts can have 2 very different kinds of relations: similarity relations based on shared features (e.g., dog-bear), which are called "taxonomic" relations, and contiguity relations based on co-occurrence in events or scenarios (e.g., dog-leash), which are called "thematic" relations. Here, we report a systematic review of experimental psychology and cognitive neuroscience evidence of this distinction in the structure of semantic memory. We propose 2 principles that may drive the development of distinct taxonomic and thematic semantic systems: differences between which features determine taxonomic versus thematic relations, and differences in the processing required to extract taxonomic versus thematic relations. This review brings together distinct threads of behavioral, computational, and neuroscience research on semantic memory in support of a functional and neural dissociation, and defines a framework for future studies of semantic memory. (PsycINFO Database Record

Thematic knowledge, artifact concepts, and the left posterior temporal lobe: Where action and object semantics converge

Converging evidence supports the existence of functionally and neuroanatomically distinct taxonomic (similarity-based; e.g., hammer-screwdriver) and thematic (event-based; e.g., hammer-nail) semantic systems. Processing of thematic relations between objects has been shown to selectively recruit the left posterior temporoparietal cortex. Similar posterior regions have also been shown to be critical for knowledge of relationships between actions and manipulable human-made objects (artifacts). Based on the hypothesis that thematic relationships for artifacts rely, at least in part, on action relationships, we assessed the prediction that the same regions of the left posterior temporoparietal cortex would be critical for conceptual processing of artifact-related actions and thematic relations for artifacts. To test this hypothesis, we evaluated processing of taxonomic and thematic relations for artifacts and natural objects as well as artifact action knowledge (gesture recognition) abilities in a large sample of 48 stroke patients with a range of lesion foci in the left hemisphere. Like control participants, patients identified thematic relations faster than taxonomic relations for artifacts, whereas they identified taxonomic relations faster than thematic relations for natural objects. Moreover, response times (RTs) for identifying thematic relations for artifacts selectively predicted performance in gesture recognition. Whole brain Voxel-based Lesion-Symptom Mapping (VLSM) analyses and Region of Interest (ROI) regression analyses further demonstrated that lesions to the left posterior temporal cortex, overlapping with LTO and visual motion area hMT+, were associated both with relatively slower RTs in identifying thematic relations for artifacts and poorer artifact action knowledge in patients. These findings provide novel insights into the functional role of left posterior temporal cortex in thematic knowledge, and suggest that the close association between thematic relations for artifacts and action representations may reflect their common dependence on visual motion and manipulation information.