Large, colorful, or noisy? Attribute- and modality-specific activations during retrieval of perceptual attribute knowledge

Meta-analytic evidence for a novel hierarchical model of conceptual processing

Conceptual knowledge plays a pivotal role in human cognition. Grounded cognition theories propose that concepts consist of perceptual-motor features represented in modality-specific perceptual-motor cortices. However, it is unclear whether conceptual processing consistently engages modality-specific areas. Here, we performed an activation likelihood estimation (ALE) meta-analysis across 212 neuroimaging experiments on conceptual processing related to 7 perceptual-motor modalities (action, sound, visual shape, motion, color, olfaction-gustation, and emotion). We found that conceptual processing consistently engages brain regions also activated during real perceptual-motor experience of the same modalities. In addition, we identified multimodal convergence zones that are recruited for multiple modalities. In particular, the left inferior parietal lobe (IPL) and posterior middle temporal gyrus (pMTG) are engaged for three modalities: action, motion, and sound. These "trimodal" regions are surrounded by "bimodal" regions engaged for two modalities. Our findings support a novel model of the conceptual system, according to which conceptual processing relies on a hierarchical neural architecture from modality-specific to multimodal areas up to an amodal hub.

Visual mental imagery: Inside the mind's eyes

What are mental images needed for? A variety of everyday situations calls for us to plan ahead; one of the clever ways our mind prepares and strategizes our next move is through mental simulation. A powerful tool in running these simulations is visual mental imagery, which can be conceived as a way to activate and maintain an internal representation of the to-be-imagined object, giving rise to predictions. Therefore, under normal conditions imagination is primarily an endogenous process, and only more rarely can mental images be activated exogenously, for example, by means of intracerebral stimulation. A large debate is still ongoing regarding the neural substrates supporting mental imagery, with the neuropsychological and neuroimaging literature agreeing in some cases, but not others. This chapter reviews the neuroscientific literature on mental imagery, and attempts to reappraise the neuropsychological and neuroimaging evidence by drawing a model of mental imagery informed by both structural and functional brain data. Overall, the role of regions in the ventral temporal cortex, especially of the left hemisphere, stands out unequivocally as a key substrate in mental imagery.

Unpredictive linguistic verbal cues accelerate congruent visual targets into awareness in a breaking continuous flash suppression paradigm

One of the most influential ideas within the domain of cognition is that of embodied cognition, in which the experienced world is the result of an interplay between an organism's physiology, sensorimotor system, and its environment. An aspect of this idea is that linguistic information activates sensory representations automatically. For example, hearing the word 'red' would automatically activate sensory representations of this color. But does linguistic information prioritize access to awareness of congruent visual information? Here, we show that linguistic verbal cues accelerate matching visual targets into awareness by using a breaking continuous flash suppression paradigm. In a speeded reaction time task, observers heard spoken color labels (e.g., red) followed by colored targets that were either congruent (red), incongruent (green), or neutral (a neutral noncolor word) with respect to the labels. Importantly, and in contrast to previous studies investigating a similar question, the incidence of congruent trials was not higher than that of incongruent trials. Our results show that RTs were selectively shortened for congruent verbal-visual pairings, and that this shortening occurred over a wide range of cue-target intervals. We suggest that linguistic verbal information preactivates sensory representations, so that hearing the word 'red' preactivates (visual) sensory information internally.

Hemispheric asymmetries in visual mental imagery

Visual mental imagery is the faculty whereby we can "visualize" objects that are not in our line of sight. Longstanding evidence dating back over thirty years has shown that unilateral brain lesions, especially in the left temporal lobe, can impair aspects of this ability. Yet, there is currently no attempt to identify analogies between these neuropsychological findings of hemispheric asymmetry and those from other neuroscientific approaches. Here, we present a critical review of the available literature on the hemispheric laterality of visual mental imagery, by looking at cross-method patterns of evidence in the domains of lesion neuropsychology, neuroimaging, and direct cortical stimulation. Results can be summarized under three main axes. First, frontoparietal networks in both hemispheres appear to be associated with visual mental imagery. Second, lateralization patterns emerge in the temporal lobes, with the left inferior temporal lobe being the most common finding in the literature for endogenously generated images, especially, but not exclusively, when orthographic material is used to ignite imagery. Third, an opposite pattern of hemispheric laterality emerges when visual mental images are induced by exogenous stimulation; direct cortical electrical stimulation tends to produce visual imagery experiences predominantly when applied to the right temporal lobe. These patterns of hemispheric asymmetry are difficult to reconcile with the dominant model of visual mental imagery, which emphasizes the implication of early sensory cortices. They suggest instead that visual mental imagery relies on large-scale brain networks, with a crucial participation of high-level visual regions in the temporal lobes.

Effects of Intermittent Theta Burst Stimulation on the Clock Drawing Test Performances in Patients with Alzheimer's Disease

The clock drawing test (CDT) is widely used in clinical neuropsychological practice. However, its neuroanatomical correlates have not been well established. This study investigated the effects of theta burst stimulation (TBS) applied over different brain regions on CDT scores in patients with Alzheimer's disease (AD). The 10-20 positions F3, F4, T3, T4, TP3, TP4, P3, P4, as determined by a 10-20 positioning cap, were targeted. Excitatory intermittent TBS (iTBS) was given over the above-mentioned eight regions to ten AD patients and ten control subjects on separate days. CDT was administered at baseline (T0), during the 5 min following the TBS (T1) and 60 min after TBS (T2), with an inter-session interval of at least 4 days. iTBS over TP4 and P4 transiently increased Rouleau CDT score in AD patients. When targeting TP4 and P4, mainly the area of the supramarginal/angular gyrus and the inferior parietal lobe, corresponding respectively to the Brodmann areas 40/39 and 7/40, are reached. iTBS thus seems able to modulate activity of the right posterior parietal cortex in AD patients performing the CDT. Our results provide physiological evidence that those parietal regions are functionally important for the execution of the Rouleau CDT. This finding suggests that CDT has reliable neuroanatomical correlates, and support the notion that this test can be used as a good marker of right parietal brain dysfunction. The present study also highlights the therapeutic potential of the induction of neuromodulatory effects using non-invasive brain stimulation techniques.

Color vision

Color is a fundamental aspect of normal visual experience. This chapter provides an overview of the role of color in human behavior, a survey of current knowledge regarding the genetic, retinal, and neural mechanisms that enable color vision, and a review of inherited and acquired defects of color vision including a discussion of diagnostic tests.

Brain Activation During Conceptual Processing of Action and Sound Verbs

Grounded cognition approaches to conceptual representations postulate a close link between conceptual knowledge and the sensorimotor brain systems. The present fMRI study tested, whether a feature-specific representation of concepts, as previously demonstrated for nouns, can also be found for action- and sound-related verbs. Participants were presented with action- and soundrelated verbs along with pseudoverbs while performing a lexical decision task. Sound-related verbs activated auditory areas in the temporal cortex, whereas action-related verbs activated brain regions in the superior frontal gyrus and the cerebellum, albeit only at a more liberal threshold. This differential brain activation during conceptual verb processing partially overlapped with or was adjacent to brain regions activated during the functional localizers probing sound perception or action execution. Activity in brain areas involved in the processing of action information was parametrically modulated by ratings of action relevance. Comparisons of action- and sound-related verbs with pseudoverbs revealed activation for both verb categories in auditory and motor areas. In contrast to proposals of strong grounded cognition approaches, our study did not demonstrate a considerable overlap of activations for action- and sound-related verbs and for the corresponding functional localizer tasks. However, in line with weaker variants of grounded cognition theories, the differential activation pattern for action- and sound-related verbs was near corresponding sensorimotor brain regions depending on conceptual feature relevance. Possibly, action-sound coupling resulted in a mutual activation of the motor and the auditory system for both action- and sound-related verbs, thereby reducing the effect sizes for the differential contrasts.

Task-Dependent Recruitment of Modality-Specific and Multimodal Regions during Conceptual Processing

Conceptual knowledge is central to cognitive abilities such as word comprehension. Previous neuroimaging evidence indicates that concepts are at least partly composed of perceptual and motor features that are represented in the same modality-specific brain regions involved in actual perception and action. However, it is unclear to what extent the retrieval of perceptual-motor features and the resulting engagement of modality-specific regions depend on the concurrent task. To address this issue, we measured brain activity in 40 young and healthy participants using functional magnetic resonance imaging, while they performed three different tasks-lexical decision, sound judgment, and action judgment-on words that independently varied in their association with sounds and actions. We found neural activation for sound and action features of concepts selectively when they were task-relevant in brain regions also activated during auditory and motor tasks, respectively, as well as in higher-level, multimodal regions which were recruited during both sound and action feature retrieval. For the first time, we show that not only modality-specific perceptual-motor areas but also multimodal regions are engaged in conceptual processing in a flexible, task-dependent fashion, responding selectively to task-relevant conceptual features.

Multimodal feature binding in object memory retrieval using event-related potentials: Implications for models of semantic memory

To test the hypothesis that semantic processes are represented in multiple subsystems, we recorded electroencephalogram (EEG) as we elicited object memories using the modified Semantic Object Retrieval Test, during which an object feature, presented as a visual word [VW], an auditory word [AW], or a picture [Pic], was followed by a second feature always presented as a visual word. We performed both hypothesis-driven and data-driven analyses using event-related potentials (ERPs) time locked to the second stimulus. We replicated a previously reported left fronto-temporal ERP effect (750-1000 ms post-stimulus) in the VW task, and also found that this ERP component was only present during object memory retrieval in verbal (VW, AW) as opposed to non-verbal (Pic) stimulus types. We also found a right temporal ERP effect (850-1000 ms post-stimulus) that was present in auditory (AW) but not in visual (VW, Pic) stimulus types. In addition, we found an earlier left temporo-parietal ERP effect between 350 and 700 ms post-stimulus and a later midline parietal ERP effect between 700 and 1100 ms post-stimulus, present in all stimulus types, suggesting common neural mechanisms for object retrieval processes and object activation, respectively. These findings support multiple semantic subsystems that respond to varying stimulus modalities, and argue against an ultimate unitary amodal semantic analysis.

Auditory cortex sensitivity to the loudness attribute of verbs

The auditory cortex was shown to be activated during the processing of words describing actions with acoustic features. The present study further examines whether processing visually presented action words characterized by different levels of loudness, i.e. "loud" (to shout) and "quiet" actions (to whisper), differentially engage the auditory cortex. Twenty healthy participants were measured with magnetoencephalography (MEG) while reading inflected verbs followed by a short tone and semantic tasks. Based on the results of a localizer task, loudness sensitive temporal Brodmann areas A22, A41/42, and pSTS were inspected in the word paradigm. "Loud" actions induced significantly stronger beta power suppression compared to "quiet" actions in the left hemisphere. Smaller N100m amplitude related to tones following "loud" compared to "quiet" actions confirmed that auditory cortex sensitivity was modulated by action words. Results point to possible selective auditory simulation mechanisms involved in verb processing and support embodiment theories.

From action to abstraction: The sensorimotor grounding of metaphor in Parkinson's disease

Embodied cognition theories propose that the semantic representations engaged in during language comprehension are partly supported by perceptual and motor systems, via simulation. Activation in modality-specific regions of cortex is associated with the comprehension of literal language that describes the analogous modalities, but studies addressing the grounding of non-literal or figurative language, such as metaphors, have yielded mixed results. Differences in the psycholinguistic characteristics of sentence stimuli across studies have likely contributed to this lack of consensus. Furthermore, previous studies have been largely correlational, whilst patient studies are a critical way of determining if intact sensorimotor function is necessary to understand language drawing on sensorimotor information. We designed a battery of metaphorical and literal sentence stimuli using action and sound words, with an unprecedented level of control over critical psycholinguistic variables, to test hypotheses about the grounding of metaphorical language. In this Registered Report, we assessed the comprehension of these sentences in 41 patients with Parkinson's disease, who were predicted to be disproportionately affected by the action sentences relative to the sound sentences, and compared their performance to that of 39 healthy age-matched controls who were predicted to show no difference in performance due to sensory modality. Using preregistered Bayesian model comparison methods, we found that PD patients' comprehension of literal action sentences was not impaired, while there was some evidence for a slowing of responses to action metaphors. Follow up exploratory analyses suggest that this response time modality effect was driven by one type of metaphor (predicate) and was absent in another (nominal), despite the fact that the action semantics were similar in both syntactic forms. These results suggest that the conditions under which PD patients demonstrate hypothesized embodiment effects are limited. We offer a critical assessment of the PD action language literature and discuss implications for the embodiment debate. In addition, we suggest how future studies could leverage Bayesian statistical methods to provide more convincing evidence for or against embodied cognition effects.

Distinguishing abstract from concrete concepts in supramodal brain regions

Concrete words have been shown to have a processing advantage over abstract words, yet theoretical accounts and neural correlates underlying the distinction between concrete and abstract concepts are still unresolved. In an fMRI study, participants performed a property verification task on abstract and concrete concepts. Property comparisons of concrete concepts were predominantly based on either visual or haptic features. Multivariate pattern analysis successfully distinguished between abstract and concrete stimulus comparisons at the whole brain level. Multivariate searchlight analyses showed that posterior and middle cingulate cortices contained information that distinguished abstract from concrete concepts regardless of feature dominance. These results support the view that supramodal convergence zones play an important role in representation of concrete and abstract concepts.

Concepts, control, and context: A connectionist account of normal and disordered semantic cognition

Semantic cognition requires conceptual representations shaped by verbal and nonverbal experience and executive control processes that regulate activation of knowledge to meet current situational demands. A complete model must also account for the representation of concrete and abstract words, of taxonomic and associative relationships, and for the role of context in shaping meaning. We present the first major attempt to assimilate all of these elements within a unified, implemented computational framework. Our model combines a hub-and-spoke architecture with a buffer that allows its state to be influenced by prior context. This hybrid structure integrates the view, from cognitive neuroscience, that concepts are grounded in sensory-motor representation with the view, from computational linguistics, that knowledge is shaped by patterns of lexical co-occurrence. The model successfully codes knowledge for abstract and concrete words, associative and taxonomic relationships, and the multiple meanings of homonyms, within a single representational space. Knowledge of abstract words is acquired through (a) their patterns of co-occurrence with other words and (b) acquired embodiment, whereby they become indirectly associated with the perceptual features of co-occurring concrete words. The model accounts for executive influences on semantics by including a controlled retrieval mechanism that provides top-down input to amplify weak semantic relationships. The representational and control elements of the model can be damaged independently, and the consequences of such damage closely replicate effects seen in neuropsychological patients with loss of semantic representation versus control processes. Thus, the model provides a wide-ranging and neurally plausible account of normal and impaired semantic cognition.

For a cognitive neuroscience of concepts: Moving beyond the grounding issue

Cognitive neuroscience research on conceptual knowledge often is discussed with respect to "embodiment" or "grounding." We tried to disentangle at least three distinct claims made using these terms. One of these, the view that concepts are entirely reducible to sensory-motor representations, is untenable and diminishing in the literature. A second is the view that concepts and sensory-motor representations "interact," and a third view addresses the question of how concepts are neurally organized-the neural partitions among concepts of different kinds, and where these partitions are localized in cortex. We argue that towards the second and third issues, much fruitful research can be pursued, but that no position on them is specifically related to "grounding." Furthermore, to move forward on them, it is important to precisely distinguish different kinds of representations-conceptual vs. sensory-motor-from each other theoretically and empirically. Neuroimaging evidence often lacks such specificity. We take an approach that distinguishes conceptual from sensory-motor representations by virtue of two properties: broad generality and tolerance to the absence of sensory-motor associations. We review three of our recent experiments that employ these criteria in order to localize neural representations of several specific kinds of nonsensory attributes: functions, intentions, and belief traits. Building on past work, we find that neuroimaging evidence can be used fruitfully to distinguish interesting hypotheses about neural organization. On the other hand, most such evidence does not speak to any clear notion of "grounding" or "embodiment," because these terms do not make clear, specific, empirical predictions. We argue that cognitive neuroscience will proceed most fruitfully by relinquishing these terms.

Evaluating the roles of left middle frontal gyrus in word production using electrocorticography

To assess the specific roles of left middle frontal gyrus (LMFG) in word production, electrocorticography signals were recorded from an epilepsy patient when he participated in language tasks. We found three sites of LMFG showed high-gamma perturbations with distinct patterns across tasks; and neural activities elicited in the same tasks shared similar patterns, while those elicited by stimuli leading to the same articulations did not. These findings confirmed that the LMFG takes active parts in word production, and suggested that it may serve as a temporal perceptual information storage space, supporting the hierarchical state feedback control model of word production.

When the Wedding March becomes sad: Semantic memory impairment for music in the semantic variant of primary progressive aphasia

Music can induce particular emotions and activate semantic knowledge. In the semantic variant of primary progressive aphasia (svPPA), semantic memory is impaired as a result of anterior temporal lobe (ATL) atrophy. Semantics is responsible for the encoding and retrieval of factual knowledge about music, including associative and emotional attributes. In the present study, we report the performance of two individuals with svPPA in three experiments. NG with bilateral ATL atrophy and ND with atrophy largely restricted to the left ATL. Experiment 1 assessed the recognition of musical excerpts and both patients were unimpaired. Experiment 2 studied the emotions conveyed by music and only NG showed impaired performance. Experiment 3 tested the association of semantic concepts to musical excerpts and both patients were impaired. These results suggest that the right ATL seems essential for the recognition of emotions conveyed by music and that the left ATL is involved in binding music to semantics. They are in line with the notion that the ATLs are devoted to the binding of different modality-specific properties and suggest that they are also differentially involved in the processing of factual and emotional knowledge associated with music.

Does the sound of a barking dog activate its corresponding visual form? An fMRI investigation of modality-specific semantic access

Much remains to be learned about the neural architecture underlying word meaning. Fully distributed models of semantic memory predict that the sound of a barking dog will conjointly engage a network of distributed sensorimotor spokes. An alternative framework holds that modality-specific features additionally converge within transmodal hubs. Participants underwent functional MRI while covertly naming familiar objects versus newly learned novel objects from only one of their constituent semantic features (visual form, characteristic sound, or point-light motion representation). Relative to the novel object baseline, familiar concepts elicited greater activation within association regions specific to the presentation modality. Furthermore, visual form elicited activation within high-level auditory association cortex. Conversely, environmental sounds elicited activation in regions proximal to visual association cortex. Both conditions commonly engaged a putative hub region within lateral anterior temporal cortex. These results support hybrid semantic models in which local hubs and distributed spokes are dually engaged in service of semantic memory.

Encoding and Recognition Processing of Chinese Characters: A Functional Magnetic Resonance Imaging Study

This study aimed to investigate the conceptual memory processes that underlie encoding and recognition processing of Chinese characters. Healthy participants (n = 14) performed a semantic-relatedness paradigm using categorically related logogram pairs from four different categories (fruit, animal, tool, and clothing). During intentional encoding, subjects were instructed to make semantic judgments and select category-correlated features to bind and memorize logogram pairs. During recognition, subjects were asked to recognize the memorized items. The MATLAB software and spatial clustering analysis were used for image data processing. Compared with baseline, encoding mainly activated BA13, with significant effects in BA6/8/9/46/45/47, BA24, BA7/39/40, BA37/20, and BA18/19; meanwhile, recognition mainly activated BA6/8/9/10/13/45/46/47, BA31, BA7/40, and BA18/19. Compared with recognition, encoding activated BA18/19/37/20/36 with a peak activation area in BA18. Compared with encoding, recognition significantly activated BA7, BA31/32, and BA10. In conclusion, distributed networks of discrete cortical regions with distinct roles are active during semantic processing of logograms. The ventral occipitotemporal and inferior frontal regions display increased levels of encoding-related activity. The dorsal medial brain regions, including the superior frontal gyrus and occipitoparietal regions, are associated with recognition-related activity.

Square bananas, blue horses: the relative weight of shape and color in concept recognition and representation

The present study investigates the role that shape and color play in the representation of animate (i.e., animals) and inanimate manipulable entities (i.e., fruits), and how the importance of these features is modulated by different tasks. Across three experiments participants were shown either images of entities (e.g., a sheep or a pineapple) or images of the same entities modified in color (e.g., a blue pineapple) or in shape (e.g., an elongated pineapple). In Experiment 1 we asked participants to categorize the entities as fruit or animal. Results showed that with animals color does not matter, while shape modifications determined a deterioration of the performance - stronger for fruit than for animals. To better understand our findings, in Experiments 2 we asked participants to judge if entities were graspable (manipulation evaluation task). Participants were faster with manipulable entities (fruit) than with animals; moreover alterations in shape affected the response latencies more for animals than for fruit. In Experiment 3 (motion evaluation task), we replicated the disadvantage for shape-altered animals, while with fruits shape and color modifications produced no effect. By contrasting shape- and color- alterations the present findings provide information on shape/color relative weight, suggesting that the action based property of shape is more crucial than color for fruit categorization, while with animals it is critical for both manipulation and motion tasks. This contextual dependency is further revealed by explicit judgments on similarity - between the altered entities and the prototypical ones - provided after the different tasks. These results extend current literature on affordances and biofunctionally embodied understanding, revealing the relative robustness of biofunctional activity compared to intellectual one.

Dissociation in borderline personality disorder: Disturbed cognitive and emotional inhibition and its neural correlates

Evidence is heterogeneous regarding whether patients with borderline personality disorder (BPD) display disturbed emotional inhibition in the emotional Stroop task. Previous findings suggest that state dissociation may influence cognitive inhibition of task-irrelevant material, particularly with negative content. Our aim was to examine performance in an emotional Stroop task including negative, neutral, and positive words in BPD patients and healthy controls during functional magnetic resonance imaging. In advance, half of the BPD patients underwent a dissociation induction using script-driven imagery. BPD patients without dissociation induction showed behavioural performance comparable to that of healthy controls but displayed stronger neural responses, especially to positive stimuli, in the superior temporal gyrus, dorsomedial prefrontal cortex, and anterior cingulate cortex. BPD patients with dissociation induction showed overall slower and less accurate responses as well as increased reaction times for negative versus neutral words compared with BPD patients without dissociation induction. Moreover, they showed comparatively decreased neuronal activity in the fusiform gyrus and parietal cortices independent of valence, but elevated activity in the left inferior frontal gyrus in response to negative versus neutral words. In conclusion, experimentally induced dissociation in BPD was associated with inefficient cognitive inhibition, particularly of negative stimuli, in the emotional Stroop task.

Look Up for Healing: Embodiment of the Heal Concept in Looking Upward

OBJECTIVE

Conceptual processing may not be restricted to the mind. The heal concept has been metaphorically associated with an "up" bodily posture. Perceptual Symbol Systems (PSS) theory suggests that this association is underpinned by bodily states which occur during learning and become instantiated as the concept. Thus the aim of this study was to examine whether processing related to the heal concept is promoted by priming the bodily state of looking upwards.

METHOD

We used a mixed 2x2 priming paradigm in which 58 participants were asked to evaluate words as either related to the heal concept or not after being primed to trigger the concept of looking up versus down (Direction--within subjects). A possible dose-response effect of priming was investigated via allocating participants to two 'strengths' of prime, observing an image of someone whose gaze was upward/downward (low strength) and observing an image of someone whose gaze was upward/downward while physically tilting their head upwards or downwards in accord with the image (high strength) (Strength--between subjects).

RESULTS

Participants responded to words related to heal faster than words unrelated to heal across both "Strength" conditions. There was no evidence that priming was stronger in the high strength condition.

CONCLUSION

The present study found that, consistent with a PSS view of cognition, the heal concept is embodied in looking upward, which has important implications for cognition, general health, health psychology, health promotion and therapy.

Reprint of: Semantic impairment disrupts perception, memory, and naming of secondary but not primary colours

To investigate how basic aspects of perception are shaped by acquired knowledge about the world, we assessed colour perception and cognition in patients with semantic dementia (SD), a disorder that progressively erodes conceptual knowledge. We observed a previously undocumented pattern of impairment to colour perception and cognition characterized by: (i) a normal ability to discriminate between only subtly different colours but an impaired ability to group different colours into categories, (ii) normal perception and memory for the colours red, green, and blue but impaired perception and memory for colours lying between these regions of a fully-saturated and luminant spectrum, and (iii) normal naming of polar colours in the opponent-process colour system (red, green, blue, yellow, white, and black) but impaired naming of other basic colours (brown, gray, pink, and orange). The results suggest that fundamental aspects of perception can be shaped by acquired knowledge about the world, but only within limits.

Demonstration of an ebbinghaus illusion at a memory level: manipulation of the memory size and not the perceptual size

Based on recent behavioral and neuroimaging data suggesting that memory and perception are partially based on the same sensorimotor system, the theoretical aim of the present study was to show that it is difficult to dissociate memory mechanisms from perceptual mechanisms other than on the basis of the presence (perceptual processing) or absence (memory processing) of the characteristics of the objects involved in the processing. In line with this assumption, two experiments using an adaptation of the Ebbinghaus illusion paradigm revealed similar effects irrespective of whether the size difference between the inner circles and the surrounding circles was manipulated perceptually (the size difference was perceptually present, Experiment 1) or merely reactivated in memory (the difference was perceptually absent, Experiment 2).

Semantic impairment disrupts perception, memory, and naming of secondary but not primary colours

To investigate how basic aspects of perception are shaped by acquired knowledge about the world, we assessed colour perception and cognition in patients with semantic dementia (SD), a disorder that progressively erodes conceptual knowledge. We observed a previously undocumented pattern of impairment to colour perception and cognition characterized by: (i) a normal ability to discriminate between only subtly different colours but an impaired ability to group different colours into categories, (ii) normal perception and memory for the colours red, green, and blue but impaired perception and memory for colours lying between these regions of a fully-saturated and luminant spectrum, and (iii) normal naming of polar colours in the opponent-process colour system (red, green, blue, yellow, white, and black) but impaired naming of other basic colours (brown, gray, pink, and orange). The results suggest that fundamental aspects of perception can be shaped by acquired knowledge about the world, but only within limits.

•

Study of colour perception and cognition in patients with semantic dementia.

•

Colour discrimination is normal but categorization is impaired.

•

Patients and controls show opposing accuracy patterns in memory and perception.

•

Naming is more impaired for secondary than primary colours.

Nonmotor aspects of action concepts

Reading an action verb elicits the retrieval of its associated body movements as well as its typical goal-the outcome to which it is directed. Two fMRI experiments are reported in which retrieval of goal attributes was isolated from retrieval of motoric ones by contrasting actions that are either done intentionally (e.g., drink) and thus have associated goal information or by accident (e.g., hiccup). Orthogonally, the actions also varied in their motoricity (e.g., drink vs. imagine). Across both levels of motoricity, goal-directedness influenced the activity of a portion of left posterior inferior parietal lobe (pIPL). These effects were not explicable by the grammatical properties, imageability, or amount of body movement associated with these different types of verbs. In contrast, motoricity (across levels of goal-directedness) activated primarily the left middle temporal gyrus. Furthermore, pIPL was found to be distinct from the portion of left parietal lobe implicated in theory of mind, as localized in the same participants. This is consistent with the observation that pIPL contains many functionally distinct subregions and that some of these support conceptual knowledge. The present findings illustrate that, in particular, the pIPL is involved in representing attributes of intentional actions, likely their typical goals, but not their associated body movements. This result serves to describe an attribute-selective semantic subsystem for at least one type of nonmotor aspect of action knowledge.

Age-related changes in feature-based object memory retrieval as measured by event-related potentials

To investigate neural mechanisms that support semantic functions in aging, we recorded scalp EEG during an object retrieval task in 22 younger and 22 older adults. The task required determining if a particular object could be retrieved when two visual words representing object features were presented. Both age groups had comparable accuracy although response times were longer in older adults. In both groups a left fronto-temporal negative potential occurred at around 750ms during object retrieval, consistent with previous findings (Brier, Maguire, Tillman, Hart, & Kraut, 2008). In only older adults, a later positive frontal potential was found peaking between 800 and 1000ms during no retrieval. These findings suggest younger and older adults employ comparable neural mechanisms when features clearly facilitate retrieval of an object memory, but when features yield no retrieval, older adults use additional neural resources to engage in a more effortful and exhaustive search prior to making a decision.

Lesion symptom mapping of manipulable object naming in nonfluent aphasia: can a brain be both embodied and disembodied?

Embodied cognition offers an approach to word meaning firmly grounded in action and perception. A strong prediction of embodied cognition is that sensorimotor simulation is a necessary component of lexical-semantic representation. One semantic distinction where motor imagery is likely to play a key role involves the representation of manufactured artefacts. Many questions remain with respect to the scope of embodied cognition. One dominant unresolved issue is the extent to which motor enactment is necessary for representing and generating words with high motor salience. We investigated lesion correlates of manipulable relative to nonmanipulable name generation (e.g., name a school supply; name a mountain range) in patients with nonfluent aphasia (N = 14). Lesion volumes within motor (BA4, where BA = Brodmann area) and premotor (BA6) cortices were not predictive of category discrepancies. Lesion symptom mapping linked impairment for manipulable objects to polymodal convergence zones and to projections of the left, primary visual cortex specialized for motion perception (MT/V5+). Lesions to motor and premotor cortex were not predictive of manipulability impairment. This lesion correlation is incompatible with an embodied perspective premised on necessity of motor cortex for the enactment and subsequent production of motor-related words. These findings instead support a graded or "soft" approach to embodied cognition premised on an ancillary role of modality-specific cortical regions in enriching modality-neutral representations. We discuss a dynamic, hybrid approach to the neurobiology of semantic memory integrating both embodied and disembodied components.

The activation of modality-specific representations during discourse processing

Previous research has shown that readers generate mental images of events. Most studies have investigated imagery during the reading of short texts, which also included explicit judgment tasks. In two fMRI studies, we assessed whether modality-specific imagery occurs during naturalistic, discourse comprehension. We identified clauses in the texts that elicited auditory, motor, or visual imagery. In both studies, reading motor imagery clauses was associated with increases in activity in left postcentral and precentral sulci, and reading auditory imagery clauses was associated with increases in left superior temporal gyrus and perisylvian language-related regions. Study 2 compared presentation of connected discourse to a condition in which unconnected sentences were presented, preventing the establishment of global coherence. Sensorimotor imagery was strongest when readers were able to generate a globally coherent discourse representation. Overall, these results suggest that modality-specific imagery occurs during discourse comprehension and it is dependent on the development of discourse-level representations.

Perceptual and motor attribute ratings for 559 object concepts

To understand how and when object knowledge influences the neural underpinnings of language comprehension and linguistic behavior, it is critical to determine the specific kinds of knowledge that people have. To extend the normative data currently available, we report a relatively more comprehensive set of object attribute rating norms for 559 concrete object nouns, each rated on seven attributes corresponding to sensory and motor modalities-color, motion, sound, smell, taste, graspability, and pain-in addition to familiarity (376 raters, M = 23 raters per item). The mean ratings were subjected to principal-components analysis, revealing two primary dimensions plausibly interpreted as relating to survival. We demonstrate the utility of these ratings in accounting for lexical and semantic decision latencies. These ratings should prove useful for the design and interpretation of experimental tests of conceptual and perceptual object processing.

Neural correlates of the components of the clock drawing test

BACKGROUND

The aim of this study was to identify the neural correlates of each component of the clock drawing test (CDT) in drug-naïve patients with Alzheimer's disease (AD) using single photon emission computed tomography.

METHODS

The participants were 95 drug-naïve patients with AD. The Rouleau CDT was used to score the clock drawings. The score for the Rouleau CDT (R total) is separated into three components: the scores for the clock face (R1), the numbers (R2), and the hands (R3). A multiple regression analysis was performed to examine the relationship of each score (i.e. R total, R1, R2, and R3) with regional cerebral blood flow (rCBF). Age, gender, and education were included as covariates. The statistical threshold was set to a family-wise error (FWE)-corrected p value of 0.05 at the voxel level.

RESULTS

The R total score was positively correlated with rCBF in the bilateral parietal and posterior temporal lobes and the right middle frontal gyrus. R1 was not significantly positively correlated with rCBF, R2 was significantly positively correlated with rCBF in the right posterior temporal lobe and the left posterior middle temporal lobe, and R3 was significantly positively correlated with rCBF in the bilateral parietal lobes, the right posterior temporal lobe, the right middle frontal gyrus, and the right occipital lobe.

CONCLUSIONS

Various brain regions were associated with each component of the CDT. These results suggest that an assessment of these components is useful for the detection of localization of brain damage.

The degraded concept representation system in semantic dementia: damage to pan-modal hub, then visual spoke

The core clinical feature of semantic dementia is a progressive yet selective degradation of conceptual knowledge. Understanding the cognitive and neuroanatomical basis for this deficit is a key challenge for both clinical and basic science. Some researchers attribute the deficit to damage to pan-modal conceptual representations that are independent of any particular sensory-motor modality and are represented in the ventrolateral anterior temporal lobes. Others claim that damage to modality-specific visual feature representations in the occipitotemporal 'ventral stream' is responsible. In the present study, we tested the hypothesis that concept degradation in semantic dementia involves a combination of these pan-modal and modality-specific elements. We investigated factors influencing knowledge of object concepts by analysing 43 sets of picture-naming data from patients with semantic dementia. We found a strong influence of two pan-modal factors: highly familiar and typical items were named more accurately than less familiar/atypical items at all stages of the disorder. Items associated with rich sensory-motor information were also named more successfully at all stages, and this effect was present for sound/motion knowledge and tactile/action knowledge when these modalities were studied separately. However, there was no advantage for items rich in visual colour/form characteristics; instead, this factor had an increasingly negative impact in the later stages of the disorder. We propose that these results are best explained by a combination of (i) degradation of modality-independent conceptual representations, which is present throughout the disorder and is a consequence of atrophy focused on the ventrolateral anterior temporal lobes; and (ii) a later additional deficit for concepts that depend heavily on visual colour/form information, caused by the spreading of atrophy to posterior ventral temporal regions specialized for representing this information. This explanation is consistent with a graded hub-and-spoke model of conceptual knowledge, in which there is a gradual convergence of information along the temporal lobes, with visual attributes represented in the posterior cortex giving way to pan-modal representations in the anterior areas.

A meta-analytic review of multisensory imagery identifies the neural correlates of modality-specific and modality-general imagery

The relationship between imagery and mental representations induced through perception has been the subject of philosophical discussion since antiquity and of vigorous scientific debate in the last century. The relatively recent advent of functional neuroimaging has allowed neuroscientists to look for brain-based evidence for or against the argument that perceptual processes underlie mental imagery. Recent investigations of imagery in many new domains and the parallel development of new meta-analytic techniques now afford us a clearer picture of the relationship between the neural processes underlying imagery and perception, and indeed between imagery and other cognitive processes. This meta-analysis surveyed 65 studies investigating modality-specific imagery in auditory, tactile, motor, gustatory, olfactory, and three visual sub-domains: form, color and motion. Activation likelihood estimate (ALE) analyses of activation foci reported within- and across sensorimotor modalities were conducted. The results indicate that modality-specific imagery activations generally overlap with—but are not confined to—corresponding somatosensory processing and motor execution areas, and suggest that there is a core network of brain regions recruited during imagery, regardless of task. These findings have important implications for investigations of imagery and theories of cognitive processes, such as perceptually-based representational systems.

Do semantic categories activate distinct cortical regions? Evidence for a distributed neural semantic system

A key issue in cognitive neuroscience concerns the neural representation of conceptual knowledge. Currently, debate focuses around the issue of whether there are neural regions specialised for the processing of specific semantic attributes or categories, or whether concepts are represented in an undifferentiated neural system. Neuropsychological studies of patients with selective semantic deficits and previous neuroimaging studies do not unequivocally support either account. We carried out a PET study to determine whether there is any regional specialisation for the processing of concepts from different semantic categories using picture stimuli and a semantic categorisation task. We found robust activation of a large semantic network extending from left inferior frontal cortex into the inferior temporal lobe and including occipital cortex and the fusiform gyrus. The only category effect that we found was additional activation for animals in the right occipital cortex, which we interpret as being due to the extra visual processing demands required in order to differentiate one animal from another. We also carried out analyses in specific cortical regions that have been claimed to be preferentially activated for various categories, but found no evidence of any differential activation as a function of category. We interpret these data within the framework of cognitive accounts in which conceptual knowledge is represented within a nondifferentiated distributed system.

Conceptual representations of perceptual knowledge

Many neuroimaging studies of semantic memory have argued that knowledge of an object's perceptual properties are represented in a modality-specific manner. These studies often base their argument on finding activation in the left-hemisphere fusiform gyrus-a region assumed to be involved in perceptual processing-when the participant is verifying verbal statements about objects and properties. In this paper, we report an extension of one of these influential papers-Kan, Barsalou, Solomon, Minor, and Thompson-Schill (2003 )-and present evidence for an amodal component in the representation and processing of perceptual knowledge. Participants were required to verify object-property statements (e.g., "cat-whiskers?"; "bear-wings?") while they were being scanned by functional magnetic resonance imaging (fMRI). We replicated Kan et al.'s activation in the left fusiform gyrus, but also found activation in regions of left inferior frontal gyrus (IFG) and middle-temporal gyrus, areas known to reflect amodal processes or representations. Further, only activations in the left IFG, an amodal area, were correlated with measures of behavioural performance.

Context-dependent changes in functional connectivity of auditory cortices during the perception of object words

Embodied theories hold that cognitive concepts are grounded in our sensorimotor systems. Specifically, a number of behavioral and neuroimaging studies have buttressed the idea that language concepts are represented in areas involved in perception and action [Pulvermueller, F. Brain mechanisms linking language and action. Nature Reviews Neuroscience, 6, 576-582, 2005; Barsalou, L. W. Perceptual symbol systems. Behavioral and Brain Sciences, 22, 577-660, 1999]. Proponents of a strong embodied account argue that activity in perception/action areas is triggered automatically upon encountering a word and reflect static semantic representations. In contrast to what would be expected if lexical semantic representations are automatically triggered upon encountering a word, a number of studies failed to find motor-related activity for words with a putative action-semantic component [Raposo, A., Moss, H. E., Stamatakis, E. A., & Tyler, L. K. Modulation of motor and premotor cortices by actions, action words and action sentences. Neuropsychologia, 47, 388-396, 2009; Rueschemeyer, S.-A., Brass, M., & Friederici, A. D. Comprehending prehending: Neural correlates of processing verbs with motor stems. Journal of Cognitive Neuroscience, 19, 855-865, 2007]. In a recent fMRI study, Van Dam and colleagues [Van Dam, W. O., Van Dijk, M., Bekkering, H., & Rueschemeyer, S.-A. Flexibility in embodied lexical-semantic representations. Human Brain Mapping, in press] showed that the degree to which a modality-specific region contributes to a representation considerably changes as a function of context. In the current study, we presented words for which both motor and visual properties (e.g., tennis ball, boxing glove) were important in constituting the concept. Our aim was to corroborate on earlier findings of flexible and context-dependent language representations by testing whether functional integration between auditory brain regions and perception/action areas is modulated by context. Functional connectivity was investigated by means of a psychophysiological interaction analysis, in which we found that bilateral superior temporal gyrus was more strongly connected with brain regions relevant for coding action information: (1) for Action Color words vs. Abstract words, and (2) for Action Color words presented in a context that emphasized action vs. a context that emphasized color properties.

Multisensory interactions between auditory and haptic object recognition

Object manipulation produces characteristic sounds and causes specific haptic sensations that facilitate the recognition of the manipulated object. To identify the neural correlates of audio-haptic binding of object features, healthy volunteers underwent functional magnetic resonance imaging while they matched a target object to a sample object within and across audition and touch. By introducing a delay between the presentation of sample and target stimuli, it was possible to dissociate haptic-to-auditory and auditory-to-haptic matching. We hypothesized that only semantically coherent auditory and haptic object features activate cortical regions that host unified conceptual object representations. The left fusiform gyrus (FG) and posterior superior temporal sulcus (pSTS) showed increased activation during crossmodal matching of semantically congruent but not incongruent object stimuli. In the FG, this effect was found for haptic-to-auditory and auditory-to-haptic matching, whereas the pSTS only displayed a crossmodal matching effect for congruent auditory targets. Auditory and somatosensory association cortices showed increased activity during crossmodal object matching which was, however, independent of semantic congruency. Together, the results show multisensory interactions at different hierarchical stages of auditory and haptic object processing. Object-specific crossmodal interactions culminate in the left FG, which may provide a higher order convergence zone for conceptual object knowledge.

Differential interference effects of negative emotional states on subsequent semantic and perceptual processing

Past studies have revealed that encountering negative events interferes with cognitive processing of subsequent stimuli. The present study investigates whether negative events affect semantic and perceptual processing differently. Presentation of negative pictures produced slower reaction times than neutral or positive pictures in tasks that require semantic processing, such as natural or man-made judgments about drawings of objects, commonness judgments about objects, and categorical judgments about pairs of words. In contrast, negative picture presentation did not slow down judgments in subsequent perceptual processing (e.g., color judgments about words, size judgments about objects). The subjective arousal level of negative pictures did not modulate the interference effects on semantic or perceptual processing. These findings indicate that encountering negative emotional events interferes with semantic processing of subsequent stimuli more strongly than perceptual processing, and that not all types of subsequent cognitive processing are impaired by negative events.

Connectivity and thought: the influence of semantic network structure in a neurodynamical model of thinking

Understanding cognition has been a central focus for psychologists, neuroscientists and philosophers for thousands of years, but many of its most fundamental processes remain very poorly understood. Chief among these is the process of thought itself: the spontaneous emergence of specific ideas within the stream of consciousness. It is widely accepted that ideas, both familiar and novel, arise from the combination of existing concepts. From this perspective, thought is an emergent attribute of memory, arising from the intrinsic dynamics of the neural substrate in which information is embedded. An important issue in any understanding of this process is the relationship between the emergence of conceptual combinations and the dynamics of the underlying neural networks. Virtually all theories of ideation hypothesize that ideas arise during the thought process through association, each one triggering the next through some type of linkage, e.g., structural analogy, semantic similarity, polysemy, etc. In particular, it has been suggested that the creativity of ideation in individuals reflects the qualitative structure of conceptual associations in their minds. Interestingly, psycholinguistic studies have shown that semantic networks across many languages have a particular type of structure with small-world, scale free connectivity. So far, however, these related insights have not been brought together, in part because there has been no explicitly neural model for the dynamics of spontaneous thought. Recently, we have developed such a model. Though simplistic and abstract, this model attempts to capture the most basic aspects of the process hypothesized by theoretical models within a neurodynamical framework. It represents semantic memory as a recurrent semantic neural network with itinerant dynamics. Conceptual combinations arise through this dynamics as co-active groups of neural units, and either dissolve quickly or persist for a time as emergent metastable attractors and are recognized consciously as ideas. The work presented in this paper describes this model in detail, and uses it to systematically study the relationship between the structure of conceptual associations in the neural substrate and the ideas arising from this system's dynamics. In particular, we consider how the small-world and scale-free characteristics influence the effectiveness of the thought process under several metrics, and show that networks with both attributes indeed provide significant advantages in generating unique conceptual combinations.

The interaction between surface color and color knowledge: behavioral and electrophysiological evidence

In this study, we used event-related potentials (ERPs) to evaluate the contribution of surface color and color knowledge information in object identification. We constructed two color-object verification tasks - a surface and a knowledge verification task - using high color diagnostic objects; both typical and atypical color versions of the same object were presented. Continuous electroencephalogram was recorded from 26 subjects. A cluster randomization procedure was used to explore the differences between typical and atypical color objects in each task. In the color knowledge task, we found two significant clusters that were consistent with the N350 and late positive complex (LPC) effects. Atypical color objects elicited more negative ERPs compared to typical color objects. The color effect found in the N350 time window suggests that surface color is an important cue that facilitates the selection of a stored object representation from long-term memory. Moreover, the observed LPC effect suggests that surface color activates associated semantic knowledge about the object, including color knowledge representations. We did not find any significant differences between typical and atypical color objects in the surface color verification task, which indicates that there is little contribution of color knowledge to resolve the surface color verification. Our main results suggest that surface color is an important visual cue that triggers color knowledge, thereby facilitating object identification.

Flexibility in embodied lexical-semantic representations

According to an embodied view of language comprehension, language concepts are grounded in our perceptual systems. Evidence for the idea that concepts are grounded in areas involved in action and perception comes from both behavioral and neuroimaging studies (Glenberg [1997]: Behav Brain Sci 20:1-55; Barsalou [1999]: Behav Brain Sci 22:577-660; Pulvermueller [1999]: Behav Brain Sci 22:253-336; Barsalou et al. [2003]: Trends Cogn Sci 7:84-91). However, the results from several studies indicate that the activation of information in perception and action areas is not a purely automatic process (Raposo et al. [2009]: Neuropsychologia 47:388-396; Rueschemeyer et al. [2007]: J Cogn Neurosci 19:855-865). These findings suggest that embodied representations are flexible. In these studies, flexibility is characterized by the relative presence or absence of activation in our perceptual systems. However, even if the context in which a word is presented does not undermine a motor interpretation, it is possible that the degree to which a modality-specific region contributes to a representation depends on the context in which conceptual features are retrieved. In the present study, we investigated this issue by presenting word stimuli for which both motor and visual properties (e.g., Tennis ball, Boxing glove) were important in constituting the concept. Conform with the idea that language representations are flexible and context dependent, we demonstrate that the degree to which a modality-specific region contributes to a representation considerably changes as a function of context.

Contextual modulation of reading rate for direct versus indirect speech quotations

In human communication, direct speech (e.g., Mary said: "I'm hungry") is perceived to be more vivid than indirect speech (e.g., Mary said [that] she was hungry). However, the processing consequences of this distinction are largely unclear. In two experiments, participants were asked to either orally (Experiment 1) or silently (Experiment 2, eye-tracking) read written stories that contained either a direct speech or an indirect speech quotation. The context preceding those quotations described a situation that implied either a fast-speaking or a slow-speaking quoted protagonist. It was found that this context manipulation affected reading rates (in both oral and silent reading) for direct speech quotations, but not for indirect speech quotations. This suggests that readers are more likely to engage in perceptual simulations of the reported speech act when reading direct speech as opposed to meaning-equivalent indirect speech quotations, as part of a more vivid representation of the former.

Anomia as a marker of distinct semantic memory impairments in Alzheimer's disease and semantic dementia

OBJECTIVE

Many neurologically constrained models of semantic memory have been informed by two primary temporal lobe pathologies: Alzheimer's disease (AD) and Semantic Dementia (SD). However, controversy persists regarding the nature of the semantic impairment associated with these patient populations. Some argue that AD presents as a disconnection syndrome in which linguistic impairment reflects difficulties in lexical or perceptual means of semantic access. In contrast, there is a wider consensus that SD reflects loss of core knowledge that underlies word and object meaning. Object naming provides a window into the integrity of semantic knowledge in these two populations.

METHOD

We examined naming accuracy, errors and the correlation of naming ability with neuropsychological measures (semantic ability, executive functioning, and working memory) in a large sample of patients with AD (n = 36) and SD (n = 21).

RESULTS

Naming ability and naming errors differed between groups, as did neuropsychological predictors of naming ability. Despite a similar extent of baseline cognitive impairment, SD patients were more anomic than AD patients.

CONCLUSIONS

These results add to a growing body of literature supporting a dual impairment to semantic content and active semantic processing in AD, and confirm the fundamental deficit in semantic content in SD. We interpret these findings as supporting of a model of semantic memory premised upon dynamic interactivity between the process and content of conceptual knowledge.