1
|
Krieger-Redwood K, Wang X, Souter N, Gonzalez Alam TRDJ, Smallwood J, Jackson RL, Jefferies E. Graded and sharp transitions in semantic function in left temporal lobe. BRAIN AND LANGUAGE 2024; 251:105402. [PMID: 38484446 DOI: 10.1016/j.bandl.2024.105402] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 02/23/2024] [Accepted: 03/05/2024] [Indexed: 04/02/2024]
Abstract
Recent work has focussed on how patterns of functional change within the temporal lobe relate to whole-brain dimensions of intrinsic connectivity variation (Margulies et al., 2016). We examined two such 'connectivity gradients' reflecting the separation of (i) unimodal versus heteromodal and (ii) visual versus auditory-motor cortex, examining visually presented verbal associative and feature judgments, plus picture-based context and emotion generation. Functional responses along the first dimension sometimes showed graded change between modality-tuned and heteromodal cortex (in the verbal matching task), and other times showed sharp functional transitions, with deactivation at the extremes and activation in the middle of this gradient (internal generation). The second gradient revealed more visual than auditory-motor activation, regardless of content (associative, feature, context, emotion) or task process (matching/generation). We also uncovered subtle differences across each gradient for content type, which predominantly manifested as differences in relative magnitude of activation or deactivation.
Collapse
Affiliation(s)
- Katya Krieger-Redwood
- Department of Psychology, York Neuroimaging Centre, York Biomedical Research Institute, University of York, United Kingdom
| | - Xiuyi Wang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China; Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Nicholas Souter
- Department of Psychology, York Neuroimaging Centre, York Biomedical Research Institute, University of York, United Kingdom; School of Psychology, University of Sussex, Brighton, United Kingdom
| | | | | | - Rebecca L Jackson
- Department of Psychology, York Neuroimaging Centre, York Biomedical Research Institute, University of York, United Kingdom
| | - Elizabeth Jefferies
- Department of Psychology, York Neuroimaging Centre, York Biomedical Research Institute, University of York, United Kingdom.
| |
Collapse
|
2
|
Noguchi Y. Harmonic memory signals in the human cerebral cortex induced by semantic relatedness of words. NPJ SCIENCE OF LEARNING 2024; 9:6. [PMID: 38355685 PMCID: PMC10866900 DOI: 10.1038/s41539-024-00221-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 02/05/2024] [Indexed: 02/16/2024]
Abstract
When we memorize multiple words simultaneously, semantic relatedness among those words assists memory. For example, the information about "apple", "banana," and "orange" will be connected via a common concept of "fruits" and become easy to retain and recall. Neural mechanisms underlying this semantic integration in verbal working memory remain unclear. Here I used electroencephalography (EEG) and investigated neural signals when healthy human participants memorized five nouns semantically related (Sem trial) or not (NonSem trial). The regularity of oscillatory signals (8-30 Hz) during the retention period was found to be lower in NonSem than Sem trials, indicating that memorizing words unrelated to each other induced a non-harmonic (irregular) waveform in the temporal cortex. These results suggest that (i) semantic features of a word are retained as a set of neural oscillations at specific frequencies and (ii) memorizing words sharing a common semantic feature produces harmonic brain responses through a resonance or integration (sharing) of the oscillatory signals.
Collapse
Affiliation(s)
- Yasuki Noguchi
- Department of Psychology, Graduate School of Humanities, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe, 657-8501, Japan.
| |
Collapse
|
3
|
Liuzzi AG, Meersmans K, Peeters R, De Deyne S, Dupont P, Vandenberghe R. Semantic representations in inferior frontal and lateral temporal cortex during picture naming, reading, and repetition. Hum Brain Mapp 2024; 45:e26603. [PMID: 38339900 PMCID: PMC10836176 DOI: 10.1002/hbm.26603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/06/2023] [Revised: 12/12/2023] [Accepted: 01/09/2024] [Indexed: 02/12/2024] Open
Abstract
Reading, naming, and repetition are classical neuropsychological tasks widely used in the clinic and psycholinguistic research. While reading and repetition can be accomplished by following a direct or an indirect route, pictures can be named only by means of semantic mediation. By means of fMRI multivariate pattern analysis, we evaluated whether this well-established fundamental difference at the cognitive level is associated at the brain level with a difference in the degree to which semantic representations are activated during these tasks. Semantic similarity between words was estimated based on a word association model. Twenty subjects participated in an event-related fMRI study where the three tasks were presented in pseudo-random order. Linear discriminant analysis of fMRI patterns identified a set of regions that allow to discriminate between words at a high level of word-specificity across tasks. Representational similarity analysis was used to determine whether semantic similarity was represented in these regions and whether this depended on the task performed. The similarity between neural patterns of the left Brodmann area 45 (BA45) and of the superior portion of the left supramarginal gyrus correlated with the similarity in meaning between entities during picture naming. In both regions, no significant effects were seen for repetition or reading. The semantic similarity effect during picture naming was significantly larger than the similarity effect during the two other tasks. In contrast, several regions including left anterior superior temporal gyrus and left ventral BA44/frontal operculum, among others, coded for semantic similarity in a task-independent manner. These findings provide new evidence for the dynamic, task-dependent nature of semantic representations in the left BA45 and a more task-independent nature of the representational activation in the lateral temporal cortex and ventral BA44/frontal operculum.
Collapse
Affiliation(s)
- Antonietta Gabriella Liuzzi
- Laboratory for Cognitive Neurology, Department of NeurosciencesLeuven Brain Institute, KU LeuvenLeuvenBelgium
| | - Karen Meersmans
- Laboratory for Cognitive Neurology, Department of NeurosciencesLeuven Brain Institute, KU LeuvenLeuvenBelgium
| | - Ronald Peeters
- Radiology DepartmentUniversity Hospitals LeuvenLeuvenBelgium
| | - Simon De Deyne
- School of Psychological SciencesUniversity of MelbourneMelbourneAustralia
| | - Patrick Dupont
- Laboratory for Cognitive Neurology, Department of NeurosciencesLeuven Brain Institute, KU LeuvenLeuvenBelgium
| | - Rik Vandenberghe
- Laboratory for Cognitive Neurology, Department of NeurosciencesLeuven Brain Institute, KU LeuvenLeuvenBelgium
- Neurology DepartmentUniversity Hospitals LeuvenLeuvenBelgium
| |
Collapse
|
4
|
Adezati E, Liu X, Ding J, Thye M, Szaflarski JP, Mirman D. Phase synchronization during the processing of taxonomic and thematic relations. BRAIN AND LANGUAGE 2024; 249:105379. [PMID: 38241856 DOI: 10.1016/j.bandl.2024.105379] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Revised: 12/20/2023] [Accepted: 01/06/2024] [Indexed: 01/21/2024]
Abstract
Semantic relations include "taxonomic" relations based on shared features and "thematic" relations based on co-occurrence in events. The "dual-hub" account proposes that the anterior temporal lobe (ATL) is functionally specialized for taxonomic relations and the inferior parietal lobule (IPL) for thematic relations. This study examined this claim by analyzing the intra- and inter-region phase synchronization of intracranial EEG data from electrodes in the ATL, IPL, and two subregions of the semantic control network: left inferior frontal gyrus (IFG) and posterior middle temporal gyrus (pMTG). Ten participants with epilepsy completed a semantic relatedness judgment task during intracranial EEG recording and had electrodes in at least one hub and at least one semantic control region. Theta band phase synchronization was partially consistent with the dual-hub account: synchronization between the ATL and IFG/pMTG increased when processing taxonomic relations, and synchronization within the IPL and between IPL and pMTG increased when processing thematic relations.
Collapse
Affiliation(s)
- Erica Adezati
- Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Xianqing Liu
- Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Junhua Ding
- Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Melissa Thye
- Department of Psychology, University of Edinburgh, Edinburgh, UK
| | - Jerzy P Szaflarski
- Department of Neurology and the University of Alabama at Birmingham (UAB) Epilepsy Center, University of Alabama at Birmingham, Birmingham, AL 35294, USA
| | - Daniel Mirman
- Department of Psychology, University of Edinburgh, Edinburgh, UK.
| |
Collapse
|
5
|
Zhang Y, Wu W, Mirman D, Hoffman P. Representation of event and object concepts in ventral anterior temporal lobe and angular gyrus. Cereb Cortex 2024; 34:bhad519. [PMID: 38185997 PMCID: PMC10839851 DOI: 10.1093/cercor/bhad519] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2023] [Revised: 12/07/2023] [Accepted: 12/08/2023] [Indexed: 01/09/2024] Open
Abstract
Semantic knowledge includes understanding of objects and their features and also understanding of the characteristics of events. The hub-and-spoke theory holds that these conceptual representations rely on multiple information sources that are integrated in a central hub in the ventral anterior temporal lobes. The dual-hub theory expands this framework with the claim that the ventral anterior temporal lobe hub is specialized for object representation, while a second hub in angular gyrus is specialized for event representation. To test these ideas, we used representational similarity analysis, univariate and psychophysiological interaction analyses of fMRI data collected while participants processed object and event concepts (e.g. "an apple," "a wedding") presented as images and written words. Representational similarity analysis showed that angular gyrus encoded event concept similarity more than object similarity, although the left angular gyrus also encoded object similarity. Bilateral ventral anterior temporal lobes encoded both object and event concept structure, and left ventral anterior temporal lobe exhibited stronger coding for events. Psychophysiological interaction analysis revealed greater connectivity between left ventral anterior temporal lobe and right pMTG, and between right angular gyrus and bilateral ITG and middle occipital gyrus, for event concepts compared to object concepts. These findings support the specialization of angular gyrus for event semantics, though with some involvement in object coding, but do not support ventral anterior temporal lobe specialization for object concepts.
Collapse
Affiliation(s)
- Yueyang Zhang
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Wei Wu
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Daniel Mirman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| | - Paul Hoffman
- School of Philosophy, Psychology & Language Sciences, University of Edinburgh, Edinburgh EH8 9JZ, United Kingdom
| |
Collapse
|
6
|
Orepic P, Truccolo W, Halgren E, Cash SS, Giraud AL, Proix T. Neural manifolds carry reactivation of phonetic representations during semantic processing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.10.30.564638. [PMID: 37961305 PMCID: PMC10634964 DOI: 10.1101/2023.10.30.564638] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/15/2023]
Abstract
Traditional models of speech perception posit that neural activity encodes speech through a hierarchy of cognitive processes, from low-level representations of acoustic and phonetic features to high-level semantic encoding. Yet it remains unknown how neural representations are transformed across levels of the speech hierarchy. Here, we analyzed unique microelectrode array recordings of neuronal spiking activity from the human left anterior superior temporal gyrus, a brain region at the interface between phonetic and semantic speech processing, during a semantic categorization task and natural speech perception. We identified distinct neural manifolds for semantic and phonetic features, with a functional separation of the corresponding low-dimensional trajectories. Moreover, phonetic and semantic representations were encoded concurrently and reflected in power increases in the beta and low-gamma local field potentials, suggesting top-down predictive and bottom-up cumulative processes. Our results are the first to demonstrate mechanisms for hierarchical speech transformations that are specific to neuronal population dynamics.
Collapse
Affiliation(s)
- Pavo Orepic
- Department of Basic Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| | - Wilson Truccolo
- Department of Neuroscience, Brown University, Providence, Rhode Island, United States of America
- Carney Institute for Brain Science, Brown University, Providence, Rhode Island, United States of America
| | - Eric Halgren
- Department of Neuroscience & Radiology, University of California San Diego, La Jolla, California, United States of America
| | - Sydney S Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, United States of America
| | - Anne-Lise Giraud
- Department of Basic Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
- Institut Pasteur, Université Paris Cité, Hearing Institute, Paris, France
| | - Timothée Proix
- Department of Basic Neurosciences, Faculty of Medicine, University of Geneva, Geneva, Switzerland
| |
Collapse
|
7
|
Ghazaryan G, van Vliet M, Lammi L, Lindh-Knuutila T, Kivisaari S, Hultén A, Salmelin R. Cortical time-course of evidence accumulation during semantic processing. Commun Biol 2023; 6:1242. [PMID: 38066098 PMCID: PMC10709650 DOI: 10.1038/s42003-023-05611-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2022] [Accepted: 11/20/2023] [Indexed: 12/18/2023] Open
Abstract
Our understanding of the surrounding world and communication with other people are tied to mental representations of concepts. In order for the brain to recognize an object, it must determine which concept to access based on information available from sensory inputs. In this study, we combine magnetoencephalography and machine learning to investigate how concepts are represented and accessed in the brain over time. Using brain responses from a silent picture naming task, we track the dynamics of visual and semantic information processing, and show that the brain gradually accumulates information on different levels before eventually reaching a plateau. The timing of this plateau point varies across individuals and feature models, indicating notable temporal variation in visual object recognition and semantic processing.
Collapse
Affiliation(s)
- Gayane Ghazaryan
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland.
| | - Marijn van Vliet
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
| | - Lotta Lammi
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
| | - Tiina Lindh-Knuutila
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
| | - Sasa Kivisaari
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
| | - Annika Hultén
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
- Aalto NeuroImaging, Aalto University, P.O. Box 12200, Aalto, FI-00076, Finland
| | - Riitta Salmelin
- Department of Neuroscience and Biomedical Engineering, Aalto University, P.O. Box 12200, FI-00076, Aalto, Finland
- Aalto NeuroImaging, Aalto University, P.O. Box 12200, Aalto, FI-00076, Finland
| |
Collapse
|
8
|
von Seth J, Nicholls VI, Tyler LK, Clarke A. Recurrent connectivity supports higher-level visual and semantic object representations in the brain. Commun Biol 2023; 6:1207. [PMID: 38012301 PMCID: PMC10682037 DOI: 10.1038/s42003-023-05565-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2023] [Accepted: 11/09/2023] [Indexed: 11/29/2023] Open
Abstract
Visual object recognition has been traditionally conceptualised as a predominantly feedforward process through the ventral visual pathway. While feedforward artificial neural networks (ANNs) can achieve human-level classification on some image-labelling tasks, it's unclear whether computational models of vision alone can accurately capture the evolving spatiotemporal neural dynamics. Here, we probe these dynamics using a combination of representational similarity and connectivity analyses of fMRI and MEG data recorded during the recognition of familiar, unambiguous objects. Modelling the visual and semantic properties of our stimuli using an artificial neural network as well as a semantic feature model, we find that unique aspects of the neural architecture and connectivity dynamics relate to visual and semantic object properties. Critically, we show that recurrent processing between the anterior and posterior ventral temporal cortex relates to higher-level visual properties prior to semantic object properties, in addition to semantic-related feedback from the frontal lobe to the ventral temporal lobe between 250 and 500 ms after stimulus onset. These results demonstrate the distinct contributions made by semantic object properties in explaining neural activity and connectivity, highlighting it as a core part of object recognition not fully accounted for by current biologically inspired neural networks.
Collapse
Affiliation(s)
- Jacqueline von Seth
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | | | - Lorraine K Tyler
- Department of Psychology, University of Cambridge, Cambridge, UK
- Cambridge Centre for Ageing and Neuroscience (Cam-CAN), University of Cambridge and MRC Cognition and Brain Sciences Unit, Cambridge, UK
| | - Alex Clarke
- Department of Psychology, University of Cambridge, Cambridge, UK.
| |
Collapse
|
9
|
Bonnì S, Borghi I, Maiella M, Casula EP, Koch G, Caltagirone C, Gainotti G. Transcranial Direct Current Stimulation Effects on the Neural Substrate of Conceptual Representations. Brain Sci 2023; 13:1037. [PMID: 37508969 PMCID: PMC10376965 DOI: 10.3390/brainsci13071037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/09/2023] [Revised: 07/03/2023] [Accepted: 07/04/2023] [Indexed: 07/30/2023] Open
Abstract
The aim of this study was to shed light on the neural substrate of conceptual representations starting from the construct of higher-order convergence zones and trying to evaluate the unitary or non-unitary nature of this construct. We used the 'Thematic and Taxonomic Semantic (TTS) task' to investigate (a) the neural substrate of stimuli belonging to biological and artifact categories, (b) the format of stimuli presentation, i.e., verbal or pictorial, and (c) the relation between stimuli, i.e., categorial or contextual. We administered anodal transcranial direct current stimulation (tDCS) to different brain structures during the execution of the TTS task. Twenty healthy participants were enrolled and divided into two groups, one investigating the role of the anterior temporal lobes (ATL) and the other the temporo-parietal junctions (TPJ). Each participant underwent three sessions of stimulation to facilitate a control condition and to investigate the role of both hemispheres. Results showed that ATL stimulation influenced all conceptual representations in relation to the format of presentation (i.e., left-verbal and right-pictorial). Moreover, ATL stimulation modulated living categories and taxonomic relations specifically, whereas TPJ stimulation did not influence semantic task performances.
Collapse
Affiliation(s)
- Sonia Bonnì
- Non-Invasive Brain Stimulation Unit, Department of Behavioral and Clinical Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
| | - Ilaria Borghi
- Non-Invasive Brain Stimulation Unit, Department of Behavioral and Clinical Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
- Section of Human Physiology, University of Ferrara, 44121 Ferrara, Italy
| | - Michele Maiella
- Non-Invasive Brain Stimulation Unit, Department of Behavioral and Clinical Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
| | - Elias Paolo Casula
- Non-Invasive Brain Stimulation Unit, Department of Behavioral and Clinical Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
- Department of Systems Medicine, University of Rome Tor Vergata, 00133 Rome, Italy
| | - Giacomo Koch
- Non-Invasive Brain Stimulation Unit, Department of Behavioral and Clinical Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
- Section of Human Physiology, University of Ferrara, 44121 Ferrara, Italy
| | - Carlo Caltagirone
- Department of Systems Medicine, University of Rome Tor Vergata, 00133 Rome, Italy
- Department of Clinical and Behavioral Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
| | - Guido Gainotti
- Department of Clinical and Behavioral Neurology, Fondazione Santa Lucia IRCCS, 00179 Rome, Italy
- Institute of Neurology, Catholic University of the Sacred Heart, 00168 Rome, Italy
| |
Collapse
|
10
|
Usami K, Matsumoto R, Korzeniewska A, Shimotake A, Matsuhashi M, Nakae T, Kikuchi T, Yoshida K, Kunieda T, Takahashi R, Crone NE, Ikeda A. The dynamics of cortical interactions in visual recognition of object category: living versus nonliving. Cereb Cortex 2023; 33:5740-5750. [PMID: 36408645 PMCID: PMC10152084 DOI: 10.1093/cercor/bhac456] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 10/23/2022] [Accepted: 10/24/2022] [Indexed: 11/22/2022] Open
Abstract
Noninvasive brain imaging studies have shown that higher visual processing of objects occurs in neural populations that are separable along broad semantic categories, particularly living versus nonliving objects. However, because of their limited temporal resolution, these studies have not been able to determine whether broad semantic categories are also reflected in the dynamics of neural interactions within cortical networks. We investigated the time course of neural propagation among cortical areas activated during object naming in 12 patients implanted with subdural electrode grids prior to epilepsy surgery, with a special focus on the visual recognition phase of the task. Analysis of event-related causality revealed significantly stronger neural propagation among sites within ventral temporal lobe (VTL) at early latencies, around 250 ms, for living objects compared to nonliving objects. Differences in other features, including familiarity, visual complexity, and age of acquisition, did not significantly change the patterns of neural propagation. Our findings suggest that the visual processing of living objects relies on stronger causal interactions among sites within VTL, perhaps reflecting greater integration of visual feature processing. In turn, this may help explain the fragility of naming living objects in neurological diseases affecting VTL.
Collapse
Affiliation(s)
- Kiyohide Usami
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Riki Matsumoto
- Division of Neurology, Kobe University Graduate School of Medicine, Kobe 650-0017, Japan
| | - Anna Korzeniewska
- Department of Neurology, Johns Hopkins University School of Medicine, MD 21287, United States
| | - Akihiro Shimotake
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Masao Matsuhashi
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Takuro Nakae
- Department of Neurosurgery, Shiga General Hospital, Moriyama 524-8524, Japan
| | - Takayuki Kikuchi
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Kazumichi Yoshida
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Takeharu Kunieda
- Department of Neurosurgery, Ehime University Graduate School of Medicine, Toon 791-0295, Japan
| | - Ryosuke Takahashi
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Nathan E Crone
- Department of Neurology, Johns Hopkins University School of Medicine, MD 21287, United States
| | - Akio Ikeda
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| |
Collapse
|
11
|
Delhaye E, Coco MI, Bahri MA, Raposo A. Typicality in the brain during semantic and episodic memory decisions. Neuropsychologia 2023; 184:108529. [PMID: 36898662 DOI: 10.1016/j.neuropsychologia.2023.108529] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2022] [Revised: 11/25/2022] [Accepted: 03/02/2023] [Indexed: 03/11/2023]
Abstract
Concept typicality is a key semantic dimension supporting the categorical organization of items based on their features, such that typical items share more features with other members of their category than atypical items, which are more distinctive. Typicality effects manifest in better accuracy and faster response times during categorization tasks, but higher performance for atypical items in episodic memory tasks, due to their distinctiveness. At a neural level, typicality has been linked to the anterior temporal lobe (ATL) and the inferior frontal gyrus (IFG) in semantic decision tasks, but patterns of brain activity during episodic memory tasks remain to be understood. We investigated the neural correlates of typicality in semantic and episodic memory to determine the brain regions associated with semantic typicality and uncover effects arising when items are reinstated during retrieval. In an fMRI study, 26 healthy young subjects first performed a category verification task on words representing typical and atypical concepts (encoding), and then completed a recognition memory task (retrieval). In line with previous literature, we observed higher accuracy and faster response times for typical items in the category verification task, while atypical items were better recognized in the episodic memory task. During category verification, univariate analyses revealed a greater involvement of the angular gyrus for typical items and the inferior frontal gyrus for atypical items. During the correct recognition of old items, regions belonging to the core recollection network were activated. We then compared the similarity of the representations from encoding to retrieval (ERS) using Representation Similarity Analyses. Results showed that typical items were reinstated more than atypical ones in several regions including the left precuneus and left anterior temporal lobe (ATL). This suggests that the correct retrieval of typical items requires finer-grained processing, evidenced by greater item-specific reinstatement, which is needed to resolve their confusability with other members of the category due to their higher feature similarity. Our findings confirm the centrality of the ATL in the processing of typicality while extending it to memory retrieval.
Collapse
Affiliation(s)
- Emma Delhaye
- GIGA-CRC IVI, Liege University, Belgium; CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Portugal.
| | - Moreno I Coco
- CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Portugal; Department of Psychology, Sapienza, University of Rome, Italy; IRCCS Santa Lucia, Rome, Italy
| | | | - Ana Raposo
- CICPSI, Faculdade de Psicologia, Universidade de Lisboa, Portugal
| |
Collapse
|
12
|
Jung J, Lambon Ralph MA. Distinct but cooperating brain networks supporting semantic cognition. Cereb Cortex 2023; 33:2021-2036. [PMID: 35595542 PMCID: PMC9977382 DOI: 10.1093/cercor/bhac190] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2021] [Revised: 04/25/2022] [Accepted: 04/07/2022] [Indexed: 02/02/2023] Open
Abstract
Semantic cognition is a complex multifaceted brain function involving multiple processes including sensory, semantic, and domain-general cognitive systems. However, it remains unclear how these systems cooperate with each other to achieve effective semantic cognition. Here, we used independent component analysis (ICA) to investigate the functional brain networks that support semantic cognition. We used a semantic judgment task and a pattern-matching control task, each with 2 levels of difficulty, to disentangle task-specific networks from domain-general networks. ICA revealed 2 task-specific networks (the left-lateralized semantic network [SN] and a bilateral, extended semantic network [ESN]) and domain-general networks including the frontoparietal network (FPN) and default mode network (DMN). SN was coupled with the ESN and FPN but decoupled from the DMN, whereas the ESN was synchronized with the FPN alone and did not show a decoupling with the DMN. The degree of decoupling between the SN and DMN was associated with semantic task performance, with the strongest decoupling for the poorest performing participants. Our findings suggest that human higher cognition is achieved by the multiple brain networks, serving distinct and shared cognitive functions depending on task demands, and that the neural dynamics between these networks may be crucial for efficient semantic cognition.
Collapse
Affiliation(s)
- JeYoung Jung
- School of Psychology, University of Nottingham, Nottingham NG7 2RD, United Kingdom
| | - Matthew A Lambon Ralph
- MRC Cognition and Brain Science Unit (CBU), University of Cambridge, Cambridge, CB2 7EF United Kingdom
| |
Collapse
|
13
|
Leisman G. On the Application of Developmental Cognitive Neuroscience in Educational Environments. Brain Sci 2022; 12:1501. [PMID: 36358427 PMCID: PMC9688360 DOI: 10.3390/brainsci12111501] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2022] [Revised: 10/25/2022] [Accepted: 11/01/2022] [Indexed: 09/29/2023] Open
Abstract
The paper overviews components of neurologic processing efficiencies to develop innovative methodologies and thinking to school-based applications and changes in educational leadership based on sound findings in the cognitive neurosciences applied to schools and learners. Systems science can allow us to better manage classroom-based learning and instruction on the basis of relatively easily evaluated efficiencies or inefficiencies and optimization instead of simply examining achievement. "Medicalizing" the learning process with concepts such as "learning disability" or employing grading methods such as pass-fail does little to aid in understanding the processes that learners employ to acquire, integrate, remember, and apply information learned. The paper endeavors to overview and provided reference to tools that can be employed that allow a better focus on nervous system-based strategic approaches to classroom learning.
Collapse
Affiliation(s)
- Gerry Leisman
- Movement and Cognition Laboratory, Department of Physical Therapy, University of Haifa, Haifa 3498838, Israel; or
- Department of Neurology, Universidad de Ciencias Médicas de la Habana, Havana 11300, Cuba
| |
Collapse
|
14
|
Farahibozorg SR, Henson RN, Woollams AM, Hauk O. Distinct roles for the anterior temporal lobe and angular gyrus in the spatiotemporal cortical semantic network. Cereb Cortex 2022; 32:4549-4564. [PMID: 35094061 PMCID: PMC9574238 DOI: 10.1093/cercor/bhab501] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2021] [Revised: 11/13/2021] [Accepted: 11/14/2021] [Indexed: 11/30/2022] Open
Abstract
Semantic knowledge is supported by numerous brain regions, but the spatiotemporal configuration of the network that links these areas remains an open question. The hub-and-spokes model posits that a central semantic hub coordinates this network. In this study, we explored distinct aspects that define a semantic hub, as reflected in the spatiotemporal modulation of neural activity and connectivity by semantic variables, from the earliest stages of semantic processing. We used source-reconstructed electro/magnetoencephalography, and investigated the concreteness contrast across three tasks. In a whole-cortex analysis, the left anterior temporal lobe (ATL) was the only area that showed modulation of evoked brain activity from 100 ms post-stimulus. Furthermore, using Dynamic Causal Modeling of the evoked responses, we investigated effective connectivity amongst the candidate semantic hub regions, that is, left ATL, supramarginal/angular gyrus (SMG/AG), middle temporal gyrus, and inferior frontal gyrus. We found that models with a single semantic hub showed the highest Bayesian evidence, and the hub region was found to change from ATL (within 250 ms) to SMG/AG (within 450 ms) over time. Our results support a single semantic hub view, with ATL showing sustained modulation of neural activity by semantics, and both ATL and AG underlying connectivity depending on the stage of semantic processing.
Collapse
Affiliation(s)
- Seyedeh-Rezvan Farahibozorg
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, UK.,Wellcome Centre for Integrative Neuroimaging, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, OX3 9DU, UK
| | - Richard N Henson
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, UK.,Department of Psychiatry, University of Cambridge, Cambridge, CB2 0SZ, UK
| | - Anna M Woollams
- Neuroscience and Aphasia Research Unit, School of Biological Sciences, University of Manchester, Manchester, M13 9PL, UK
| | - Olaf Hauk
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, CB2 7EF, UK
| |
Collapse
|
15
|
Donos C, Blidarescu B, Pistol C, Oane I, Mindruta I, Barborica A. A comparison of uni- and multi-variate methods for identifying brain networks activated by cognitive tasks using intracranial EEG. Front Neurosci 2022; 16:946240. [PMID: 36225734 PMCID: PMC9549146 DOI: 10.3389/fnins.2022.946240] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 09/08/2022] [Indexed: 11/20/2022] Open
Abstract
Cognitive tasks are commonly used to identify brain networks involved in the underlying cognitive process. However, inferring the brain networks from intracranial EEG data presents several challenges related to the sparse spatial sampling of the brain and the high variability of the EEG trace due to concurrent brain processes. In this manuscript, we use a well-known facial emotion recognition task to compare three different ways of analyzing the contrasts between task conditions: permutation cluster tests, machine learning (ML) classifiers, and a searchlight implementation of multivariate pattern analysis (MVPA) for intracranial sparse data recorded from 13 patients undergoing presurgical evaluation for drug-resistant epilepsy. Using all three methods, we aim at highlighting the brain structures with significant contrast between conditions. In the absence of ground truth, we use the scientific literature to validate our results. The comparison of the three methods’ results shows moderate agreement, measured by the Jaccard coefficient, between the permutation cluster tests and the machine learning [0.33 and 0.52 for the left (LH) and right (RH) hemispheres], and 0.44 and 0.37 for the LH and RH between the permutation cluster tests and MVPA. The agreement between ML and MVPA is higher: 0.65 for the LH and 0.62 for the RH. To put these results in context, we performed a brief review of the literature and we discuss how each brain structure’s involvement in the facial emotion recognition task.
Collapse
Affiliation(s)
- Cristian Donos
- Department of Physics, University of Bucharest, Bucharest, Romania
- *Correspondence: Cristian Donos,
| | | | | | - Irina Oane
- Department of Physics, University of Bucharest, Bucharest, Romania
- Epilepsy Monitoring Unit, Department of Neurology, Emergency University Hospital Bucharest, Bucharest, Romania
| | - Ioana Mindruta
- Department of Physics, University of Bucharest, Bucharest, Romania
| | - Andrei Barborica
- Department of Physics, University of Bucharest, Bucharest, Romania
| |
Collapse
|
16
|
Na Y, Jung J, Tench CR, Auer DP, Pyun SB. Language systems from lesion-symptom mapping in aphasia: A meta-analysis of voxel-based lesion mapping studies. Neuroimage Clin 2022; 35:103038. [PMID: 35569227 PMCID: PMC9112051 DOI: 10.1016/j.nicl.2022.103038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2021] [Revised: 03/30/2022] [Accepted: 05/04/2022] [Indexed: 11/28/2022]
Abstract
Meta-analysis of 2,007 individuals with aphasia from 25 voxel-based lesion mapping studies. Distinctive patterns of lesions in aphasia are associated with different language functions. The patterns of lesion in aphasia support the dual pathway model of language processing.
Background Aphasia is one of the most common causes of post-stroke disabilities. As the symptoms and impact of post-stroke aphasia are heterogeneous, it is important to understand how topographical lesion heterogeneity in patients with aphasia is associated with different domains of language impairments. Here, we aim to provide a comprehensive overview of neuroanatomical basis in post-stroke aphasia through coordinate based meta-analysis of voxel-based lesion-symptom mapping studies. Methods We performed a meta-analysis of lesion-symptom mapping studies in post-stroke aphasia. We obtained coordinate-based structural neuroimaging data for 2,007 individuals with aphasia from 25 studies that met predefined inclusion criteria. Results Overall, our results revealed that the distinctive patterns of lesions in aphasia are associated with different language functions and tasks. Damage to the insular-motor areas impaired speech with preserved comprehension and a similar pattern was observed when the lesion covered the insular-motor and inferior parietal lobule. Lesions in the frontal area severely impaired speaking with relatively good comprehension. The repetition-selective deficits only arise from lesions involving the posterior superior temporal gyrus. Damage in the anterior-to-posterior temporal cortex was associated with semantic deficits. Conclusion The association patterns of lesion topography and specific language deficits provide key insights into the specific underlying language pathways. Our meta-analysis results strongly support the dual pathway model of language processing, capturing the link between the different symptom complexes of aphasias and the different underlying location of damage.
Collapse
Affiliation(s)
- Yoonhye Na
- Department of Biomedical Sciences, Korea University College of Medicine, Seoul, Republic of Korea; Brain Convergence Research Center, Korea University College of Medicine, Seoul, Republic of Korea
| | - JeYoung Jung
- School of Psychology, University of Nottingham, Nottingham, UK
| | - Christopher R Tench
- Division of Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK; NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK; Division of Clinical Neurosciences, Clinical Neurology, University of Nottingham, Queen's Medical Centre, Nottingham, UK
| | - Dorothee P Auer
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, UK; Division of Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, UK; NIHR Nottingham Biomedical Research Centre, University of Nottingham, Nottingham, UK; Neuroradiology, Nottingham University Hospitals Trust, Nottingham, UK.
| | - Sung-Bom Pyun
- Department of Biomedical Sciences, Korea University College of Medicine, Seoul, Republic of Korea; Brain Convergence Research Center, Korea University College of Medicine, Seoul, Republic of Korea; Department of Physical Medicine and Rehabilitation, Korea University Anam Hospital, Seoul, Republic of Korea.
| |
Collapse
|
17
|
Liu X, Gu L, Liu J, Hong S, Luo Q, Wu Y, Yang J, Jiang J. MRI Study of Cerebral Cortical Thickness in Patients with Herpes Zoster and Postherpetic Neuralgia. J Pain Res 2022; 15:623-632. [PMID: 35250306 PMCID: PMC8894103 DOI: 10.2147/jpr.s352105] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2021] [Accepted: 02/15/2022] [Indexed: 12/03/2022] Open
Abstract
Objective To measure the changes in cerebral cortical thickness in patients with herpes zoster (HZ) and postherpetic neuralgia (PHN) by surface-based morphometry (SBM) and further estimate its correlation with clinical scores. Materials and Methods Twenty-nine HZ patients, 30 PHN patients and 30 well-matched healthy controls (HCs) were included. Magnetic resonance imaging (MRI) data from all subjects were collected and then analyzed by SBM. The changes in cortical thickness among the HZ, PHN and HC groups were analyzed by ANOVA and correlated with clinical scores. Results The thickness of the bilateral primary visual cortex (V1, V2) and right primary visual cortex (V3), left somatosensory cortex (L3A), right anterior cingulate gyrus and medial prefrontal cortex (RS32) increased in PHN group, and the thickness the left insular and frontal opercular cortex (LFOP4), left motor cortex (L3B), and right superior temporal visual cortex (RSTV) were decreased in the HZ and PHN groups compared to the HC group. The thickness measurements of RS32, LFOP4, and (L3B) in HZ and PHN patients were correlated with the duration of disease. In HZ and PHN patients, the Hamilton Anxiety Scale (HAMA) and Hamilton Depression Scale (HAMD) scores were significantly positively correlated. Conclusion Changes in cortical thickness in the areas related to sensory, motor, and cognitive/emotional changes in patients with PHN affect the neuroplasticity process of the brain, which may be the reason for the transformation of HZ into PHN and provide a possible explanation for the neuropathological mechanism of pain persistence in PHN patients.
Collapse
Affiliation(s)
- Xian Liu
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Lili Gu
- Department of Pain, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Jiaqi Liu
- Department of Radiology, The Jiangxi Provincial People's Hospital, Nanchang, Jiangxi, 330006, People's Republic of China
| | - Shunda Hong
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Qing Luo
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Ying Wu
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Jiaojiao Yang
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
| | - Jian Jiang
- Department of Radiology, The First Affiliated Hospital, Nanchang University, Nanchang, Jiangxi, People’s Republic of China
- Correspondence: Jian Jiang, Department of Radiology, The First Affiliated Hospital, Nanchang University, 17 Yongwaizheng Street, Nanchang, 330006, Jiangxi, People’s Republic of China, Tel +86 791 8869 3825, Email
| |
Collapse
|
18
|
Luo S, Rabbani Q, Crone NE. Brain-Computer Interface: Applications to Speech Decoding and Synthesis to Augment Communication. Neurotherapeutics 2022; 19:263-273. [PMID: 35099768 PMCID: PMC9130409 DOI: 10.1007/s13311-022-01190-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/16/2022] [Indexed: 01/03/2023] Open
Abstract
Damage or degeneration of motor pathways necessary for speech and other movements, as in brainstem strokes or amyotrophic lateral sclerosis (ALS), can interfere with efficient communication without affecting brain structures responsible for language or cognition. In the worst-case scenario, this can result in the locked in syndrome (LIS), a condition in which individuals cannot initiate communication and can only express themselves by answering yes/no questions with eye blinks or other rudimentary movements. Existing augmentative and alternative communication (AAC) devices that rely on eye tracking can improve the quality of life for people with this condition, but brain-computer interfaces (BCIs) are also increasingly being investigated as AAC devices, particularly when eye tracking is too slow or unreliable. Moreover, with recent and ongoing advances in machine learning and neural recording technologies, BCIs may offer the only means to go beyond cursor control and text generation on a computer, to allow real-time synthesis of speech, which would arguably offer the most efficient and expressive channel for communication. The potential for BCI speech synthesis has only recently been realized because of seminal studies of the neuroanatomical and neurophysiological underpinnings of speech production using intracranial electrocorticographic (ECoG) recordings in patients undergoing epilepsy surgery. These studies have shown that cortical areas responsible for vocalization and articulation are distributed over a large area of ventral sensorimotor cortex, and that it is possible to decode speech and reconstruct its acoustics from ECoG if these areas are recorded with sufficiently dense and comprehensive electrode arrays. In this article, we review these advances, including the latest neural decoding strategies that range from deep learning models to the direct concatenation of speech units. We also discuss state-of-the-art vocoders that are integral in constructing natural-sounding audio waveforms for speech BCIs. Finally, this review outlines some of the challenges ahead in directly synthesizing speech for patients with LIS.
Collapse
Affiliation(s)
- Shiyu Luo
- Department of Biomedical Engineering, The Johns Hopkins University School of Medicine, Baltimore, MD, USA.
| | - Qinwan Rabbani
- Department of Electrical and Computer Engineering, The Johns Hopkins University, Baltimore, MD, USA
| | - Nathan E Crone
- Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
19
|
Rogers TT, Cox CR, Lu Q, Shimotake A, Kikuchi T, Kunieda T, Miyamoto S, Takahashi R, Ikeda A, Matsumoto R, Lambon Ralph MA. Evidence for a deep, distributed and dynamic code for animacy in human ventral anterior temporal cortex. eLife 2021; 10:66276. [PMID: 34704935 PMCID: PMC8550752 DOI: 10.7554/elife.66276] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/05/2021] [Accepted: 10/09/2021] [Indexed: 12/01/2022] Open
Abstract
How does the human brain encode semantic information about objects? This paper reconciles two seemingly contradictory views. The first proposes that local neural populations independently encode semantic features; the second, that semantic representations arise as a dynamic distributed code that changes radically with stimulus processing. Combining simulations with a well-known neural network model of semantic memory, multivariate pattern classification, and human electrocorticography, we find that both views are partially correct: information about the animacy of a depicted stimulus is distributed across ventral temporal cortex in a dynamic code possessing feature-like elements posteriorly but with elements that change rapidly and nonlinearly in anterior regions. This pattern is consistent with the view that anterior temporal lobes serve as a deep cross-modal ‘hub’ in an interactive semantic network, and more generally suggests that tertiary association cortices may adopt dynamic distributed codes difficult to detect with common brain imaging methods.
Collapse
Affiliation(s)
- Timothy T Rogers
- Department of Psychology, University of Wisconsin- Madison, Madison, United States
| | - Christopher R Cox
- Department of Psychology, Louisiana State University, Baton Rouge, United States
| | - Qihong Lu
- Department of Psychology, Princeton University, Princeton, United States
| | - Akihiro Shimotake
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Takayuki Kikuchi
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Takeharu Kunieda
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto, Japan.,Department of Neurosurgery, Ehime University Graduate School of Medicine, Ehime, Japan
| | - Susumu Miyamoto
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Ryosuke Takahashi
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto, Japan
| | - Akio Ikeda
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School ofMedicine, Kyoto, Japan
| | - Riki Matsumoto
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto, Japan.,Division of Neurology, Kobe University Graduate School of Medicine, Kusunoki-cho, Kobe, Japan
| | - Matthew A Lambon Ralph
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
20
|
Flick G, Abdullah O, Pylkkänen L. From letters to composed concepts: A magnetoencephalography study of reading. Hum Brain Mapp 2021; 42:5130-5153. [PMID: 34402114 PMCID: PMC8449097 DOI: 10.1002/hbm.25608] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2020] [Revised: 06/23/2021] [Accepted: 07/20/2021] [Indexed: 11/30/2022] Open
Abstract
Language comprehension requires the recognition of individual words and the combination of their meanings to yield complex concepts or interpretations. This combinatory process often requires the insertion of unstated semantic material between words, based on thematic or feature knowledge. For example, the phrase horse barn is not interpreted as a blend of a horse and a barn, but specifically a barn where horses are kept. Previous neuroscientific evidence suggests that left posterior and anterior temporal cortex underpin thematic and feature‐based concept knowledge, respectively, but much remains unclear about how these areas contribute to combinatory language processing. Using magnetoencephalography, we contrasted source‐localized responses to modifier‐noun phrases involving thematic relations versus feature modifications, while also examining how lower‐level orthographic processing fed composition. Participants completed three procedures examining responses to letter‐strings, adjective‐noun phrases, and noun–noun combinations that varied the semantic relations between words. We found that sections of the left anterior temporal lobe, posterior temporal lobe, and cortex surrounding the angular gyrus were all engaged in the minimal composition of adjective‐noun phrases, a more distributed network than in most prior studies of minimal composition. Of these regions, only the left posterior temporal lobe was additionally sensitive to implicit thematic relations between composing words, suggesting that it houses a specialized relational processing component in a wider composition network. We additionally identified a left occipitotemporal progression from orthographic to lexical processing, feeding ventral anterior areas engaged in the combination of word meanings. Finally, by examining source signal leakage, we characterized the degree to which these responses could be distinguished from one another using source estimation.
Collapse
Affiliation(s)
- Graham Flick
- Department of Psychology, New York University, New York, New York, USA.,NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Osama Abdullah
- NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates
| | - Liina Pylkkänen
- Department of Psychology, New York University, New York, New York, USA.,NYUAD Research Institute, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates.,Department of Linguistics, New York University, New York, New York, USA
| |
Collapse
|
21
|
Sato N, Matsumoto R, Shimotake A, Matsuhashi M, Otani M, Kikuchi T, Kunieda T, Mizuhara H, Miyamoto S, Takahashi R, Ikeda A. Frequency-Dependent Cortical Interactions during Semantic Processing: An Electrocorticogram Cross-spectrum Analysis Using a Semantic Space Model. Cereb Cortex 2021; 31:4329-4339. [PMID: 33942078 DOI: 10.1093/cercor/bhab089] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022] Open
Abstract
Convergent evidence has demonstrated that semantics are represented by the interaction between a multimodal semantic hub at the anterior temporal lobe (ATL) and other modality-specific association cortical areas. Electrocorticogram (ECoG) recording with high spatiotemporal resolutions is efficient in evaluating such cortical interactions; however, this has not been a focus of preceding studies. The present study evaluated cortical interactions during picture naming using a novel ECoG cross-spectrum analysis, which was formulated from a computational simulation of neuronal networks and combined with a vector space model of semantics. The results clarified three types of frequency-dependent cortical networks: 1) an earlier-period (0.2-0.8 s from stimulus onset) high-gamma-band (90-150 Hz) network with a hub at the posterior fusiform gyrus, 2) a later-period (0.4-1.0 s) beta-band (15-40 Hz) network with multiple hubs at the ventral ATL and posterior middle temporal gyrus, and 3) a pre-articulation theta-band (4-7 Hz) network distributed over widely located cortical regions. These results suggest that frequency-dependent cortical interactions can characterize the underlying processes of semantic cognition, and the beta-band network with a hub at the ventral ATL is especially associated with the formation of semantic representation.
Collapse
Affiliation(s)
- Naoyuki Sato
- Department of Complex and Intelligent Systems, School of Systems Information Science, Future University Hakodate, Hakodate, Hokkaido 041-8655, Japan
| | - Riki Matsumoto
- Division of Neurology, Kobe University Graduate School of Medicine, Kobe, Hyogo 650-0017, Japan.,Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan
| | - Akihiro Shimotake
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan.,Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Sakyo, Kyoto 606-8507, Japan
| | - Masao Matsuhashi
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Sakyo, Kyoto 606-8507, Japan.,Human Brain Research Center, Kyoto University Graduate School of Medicine, Kyoto 606-8507, Japan
| | - Mayumi Otani
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan
| | - Takayuki Kikuchi
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan
| | - Takeharu Kunieda
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan.,Department of Neurosurgery, Ehime University Graduate School of Medicine, Shizukawa Toon City, Ehime 791-0295, Japan
| | - Hiroaki Mizuhara
- Kyoto University Graduate School of Informatics, Sakyo, Kyoto 606-8501, Japan
| | - Susumu Miyamoto
- Department of Neurosurgery, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan
| | - Ryosuke Takahashi
- Department of Neurology, Kyoto University Graduate School of Medicine, Kyoto University Hospital, Sakyo, Kyoto 606-8507, Japan
| | - Akio Ikeda
- Department of Epilepsy, Movement Disorders and Physiology, Kyoto University Graduate School of Medicine, Sakyo, Kyoto 606-8507, Japan
| |
Collapse
|
22
|
Jackson RL, Rogers TT, Lambon Ralph MA. Reverse-engineering the cortical architecture for controlled semantic cognition. Nat Hum Behav 2021; 5:774-786. [PMID: 33462472 PMCID: PMC7611056 DOI: 10.1038/s41562-020-01034-z] [Citation(s) in RCA: 20] [Impact Index Per Article: 6.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Accepted: 12/09/2020] [Indexed: 12/02/2022]
Abstract
We employ a reverse-engineering approach to illuminate the neurocomputational building blocks that combine to support controlled semantic cognition: the storage and context-appropriate use of conceptual knowledge. By systematically varying the structure of a computational model and assessing the functional consequences, we identified the architectural properties that best promote some core functions of the semantic system. Semantic cognition presents a challenging test case, as the brain must achieve two seemingly contradictory functions: abstracting context-invariant conceptual representations across time and modalities, while producing specific context-sensitive behaviours appropriate for the immediate task. These functions were best achieved in models possessing a single, deep multimodal hub with sparse connections from modality-specific regions, and control systems acting on peripheral rather than deep network layers. The reverse-engineered model provides a unifying account of core findings in the cognitive neuroscience of controlled semantic cognition, including evidence from anatomy, neuropsychology and functional brain imaging.
Collapse
Affiliation(s)
- Rebecca L Jackson
- MRC Cognition & Brain Sciences Unit, University of Cambridge, Cambridge, UK.
| | - Timothy T Rogers
- Department of Psychology, University of Wisconsin-Madison, Madison, WI, USA
| | | |
Collapse
|
23
|
Kim J, Jung J, Nam K. Neural correlates of confusability in recognition of morphologically complex Korean words. PLoS One 2021; 16:e0249111. [PMID: 33857191 PMCID: PMC8049294 DOI: 10.1371/journal.pone.0249111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2019] [Accepted: 03/11/2021] [Indexed: 11/30/2022] Open
Abstract
When people confuse and reject a non-word that is created by switching two adjacent letters from an actual word, is called the transposition confusability effect (TCE). The TCE is known to occur at the very early stages of visual word recognition with such unit exchange as letters or syllables, but little is known about the brain mechanisms of TCE. In this study, we examined the neural correlates of TCE and the effect of a morpheme boundary placement on TCE. We manipulated the placement of a morpheme boundary by exchanging places of two syllables embedded in Korean morphologically complex words made up of lexical morpheme and grammatical morpheme. In the two experimental conditions, the transposition syllable within-boundary condition (TSW) involved exchanging two syllables within the same morpheme, whereas the across-boundary condition (TSA) involved the exchange of syllables across the stem and grammatical morpheme boundary. During fMRI, participants performed the lexical decision task. Behavioral results revealed that the TCE was found in TSW condition, and the morpheme boundary, which is manipulated in TSA, modulated the TCE. In the fMRI results, TCE induced activation in the left inferior parietal lobe (IPL) and intraparietal sulcus (IPS). The IPS activation was specific to a TCE and its strength of activation was associated with task performance. Furthermore, two functional networks were involved in the TCE: the central executive network and the dorsal attention network. Morpheme boundary modulation suppressed the TCE by recruiting the prefrontal and temporal regions, which are the key regions involved in semantic processing. Our findings propose the role of the dorsal visual pathway in syllable position processing and that its interaction with other higher cognitive systems is modulated by the morphological boundary in the early phases of visual word recognition.
Collapse
Affiliation(s)
- Jeahong Kim
- Department of Psychology, Korea University, Seoul, Republic of Korea
| | - JeYoung Jung
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| | - Kichun Nam
- Department of Psychology, Korea University, Seoul, Republic of Korea
| |
Collapse
|
24
|
Argiris G, Rumiati RI, Crepaldi D. No fruits without color: Cross-modal priming and EEG reveal different roles for different features across semantic categories. PLoS One 2021; 16:e0234219. [PMID: 33852575 PMCID: PMC8046255 DOI: 10.1371/journal.pone.0234219] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 03/22/2021] [Indexed: 11/18/2022] Open
Abstract
Category-specific impairments witnessed in patients with semantic deficits have broadly dissociated into natural and artificial kinds. However, how the category of food (more specifically, fruits and vegetables) fits into this distinction has been difficult to interpret, given a pattern of deficit that has inconsistently mapped onto either kind, despite its intuitive membership to the natural domain. The present study explores the effects of a manipulation of a visual sensory (i.e., color) or functional (i.e., orientation) feature on the consequential semantic processing of fruits and vegetables (and tools, by comparison), first at the behavioral and then at the neural level. The categorization of natural (i.e., fruits/vegetables) and artificial (i.e., utensils) entities was investigated via cross-modal priming. Reaction time analysis indicated a reduction in priming for color-modified natural entities and orientation-modified artificial entities. Standard event-related potentials (ERP) analysis was performed, in addition to linear classification. For natural entities, a N400 effect at central channel sites was observed for the color-modified condition compared relative to normal and orientation conditions, with this difference confirmed by classification analysis. Conversely, there was no significant difference between conditions for the artificial category in either analysis. These findings provide strong evidence that color is an integral property to the categorization of fruits/vegetables, thus substantiating the claim that feature-based processing guides as a function of semantic category.
Collapse
Affiliation(s)
| | | | - Davide Crepaldi
- International School for Advanced Studies (SISSA), Trieste, Italy
| |
Collapse
|
25
|
Jackson RL, Bajada CJ, Lambon Ralph MA, Cloutman LL. The Graded Change in Connectivity across the Ventromedial Prefrontal Cortex Reveals Distinct Subregions. Cereb Cortex 2021; 30:165-180. [PMID: 31329834 PMCID: PMC7029692 DOI: 10.1093/cercor/bhz079] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/07/2018] [Revised: 02/21/2019] [Accepted: 03/19/2019] [Indexed: 11/20/2022] Open
Abstract
The functional heterogeneity of the ventromedial prefrontal cortex (vmPFC) suggests it may include distinct functional subregions. To date these have not been well elucidated. Regions with differentiable connectivity (and as a result likely dissociable functions) may be identified using emergent data-driven approaches. However, prior parcellations of the vmPFC have only considered hard splits between distinct regions, although both hard and graded connectivity changes may exist. Here we determine the full pattern of change in structural and functional connectivity across the vmPFC for the first time and extract core distinct regions. Both structural and functional connectivity varied along a dorsomedial to ventrolateral axis from relatively dorsal medial wall regions to relatively lateral basal orbitofrontal cortex. The pattern of connectivity shifted from default mode network to sensorimotor and multimodal semantic connections. This finding extends the classical distinction between primate medial and orbital regions by demonstrating a similar gradient in humans for the first time. Additionally, core distinct regions in the medial wall and orbitofrontal cortex were identified that may show greater correspondence to functional differences than prior hard parcellations. The possible functional roles of the orbitofrontal cortex and medial wall are discussed.
Collapse
Affiliation(s)
- Rebecca L Jackson
- Medical Research Council Cognition & Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Claude J Bajada
- Faculty of Medicine and Surgery, University of Malta, Msida, MSD, Malta
| | - Matthew A Lambon Ralph
- Medical Research Council Cognition & Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Lauren L Cloutman
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology (Zochonis Building), University of Manchester, Manchester, UK
| |
Collapse
|
26
|
Jung J, Lambon Ralph MA. Enhancing vs. inhibiting semantic performance with transcranial magnetic stimulation over the anterior temporal lobe: Frequency- and task-specific effects. Neuroimage 2021; 234:117959. [PMID: 33744456 PMCID: PMC8204263 DOI: 10.1016/j.neuroimage.2021.117959] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2020] [Revised: 03/08/2021] [Accepted: 03/10/2021] [Indexed: 11/24/2022] Open
Abstract
Accumulating, converging evidence indicates that the anterior temporal lobe (ATL) appears to be the transmodal hub for semantic representation. A series of repetitive transcranial magnetic stimulation (rTMS) investigations utilizing the ‘virtual lesion’ approach have established the brain-behavioural relationship between the ATL and semantic processing by demonstrating that inhibitory rTMS over the ATL induced impairments in semantic performance in healthy individuals. However, a growing body of rTMS studies suggest that rTMS might also be a tool for cognitive enhancement and rehabilitation, though there has been no previous exploration in semantic cognition. Here, we explored a potential role of rTMS in enhancing and inhibiting semantic performance with contrastive rTMS protocols (1 Hz vs. 20 Hz) by controlling practice effects. Twenty-one healthy participants were recruited and performed an object category judgement task and a pattern matching task serving as a control task before and after the stimulation over the ATL (1 Hz, 20 Hz, and sham). A task familiarization procedure was performed prior to the experiment in order to establish a ‘stable baseline’ prior to stimulation and thus minimize practice effect. Our results demonstrated that it is possible to modulate semantic performance positively or negatively depending on the ATL stimulation frequency: 20 Hz rTMS was optimal for facilitating cortical processing (faster RT in a semantic task) contrasting with diminished semantic performance after 1 Hz rTMS. In addition to cementing the importance of the ATL to semantic representation, our findings suggest that 20 Hz rTMS leads to semantic enhancement in healthy individuals and potentially could be used for patients with semantic impairments as a therapeutic tool.
Collapse
Affiliation(s)
- JeYoung Jung
- School of Psychology, University of Nottingham, University Park, Nottingham NG7 2RD, UK.
| | - Matthew A Lambon Ralph
- MRC Cognition and Brain Science Unit (CBU), University of Cambridge, Cambridge CB2 7EF, UK.
| |
Collapse
|
27
|
Lu Z, Ku Y. NeuroRA: A Python Toolbox of Representational Analysis From Multi-Modal Neural Data. Front Neuroinform 2021; 14:563669. [PMID: 33424573 PMCID: PMC7787009 DOI: 10.3389/fninf.2020.563669] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2020] [Accepted: 12/03/2020] [Indexed: 11/26/2022] Open
Abstract
In studies of cognitive neuroscience, multivariate pattern analysis (MVPA) is widely used as it offers richer information than traditional univariate analysis. Representational similarity analysis (RSA), as one method of MVPA, has become an effective decoding method based on neural data by calculating the similarity between different representations in the brain under different conditions. Moreover, RSA is suitable for researchers to compare data from different modalities and even bridge data from different species. However, previous toolboxes have been made to fit specific datasets. Here, we develop NeuroRA, a novel and easy-to-use toolbox for representational analysis. Our toolbox aims at conducting cross-modal data analysis from multi-modal neural data (e.g., EEG, MEG, fNIRS, fMRI, and other sources of neruroelectrophysiological data), behavioral data, and computer-simulated data. Compared with previous software packages, our toolbox is more comprehensive and powerful. Using NeuroRA, users can not only calculate the representational dissimilarity matrix (RDM), which reflects the representational similarity among different task conditions and conduct a representational analysis among different RDMs to achieve a cross-modal comparison. Besides, users can calculate neural pattern similarity (NPS), spatiotemporal pattern similarity (STPS), and inter-subject correlation (ISC) with this toolbox. NeuroRA also provides users with functions performing statistical analysis, storage, and visualization of results. We introduce the structure, modules, features, and algorithms of NeuroRA in this paper, as well as examples applying the toolbox in published datasets.
Collapse
Affiliation(s)
- Zitong Lu
- Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Department of Psychology, Sun Yat-sen University, Guangzhou, China.,Peng Cheng Laboratory, Shenzhen, China.,Shanghai Key Laboratory of Brain Functional Genomics, Shanghai Changning-East China Normal University (ECNU) Mental Health Center, School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Yixuan Ku
- Guangdong Provincial Key Laboratory of Social Cognitive Neuroscience and Mental Health, Department of Psychology, Sun Yat-sen University, Guangzhou, China.,Peng Cheng Laboratory, Shenzhen, China
| |
Collapse
|
28
|
Pflugshaupt T, Bauer D, Frey J, Vanbellingen T, Kaufmann BC, Bohlhalter S, Nyffeler T. The right anterior temporal lobe critically contributes to magnitude knowledge. Brain Commun 2020; 2:fcaa157. [PMID: 33225278 PMCID: PMC7667527 DOI: 10.1093/braincomms/fcaa157] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2020] [Revised: 08/20/2020] [Accepted: 08/26/2020] [Indexed: 11/14/2022] Open
Abstract
Cognitive estimation is a mental ability applied to solve numerical problems when precise facts are unknown, unavailable or impractical to calculate. It has been associated with several underlying cognitive components, most often with executive functions and semantic memory. Little is known about the neural correlates of cognitive estimation. To address this issue, the present cross-sectional study applied lesion-symptom mapping in a group of 55 patients with left hemineglect due to right-hemisphere stroke. Previous evidence suggests a high prevalence of cognitive estimation impairment in these patients, as they might show a general bias towards large magnitudes. Compared to 55 age- and gender-matched healthy controls, the patient group demonstrated impaired cognitive estimation. However, the expected large magnitude bias was not found. Lesion-symptom mapping related their general estimation impairment predominantly to brain damage in the right anterior temporal lobe. Also critically involved were the right uncinate fasciculus, the anterior commissure and the right inferior frontal gyrus. The main findings of this study emphasize the role of semantic memory in cognitive estimation, with reference to a growing body of neuroscientific literature postulating a transmodal hub for semantic cognition situated in the bilateral anterior temporal lobe. That such semantic hub function may also apply to numerical knowledge is not undisputed. We here propose a critical contribution of the right anterior temporal lobe to at least one aspect of number processing, i.e. the knowledge about real-world numerical magnitudes.
Collapse
Affiliation(s)
| | - Daniel Bauer
- Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland
| | - Julia Frey
- Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland
| | - Tim Vanbellingen
- Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland
- Gerontechnology and Rehabilitation Group, ARTORG Center for Biomedical Engineering, University of Bern, Bern, Switzerland
| | - Brigitte C Kaufmann
- Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland
- Gerontechnology and Rehabilitation Group, ARTORG Center for Biomedical Engineering, University of Bern, Bern, Switzerland
| | | | - Thomas Nyffeler
- Neurocenter, Luzerner Kantonsspital, Luzern, Switzerland
- Gerontechnology and Rehabilitation Group, ARTORG Center for Biomedical Engineering, University of Bern, Bern, Switzerland
| |
Collapse
|
29
|
Berezutskaya J, Freudenburg ZV, Ambrogioni L, Güçlü U, van Gerven MAJ, Ramsey NF. Cortical network responses map onto data-driven features that capture visual semantics of movie fragments. Sci Rep 2020; 10:12077. [PMID: 32694561 PMCID: PMC7374611 DOI: 10.1038/s41598-020-68853-y] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2020] [Accepted: 06/30/2020] [Indexed: 11/08/2022] Open
Abstract
Research on how the human brain extracts meaning from sensory input relies in principle on methodological reductionism. In the present study, we adopt a more holistic approach by modeling the cortical responses to semantic information that was extracted from the visual stream of a feature film, employing artificial neural network models. Advances in both computer vision and natural language processing were utilized to extract the semantic representations from the film by combining perceptual and linguistic information. We tested whether these representations were useful in studying the human brain data. To this end, we collected electrocorticography responses to a short movie from 37 subjects and fitted their cortical patterns across multiple regions using the semantic components extracted from film frames. We found that individual semantic components reflected fundamental semantic distinctions in the visual input, such as presence or absence of people, human movement, landscape scenes, human faces, etc. Moreover, each semantic component mapped onto a distinct functional cortical network involving high-level cognitive regions in occipitotemporal, frontal and parietal cortices. The present work demonstrates the potential of the data-driven methods from information processing fields to explain patterns of cortical responses, and contributes to the overall discussion about the encoding of high-level perceptual information in the human brain.
Collapse
Affiliation(s)
- Julia Berezutskaya
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands.
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands.
| | - Zachary V Freudenburg
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands
| | - Luca Ambrogioni
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands
| | - Umut Güçlü
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands
| | - Marcel A J van Gerven
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Montessorilaan 3, 6525 HR, Nijmegen, The Netherlands
| | - Nick F Ramsey
- Brain Center, Department of Neurology and Neurosurgery, University Medical Center Utrecht, Heidelberglaan 100, 3584 CX, Utrecht, The Netherlands
| |
Collapse
|
30
|
Clarke A. Dynamic activity patterns in the anterior temporal lobe represents object semantics. Cogn Neurosci 2020; 11:111-121. [PMID: 32249714 PMCID: PMC7446031 DOI: 10.1080/17588928.2020.1742678] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2019] [Revised: 02/07/2020] [Indexed: 02/07/2023]
Abstract
The anterior temporal lobe (ATL) is considered a crucial area for the representation of transmodal concepts. Recent evidence suggests that specific regions within the ATL support the representation of individual object concepts, as shown by studies combining multivariate analysis methods and explicit measures of semantic knowledge. This research looks to further our understanding by probing conceptual representations at a spatially and temporally resolved neural scale. Representational similarity analysis was applied to human intracranial recordings from anatomically defined lateral to medial ATL sub-regions. Neural similarity patterns were tested against semantic similarity measures, where semantic similarity was defined by a hybrid corpus-based and feature-based approach. Analyses show that the perirhinal cortex, in the medial ATL, significantly related to semantic effects around 200 to 400 ms, and were greater than more lateral ATL regions. Further, semantic effects were present in low frequency (theta and alpha) oscillatory phase signals. These results provide converging support that more medial regions of the ATL support the representation of basic-level visual object concepts within the first 400 ms, and provide a bridge between prior fMRI and MEG work by offering detailed evidence for the presence of conceptual representations within the ATL.
Collapse
Affiliation(s)
- Alex Clarke
- Department of Psychology, University of Cambridge, Cambridge, UK
| |
Collapse
|
31
|
García AM, Hesse E, Birba A, Adolfi F, Mikulan E, Caro MM, Petroni A, Bekinschtein TA, Del Carmen García M, Silva W, Ciraolo C, Vaucheret E, Sedeño L, Ibáñez A. Time to Face Language: Embodied Mechanisms Underpin the Inception of Face-Related Meanings in the Human Brain. Cereb Cortex 2020; 30:6051-6068. [PMID: 32577713 PMCID: PMC7673477 DOI: 10.1093/cercor/bhaa178] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2019] [Revised: 04/21/2020] [Accepted: 06/02/2020] [Indexed: 12/18/2022] Open
Abstract
In construing meaning, the brain recruits multimodal (conceptual) systems and embodied (modality-specific) mechanisms. Yet, no consensus exists on how crucial the latter are for the inception of semantic distinctions. To address this issue, we combined electroencephalographic (EEG) and intracranial EEG (iEEG) to examine when nouns denoting facial body parts (FBPs) and nonFBPs are discriminated in face-processing and multimodal networks. First, FBP words increased N170 amplitude (a hallmark of early facial processing). Second, they triggered fast (~100 ms) activity boosts within the face-processing network, alongside later (~275 ms) effects in multimodal circuits. Third, iEEG recordings from face-processing hubs allowed decoding ~80% of items before 200 ms, while classification based on multimodal-network activity only surpassed ~70% after 250 ms. Finally, EEG and iEEG connectivity between both networks proved greater in early (0–200 ms) than later (200–400 ms) windows. Collectively, our findings indicate that, at least for some lexico-semantic categories, meaning is construed through fast reenactments of modality-specific experience.
Collapse
Affiliation(s)
- Adolfo M García
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina.,National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina.,Faculty of Education, National University of Cuyo (UNCuyo), MM5502GKA Mendoza, Argentina.,Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, 9170020 Santiago, Chile.,Global Brain Health Institute, University of California, CA 94158 San Francisco, USA
| | - Eugenia Hesse
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina.,National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustina Birba
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina.,National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Federico Adolfi
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Ezequiel Mikulan
- Department of Biomedical and Clinical Sciences "L. Sacco", University of Milan, 20122 Milan, Italy
| | - Miguel Martorell Caro
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustín Petroni
- Instituto de Ingeniería Biomédica, Facultad de Ingeniería, Universidad de Buenos Aires, C1063ACV Buenos Aires, Argentina.,Laboratorio de Inteligencia Artificial Aplicada, Departamento de Computación, Facultad de Ciencias Exactas y Naturales, Universidad de Buenos Aires, ICC-CONICET, C1063ACV Buenos Aires, Argentina
| | | | - María Del Carmen García
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Walter Silva
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Carlos Ciraolo
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Esteban Vaucheret
- Programa de Cirugía de Epilepsia, Hospital Italiano de Buenos Aires, C1181ACH, Buenos Aires, Argentina
| | - Lucas Sedeño
- National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina
| | - Agustín Ibáñez
- Universidad de San Andrés, B1644BID Buenos Aires, Argentina.,National Scientific and Technical Research Council (CONICET), C1425FQB Buenos Aires, Argentina.,Global Brain Health Institute, University of California, CA 94158 San Francisco, USA.,Center for Social and Cognitive Neuroscience (CSCN), School of Psychology, Universidad Adolfo Ibáñez, 8320000, Santiago, Chile.,Universidad Autónoma del Caribe, 080003, Barranquilla, Colombia
| |
Collapse
|
32
|
Popal H, Wang Y, Olson IR. A Guide to Representational Similarity Analysis for Social Neuroscience. Soc Cogn Affect Neurosci 2019; 14:1243-1253. [PMID: 31989169 PMCID: PMC7057283 DOI: 10.1093/scan/nsz099] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2019] [Revised: 10/13/2019] [Accepted: 10/22/2019] [Indexed: 01/04/2023] Open
Abstract
Representational similarity analysis (RSA) is a computational technique that uses pairwise comparisons of stimuli to reveal their representation in higher-order space. In the context of neuroimaging, mass-univariate analyses and other multivariate analyses can provide information on what and where information is represented but have limitations in their ability to address how information is represented. Social neuroscience is a field that can particularly benefit from incorporating RSA techniques to explore hypotheses regarding the representation of multidimensional data, how representations can predict behavior, how representations differ between groups and how multimodal data can be compared to inform theories. The goal of this paper is to provide a practical as well as theoretical guide to implementing RSA in social neuroscience studies.
Collapse
Affiliation(s)
- Haroon Popal
- Department of Psychology, Temple University, Philadelphia, PA
| | | | - Ingrid R Olson
- Department of Psychology, Temple University, Philadelphia, PA
| |
Collapse
|
33
|
Zhang Y, Zhang M, Zhu W, Pan X, Wang Q, Gao X, Wang C, Zhang X, Liu Y, Li S, Sun H. Role of Elevated Thrombospondin-1 in Kainic Acid-Induced Status Epilepticus. Neurosci Bull 2019; 36:263-276. [PMID: 31664678 DOI: 10.1007/s12264-019-00437-x] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2019] [Accepted: 07/22/2019] [Indexed: 11/29/2022] Open
Abstract
Previous studies have suggested that thrombospondin-1 (TSP-1) regulates the transforming growth factor beta 1 (TGF-β1)/phosphorylated Smad2/3 (pSmad2/3) pathway. Moreover, TSP-1 is closely associated with epilepsy. However, the role of the TSP-1-regulated TGF-β1/pSmad2/3 pathway in seizures remains unclear. In this study, changes in this pathway were assessed following kainic acid (KA)-induced status epilepticus (SE) in rats. The results showed that increases in the TSP-1/TGF-β1/pSmad2/3 levels spatially and temporally matched the increases in glial fibrillary acidic protein (GFAP)/chondroitin sulfate (CS56) levels following KA administration. Inhibition of TSP-1 expression by small interfering RNA or inhibition of TGF-β1 activation with a Leu-Ser-Lys-Leu peptide significantly reduced the severity of KA-induced acute seizures. These anti-seizure effects were accompanied by decreased GFAP/CS56 expression and Smad2/3 phosphorylation. Moreover, inhibiting Smad2/3 phosphorylation with ponatinib or SIS3 also significantly reduced seizure severity, alongside reducing GFAP/CS56 immunoreactivity. These results suggest that the TSP-1-regulated TGF-β1/pSmad2/3 pathway plays a key role in KA-induced SE and astrogliosis, and that inhibiting this pathway may be a potential anti-seizure strategy.
Collapse
Affiliation(s)
- Yurong Zhang
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Mengdi Zhang
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Wei Zhu
- Shandong Academy of Medical Sciences, Jinan, 250062, China
| | - Xiaohong Pan
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Qiaoyun Wang
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Xue Gao
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Chaoyun Wang
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Xiuli Zhang
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Yuxia Liu
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Shucui Li
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China
| | - Hongliu Sun
- School of Pharmaceutical Sciences, Binzhou Medical University, Yantai, 264003, China.
| |
Collapse
|
34
|
Bruffaerts R, Tyler LK, Shafto M, Tsvetanov KA, Clarke A. Perceptual and conceptual processing of visual objects across the adult lifespan. Sci Rep 2019; 9:13771. [PMID: 31551468 PMCID: PMC6760174 DOI: 10.1038/s41598-019-50254-5] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2019] [Accepted: 09/02/2019] [Indexed: 12/24/2022] Open
Abstract
Making sense of the external world is vital for multiple domains of cognition, and so it is crucial that object recognition is maintained across the lifespan. We investigated age differences in perceptual and conceptual processing of visual objects in a population-derived sample of 85 healthy adults (24-87 years old) by relating measures of object processing to cognition across the lifespan. Magnetoencephalography (MEG) was recorded during a picture naming task to provide a direct measure of neural activity, that is not confounded by age-related vascular changes. Multiple linear regression was used to estimate neural responsivity for each individual, namely the capacity to represent visual or semantic information relating to the pictures. We find that the capacity to represent semantic information is linked to higher naming accuracy, a measure of task-specific performance. In mature adults, the capacity to represent semantic information also correlated with higher levels of fluid intelligence, reflecting domain-general performance. In contrast, the latency of visual processing did not relate to measures of cognition. These results indicate that neural responsivity measures relate to naming accuracy and fluid intelligence. We propose that maintaining neural responsivity in older age confers benefits in task-related and domain-general cognitive processes, supporting the brain maintenance view of healthy cognitive ageing.
Collapse
Affiliation(s)
- Rose Bruffaerts
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, UK
- Laboratory for Cognitive Neurology, Department of Neurosciences, University of Leuven, 3000, Leuven, Belgium
- Neurology Department, University Hospitals Leuven, 3000, Leuven, Belgium
| | - Lorraine K Tyler
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, UK.
- Cambridge Centre for Ageing and Neuroscience (Cam-CAN), University of Cambridge and MRC Cognition and Brain Sciences Unit, Cambridge, CB2 7EF, UK.
| | - Meredith Shafto
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, UK
| | - Kamen A Tsvetanov
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, UK
- Cambridge Centre for Ageing and Neuroscience (Cam-CAN), University of Cambridge and MRC Cognition and Brain Sciences Unit, Cambridge, CB2 7EF, UK
| | - Alex Clarke
- Department of Psychology, University of Cambridge, Cambridge, CB2 3EB, UK
| |
Collapse
|
35
|
Folstein JR, Dieciuc MA. The Cognitive Neuroscience of Stable and Flexible Semantic Typicality. Front Psychol 2019; 10:1265. [PMID: 31214079 PMCID: PMC6554317 DOI: 10.3389/fpsyg.2019.01265] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2018] [Accepted: 05/13/2019] [Indexed: 12/15/2022] Open
Abstract
Typicality effects are among the most well-studied phenomena in the study of concepts. The classical notion of typicality is that typical concepts share many features with category co-members and few features with members of contrast categories. However, this notion was challenged by evidence that typicality is highly context dependent and not always dependent on central tendency. Dieciuc and Folstein (2019) argued that there is strong evidence for both views and that the two types of typicality effects might depend on different mechanisms. A recent theoretical framework, the controlled semantic cognition framework (Lamdon Ralph et al., 2017) strongly emphasizes the classical view, but includes mechanisms that could potentially account for both kinds of typicality. In contrast, the situated cognition framework (Barsalou, 2009b) articulates the context-dependent view. Here, we review evidence from cognitive neuroscience supporting the two frameworks. We also briefly evaluate the ability of computational models associated with the CSC to account for phenomena supporting SitCog (Rogers and McClelland, 2004). Many predictions of both frameworks are borne out by recent cognitive neuroscience evidence. While the CSC framework can at least potentially account for many of the typicality phenomena reviewed, challenges remain, especially with regard to ad hoc categories.
Collapse
Affiliation(s)
- Jonathan R. Folstein
- Department of Psychology, Florida State University, Tallahassee, FL, United States
| | | |
Collapse
|
36
|
Bruffaerts R, De Deyne S, Meersmans K, Liuzzi AG, Storms G, Vandenberghe R. Redefining the resolution of semantic knowledge in the brain: Advances made by the introduction of models of semantics in neuroimaging. Neurosci Biobehav Rev 2019; 103:3-13. [PMID: 31132379 DOI: 10.1016/j.neubiorev.2019.05.015] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Revised: 05/15/2019] [Accepted: 05/17/2019] [Indexed: 12/12/2022]
Abstract
The boundaries of our understanding of conceptual representation in the brain have been redrawn since the introduction of explicit models of semantics. These models are grounded in vast behavioural datasets acquired in healthy volunteers. Here, we review the most important techniques which have been applied to detect semantic information in neuroimaging data and argue why semantic models are possibly the most valuable addition to the research of semantics in recent years. Using multivariate analysis, predictions based on patient lesion data have been confirmed during semantic processing in healthy controls. Secondly, this new method has given rise to new research avenues, e.g. the detection of semantic processing outside of the temporal cortex. As a future line of work, the same research strategy could be useful to study neurological conditions such as the semantic variant of primary progressive aphasia, which is characterized by pathological semantic processing.
Collapse
Affiliation(s)
- Rose Bruffaerts
- Laboratory for Cognitive Neurology, Department of Neurosciences, KU Leuven, Belgium; Neurology Department, University Hospitals Leuven, 3000 Leuven, Belgium.
| | - Simon De Deyne
- Laboratory of Experimental Psychology, Humanities and Social Sciences Group, KU Leuven, Belgium
| | - Karen Meersmans
- Laboratory for Cognitive Neurology, Department of Neurosciences, KU Leuven, Belgium
| | | | - Gert Storms
- Laboratory of Experimental Psychology, Humanities and Social Sciences Group, KU Leuven, Belgium
| | - Rik Vandenberghe
- Laboratory for Cognitive Neurology, Department of Neurosciences, KU Leuven, Belgium; Neurology Department, University Hospitals Leuven, 3000 Leuven, Belgium
| |
Collapse
|
37
|
How meaning unfolds in neural time: Embodied reactivations can precede multimodal semantic effects during language processing. Neuroimage 2019; 197:439-449. [PMID: 31059796 DOI: 10.1016/j.neuroimage.2019.05.002] [Citation(s) in RCA: 29] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2018] [Revised: 03/08/2019] [Accepted: 05/02/2019] [Indexed: 02/08/2023] Open
Abstract
Research on how the brain construes meaning during language use has prompted two conflicting accounts. According to the 'grounded view', word understanding involves quick reactivations of sensorimotor (embodied) experiences evoked by the stimuli, with simultaneous or later engagement of multimodal (conceptual) systems integrating information from various sensory streams. Contrariwise, for the 'symbolic view', this capacity depends crucially on multimodal operations, with embodied systems playing epiphenomenal roles after comprehension. To test these contradictory hypotheses, the present magnetoencephalography study assessed implicit semantic access to grammatically constrained action and non-action verbs (n = 100 per category) while measuring spatiotemporally precise signals from the primary motor cortex (M1, a core region subserving bodily movements) and the anterior temporal lobe (ATL, a putative multimodal semantic hub). Convergent evidence from sensor- and source-level analyses revealed that increased modulations for action verbs occurred earlier in M1 (∼130-190 ms) than in specific ATL hubs (∼250-410 ms). Moreover, machine-learning decoding showed that trial-by-trial classification peaks emerged faster in M1 (∼100-175 ms) than in the ATL (∼345-500 ms), with over 71% accuracy in both cases. Considering their latencies, these results challenge the 'symbolic view' and its implication that sensorimotor mechanisms play only secondary roles in semantic processing. Instead, our findings support the 'grounded view', showing that early semantic effects are critically driven by embodied reactivations and that these cannot be reduced to post-comprehension epiphenomena, even when words are individually classified. Briefly, our study offers non-trivial insights to constrain fine-grained models of language and understand how meaning unfolds in neural time.
Collapse
|
38
|
Platonov A, Avanzini P, Pelliccia V, LoRusso G, Sartori I, Orban GA. Rapid and specific processing of person-related information in human anterior temporal lobe. Commun Biol 2019; 2:5. [PMID: 30740541 PMCID: PMC6320334 DOI: 10.1038/s42003-018-0250-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2018] [Accepted: 12/05/2018] [Indexed: 11/09/2022] Open
Abstract
The anterior temporal lobe (ATL), located at the tip of the human temporal lobes, has been heavily implicated in semantic processing by neuropsychological and functional imaging studies. These techniques have revealed a hemispheric specialization of ATL, but little about the time scale on which it operates. Here we show that ATL is specifically activated in intracerebral recordings when subjects discriminate the gender of an actor presented in a static frame followed by a video. ATL recording sites respond briefly (100 ms duration) to the visual static presentation of an actor in a task-, but not in a stimulus-duration-dependent way. Their response latencies correlate with subjects' reaction times, as do their activity levels, but oppositely in the two hemispheres operating in a push-pull fashion. Comparison of ATL time courses with those of more posterior, less specific regions emphasizes the role of inhibitory operations sculpting the fast ATL responses underlying semantic processing.
Collapse
Affiliation(s)
- Artem Platonov
- Department of Medicine and Surgery, University of Parma, via Volturno 39E, 43125 Parma, Italy
| | - Pietro Avanzini
- Institute of Neuroscience, CNR, via Volturno 39E, 43125 Parma, Italy
| | - Veronica Pelliccia
- Claudio Munari Center for Epilepsy Surgery, Niguarda Hospital, Ospedale Ca’Granda Niguarda, Piazza dell’Ospedale Maggiore, 3, 20162 Milan, Italy
| | - Giorgio LoRusso
- Claudio Munari Center for Epilepsy Surgery, Niguarda Hospital, Ospedale Ca’Granda Niguarda, Piazza dell’Ospedale Maggiore, 3, 20162 Milan, Italy
| | - Ivana Sartori
- Claudio Munari Center for Epilepsy Surgery, Niguarda Hospital, Ospedale Ca’Granda Niguarda, Piazza dell’Ospedale Maggiore, 3, 20162 Milan, Italy
| | - Guy A. Orban
- Department of Medicine and Surgery, University of Parma, via Volturno 39E, 43125 Parma, Italy
| |
Collapse
|
39
|
Rabbani Q, Milsap G, Crone NE. The Potential for a Speech Brain-Computer Interface Using Chronic Electrocorticography. Neurotherapeutics 2019; 16:144-165. [PMID: 30617653 PMCID: PMC6361062 DOI: 10.1007/s13311-018-00692-2] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/30/2022] Open
Abstract
A brain-computer interface (BCI) is a technology that uses neural features to restore or augment the capabilities of its user. A BCI for speech would enable communication in real time via neural correlates of attempted or imagined speech. Such a technology would potentially restore communication and improve quality of life for locked-in patients and other patients with severe communication disorders. There have been many recent developments in neural decoders, neural feature extraction, and brain recording modalities facilitating BCI for the control of prosthetics and in automatic speech recognition (ASR). Indeed, ASR and related fields have developed significantly over the past years, and many lend many insights into the requirements, goals, and strategies for speech BCI. Neural speech decoding is a comparatively new field but has shown much promise with recent studies demonstrating semantic, auditory, and articulatory decoding using electrocorticography (ECoG) and other neural recording modalities. Because the neural representations for speech and language are widely distributed over cortical regions spanning the frontal, parietal, and temporal lobes, the mesoscopic scale of population activity captured by ECoG surface electrode arrays may have distinct advantages for speech BCI, in contrast to the advantages of microelectrode arrays for upper-limb BCI. Nevertheless, there remain many challenges for the translation of speech BCIs to clinical populations. This review discusses and outlines the current state-of-the-art for speech BCI and explores what a speech BCI using chronic ECoG might entail.
Collapse
Affiliation(s)
- Qinwan Rabbani
- Department of Electrical Engineering, The Johns Hopkins University Whiting School of Engineering, Baltimore, MD, USA.
| | - Griffin Milsap
- Department of Biomedical Engineering, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| | - Nathan E Crone
- Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD, USA
| |
Collapse
|
40
|
Borghesani V, Buiatti M, Eger E, Piazza M. Conceptual and Perceptual Dimensions of Word Meaning Are Recovered Rapidly and in Parallel during Reading. J Cogn Neurosci 2019; 31:95-108. [DOI: 10.1162/jocn_a_01328] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
A single word (the noun “ elephant”) encapsulates a complex multidimensional meaning, including both perceptual (“ big”, “ gray”, “ trumpeting”) and conceptual (“ mammal”, “ can be found in India”) features. Opposing theories make different predictions as to whether different features (also conceivable as dimensions of the semantic space) are stored in similar neural regions and recovered with similar temporal dynamics during word reading. In this magnetoencephalography study, we tracked the brain activity of healthy human participants while reading single words varying orthogonally across three semantic dimensions: two perceptual ones (i.e., the average implied real-world size and the average strength of association with a prototypical sound) and a conceptual one (i.e., the semantic category). The results indicate that perceptual and conceptual representations are supported by partially segregated neural networks: Whereas visual and auditory dimensions are encoded in the phase coherence of low-frequency oscillations of occipital and superior temporal regions, respectively, semantic features are encoded in the power of low-frequency oscillations of anterior temporal and inferior parietal areas. However, despite the differences, these representations appear to emerge at the same latency: around 200 msec after stimulus onset. Taken together, these findings suggest that perceptual and conceptual dimensions of the semantic space are recovered automatically, rapidly, and in parallel during word reading.
Collapse
Affiliation(s)
- Valentina Borghesani
- Université Pierre et Marie Curie, Paris, France
- Institut National de la Santé et de la Recherche Médicale, Gif/Yvette, France
- University of California, San Francisco
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| | - Marco Buiatti
- Institut National de la Santé et de la Recherche Médicale, Gif/Yvette, France
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| | - Evelyn Eger
- Institut National de la Santé et de la Recherche Médicale, Gif/Yvette, France
| | - Manuela Piazza
- Institut National de la Santé et de la Recherche Médicale, Gif/Yvette, France
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| |
Collapse
|
41
|
Wang L, Kuperberg G, Jensen O. Specific lexico-semantic predictions are associated with unique spatial and temporal patterns of neural activity. eLife 2018; 7:e39061. [PMID: 30575521 PMCID: PMC6322859 DOI: 10.7554/elife.39061] [Citation(s) in RCA: 23] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2018] [Accepted: 12/20/2018] [Indexed: 11/13/2022] Open
Abstract
We used Magnetoencephalography (MEG) in combination with Representational Similarity Analysis to probe neural activity associated with distinct, item-specific lexico-semantic predictions during language comprehension. MEG activity was measured as participants read highly constraining sentences in which the final words could be predicted. Before the onset of the predicted words, both the spatial and temporal patterns of brain activity were more similar when the same words were predicted than when different words were predicted. The temporal patterns localized to the left inferior and medial temporal lobe. These findings provide evidence that unique spatial and temporal patterns of neural activity are associated with item-specific lexico-semantic predictions. We suggest that the unique spatial patterns reflected the prediction of spatially distributed semantic features associated with the predicted word, and that the left inferior/medial temporal lobe played a role in temporally 'binding' these features, giving rise to unique lexico-semantic predictions.
Collapse
Affiliation(s)
- Lin Wang
- Department of PsychiatryHarvard Medical SchoolBostonUnited States
- Athinoula A. Martinos Center for Biomedical ImagingMassachusetts General HospitalCharlestownUnited States
- Department of PsychologyTufts UniversityMedfordUnited States
| | - Gina Kuperberg
- Department of PsychiatryHarvard Medical SchoolBostonUnited States
- Athinoula A. Martinos Center for Biomedical ImagingMassachusetts General HospitalCharlestownUnited States
- Department of PsychologyTufts UniversityMedfordUnited States
| | - Ole Jensen
- School of PsychologyCentre for Human Brain Health, University of BirminghamBirminghamUnited Kingdom
| |
Collapse
|
42
|
Evidence for a functional specialization of ventral anterior temporal lobe for language. Neuroimage 2018; 183:800-810. [DOI: 10.1016/j.neuroimage.2018.08.062] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2018] [Revised: 07/25/2018] [Accepted: 08/25/2018] [Indexed: 11/17/2022] Open
|
43
|
Humphreys GF, Lambon Ralph MA. Mapping Domain-Selective and Counterpointed Domain-General Higher Cognitive Functions in the Lateral Parietal Cortex: Evidence from fMRI Comparisons of Difficulty-Varying Semantic Versus Visuo-Spatial Tasks, and Functional Connectivity Analyses. Cereb Cortex 2018; 27:4199-4212. [PMID: 28472382 DOI: 10.1093/cercor/bhx107] [Citation(s) in RCA: 52] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2017] [Indexed: 11/13/2022] Open
Abstract
Numerous cognitive domains have been associated with the lateral parietal cortex, yet how these disparate functions are packed into this region remains unclear. Whilst areas within the dorsal and the ventral parietal cortex (DPC and VPC) show differential function, there is considerable disagreement as to what these functions might be. Studies focussed on individual domains have plotted out variations of function across the region. Direct cross-domain comparisons are rare yet, when they have been undertaken, at least some regions (particularly the intraparietal sulcus [IPS] and core angular gyrus [AG]) appear to have contrastive domain-general qualities. In order to pursue this parietal puzzle, this study utilized both functional and resting-state magnetic resonance imaging to investigate a potential unifying neurocomputational framework-in which both domain general as well as domain-selective regions arise from differential patterns of connectivity into subregions of the lateral parietal cortex. Specifically we found that, consistent with their contrastive patterns of functional connectivity, subregions of DPC (anterior IPS) and VPC (AG) exhibit counterpointed functions sensitive to task/item-difficulty irrespective of cognitive domain. We propose that these regions serve as top-down executively penetrated and automatic bottom-up domain-general buffers of active information, respectively. In contrast, other parietal and nonparietal regions are tuned toward specific domains.
Collapse
Affiliation(s)
- Gina F Humphreys
- Neuroscience and Aphasia Research Unit (NARU), School of Psychological Sciences, University of Manchester, ManchesterM13 9PL, UK
| | - Matthew A Lambon Ralph
- Neuroscience and Aphasia Research Unit (NARU), School of Psychological Sciences, University of Manchester, ManchesterM13 9PL, UK
| |
Collapse
|
44
|
Teige C, Mollo G, Millman R, Savill N, Smallwood J, Cornelissen PL, Jefferies E. Dynamic semantic cognition: Characterising coherent and controlled conceptual retrieval through time using magnetoencephalography and chronometric transcranial magnetic stimulation. Cortex 2018; 103:329-349. [PMID: 29684752 PMCID: PMC6002612 DOI: 10.1016/j.cortex.2018.03.024] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/19/2017] [Revised: 01/24/2018] [Accepted: 03/20/2018] [Indexed: 12/14/2022]
Abstract
Distinct neural processes are thought to support the retrieval of semantic information that is (i) coherent with strongly-encoded aspects of knowledge, and (ii) non-dominant yet relevant for the current task or context. While the brain regions that support readily coherent and more controlled patterns of semantic retrieval are relatively well-characterised, the temporal dynamics of these processes are not well-understood. This study used magnetoencephalography (MEG) and dual-pulse chronometric transcranial magnetic stimulation (cTMS) in two separate experiments to examine temporal dynamics during the retrieval of strong and weak associations. MEG results revealed a dissociation within left temporal cortex: anterior temporal lobe (ATL) showed greater oscillatory response for strong than weak associations, while posterior middle temporal gyrus (pMTG) showed the reverse pattern. Left inferior frontal gyrus (IFG), a site associated with semantic control and retrieval, showed both patterns at different time points. In the cTMS experiment, stimulation of ATL at ∼150 msec disrupted the efficient retrieval of strong associations, indicating a necessary role for ATL in coherent conceptual activations. Stimulation of pMTG at the onset of the second word disrupted the retrieval of weak associations, suggesting this site may maintain information about semantic context from the first word, allowing efficient engagement of semantic control. Together these studies provide converging evidence for a functional dissociation within the temporal lobe, across both tasks and time.
Collapse
Affiliation(s)
- Catarina Teige
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| | - Giovanna Mollo
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| | - Rebecca Millman
- Manchester Centre for Audiology and Deafness, Division of Human Communication, Development and Hearing, School of Health Sciences, Faculty of Biology, Medicine and Health, University of Manchester, UK
| | - Nicola Savill
- Department of Psychology and York Neuroimaging Centre, University of York, UK; School of Psychology and Social Science, York St John University, York, UK
| | - Jonathan Smallwood
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| | | | - Elizabeth Jefferies
- Department of Psychology and York Neuroimaging Centre, University of York, UK.
| |
Collapse
|
45
|
Jung J, Williams SR, Sanaei Nezhad F, Lambon Ralph MA. GABA concentrations in the anterior temporal lobe predict human semantic processing. Sci Rep 2017; 7:15748. [PMID: 29146995 PMCID: PMC5691052 DOI: 10.1038/s41598-017-15981-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2017] [Accepted: 11/01/2017] [Indexed: 11/16/2022] Open
Abstract
There is now considerable convergent evidence from multiple methodologies and clinical studies that the human anterior temporal lobe (ATL) is a semantic representational hub. However, the neurochemical nature of the ATL in the semantic processing remains unclear. The current study investigated the neurochemical mechanism underlying semantic processing in the ATL. We combined functional magnetic resonance imaging (fMRI) with resting-state magnetic resonance spectroscopy (MRS) to measure task-related blood-oxygen level-dependent (BOLD) signal changes during sematic processing and resting-state GABA concentrations in the ATL. Our combined fMRI and MRS investigation showed that the stronger ATL BOLD response induced by the semantic task, the lower GABA concentration in the same region. Moreover, individuals with higher GABA concentration in the ATL showed better semantic performance and stronger BOLD-related fluctuations in the semantic network. Our data demonstrated that the resting-state GABA concentration predicts neural changes in the human ATL and task performance during semantic processing. Our findings indicate that individuals with higher GABA may have a more efficient semantic processing leading to better task performance and imply that GABAergic neurochemical processes are potentially crucial to the neurobiological contribution of the ATL to semantic cognition.
Collapse
Affiliation(s)
- JeYoung Jung
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences, University of Manchester, Manchester, UK.
| | - Stephen R Williams
- Centre for Imaging Science and Manchester Academic Health Sciences Centre, University of Manchester, Manchester, UK
| | - Faezeh Sanaei Nezhad
- Centre for Imaging Science and Manchester Academic Health Sciences Centre, University of Manchester, Manchester, UK
| | - Matthew A Lambon Ralph
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences, University of Manchester, Manchester, UK.
| |
Collapse
|
46
|
Iljina O, Derix J, Schirrmeister RT, Schulze-Bonhage A, Auer P, Aertsen A, Ball T. Neurolinguistic and machine-learning perspectives on direct speech BCIs for restoration of naturalistic communication. BRAIN-COMPUTER INTERFACES 2017. [DOI: 10.1080/2326263x.2017.1330611] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- Olga Iljina
- GRK 1624 ‘Frequency effects in language’, University of Freiburg, Freiburg, Germany
- Department of German Linguistics, University of Freiburg, Freiburg, Germany
- Hermann Paul School of Linguistics, University of Freiburg, Germany
- BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
- Neurobiology and Biophysics, Faculty of Biology, University of Freiburg, Freiburg, Germany
| | - Johanna Derix
- BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
- Translational Neurotechnology Lab, Department of Neurosurgery, University Medical Center Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Robin Tibor Schirrmeister
- BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
- Translational Neurotechnology Lab, Department of Neurosurgery, University Medical Center Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Andreas Schulze-Bonhage
- Epilepsy Center, Department of Neurosurgery, University Medical Center Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
- BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
| | - Peter Auer
- GRK 1624 ‘Frequency effects in language’, University of Freiburg, Freiburg, Germany
- Department of German Linguistics, University of Freiburg, Freiburg, Germany
- Hermann Paul School of Linguistics, University of Freiburg, Germany
- Freiburg Institute for Advanced Studies (FRIAS), University of Freiburg, Freiburg, Germany
| | - Ad Aertsen
- Neurobiology and Biophysics, Faculty of Biology, University of Freiburg, Freiburg, Germany
- Bernstein Center Freiburg, University of Freiburg, Germany
| | - Tonio Ball
- BrainLinks-BrainTools, University of Freiburg, Freiburg, Germany
- Translational Neurotechnology Lab, Department of Neurosurgery, University Medical Center Freiburg, Faculty of Medicine, University of Freiburg, Freiburg, Germany
| |
Collapse
|
47
|
Jackson RL, Bajada CJ, Rice GE, Cloutman LL, Lambon Ralph MA. An emergent functional parcellation of the temporal cortex. Neuroimage 2017; 170:385-399. [PMID: 28419851 DOI: 10.1016/j.neuroimage.2017.04.024] [Citation(s) in RCA: 60] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2016] [Revised: 04/07/2017] [Accepted: 04/08/2017] [Indexed: 12/13/2022] Open
Abstract
The temporal lobe has been associated with various cognitive functions which include memory, auditory cognition and semantics. However, at a higher level of conceptualisation, all of the functions associated with the temporal lobe can be considered as lying along one major axis; from modality-specific to modality-general processing. This paper used a spectral reordering technique on resting-state and task-based functional data to extract the major organisational axis of the temporal lobe in a bottom-up, data-driven fashion. Independent parcellations were performed on resting-state scans from 71 participants and active semantic task scans from 23 participants acquired using dual echo gradient echo planar imaging in order to preserve signal in inferior temporal cortex. The resulting organisational axis was consistent (over dataset and hemisphere) and progressed from superior temporal gyrus and posterior inferior temporal cortex to ventrolateral anterior temporal cortex. A hard parcellation separated a posterior (superior temporal and posterior fusiform and inferior temporal gyri) and an anterior cluster (ventrolateral anterior temporal lobe). The functional connectivity of the hard clusters supported the hypothesis that the connectivity gradient separated modality-specific and modality-general regions. This hypothesis was then directly tested by performing a VOI analysis upon an independent semantic task-based data set including auditory and visually presented stimuli. This confirmed that the ventrolateral anterior aspects of the temporal lobe are associated with modality-general processes whilst posterior and superior aspects are specific to certain modalities, with the posterior inferior subregions involved in visual processes and superior regions involved in audition.
Collapse
Affiliation(s)
- Rebecca L Jackson
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences (Zochonis Building), University of Manchester, M13 9PL, UK
| | - Claude J Bajada
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences (Zochonis Building), University of Manchester, M13 9PL, UK
| | - Grace E Rice
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences (Zochonis Building), University of Manchester, M13 9PL, UK
| | - Lauren L Cloutman
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences (Zochonis Building), University of Manchester, M13 9PL, UK
| | - Matthew A Lambon Ralph
- Neuroscience and Aphasia Research Unit (NARU), Division of Neuroscience & Experimental Psychology, School of Biological Sciences (Zochonis Building), University of Manchester, M13 9PL, UK.
| |
Collapse
|
48
|
Joyal M, Brambati SM, Laforce RJ, Montembeault M, Boukadi M, Rouleau I, Macoir J, Joubert S, Fecteau S, Wilson MA. The Role of the Left Anterior Temporal Lobe for Unpredictable and Complex Mappings in Word Reading. Front Psychol 2017; 8:517. [PMID: 28424650 PMCID: PMC5380751 DOI: 10.3389/fpsyg.2017.00517] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2016] [Accepted: 03/21/2017] [Indexed: 11/13/2022] Open
Abstract
The anterior temporal lobes (ATLs) have been consistently associated with semantic processing which, in turn, has a key role in reading aloud single words. This study aimed to investigate (1) the reading abilities in patients with the semantic variant of primary progressive aphasia (svPPA), and (2) the relationship between gray matter (GM) volume of the left ATL and word reading performance using voxel-based morphometry (VBM). Three groups of participants (svPPA, Alzheimer’s Disease, AD and healthy elderly adults) performed a reading task with exception words, regular words and pseudowords, along with a structural magnetic resonance imaging scan. For exception words, the svPPA group had a lower accuracy and a greater number of regularization errors as compared to the control groups of healthy participants and AD patients. Similarly, for regular words, svPPA patients had a lower accuracy in comparison with AD patients, and a greater number of errors related to complex orthography-to-phonology mappings (OPM) in comparison to both control groups. VBM analyses revealed that GM volume of the left ATL was associated with the number of regularization errors. Also, GM volume of the left lateral ATL was associated with the number of errors with complex OPM during regular word reading. Our results suggest that the left ATL might play a role in the reading of exception words, in accordance with its role in semantic processing. Results further support the involvement of the left lateral ATL in combinatorial processes, including the integration of semantic and phonological information, for both exception and regular words.
Collapse
Affiliation(s)
- Marilyne Joyal
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Québec and Département de Réadaptation, Université Laval, Québec CityQC, Canada.,Centre Interdisciplinaire de Recherche en Réadaptation et Intégration Sociale and Département de Réadaptation, Université Laval, Québec CityQC, Canada
| | - Simona M Brambati
- Centre de Recherche de l'Institut Universitaire de Gériatrie and Département de Psychologie, Université de Montréal, MontréalQC, Canada
| | - Robert J Laforce
- Clinique Interdisciplinaire de Mémoire, Centre Hospitalier Universitaire de Québec and Département des Sciences Neurologiques, Université Laval, Québec CityQC, Canada
| | - Maxime Montembeault
- Centre de Recherche de l'Institut Universitaire de Gériatrie and Département de Psychologie, Université de Montréal, MontréalQC, Canada
| | - Mariem Boukadi
- Centre de Recherche de l'Institut Universitaire de Gériatrie and Département de Psychologie, Université de Montréal, MontréalQC, Canada
| | - Isabelle Rouleau
- Centre de Recherche du Centre Hospitalier de l'Université de Montréal, Axe Neurosciences et Département de Psychologie, Université du Québec à Montréal, MontréalQC, Canada
| | - Joël Macoir
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Québec and Département de Réadaptation, Université Laval, Québec CityQC, Canada
| | - Sven Joubert
- Centre de Recherche de l'Institut Universitaire de Gériatrie and Département de Psychologie, Université de Montréal, MontréalQC, Canada
| | - Shirley Fecteau
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Québec and Département de Réadaptation, Université Laval, Québec CityQC, Canada.,Centre Interdisciplinaire de Recherche en Réadaptation et Intégration Sociale and Département de Réadaptation, Université Laval, Québec CityQC, Canada
| | - Maximiliano A Wilson
- Centre de Recherche de l'Institut Universitaire en Santé Mentale de Québec and Département de Réadaptation, Université Laval, Québec CityQC, Canada
| |
Collapse
|
49
|
Rupp K, Roos M, Milsap G, Caceres C, Ratto C, Chevillet M, Crone NE, Wolmetz M. Semantic attributes are encoded in human electrocorticographic signals during visual object recognition. Neuroimage 2017; 148:318-329. [DOI: 10.1016/j.neuroimage.2016.12.074] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2016] [Revised: 12/21/2016] [Accepted: 12/26/2016] [Indexed: 10/20/2022] Open
|
50
|
Murphy C, Rueschemeyer SA, Watson D, Karapanagiotidis T, Smallwood J, Jefferies E. Fractionating the anterior temporal lobe: MVPA reveals differential responses to input and conceptual modality. Neuroimage 2016; 147:19-31. [PMID: 27908787 PMCID: PMC5315053 DOI: 10.1016/j.neuroimage.2016.11.067] [Citation(s) in RCA: 45] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2016] [Revised: 11/23/2016] [Accepted: 11/27/2016] [Indexed: 12/12/2022] Open
Abstract
Words activate cortical regions in accordance with their modality of presentation (i.e., written vs. spoken), yet there is a long-standing debate about whether patterns of activity in any specific brain region capture modality-invariant conceptual information. Deficits in patients with semantic dementia highlight the anterior temporal lobe (ATL) as an amodal store of semantic knowledge but these studies do not permit precise localisation of this function. The current investigation used multiple imaging methods in healthy participants to examine functional dissociations within ATL. Multi-voxel pattern analysis identified spatially segregated regions: a response to input modality in anterior superior temporal gyrus (aSTG) and a response to meaning in more ventral anterior temporal lobe (vATL). This functional dissociation was supported by resting-state connectivity that found greater coupling for aSTG with primary auditory cortex and vATL with the default mode network. A meta-analytic decoding of these connectivity patterns implicated aSTG in processes closely tied to auditory processing (such as phonology and language) and vATL in meaning-based tasks (such as comprehension or social cognition). Thus we provide converging evidence for the segregation of meaning and input modality in the ATL.
Collapse
Affiliation(s)
- Charlotte Murphy
- Department of Psychology and York Neuroimaging Centre, University of York, UK.
| | | | - David Watson
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| | | | - Jonathan Smallwood
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| | - Elizabeth Jefferies
- Department of Psychology and York Neuroimaging Centre, University of York, UK
| |
Collapse
|