1
|
Mazzuca C, Villani C, Lamarra T, Bolognesi MM, Borghi AM. Abstractness impacts conversational dynamics. Cognition 2025; 258:106084. [PMID: 39954368 DOI: 10.1016/j.cognition.2025.106084] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2024] [Revised: 02/07/2025] [Accepted: 02/08/2025] [Indexed: 02/17/2025]
Abstract
Conversation topics may vary in abstractness. This might impact the effort required by speakers to reach a common ground and, ultimately, an interactive alignment. In fact, people typically feel less confident with abstract concepts and single-words rating studies suggest abstract concepts are more associated with social interactions than concrete concepts-hence suggesting increasing levels of abstractness enhance inner and mutual monitoring processes. However, experimental studies addressing conversational dynamics afforded by abstract concepts are still sparse. In three preregistered experiments we ask whether abstract sentences are associated with specific constructs in dialogue, i.e., higher uncertainty, more curiosity and willingness to continue a conversation, and more questions related to causal and agency aspects. We do so by asking participants to evaluate the plausibility of linguistic exchanges referring to concrete and abstract concepts. Results support theories proposing that abstract concepts involve more inner monitoring and social dynamics compared to concrete concepts and suggest that reaching alignment in dialogue is more effortful with abstract than with concrete concepts.
Collapse
Affiliation(s)
- Claudia Mazzuca
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, via degli Apuli 1, Rome 00185, Italy.
| | - Caterina Villani
- Department of Modern Languages, Literatures, and Cultures, University of Bologna, via Cartoleria 5, Bologna 40124, Italy
| | - Tommaso Lamarra
- Department of Modern Languages, Literatures, and Cultures, University of Bologna, via Cartoleria 5, Bologna 40124, Italy
| | - Marianna Marcella Bolognesi
- Department of Modern Languages, Literatures, and Cultures, University of Bologna, via Cartoleria 5, Bologna 40124, Italy
| | - Anna M Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, via degli Apuli 1, Rome 00185, Italy; Institute of Cognitive Sciences and Technologies, Italian National Research Council, via Romagnosi 18/A, Rome 00196, Italy
| |
Collapse
|
2
|
Vlašiček D, Dumančić F, Tonković M. Lexical decision times for nouns from the Croatian Psycholinguistic Database. Behav Res Methods 2025; 57:156. [PMID: 40281369 DOI: 10.3758/s13428-025-02676-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/31/2025] [Indexed: 04/29/2025]
Abstract
Megastudies are one of the tools that researchers in psychology and linguistics use when investigating various language phenomena. This study presents an analysis of the association between word length, subjective frequency, concreteness and age of acquisition ratings, and reaction times in a visual lexical decision task. Using a megastudy paradigm, we collected data on 2614 Croatian nouns from a total of 92 participants. The results of the analyses conducted on the dataset mostly confirm the findings of previous research - shorter lexical decision times are associated with more frequent words, shorter words, and words acquired earlier in life. Findings on the association between lexical decision times and word concreteness are mixed. Both reaction-level and aggregate data related to the study have been made freely available to the public. The datasets contain lexical decision times as well as variables available from the Croatian Psycholinguistic Database.
Collapse
Affiliation(s)
- Denis Vlašiček
- Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Ivana Lučića 3, 10000, Zagreb, Croatia.
| | - Francesca Dumančić
- Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Ivana Lučića 3, 10000, Zagreb, Croatia
| | - Mirjana Tonković
- Department of Psychology, Faculty of Humanities and Social Sciences, University of Zagreb, Ivana Lučića 3, 10000, Zagreb, Croatia
| |
Collapse
|
3
|
Giacobbe C, Baiano C, Vitale C, Amboni M, Santangelo G. Flexibility of action verbs processing in Parkinson's disease. J Int Neuropsychol Soc 2025:1-9. [PMID: 40274640 DOI: 10.1017/s135561772500013x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/26/2025]
Abstract
OBJECTIVE This study aims to investigate action language processing abilities in Parkinson's disease (PD) compared to healthy controls (HCs), specifically examining whether the involvement of motor systems is influenced by task context. By focusing on implicit versus explicit task demands, the study evaluates how semantic processing differs in PD and whether these differences align with a flexible embodied cognition framework. METHODS The study analyzed the performance of participants on two tasks: an explicit task (semantic judgment task, SJ) and an implicit task (letter detection task, LD). PD outpatients (n = 31, mean age 64.58 years) referred to the Parkinson and Movement Disorders Unit of ICS Maugeri Hermitage were enrolled, along with a group of healthy controls (n = 31, mean age 64.19 years). Performance was measured through reaction times (RTs) and accuracy scores (Acc) during the processing of action verbs and abstract verbs. RESULTS PD patients exhibited slower RTs and lower accuracy when processing action verbs compared to abstract verbs, but only during the SJ task. Slower RTs in the SJ task were predicted by language and executive functioning (semantic fluency) and disease progression (Hoehn and Yahr stages) for both action and abstract verbs. In the LD task, slower RTs were predicted by executive functioning for action verbs and attention (measured by Trail Making Test Part B and Stroop task) for abstract verbs. CONCLUSIONS The findings suggest a context-dependent involvement of the motor system in action language processing, supporting a flexible, embodied approach to conceptual semantic processing rather than an automatic one.
Collapse
Affiliation(s)
- Chiara Giacobbe
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Chiara Baiano
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| | - Carmine Vitale
- Department of Medical, Human Movement and Well-being Sciences, University "Parthenope", Naples, Italy
- Clinical and Scientific Institutes (ICS) Maugeri Hermitage, Naples, Italy
| | - Marianna Amboni
- Department of Medicine, Surgery and Dentistry, University of Salerno, Salerno, Italy
| | - Gabriella Santangelo
- Department of Psychology, University of Campania "Luigi Vanvitelli", Caserta, Italy
| |
Collapse
|
4
|
McCabe C, Cahalan S, Pincus M, Rosenberg-Lee M, Graves WW. Neural correlates of reading aloud on the autism spectrum. Sci Rep 2025; 15:8240. [PMID: 40064934 PMCID: PMC11894215 DOI: 10.1038/s41598-025-88903-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2024] [Accepted: 01/31/2025] [Indexed: 03/14/2025] Open
Abstract
Individuals with autism can show intact decoding (i.e., ability to recognize and pronounce written words accurately). However, reading comprehension (i.e., ability to infer meaning from written text) in autistic individuals is often lower than expected based on age or grade level. Having intact decoding skills despite potentially atypical reading comprehension suggests altered reading pathways in autism, particularly when processing semantics (i.e., word meaning). To test for neural differences in word processing between autistic and non-autistic younger adults, we examined behavioral and neural responses to reading aloud words and pronounceable nonsense words (pseudowords). Additionally, we manipulated word imageability, word frequency, and word and pseudoword spelling-sound consistency as probes for different components (i.e., orthography, phonology and semantics) of the reading system. Behaviorally, the autistic group had a greater reduction in reaction time as word imageability increased. Neurally, pseudoword consistency effects, a probe of spelling-sound mappings without semantics, were only observed in the autistic group, where increased consistency was associated with decreased activity in bilateral intraparietal sulcus. Also compared to the non-autistic group, the autistic group showed greater effects of word consistency, where increasing word consistency was associated with increasing activation in the bilateral posterior superior temporal gyrus and ventral occipitotemporal cortex. Finally, the autistic group showed stronger effects of pseudoword consistency than the non-autistic group, that is increasing pseudoword consistency was associated with decreasing activation in the left ventral occipitotemporal cortex. Together, these results point to differences in how neural resources are used for reading, with more bilateral areas recruited during spelling-sound decoding in autistics to achieve comparable performance to non-autistics.
Collapse
Affiliation(s)
- Cory McCabe
- Department of Psychology, Rutgers University, Newark, NJ, 07102, USA.
| | - Shannon Cahalan
- Department of Psychological and Brain Sciences, George Washington University, Washington, DC, 20052, USA
| | - Melanie Pincus
- Department of Psychology, Rutgers University, Newark, NJ, 07102, USA
| | | | - William W Graves
- Department of Psychology, Rutgers University, Newark, NJ, 07102, USA.
| |
Collapse
|
5
|
Wang T, Xu X. A generative approach to extrapolate word concreteness ratings. Q J Exp Psychol (Hove) 2025:17470218251320641. [PMID: 39891373 DOI: 10.1177/17470218251320641] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2025]
Abstract
A wealth of psycholinguistic and clinical research is supported by normative ratings of lexicosemantic properties, e.g., word concreteness, word valence, age-of-acquisition, etc. Collecting such ratings for a sufficiently large number of words is, however, notoriously labour-intensive. This study utilised the mixture density network (MDN), a generative approach, to implement a computational expansion of the concreteness ratings for simplified Chinese words. Based on different word embeddings, the MDN was trained to generate the probability density of a word's trial-level ratings, allowing us to predict not only the word's mean concreteness rating (con.mean), but also the potential variability (con.var) in people's perceptions about the word's concreteness. The resulting estimates were shown to largely converge with human ratings in both central tendency and variability, and to precisely reflect the important representational features of the construct. Apart from these internal validations, we also examined the contributions of con.mean to Chinese lexical processing. The results revealed the concreteness effect on event-related potentials associated with visual word recognition. To assist and enhance future research, we released the extrapolated concreteness ratings, along with degrees of variability, for over 78,000 Chinese words in the Open Science Framework (https://osf.io/gwr5h/).
Collapse
Affiliation(s)
- Tianqi Wang
- School of Foreign Languages, Shanghai Jiao Tong University, Shanghai, China
- Speech Science Laboratory, The University of Hong Kong, Hong Kong, China
| | - Xu Xu
- School of Foreign Languages, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
6
|
Tian L, Chen H, Kujala J, Parviainen T. Spatiotemporal dynamics of abstract concept processing: An MEG study. BRAIN AND LANGUAGE 2025; 260:105505. [PMID: 39637563 DOI: 10.1016/j.bandl.2024.105505] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/04/2023] [Revised: 08/06/2024] [Accepted: 11/27/2024] [Indexed: 12/07/2024]
Abstract
Our current understanding of how linguistic concepts are represented and retrieved in the brain is largely based on studies using concrete language, and only few studies have focused on the neural correlates of abstract concepts. The role of the motor system, besides the classical language network, has been intensively discussed in action-related concrete concepts. To advance our understanding of spatiotemporal dynamics underlying abstract concept processing, our study investigated to what extent language and motor regions are engaged in the processing of abstract concepts vs. concrete concepts. We used concrete, metaphorical, and abstract phrases as stimuli, creating a graded continuum of abstractness. Neuromagnetic signals were recorded from 26 Chinese native speakers using a 306-channel whole-head magnetoencephalography (MEG) system. Cluster-based permutation F-tests were carried out on the amplitude of source waveform for individual language and motor regions of interest (ROIs) in the three consecutive time-windows (200-300, 300-400, and 400-500 ms). Results showed that, compared with concrete and metaphorical phrases, abstract phrases evoked significantly weaker activation in the left posterior part of superior temporal sulcus (STS) at 200-300 ms, and significantly stronger activation in the left anterior temporal pole (TP) at 300-400 ms. We found no significant differences in the involvement of motor ROIs across conditions. Our results suggest that concrete concept processing engages more the posterior STS in an earlier time window, while abstract concept processing relies more strongly on the anterior TP in a later time window. Results are discussed by revisiting the ATL (anterior temporal lobe)-hub hypothesis and the novel definition of concrete and abstract concepts.
Collapse
Affiliation(s)
- Lili Tian
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä 40014, Finland; School of Foreign Languages, Dalian University of Technology, Dalian 116024, China; Language and Brain Research Centre, Sichuan International Studies University, Chongqing 400031, China
| | - Hongjun Chen
- School of Foreign Languages, Dalian University of Technology, Dalian 116024, China.
| | - Jan Kujala
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland
| | - Tiina Parviainen
- Department of Psychology, University of Jyväskylä, Jyväskylä 40014, Finland; Centre for Interdisciplinary Brain Research, University of Jyväskylä, Jyväskylä 40014, Finland.
| |
Collapse
|
7
|
Bahrami Balani A, Bickerton WL. Acquired reading impairment following brain injury. APPLIED NEUROPSYCHOLOGY. ADULT 2025; 32:1-19. [PMID: 36745703 DOI: 10.1080/23279095.2023.2165923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/08/2023]
Abstract
This large-scale patient study investigated the rate, unique signatures associated with acquired reading impairments, its neurocognitive correlates, and long-term outcome in 731 acute stroke patients using the sentence and non-word reading subtests of Birmingham Cognitive Screen (BCoS). The objectives for the study were to explore the (i) potentially different error patterns among adult patients, (ii) associative relationship between the different subclasses of reading impairment and performance in other cognitive domains, and (iii) recovery rates in patients nine months post-lesion compared with their initial performance. The study revealed distinctive reading impairment profiles in patients with left hemisphere (LH) and right hemisphere (RH) lesions. Some interesting associations between reading disorder and other cognitive functions were observed. Nine months post-lesion, both groups showed some recovery in reading performance compared with their baseline performance, but the rate of improvement was higher for the LH group. The study reveals unique reading profiles and impairment patterns among left and right hemisphere lesions. The findings of the study provide a deeper understanding of reading deficits that will inform clinical practice, planning of rehabilitative interventions of brain injured patients, and the scientific community.
Collapse
|
8
|
Hosseini E, Casto C, Zaslavsky N, Conwell C, Richardson M, Fedorenko E. Universality of representation in biological and artificial neural networks. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.12.26.629294. [PMID: 39764030 PMCID: PMC11703180 DOI: 10.1101/2024.12.26.629294] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 01/12/2025]
Abstract
Many artificial neural networks (ANNs) trained with ecologically plausible objectives on naturalistic data align with behavior and neural representations in biological systems. Here, we show that this alignment is a consequence of convergence onto the same representations by high-performing ANNs and by brains. We developed a method to identify stimuli that systematically vary the degree of inter-model representation agreement. Across language and vision, we then showed that stimuli from high- and low-agreement sets predictably modulated model-to-brain alignment. We also examined which stimulus features distinguish high- from low-agreement sentences and images. Our results establish representation universality as a core component in the model-to-brain alignment and provide a new approach for using ANNs to uncover the structure of biological representations and computations.
Collapse
Affiliation(s)
- Eghbal Hosseini
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Colton Casto
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Program in Speech and Hearing Bioscience and Technology (SHBT), Harvard University, Boston, MA, USA
- Kempner Institute for the Study of Natural and Artificial Intelligence, Harvard University, Allston, MA, USA
| | - Noga Zaslavsky
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Department of Psychology, New York University, New York, NY, USA
| | - Colin Conwell
- Department of Psychology, Harvard University, Cambridge, MA, USA
| | - Mark Richardson
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- Program in Speech and Hearing Bioscience and Technology (SHBT), Harvard University, Boston, MA, USA
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Program in Speech and Hearing Bioscience and Technology (SHBT), Harvard University, Boston, MA, USA
| |
Collapse
|
9
|
Kewenig VN, Vigliocco G, Skipper JI. When abstract becomes concrete, naturalistic encoding of concepts in the brain. eLife 2024; 13:RP91522. [PMID: 39636743 PMCID: PMC11620750 DOI: 10.7554/elife.91522] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2024] Open
Abstract
Language is acquired and processed in complex and dynamic naturalistic contexts, involving the simultaneous processing of connected speech, faces, bodies, objects, etc. How words and their associated concepts are encoded in the brain during real-world processing is still unknown. Here, the representational structure of concrete and abstract concepts was investigated during movie watching to address the extent to which brain responses dynamically change depending on visual context. First, across contexts, concrete and abstract concepts are shown to encode different experience-based information in separable sets of brain regions. However, these differences are reduced when multimodal context is considered. Specifically, the response profile of abstract words becomes more concrete-like when these are processed in visual scenes highly related to their meaning. Conversely, when the visual context is unrelated to a given concrete word, the activation pattern resembles more that of abstract conceptual processing. These results suggest that while concepts generally encode habitual experiences, the underlying neurobiological organisation is not fixed but depends dynamically on available contextual information.
Collapse
Affiliation(s)
| | | | - Jeremy I Skipper
- Experimental Psychology, University College LondonLondonUnited Kingdom
| |
Collapse
|
10
|
Garcia A, Cohen RA, Langer KG, O'Neal AG, Porges EC, Woods AJ, Williamson JB. Semantic processing in older adults is associated with distributed neural activation which varies by association and abstractness of words. GeroScience 2024; 46:6195-6212. [PMID: 38822124 PMCID: PMC11493883 DOI: 10.1007/s11357-024-01216-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Accepted: 05/20/2024] [Indexed: 06/02/2024] Open
Abstract
The extent to which the neural systems underlying semantic processes degrade with advanced age remains unresolved, which motivated the current study of neural activation on functional magnetic resonance imaging (fMRI) during semantic judgments of associated vs. unassociated, semantic vs. rhyme, and abstract vs. rhyme word pairs. Thirty-eight older adults, 55-85 years of age, performed semantic association decision tasks in a mixed event-related block fMRI paradigm involving binary judgments as to whether word pairs were related (i.e., semantically associated). As hypothesized, significantly greater activation was evident during processing of associated (vs. unassociated) word pairs in cortical areas implicated in semantic processing, including the angular gyrus, temporal cortex, and inferior frontal cortex. Cortical areas showed greater activation to unassociated (vs. associated) word pairs, primarily within a large occipital cluster. Greater activation was evident in cortical areas when response to semantic vs. phonemic word pairs. Contrasting activation during abstract vs. concrete semantic processing revealed areas of co-activation to both semantic classes, and areas that had greater response to either abstract or concrete word pairs. Neural activation across conditions did not vary as a function of greater age, indicating only minimal age-associated perturbation in neural activation during semantic processing. Therefore, the response of the semantic hubs, semantic control, and secondary association areas appear to be largely preserved with advanced age among older adults exhibiting successful cognitive aging. These findings may provide a useful clinical contrast if compared to activation among adults experiencing cognitive decline due Alzheimer's, frontal-temporal dementia, and other neurodegenerative diseases.
Collapse
Affiliation(s)
- Amanda Garcia
- Behavioral Sciences Department, James A. Haley Veterans' Hospital, Tampa, FL, USA
| | - Ronald A Cohen
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA.
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA.
- Brain Rehabilitation and Research Center, Malcom Randall VAMC, Gainesville, FL, USA.
| | - Kailey G Langer
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA
| | - Alexandria G O'Neal
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA
- Center for OCD and Anxiety Related Disorders, Department of Psychiatry, McKnight Brain Institute, College of Medicine, University of Florida, Gainesville, FL, USA
| | - Eric C Porges
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA
- Brain Rehabilitation and Research Center, Malcom Randall VAMC, Gainesville, FL, USA
| | - Adam J Woods
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA
- Center for OCD and Anxiety Related Disorders, Department of Psychiatry, McKnight Brain Institute, College of Medicine, University of Florida, Gainesville, FL, USA
| | - John B Williamson
- Center for Cognitive Aging and Memory, McKnight Brain Institute, University of Florida, Gainesville, FL, USA
- Department of Clinical and Health Psychology, College of Public Health and Health Professions, University of Florida, Gainesville, FL, USA
- Brain Rehabilitation and Research Center, Malcom Randall VAMC, Gainesville, FL, USA
- Center for OCD and Anxiety Related Disorders, Department of Psychiatry, McKnight Brain Institute, College of Medicine, University of Florida, Gainesville, FL, USA
| |
Collapse
|
11
|
Botch TL, Finn ES. Neural Representations of Concreteness and Concrete Concepts Are Specific to the Individual. J Neurosci 2024; 44:e0288242024. [PMID: 39349055 PMCID: PMC11551891 DOI: 10.1523/jneurosci.0288-24.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Revised: 08/29/2024] [Accepted: 09/09/2024] [Indexed: 10/02/2024] Open
Abstract
Different people listening to the same story may converge upon a largely shared interpretation while still developing idiosyncratic experiences atop that shared foundation. What linguistic properties support this individualized experience of natural language? Here, we investigate how the "concrete-abstract" axis-the extent to which a word is grounded in sensory experience-relates to within- and across-subject variability in the neural representations of language. Leveraging a dataset of human participants of both sexes who each listened to four auditory stories while undergoing functional magnetic resonance imaging, we demonstrate that neural representations of "concreteness" are both reliable across stories and relatively unique to individuals, while neural representations of "abstractness" are variable both within individuals and across the population. Using natural language processing tools, we show that concrete words exhibit similar neural representations despite spanning larger distances within a high-dimensional semantic space, which potentially reflects an underlying representational signature of sensory experience-namely, imageability-shared by concrete words but absent from abstract words. Our findings situate the concrete-abstract axis as a core dimension that supports both shared and individualized representations of natural language.
Collapse
Affiliation(s)
- Thomas L Botch
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| | - Emily S Finn
- Department of Psychological & Brain Sciences, Dartmouth College, Hanover, New Hampshire 03755
| |
Collapse
|
12
|
Marín-Gutiérrez A, Díez Villoria E, González Martín AM. The differential illusion memory for high-associated abstract concepts (DIM-HA) effect. Cogn Process 2024; 25:575-586. [PMID: 39153036 PMCID: PMC11541266 DOI: 10.1007/s10339-024-01220-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2024] [Accepted: 08/10/2024] [Indexed: 08/19/2024]
Abstract
A vast body of evidence has shown that concrete concepts are processed faster and more accurately than abstract concepts in a variety of cognitive tasks. This phenomenon is widely known as the concreteness effect, and explanations for its occurrence seem to reflect differences in processing and organization for both types of representations. While there is considerable evidence to support this concreteness effect, the nature of these differences is still controversial. In developing an explanation, we have proposed a relatively different approach from a false memory perspective using the Deese-Roediger-McDermott paradigm. To explore the implications of the association in creating false memories, we explore behavioral and electrophysiologically the false memory effect, where targets were manipulated according to their association strength and their concreteness. Results showed that false recognition rates differed significantly between concrete and abstract critical words when they were associated strongly with their respective lists, which led to a higher proportion of abstract false alarms both in behavioral and electrophysiological experiments. The principal outcome, which was called the DIM-HA effect, was discussed in terms of theories of associative activation and qualitatively different representation.
Collapse
Affiliation(s)
- Alejandro Marín-Gutiérrez
- Facultad de Educación y Psicología, Universidad del Atlántico Medio, Carretera de Quilmes, 37, Gran Canaria, 35017, Tafira Baja, Spain.
| | - Emiliano Díez Villoria
- Departamento de Psicología Básica, Psicobiología y Metodología de las Ciencias del Comportamiento. Facultad de Psicología, Universidad de Salamanca, Salamanca, Spain
- Instituto Universitario de Integración en la Comunidad (INICO), Universidad de Salamanca, Salamanca, Spain
| | - Ana María González Martín
- Facultad de Educación y Psicología, Universidad del Atlántico Medio, Carretera de Quilmes, 37, Gran Canaria, 35017, Tafira Baja, Spain
| |
Collapse
|
13
|
Lago S, Zago S, Bambini V, Arcara G. Pre-Stimulus Activity of Left and Right TPJ in Linguistic Predictive Processing: A MEG Study. Brain Sci 2024; 14:1014. [PMID: 39452027 PMCID: PMC11505736 DOI: 10.3390/brainsci14101014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/15/2024] [Revised: 09/10/2024] [Accepted: 09/18/2024] [Indexed: 10/26/2024] Open
Abstract
BACKGROUND The left and right temporoparietal junctions (TPJs) are two brain areas involved in several brain networks, largely studied for their diverse roles, from attentional orientation to theory of mind and, recently, predictive processing. In predictive processing, one crucial concept is prior precision, that is, the reliability of the predictions of incoming stimuli. This has been linked with modulations of alpha power as measured with electrophysiological techniques, but TPJs have seldom been studied in this framework. METHODS The present article investigates, using magnetoencephalography, whether spontaneous oscillations in pre-stimulus alpha power in the left and right TPJs can modulate brain responses during a linguistic task that requires predictive processing in literal and non-literal sentences. RESULTS Overall, results show that pre-stimulus alpha power in the rTPJ was associated with post-stimulus responses only in the left superior temporal gyrus, while lTPJ pre-stimulus alpha power was associated with post-stimulus activity in Broca's area, left middle temporal gyrus, and left superior temporal gyrus. CONCLUSIONS We conclude that both the right and left TPJs have a role in linguistic prediction, involving a network of core language regions, with differences across brain areas and linguistic conditions that can be parsimoniously explained in the context of predictive processing.
Collapse
Affiliation(s)
- Sara Lago
- IRCCS San Camillo Hospital, 30126 Venice, Italy; (S.L.); (S.Z.)
- Padova Neuroscience Center, University of Padua, 35129 Padua, Italy
| | - Sara Zago
- IRCCS San Camillo Hospital, 30126 Venice, Italy; (S.L.); (S.Z.)
| | - Valentina Bambini
- Laboratory of Neurolinguistics and Experimental Pragmatics (NEPLab), Department of Humanities and Life Sciences, University School for Advanced Studies IUSS, 27100 Pavia, Italy;
| | - Giorgio Arcara
- IRCCS San Camillo Hospital, 30126 Venice, Italy; (S.L.); (S.Z.)
- Padova Neuroscience Center, University of Padua, 35129 Padua, Italy
| |
Collapse
|
14
|
Kearney E, McMahon KL, Guenther F, Arciuli J, de Zubicaray GI. Revisiting the concreteness effect: Non-arbitrary mappings between form and concreteness of English words influence lexical processing. Cognition 2024; 254:105972. [PMID: 39388784 DOI: 10.1016/j.cognition.2024.105972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2024] [Revised: 08/08/2024] [Accepted: 09/28/2024] [Indexed: 10/12/2024]
Abstract
How do we represent and process abstract and concrete concepts? The "concreteness effect", in which words with more concrete meanings are processed more quickly and accurately across a range of language tasks compared to abstract ones, suggests a differential conceptual organization of these words in the brain. However, concrete words tend to be marked by specific phonotactic features, such as having fewer syllables and more phonological neighbours. It is unclear whether these non-arbitrary form-meaning relationships that systematically denote the concreteness of a word impact language processing. In the current study, we first establish the extent of systematic mappings between phonological/phonetic features and concreteness ratings in a large set of monosyllabic and polysyllabic English words (i.e., concreteness form typicality), then demonstrate that they significantly influence lexical processing using behavioural megastudy datasets. Surface form features predicted a significant proportion of variance in concreteness ratings of monomorphemic words (25 %) which increased with the addition of polymorphemic forms (43 %). In addition, concreteness form typicality was a significant predictor of performance on visual and auditory lexical decision, naming, and semantic (concrete/abstract) decision tasks, after controlling for a range of psycholinguistic variables and concreteness ratings. Overall, our results provide the first evidence that concreteness form typicality influences lexical processing. We discuss theoretical implications for interpretations of the concreteness effect and models of language processing that have yet to incorporate non-arbitrary relationships between form and meaning into their feature sets.
Collapse
Affiliation(s)
- Elaine Kearney
- School of Psychology and Counselling, Faculty of Health, Queensland University of Technology (QUT), Kelvin Grove, QLD 4059, Australia.
| | - Katie L McMahon
- School of Clinical Sciences, Centre for Biomedical Technologies, QUT, Kelvin Grove, QLD 4059, Australia; Herston Imaging Research Facility, Royal Brisbane & Women's Hospital, Herston, QLD 4029, Australia
| | - Frank Guenther
- Department of Speech, Language, and Hearing Sciences, Boston University, Boston, MA 02215, USA; Department of Biomedical Engineering, Boston University, Boston, MA 02215, USA
| | - Joanne Arciuli
- College of Nursing and Health Sciences, Flinders University, Bedford Park, SA 5042, Australia
| | - Greig I de Zubicaray
- School of Psychology and Counselling, Faculty of Health, Queensland University of Technology (QUT), Kelvin Grove, QLD 4059, Australia
| |
Collapse
|
15
|
Curley LJ, Lages M, Sime PJ, Munro J. Rape Myths and Verdict Systems: What Is Influencing Conviction Rates in Rape Trials in Scotland? Behav Sci (Basel) 2024; 14:619. [PMID: 39062442 PMCID: PMC11273493 DOI: 10.3390/bs14070619] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 07/09/2024] [Accepted: 07/15/2024] [Indexed: 07/28/2024] Open
Abstract
The Scottish verdict system includes three verdicts: 'guilty', 'not guilty' and 'not proven'. Politicians propose that the three-verdict system is partially to blame for the low conviction rate of rape, whereas research suggests that rape myths may be having a larger impact. To test the effects of varying verdict systems (guilty, not guilty and not proven; guilty and not guilty; a series of proven and not proven verdicts) and rape myths on juror verdicts. A total of 180 participants answered questions regarding their acceptance of rape myths using the Acceptance of Modern Myth and Sexual Aggression (AMMSA) scale. They then watched a staged rape trial filmed in a real courtroom and reached a verdict. Participants also provided longer-form answers on which thematical analysis was conducted. The main findings are as follows: (1) The special verdict system leads to a higher conviction rate than the other systems when rape myth acceptance is controlled for. (2) The higher the rape myth acceptance, the more favourably the accused was perceived and the less favourably the complainer was perceived.
Collapse
Affiliation(s)
- Lee John Curley
- Department of Psychology, Glasgow Caledonian University, Glasgow G4 0BA, UK; (L.J.C.); (P.J.S.)
| | - Martin Lages
- School of Psychology & Neuroscience, University of Glasgow, Glasgow G12 8QQ, UK;
| | - Pamela J. Sime
- Department of Psychology, Glasgow Caledonian University, Glasgow G4 0BA, UK; (L.J.C.); (P.J.S.)
| | - James Munro
- Faculty of Arts and Social Sciences, School of Psychology and Counselling, The Open University, Milton Keynes MK7 6AA, UK
| |
Collapse
|
16
|
Yao B, Scott GG, Bruce G, Monteith-Hodge E, Sereno SC. Emotion processing in concrete and abstract words: evidence from eye fixations during reading. Cogn Emot 2024:1-10. [PMID: 38961837 DOI: 10.1080/02699931.2024.2367062] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 06/05/2024] [Indexed: 07/05/2024]
Abstract
We replicated and extended the findings of Yao et al. [(2018). Differential emotional processing in concrete and abstract words. Journal of Experimental Psychology: Learning, Memory, and Cognition, 44(7), 1064-1074] regarding the interaction of emotionality, concreteness, and imageability in word processing by measuring eye fixation times on target words during normal reading. A 3 (Emotion: negative, neutral, positive) × 2 (Concreteness: abstract, concrete) design was used with 22 items per condition, with each set of six target words matched across conditions in terms of word length and frequency. Abstract (e.g. shocking, reserved, fabulous) and concrete (e.g. massacre, calendar, treasure) target words appeared (separately) within contextually neutral, plausible sentences. Sixty-three participants each read all 132 experimental sentences while their eye movements were recorded. Analyses using Gamma generalised linear mixed models revealed significant effects of both Emotion and Concreteness on all fixation measures, indicating faster processing for emotional and concrete words. Additionally, there was a significant Emotion × Concreteness interaction which, critically, was modulated by Imageability in early fixation time measures. Emotion effects were significantly larger in higher-imageability abstract words than in lower-imageability ones, but remained unaffected by imageability in concrete words. These findings support the multimodal induction hypothesis and highlight the intricate interplay of these factors in the immediate stages of word processing during fluent reading.
Collapse
Affiliation(s)
- Bo Yao
- Department of Psychology, Lancaster University, Lancaster, UK
| | - Graham G Scott
- School of Education and Social Sciences, University of the West of Scotland, Paisley, UK
| | - Gillian Bruce
- School of Education and Social Sciences, University of the West of Scotland, Paisley, UK
| | - Ewa Monteith-Hodge
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| | - Sara C Sereno
- School of Psychology and Neuroscience, University of Glasgow, Glasgow, UK
| |
Collapse
|
17
|
MacNiven S, Tench R. Keystrokes: A practical exploration of semantic drift in timed word association tasks. PLoS One 2024; 19:e0305568. [PMID: 38950044 PMCID: PMC11216599 DOI: 10.1371/journal.pone.0305568] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2024] [Accepted: 05/31/2024] [Indexed: 07/03/2024] Open
Abstract
This study investigates the phenomena of semantic drift through the lenses of language and situated simulation (LASS) and the word frequency effect (WFE) within a timed word association task. Our primary objectives were to determine whether semantic drift can be identified over the short time (25 seconds) of a free word association task (a predicted corollary of LASS), and whether more frequent terms are generated earlier in the process (as expected due to the WFE). Respondents were provided with five cue words (tree, dog, quality, plastic and love), and asked to write as many associations as they could. We hypothesized that terms generated later in the task (fourth time quartile, the last 19-25 seconds) would be semantically more distant (cosine similarity) from the cue word than those generated earlier (first quartile, the first 1-7 seconds), indicating semantic drift. Additionally, we explored the WFE by hypothesizing that earlier generated words would be more frequent and less diverse. Utilizing a dataset matched with GloVe 300B word embeddings, BERT and WordNet synsets, we analysed semantic distances among 1569 unique term pairs for all cue words across time. Our results supported the presence of semantic drift, with significant evidence of within-participant, semantic drift from the first to fourth time (LASS) and frequency (WFE) quartiles. In terms of the WFE, we observed a notable decrease in the diversity of terms generated earlier in the task, while more unique terms (greater diversity and relative uniqueness) were generated in the 4th time quartile, aligning with our hypothesis that more frequently used words dominate early stages of a word association task. We also found that the size of effects varied substantially across cues, suggesting that some cues might invoke stronger and more idiosyncratic situated simulations. Theoretically, our study contributes to the understanding of LASS and the WFE. It suggests that semantic drift might serve as a scalable indicator of the invocation of language versus simulation systems in LASS and might also be used to explore cognition within word association tasks more generally. The findings also add a temporal and relational dimension to the WFE. Practically, our research highlights the utility of word association tasks in understanding semantic drift and the diffusion of word usage over a sub-minute task, arguably the shortest practically feasible timeframe, offering a scalable method to explore group and individual changes in semantic relationships, whether via the targeted diffusion of influence in a marketing campaign, or seeking to understand differences in cognition more generally. Possible practical uses and opportunities for future research are discussed.
Collapse
Affiliation(s)
- Sean MacNiven
- Leeds Business School, Leeds Beckett University, Leeds, United Kingdom
- Glasgow School of Business for Society, Glasgow Caledonian University, Glasgow, United Kingdom
| | - Ralph Tench
- Leeds Business School, Leeds Beckett University, Leeds, United Kingdom
| |
Collapse
|
18
|
Alcalá-López D, Mei N, Margolles P, Soto D. Brain-wide representation of social knowledge. Soc Cogn Affect Neurosci 2024; 19:nsae032. [PMID: 38804694 PMCID: PMC11173195 DOI: 10.1093/scan/nsae032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Revised: 02/28/2024] [Accepted: 05/30/2024] [Indexed: 05/29/2024] Open
Abstract
Understanding how the human brain maps different dimensions of social conceptualizations remains a key unresolved issue. We performed a functional magnetic resonance imaging (MRI) study in which participants were exposed to audio definitions of personality traits and asked to simulate experiences associated with the concepts. Half of the concepts were affective (e.g. empathetic), and the other half were non-affective (e.g. intelligent). Orthogonally, half of the concepts were highly likable (e.g. sincere) and half were socially undesirable (e.g. liar). Behaviourally, we observed that the dimension of social desirability reflected the participant's subjective ratings better than affect. FMRI decoding results showed that both social desirability and affect could be decoded in local patterns of activity through distributed brain regions including the superior temporal, inferior frontal, precuneus and key nodes of the default mode network in posterior/anterior cingulate and ventromedial prefrontal cortex. Decoding accuracy was better for social desirability than affect. A representational similarity analysis further demonstrated that a deep language model significantly predicted brain activity associated with the concepts in bilateral regions of superior and anterior temporal lobes. The results demonstrate a brain-wide representation of social knowledge, involving default model network systems that support the multimodal simulation of social experience, with a further reliance on language-related preprocessing.
Collapse
Affiliation(s)
- Daniel Alcalá-López
- Consciousness group, Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain
| | - Ning Mei
- Psychology Department, Shenzhen University, Nanshan district, Guangdong province 3688, China
| | - Pedro Margolles
- Consciousness group, Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain
| | - David Soto
- Consciousness group, Basque Center on Cognition, Brain and Language, San Sebastian 20009, Spain
| |
Collapse
|
19
|
Grzybowski SJ, Wyczesany M. Hemispheric engagement during the processing of affective adjectives-an ERP divided visual field study. Laterality 2024; 29:223-245. [PMID: 38507594 DOI: 10.1080/1357650x.2024.2331278] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Accepted: 03/11/2024] [Indexed: 03/22/2024]
Abstract
The study looked into the hemispheres' involvement in emotional word encoding. It combined brain activity measures (ERPs) with behavioural data during the affective categorization task in the divided visual field presentation paradigm. Forty healthy right-handed student volunteers took part in the study, in which they viewed and evaluated 33 positive and 33 negative emotional adjectives presented to either the left or right visual field. We observed a marginally significant effect on the earlier time window (220-250 ms, the P2 component) with higher mean amplitudes evoked to the words presented to the right hemisphere, and then a strong effect on the 340-400 ms (the P3) with a reversed pattern (higher amplitudes for words presented to the left hemisphere). The latter effect was also visible in the error rates and RTs, with better overall performance for adjectives presented to the left hemisphere. There was also an effect on behavioural data of positive words only (higher error rates, shorter RTs). Thus, the study showed a particular "progression" pattern of hemispheric engagement: dependence of the initial stages of affective lexico-semantic processing on the right hemisphere, replaced by the left-hemispheric dominance for content evaluation and response programming stages.
Collapse
Affiliation(s)
- Szczepan J Grzybowski
- Institute of Applied Psychology, Faculty of Management and Social Communication, Jagiellonian University, Kraków, Poland
| | - Miroslaw Wyczesany
- Institute of Psychology, Faculty of Philosophy, Jagiellonian University, Kraków, Poland
| |
Collapse
|
20
|
Jain S, Vo VA, Wehbe L, Huth AG. Computational Language Modeling and the Promise of In Silico Experimentation. NEUROBIOLOGY OF LANGUAGE (CAMBRIDGE, MASS.) 2024; 5:80-106. [PMID: 38645624 PMCID: PMC11025654 DOI: 10.1162/nol_a_00101] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/28/2022] [Accepted: 01/18/2023] [Indexed: 04/23/2024]
Abstract
Language neuroscience currently relies on two major experimental paradigms: controlled experiments using carefully hand-designed stimuli, and natural stimulus experiments. These approaches have complementary advantages which allow them to address distinct aspects of the neurobiology of language, but each approach also comes with drawbacks. Here we discuss a third paradigm-in silico experimentation using deep learning-based encoding models-that has been enabled by recent advances in cognitive computational neuroscience. This paradigm promises to combine the interpretability of controlled experiments with the generalizability and broad scope of natural stimulus experiments. We show four examples of simulating language neuroscience experiments in silico and then discuss both the advantages and caveats of this approach.
Collapse
Affiliation(s)
- Shailee Jain
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
| | - Vy A. Vo
- Brain-Inspired Computing Lab, Intel Labs, Hillsboro, OR, USA
| | - Leila Wehbe
- Machine Learning Department, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Alexander G. Huth
- Department of Computer Science, University of Texas at Austin, Austin, TX, USA
- Department of Neuroscience, University of Texas at Austin, Austin, TX, USA
| |
Collapse
|
21
|
Gnedykh D, Tsvetova D, Mkrtychian N, Blagovechtchenski E, Kostromina S, Shtyrov Y. tDCS of right-hemispheric Wernicke's area homologue affects contextual learning of novel lexicon. Neurobiol Learn Mem 2024; 210:107905. [PMID: 38403010 DOI: 10.1016/j.nlm.2024.107905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Revised: 11/01/2023] [Accepted: 02/21/2024] [Indexed: 02/27/2024]
Abstract
Numerous studies have shown robust evidence of the right hemisphere's involvement in the language function, for instance in the processing of intonation, grammar, word meanings, metaphors, etc. However, its role in lexicon acquisition remains obscure. We applied transcranial direct current stimulation (tDCS) over the right-hemispheric homologue of Wernicke's area to assess its putative involvement in the processing of different types of novel semantics. After receiving 15 min of anodal, cathodal, or sham (placebo) tDCS, three groups of healthy participants learnt novel concrete and abstract words in the context of short stories. Learning outcomes were assessed using a battery of tests immediately after this contextual learning session and 24 h later. As a result, an inhibitory effect of cathodal tDCS and a facilitatory effect of anodal tDCS were found for abstract word acquisition only. We also found a significant drop in task performance on the second day of the assessment for both word types in all the stimulation groups, suggesting no significant influence of tDCS on the post-learning consolidation of new memory traces. The results suggest an involvement of Wernicke's right-hemispheric counterpart in initial encoding (but not consolidation) of abstract semantics, which may be explained either by the right hemispheres direct role in processing lexical semantics or by an indirect impact of tDCS on contralateral (left-hemispheric) cortical areas through cross-callosal connections.
Collapse
Affiliation(s)
- Daria Gnedykh
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, 199034 St. Petersburg, Russia; Department of Psychology, St. Petersburg State University, 199034 St. Petersburg, Russia.
| | - Diana Tsvetova
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, 199034 St. Petersburg, Russia
| | - Nadezhda Mkrtychian
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, 199034 St. Petersburg, Russia
| | - Evgeny Blagovechtchenski
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, 199034 St. Petersburg, Russia; Department of Psychology, St. Petersburg State University, 199034 St. Petersburg, Russia
| | - Svetlana Kostromina
- Laboratory of Behavioural Neurodynamics, St. Petersburg State University, 199034 St. Petersburg, Russia; Department of Psychology, St. Petersburg State University, 199034 St. Petersburg, Russia
| | - Yury Shtyrov
- Center of Functionally Integrative Neuroscience (CFIN), Department of Clinical Medicine, Aarhus University, 8000 Aarhus, Denmark
| |
Collapse
|
22
|
Maziyah Mohamed M, Jared D. Malay Lexicon Project 3: The impact of orthographic-semantic consistency on lexical decision latencies. Q J Exp Psychol (Hove) 2024; 78:17470218241234668. [PMID: 38356189 PMCID: PMC11684139 DOI: 10.1177/17470218241234668] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 01/30/2024] [Accepted: 01/30/2024] [Indexed: 02/16/2024]
Abstract
Theories of word processing propose that readers are sensitive to statistical co-occurrences between spelling and meaning. Orthographic-semantic consistency (OSC) measures provide a continuous estimate of the statistical regularities between spelling and meaning. Here we examined Malay, an Austronesian language that is agglutinative. In Malay, stems are often repeated in other words that share a related meaning (e.g., sunyi/quiet; ke-sunyi-an/silence; makan/eat; makan-an/foods). The first goal was to expand an existing large Malay database by computing OSC estimates for 2,287 monomorphemic words. The second goal was to explore the impact of root family size and OSC on lexical decision latencies for monomorphemic words. Decision latencies were collected for 1,280 Malay words of various morphological structures. Of these, data from 1,000 monomorphemic words were analysed in a series of generalised additive mixed models (GAMMs). Root family size and OSC were significant predictors of decision latencies, particularly for lower frequency words. We found a facilitative effect of root family size and OSC. Furthermore, we observed an interaction between root family size and OSC in that an effect of OSC was only apparent in words with larger root families. This interaction has not yet been explored in English but has the potential to be a new benchmark effect to test distributional models of word processing.
Collapse
Affiliation(s)
| | - Debra Jared
- Department of Psychology, University of Western Ontario, London, ON, Canada
| |
Collapse
|
23
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. Nat Hum Behav 2024; 8:544-561. [PMID: 38172630 DOI: 10.1038/s41562-023-01783-7] [Citation(s) in RCA: 20] [Impact Index Per Article: 20.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 11/10/2023] [Indexed: 01/05/2024]
Abstract
Transformer models such as GPT generate human-like language and are predictive of human brain responses to language. Here, using functional-MRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of the brain response associated with each sentence. We then use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress the activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also non-invasively control neural activity in higher-level cortical areas, such as the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA
- MIT-IBM Watson AI Lab, Cambridge, MA, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA, USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN, USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA, USA.
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA, USA.
- Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA, USA.
| |
Collapse
|
24
|
Petilli MA, Marelli M. Visual Intuitions in the Absence of Visual Experience: The Role of Direct Experience in Concreteness and Imageability Judgements. J Cogn 2024; 7:3. [PMID: 38223227 PMCID: PMC10785963 DOI: 10.5334/joc.328] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2022] [Accepted: 10/23/2023] [Indexed: 01/16/2024] Open
Abstract
The strongest formulations of grounded cognition assume that perceptual intuitions about concepts involve the re-activation of sensorimotor experience we have made with their referents in the world. Within this framework, concreteness and imageability ratings are indeed of crucial importance by operationalising the amount of perceptual interaction we have made with objects. Here we tested such an assumption by asking whether visual intuitions about concepts are provided accurately even when direct visual experience is absent. To this aim, we considered concreteness and imageability intuitions in blind people and tested whether these judgments are predicted by Image-based Frequency (IF, i.e. a data-driven estimate approximating the availability of the word referent in the visual environment). Results indicated that IF predicts perceptual intuitions with a larger extent in sighted compared to blind individuals, thus suggesting a role of direct experience in shaping our judgements. However, the effect of IF was significant not only in sighted but also in blind individuals. This indicates that having direct visual experience with objects does not play a critical role in making them concrete and imageable in a person's intuitions: people do not need visual experience to develop intuition about the availability of things in the external visual environment and use this intuition to inform concreteness/imageability judgments. Our findings fit closely the idea that perceptual judgments are the outcome of introspection/abstraction tasks invoking high-level conceptual knowledge that is not necessarily acquired via direct perceptual experience.
Collapse
Affiliation(s)
| | - Marco Marelli
- University of Milano–Bicocca, Milan, Italy
- NeuroMI, Milan Center for Neuroscience, Milan, Italy
| |
Collapse
|
25
|
Toro-Hernández FD, Migeot J, Marchant N, Olivares D, Ferrante F, González-Gómez R, González Campo C, Fittipaldi S, Rojas-Costa GM, Moguilner S, Slachevsky A, Chaná Cuevas P, Ibáñez A, Chaigneau S, García AM. Neurocognitive correlates of semantic memory navigation in Parkinson's disease. NPJ Parkinsons Dis 2024; 10:15. [PMID: 38195756 PMCID: PMC10776628 DOI: 10.1038/s41531-024-00630-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2023] [Accepted: 12/29/2023] [Indexed: 01/11/2024] Open
Abstract
Cognitive studies on Parkinson's disease (PD) reveal abnormal semantic processing. Most research, however, fails to indicate which conceptual properties are most affected and capture patients' neurocognitive profiles. Here, we asked persons with PD, healthy controls, and individuals with behavioral variant frontotemporal dementia (bvFTD, as a disease control group) to read concepts (e.g., 'sun') and list their features (e.g., hot). Responses were analyzed in terms of ten word properties (including concreteness, imageability, and semantic variability), used for group-level comparisons, subject-level classification, and brain-behavior correlations. PD (but not bvFTD) patients produced more concrete and imageable words than controls, both patterns being associated with overall cognitive status. PD and bvFTD patients showed reduced semantic variability, an anomaly which predicted semantic inhibition outcomes. Word-property patterns robustly classified PD (but not bvFTD) patients and correlated with disease-specific hypoconnectivity along the sensorimotor and salience networks. Fine-grained semantic assessments, then, can reveal distinct neurocognitive signatures of PD.
Collapse
Affiliation(s)
- Felipe Diego Toro-Hernández
- Graduate Program in Neuroscience and Cognition, Federal University of ABC, São Paulo, Brazil
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
| | - Joaquín Migeot
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
- Latin American Brain Health Institute, Universidad Adolfo Ibáñez, Santiago, Chile
| | - Nicolás Marchant
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
| | - Daniela Olivares
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
- Laboratorio de Neuropsicología y Neurociencias Clínicas, Universidad de Chile, Santiago, Chile
| | - Franco Ferrante
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires, Argentina
- National Scientific and Technical Research Council, Buenos Aires, Argentina
- Facultad de Ingeniería, Universidad de Buenos Aires, Buenos Aires, Argentina
| | - Raúl González-Gómez
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
- Latin American Brain Health Institute, Universidad Adolfo Ibáñez, Santiago, Chile
| | - Cecilia González Campo
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires, Argentina
- National Scientific and Technical Research Council, Buenos Aires, Argentina
| | - Sol Fittipaldi
- Latin American Brain Health Institute, Universidad Adolfo Ibáñez, Santiago, Chile
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires, Argentina
- Global Brain Health Institute, University of California, San Francisco, California, USA; & Trinity College, Dublin, Ireland
| | - Gonzalo M Rojas-Costa
- Department of Radiology, Clínica las Condes, Santiago, Chile
- Advanced Epilepsy Center, Clínica las Condes, Santiago, Chile
- Join Unit FISABIO-CIPF, Valencia, Spain
- School of Medicine, Finis Terrae University, Santiago, Chile
- Health Innovation Center, Clínica Las Condes, Santiago, Chile
| | - Sebastian Moguilner
- Global Brain Health Institute, University of California, San Francisco, California, USA; & Trinity College, Dublin, Ireland
| | - Andrea Slachevsky
- Memory and Neuropsychiatric Center (CMYN), Neurology Department, Hospital del Salvador & Faculty of Medicine, University of Chile, Santiago, Chile
- Geroscience Center for Brain Health and Metabolism (GERO), Santiago, Chile
- Neuropsychology and Clinical Neuroscience Laboratory (LANNEC), Physiopatology Program - Institute of Biomedical Sciences (ICBM), Neuroscience and East Neuroscience Departments, Faculty of Medicine, University of Chile, Santiago, Chile
- Neurology and Psychiatry Department, Clínica Alemana-Universidad Desarrollo, Santiago, Chile
| | - Pedro Chaná Cuevas
- Facultad de Ciencias Médicas, Universidad de Santiago de Chile, Santiago, Chile
| | - Agustín Ibáñez
- Latin American Brain Health Institute, Universidad Adolfo Ibáñez, Santiago, Chile
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires, Argentina
- Global Brain Health Institute, University of California, San Francisco, California, USA; & Trinity College, Dublin, Ireland
| | - Sergio Chaigneau
- Center for Social and Cognitive Neuroscience, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
- Center for Cognition Research, School of Psychology, Universidad Adolfo Ibáñez, Santiago, Chile
| | - Adolfo M García
- Latin American Brain Health Institute, Universidad Adolfo Ibáñez, Santiago, Chile.
- Cognitive Neuroscience Center, Universidad de San Andrés, Buenos Aires, Argentina.
- Global Brain Health Institute, University of California, San Francisco, California, USA; & Trinity College, Dublin, Ireland.
- Departamento de Lingüística y Literatura, Facultad de Humanidades, Universidad de Santiago de Chile, Santiago, Chile.
| |
Collapse
|
26
|
Petilli MA, Günther F, Marelli M. The Flickr frequency norms: What 17 years of images tagged online tell us about lexical processing. Behav Res Methods 2024; 56:126-147. [PMID: 36509941 DOI: 10.3758/s13428-022-02031-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/19/2022] [Indexed: 12/15/2022]
Abstract
Word frequency is one of the best predictors of language processing. Typically, word frequency norms are entirely based on natural-language text data, thus representing what the literature typically refers to as purely linguistic experience. This study presents Flickr frequency norms as a novel word frequency measure from a domain-specific corpus inherently tied to extra-linguistic information: words used as image tags on social media. To obtain Flickr frequency measures, we exploited the photo-sharing platform Flickr Image (containing billions of photos) and extracted the number of uploaded images tagged with each of the words considered in the lexicon. Here, we systematically examine the peculiarities of Flickr frequency norms and show that Flickr frequency is a hybrid metrics, lying at the intersection between language and visual experience and with specific biases induced by being based on image-focused social media. Moreover, regression analyses indicate that Flickr frequency captures additional information beyond what is already encoded in existing norms of linguistic, sensorimotor, and affective experience. Therefore, these new norms capture aspects of language usage that are missing from traditional frequency measures: a portion of language usage capturing the interplay between language and vision, which - this study demonstrates - has its own impact on word processing. The Flickr frequency norms are openly available on the Open Science Framework (https://osf.io/2zfs3/).
Collapse
Affiliation(s)
| | | | - Marco Marelli
- University of Milano-Bicocca, Milan, Italy
- NeuroMI, Milan Center for Neuroscience, Milan, Italy
| |
Collapse
|
27
|
Bruera A, Tao Y, Anderson A, Çokal D, Haber J, Poesio M. Modeling Brain Representations of Words' Concreteness in Context Using GPT-2 and Human Ratings. Cogn Sci 2023; 47:e13388. [PMID: 38103208 DOI: 10.1111/cogs.13388] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2023] [Revised: 09/12/2023] [Accepted: 10/27/2023] [Indexed: 12/18/2023]
Abstract
The meaning of most words in language depends on their context. Understanding how the human brain extracts contextualized meaning, and identifying where in the brain this takes place, remain important scientific challenges. But technological and computational advances in neuroscience and artificial intelligence now provide unprecedented opportunities to study the human brain in action as language is read and understood. Recent contextualized language models seem to be able to capture homonymic meaning variation ("bat", in a baseball vs. a vampire context), as well as more nuanced differences of meaning-for example, polysemous words such as "book", which can be interpreted in distinct but related senses ("explain a book", information, vs. "open a book", object) whose differences are fine-grained. We study these subtle differences in lexical meaning along the concrete/abstract dimension, as they are triggered by verb-noun semantic composition. We analyze functional magnetic resonance imaging (fMRI) activations elicited by Italian verb phrases containing nouns whose interpretation is affected by the verb to different degrees. By using a contextualized language model and human concreteness ratings, we shed light on where in the brain such fine-grained meaning variation takes place and how it is coded. Our results show that phrase concreteness judgments and the contextualized model can predict BOLD activation associated with semantic composition within the language network. Importantly, representations derived from a complex, nonlinear composition process consistently outperform simpler composition approaches. This is compatible with a holistic view of semantic composition in the brain, where semantic representations are modified by the process of composition itself. When looking at individual brain areas, we find that encoding performance is statistically significant, although with differing patterns of results, suggesting differential involvement, in the posterior superior temporal sulcus, inferior frontal gyrus and anterior temporal lobe, and in motor areas previously associated with processing of concreteness/abstractness.
Collapse
Affiliation(s)
- Andrea Bruera
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences
| | - Yuan Tao
- Department of Cognitive Science, Johns Hopkins University
| | | | - Derya Çokal
- Department of German Language and Literature I-Linguistics, University of Cologne
| | - Janosch Haber
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Chattermill, London
| | - Massimo Poesio
- School of Electronic Engineering and Computer Science, Cognitive Science Research Group, Queen Mary University of London
- Department of Information and Computing Sciences, University of Utrecht
| |
Collapse
|
28
|
Magnabosco F, Hauk O. An eye on semantics: a study on the influence of concreteness and predictability on early fixation durations. LANGUAGE, COGNITION AND NEUROSCIENCE 2023; 39:302-316. [PMID: 38533420 PMCID: PMC10962710 DOI: 10.1080/23273798.2023.2274558] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/12/2022] [Accepted: 10/17/2023] [Indexed: 03/28/2024]
Abstract
We used eye-tracking during natural reading to study how semantic control and representation mechanisms interact for the successful comprehension of sentences, by manipulating sentence context and single-word meaning. Specifically, we examined whether a word's semantic characteristic (concreteness) affects first fixation and gaze durations (FFDs and GDs) and whether it interacts with the predictability of a word. We used a linear mixed effects model including several possible psycholinguistic covariates. We found a small but reliable main effect of concreteness and replicated a predictability effect on FFDs, but we found no interaction between the two. The results parallel previous findings of additive effects of predictability (context) and frequency (lexical level) in fixation times. Our findings suggest that the semantics of a word and the context created by the preceding words additively influence early stages of word processing in natural sentence reading.
Collapse
Affiliation(s)
- Federica Magnabosco
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| | - Olaf Hauk
- MRC Cognition and Brain Sciences Unit, University of Cambridge, Cambridge, UK
| |
Collapse
|
29
|
Tuckute G, Sathe A, Srikant S, Taliaferro M, Wang M, Schrimpf M, Kay K, Fedorenko E. Driving and suppressing the human language network using large language models. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.04.16.537080. [PMID: 37090673 PMCID: PMC10120732 DOI: 10.1101/2023.04.16.537080] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/25/2023]
Abstract
Transformer models such as GPT generate human-like language and are highly predictive of human brain responses to language. Here, using fMRI-measured brain responses to 1,000 diverse sentences, we first show that a GPT-based encoding model can predict the magnitude of brain response associated with each sentence. Then, we use the model to identify new sentences that are predicted to drive or suppress responses in the human language network. We show that these model-selected novel sentences indeed strongly drive and suppress activity of human language areas in new individuals. A systematic analysis of the model-selected sentences reveals that surprisal and well-formedness of linguistic input are key determinants of response strength in the language network. These results establish the ability of neural network models to not only mimic human language but also noninvasively control neural activity in higher-level cortical areas, like the language network.
Collapse
Affiliation(s)
- Greta Tuckute
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Aalok Sathe
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Shashank Srikant
- Computer Science & Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- MIT-IBM Watson AI Lab, Cambridge, MA 02142, USA
| | - Maya Taliaferro
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Mingye Wang
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
| | - Martin Schrimpf
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Quest for Intelligence, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- Neuro-X Institute, École Polytechnique Fédérale de Lausanne, CH-1015 Lausanne, Switzerland
| | - Kendrick Kay
- Center for Magnetic Resonance Research, University of Minnesota, Minneapolis, MN 55455 USA
| | - Evelina Fedorenko
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- McGovern Institute for Brain Research, Massachusetts Institute of Technology, Cambridge, MA 02139 USA
- The Program in Speech and Hearing Bioscience and Technology, Harvard University, Cambridge, MA 02138 USA
| |
Collapse
|
30
|
Montefinese M, Gregori L, Ravelli AA, Varvara R, Radicioni DP. CONcreTEXT norms: Concreteness ratings for Italian and English words in context. PLoS One 2023; 18:e0293031. [PMID: 37862357 PMCID: PMC10588859 DOI: 10.1371/journal.pone.0293031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 10/03/2023] [Indexed: 10/22/2023] Open
Abstract
Concreteness is a fundamental dimension of word semantic representation that has attracted more and more interest to become one of the most studied variables in the psycholinguistic and cognitive neuroscience literature in the last decade. Concreteness effects have been found at both the brain and the behavioral levels, but they may vary depending on the constraints of the context and task demands. In this study, we collected concreteness norms for English and Italian words presented in different context sentences to allow better control and manipulation of concreteness in future psycholinguistic research. First, we observed high split-half correlations and Cronbach's alpha coefficients, suggesting that our ratings were highly reliable and can be used in Italian- and English-speaking populations. Second, our data indicate that the concreteness ratings are related to the lexical density and accessibility of the sentence in both English and Italian. We also found that the concreteness of words in isolation was highly correlated with that of words in context. Finally, we analyzed differences between nouns and verbs in concreteness ratings without significant effects. Our new concreteness norms of words in context are a valuable source of information for future research in both the English and Italian language. The complete database is available on the Open Science Framework (doi: 10.17605/OSF.IO/U3PC4).
Collapse
Affiliation(s)
- Maria Montefinese
- Department of Developmental and Social Psychology, University of Padova, Padova, Italy
| | - Lorenzo Gregori
- Department of Literature and Philosophy, University of Florence, Florence, Italy
| | - Andrea Amelio Ravelli
- Department of Modern Languages, Literatures, and Cultures, University of Bologna, Bologna, Italy
| | - Rossella Varvara
- Department of French, University of Fribourg, Fribourg, Switzerland
| | | |
Collapse
|
31
|
Bechtold L, Cosper SH, Malyshevskaya A, Montefinese M, Morucci P, Niccolai V, Repetto C, Zappa A, Shtyrov Y. Brain Signatures of Embodied Semantics and Language: A Consensus Paper. J Cogn 2023; 6:61. [PMID: 37841669 PMCID: PMC10573703 DOI: 10.5334/joc.237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2022] [Accepted: 07/29/2022] [Indexed: 10/17/2023] Open
Abstract
According to embodied theories (including embodied, embedded, extended, enacted, situated, and grounded approaches to cognition), language representation is intrinsically linked to our interactions with the world around us, which is reflected in specific brain signatures during language processing and learning. Moving on from the original rivalry of embodied vs. amodal theories, this consensus paper addresses a series of carefully selected questions that aim at determining when and how rather than whether motor and perceptual processes are involved in language processes. We cover a wide range of research areas, from the neurophysiological signatures of embodied semantics, e.g., event-related potentials and fields as well as neural oscillations, to semantic processing and semantic priming effects on concrete and abstract words, to first and second language learning and, finally, the use of virtual reality for examining embodied semantics. Our common aim is to better understand the role of motor and perceptual processes in language representation as indexed by language comprehension and learning. We come to the consensus that, based on seminal research conducted in the field, future directions now call for enhancing the external validity of findings by acknowledging the multimodality, multidimensionality, flexibility and idiosyncrasy of embodied and situated language and semantic processes.
Collapse
Affiliation(s)
- Laura Bechtold
- Institute for Experimental Psychology, Department for Biological Psychology, Heinrich-Heine University Düsseldorf, Germany
| | - Samuel H. Cosper
- Institute of Cognitive Science, University of Osnabrück, Germany
| | - Anastasia Malyshevskaya
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Potsdam Embodied Cognition Group, Cognitive Sciences, University of Potsdam, Germany
| | | | | | - Valentina Niccolai
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty, Heinrich-Heine University Düsseldorf, Germany
| | - Claudia Repetto
- Department of Psychology, Università Cattolica del Sacro Cuore, Milan, Italy
| | - Ana Zappa
- Laboratoire parole et langage, Aix-Marseille Université, Aix-en-Provence, France
| | - Yury Shtyrov
- Centre for Cognition and Decision making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Center of Functionally Integrative Neuroscience, Department of Clinical Medicine, Aarhus University, Denmark
| |
Collapse
|
32
|
Vignali L, Xu Y, Turini J, Collignon O, Crepaldi D, Bottini R. Spatiotemporal dynamics of abstract and concrete semantic representations. BRAIN AND LANGUAGE 2023; 243:105298. [PMID: 37399687 DOI: 10.1016/j.bandl.2023.105298] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/11/2022] [Revised: 05/19/2023] [Accepted: 06/21/2023] [Indexed: 07/05/2023]
Abstract
Dual Coding Theories (DCT) suggest that meaning is represented in the brain by a double code: a language-derived code in the Anterior Temporal Lobe (ATL) and a sensory-derived code in perceptual and motor regions. Concrete concepts should activate both codes, while abstract ones rely solely on the linguistic code. To test these hypotheses, the present magnetoencephalography (MEG) experiment had participants judge whether visually presented words relate to the senses while we recorded brain responses to abstract and concrete semantic components obtained from 65 independently rated semantic features. Results evidenced early involvement of anterior-temporal and inferior-frontal brain areas in both abstract and concrete semantic information encoding. At later stages, occipital and occipito-temporal regions showed greater responses to concrete compared to abstract features. The present findings suggest that the concreteness of words is processed first with a transmodal/linguistic code, housed in frontotemporal brain systems, and only after with an imagistic/sensorimotor code in perceptual regions.
Collapse
Affiliation(s)
- Lorenzo Vignali
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy; International School for Advanced Studies (SISSA), Trieste, Italy
| | - Yangwen Xu
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy; International School for Advanced Studies (SISSA), Trieste, Italy
| | | | - Olivier Collignon
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy; Psychological Sciences Research Institute (IPSY) and Institute of NeuroScience (IoNS), University of Louvain, Louvain-la-Neuve, Belgium; School of Health Sciences, HES-SO Valais-Wallis, The Sense Innovation and Research Center, Lausanne and Sion, Switzerland
| | - Davide Crepaldi
- International School for Advanced Studies (SISSA), Trieste, Italy
| | - Roberto Bottini
- Center for Mind/Brain Sciences (CIMeC), University of Trento, Trento, Italy.
| |
Collapse
|
33
|
Mastrandrea R, Cecchetti L, Lettieri G, Handjaras G, Leo A, Papale P, Gili T, Martini N, Latta DD, Chiappino D, Pietrini P, Ricciardi E. Information load dynamically modulates functional brain connectivity during narrative listening. Sci Rep 2023; 13:8110. [PMID: 37208405 DOI: 10.1038/s41598-023-34998-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Accepted: 05/11/2023] [Indexed: 05/21/2023] Open
Abstract
Narratives are paradigmatic examples of natural language, where nouns represent a proxy of information. Functional magnetic resonance imaging (fMRI) studies revealed the recruitment of temporal cortices during noun processing and the existence of a noun-specific network at rest. Yet, it is unclear whether, in narratives, changes in noun density influence the brain functional connectivity, so that the coupling between regions correlates with information load. We acquired fMRI activity in healthy individuals listening to a narrative with noun density changing over time and measured whole-network and node-specific degree and betweenness centrality. Network measures were correlated with information magnitude with a time-varying approach. Noun density correlated positively with the across-regions average number of connections and negatively with the average betweenness centrality, suggesting the pruning of peripheral connections as information decreased. Locally, the degree of the bilateral anterior superior temporal sulcus (aSTS) was positively associated with nouns. Importantly, aSTS connectivity cannot be explained by changes in other parts of speech (e.g., verbs) or syllable density. Our results indicate that the brain recalibrates its global connectivity as a function of the information conveyed by nouns in natural language. Also, using naturalistic stimulation and network metrics, we corroborate the role of aSTS in noun processing.
Collapse
Affiliation(s)
| | - Luca Cecchetti
- Social and Affective Neuroscience (SANe) Group, MoMiLab, IMT School for Advanced Studies, Lucca, Italy
| | - Giada Lettieri
- Social and Affective Neuroscience (SANe) Group, MoMiLab, IMT School for Advanced Studies, Lucca, Italy
- Crossmodal Perception and Plasticity Laboratory, Institute of Psychology, University of Louvain, Louvain-La-Neuve, Belgium
| | | | - Andrea Leo
- Department of Translational Research and Advanced Technologies in Medicine and Surgery, University of Pisa, Pisa, Italy
| | - Paolo Papale
- MoMiLab, IMT School for Advanced Studies, Lucca, Italy
- Department of Vision & Cognition, Netherlands Institute for Neuroscience (KNAW), 1105 BA, Amsterdam, The Netherlands
| | - Tommaso Gili
- NETWORKS, IMT School for Advanced Studies, Lucca, Italy
| | | | | | | | | | | |
Collapse
|
34
|
Ding J, Liang P, Guo X, Yang Y. The influence of conceptual concreteness on the reading acquisition and integration of novel words into semantic memory via thematic relations. Front Psychol 2023; 14:1132039. [PMID: 37251046 PMCID: PMC10211391 DOI: 10.3389/fpsyg.2023.1132039] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2022] [Accepted: 04/14/2023] [Indexed: 05/31/2023] Open
Abstract
Plenty of studies have been conducted to reveal neurocognitive underpinnings of conceptual representation. Compared with that of concrete concepts, the neurocognitive correlates of abstract concepts remain elusive. The current study aimed to investigate the influence of conceptual concreteness on the reading acquisition and integration of novel words into semantic memory. We constructed two-sentence contexts in which two-character pseudowords were embedded as novel words. Participants read the contexts to infer the meaning of novel words which were either concrete or abstract, and then performed a lexical decision task and a cued-recall memory task. In lexical decision task, primed by the learned novel words, their corresponding concepts, thematically related or unrelated words as well as unlearned pseudowords were judged whether they were words or not. In memory task, participants were presented with the novel words and asked to write down their meaning. The contextual reading and memory test can demonstrate the modulation of conceptual concreteness on novel word learning and the lexical decision task can reveal whether concrete and abstract novel words are integrated into semantic memory similarly or not. During contextual reading, abstract novel words presented for the first time elicited a larger N400 than concrete ones. In memory task, the meaning of concrete novel words was recollected better than abstract novel words. These results indicate that abstract novel words are more difficult to acquire during contextual reading, and to retain afterwards. For lexical decision task behavioral and ERPs were graded, with the longest reaction time, the lowest accuracy and the largest N400s for the unrelated words, then the thematically related words and finally the corresponding concepts of the novel words, regardless of conceptual concreteness. The results suggest that both concrete and abstract novel words can be integrated into semantic memory via thematic relations. These findings are discussed in terms of differential representational framework which posits that concrete words connect with each other via semantic similarities, and abstract ones via thematic relations.
Collapse
Affiliation(s)
- Jinfeng Ding
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Panpan Liang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Xinyu Guo
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| | - Yufang Yang
- CAS Key Laboratory of Behavioral Science, Institute of Psychology, Beijing, China
- Department of Psychology, University of Chinese Academy of Sciences, Beijing, China
| |
Collapse
|
35
|
Ding W, Ren P, Yi L, Si Y, Yang F, Li Z, Bao H, Yan S, Zhang X, Li S, Liang X, Yao L. Association of cortical and subcortical microstructure with disease severity: impact on cognitive decline and language impairments in frontotemporal lobar degeneration. Alzheimers Res Ther 2023; 15:58. [PMID: 36941645 PMCID: PMC10029187 DOI: 10.1186/s13195-023-01208-7] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Accepted: 03/13/2023] [Indexed: 03/23/2023]
Abstract
BACKGROUND Cortical and subcortical microstructural modifications are critical to understanding the pathogenic changes in frontotemporal lobar degeneration (FTLD) subtypes. In this study, we investigated cortical and subcortical microstructure underlying cognitive and language impairments across behavioral variant of frontotemporal dementia (bvFTD), semantic variant of primary progressive aphasia (svPPA), and nonfluent variant of primary progressive aphasia (nfvPPA) subtypes. METHODS The current study characterized 170 individuals with 3 T MRI structural and diffusion-weighted imaging sequences as portion of the Frontotemporal Lobar Degeneration Neuroimaging Initiative study: 41 bvFTD, 35 nfvPPA, 34 svPPA, and 60 age-matched cognitively unimpaired controls. To determine the severity of the disease, clinical dementia rating plus national Alzheimer's coordinating center behavior and language domains sum of boxes scores were used; other clinical measures, including the Boston naming test and verbal fluency test, were also evaluated. We computed surface-based cortical thickness and cortical and subcortical microstructural metrics using tract-based spatial statistics and explored their relationships with clinical and cognitive assessments. RESULTS Compared with controls, those with FTLD showed substantial cortical mean diffusivity alterations extending outside the regions with cortical thinning. Tract-based spatial statistics revealed that anomalies in subcortical white matter diffusion were widely distributed across the frontotemporal and parietal areas. Patients with bvFTD, nfvPPA, and svPPA exhibited distinct patterns of cortical and subcortical microstructural abnormalities, which appeared to correlate with disease severity, and separate dimensions of language functions. CONCLUSIONS Our findings imply that cortical and subcortical microstructures may serve as sensitive biomarkers for the investigation of neurodegeneration-associated microstructural alterations in FTLD subtypes. Flowchart of the study design (see materials and methods for detailed description).
Collapse
Affiliation(s)
- Wencai Ding
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Peng Ren
- Laboratory for Space Environment and Physical Science, Harbin Institute of Technology, Harbin, 150001, China
- School of Life Science and Technology, Harbin Institute of Technology, Harbin, 150001, China
| | - Liye Yi
- Department of Neurosurgery, The Second Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Yao Si
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Fan Yang
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Zhipeng Li
- Laboratory for Space Environment and Physical Science, Harbin Institute of Technology, Harbin, 150001, China
- School of Life Science and Technology, Harbin Institute of Technology, Harbin, 150001, China
| | - Hongbo Bao
- Department of Neurosurgery, Harbin Medical University Cancer Hospital, Harbin, 150001, China
| | - Shi Yan
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Xinyu Zhang
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Siyang Li
- Laboratory for Space Environment and Physical Science, Harbin Institute of Technology, Harbin, 150001, China
- School of Life Science and Technology, Harbin Institute of Technology, Harbin, 150001, China
| | - Xia Liang
- Laboratory for Space Environment and Physical Science, Harbin Institute of Technology, Harbin, 150001, China.
- School of Life Science and Technology, Harbin Institute of Technology, Harbin, 150001, China.
| | - Lifen Yao
- Department of Neurology, The First Affiliated Hospital of Harbin Medical University, Harbin, 150001, China.
| |
Collapse
|
36
|
Liu Q, Lupyan G. Cross-domain semantic alignment: concrete concepts are more abstract than you think. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210372. [PMID: 36571138 PMCID: PMC9791493 DOI: 10.1098/rstb.2021.0372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2022] [Accepted: 08/05/2022] [Indexed: 12/27/2022] Open
Abstract
We can easily evaluate similarities between concepts within semantic domains, e.g. doctor and nurse, or violin and piano. Here, we show that people are also able to evaluate similarities across domains, e.g. aligning doctors with pianos and nurses with violins. We argue that understanding how people do this is important for understanding conceptual organization and the ubiquity of metaphorical language. We asked people to answer questions of the form 'If a nurse were an animal, they would be a(n) …' (Experiments 1 and 2) and asked them to explain the basis for their response (Experiment 1). People converged to a surprising degree (e.g. 20% answered 'cat'). In Experiment 3, we presented people with cross-domain mappings of the form 'If a nurse were an animal, they would be a cat' and asked them to indicate how good each mapping was. The results showed that the targets people chose and their goodness ratings of a given response were predicted by similarity along abstract semantic dimensions such as valence, speed and genderedness. Reliance on such dimensions was also the most common explanation for their responses. Altogether, we show that people can evaluate similarity between very different domains in predictable ways, suggesting either that seemingly concrete concepts are represented along relatively abstract dimensions (e.g. weak-strong) or that they can be readily projected onto these dimensions. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Qiawen Liu
- Department of Psychology, University of Wisconsin, Madison, WI 53706, USA
| | - Gary Lupyan
- Department of Psychology, University of Wisconsin, Madison, WI 53706, USA
| |
Collapse
|
37
|
Winter B. Abstract concepts and emotion: cross-linguistic evidence and arguments against affective embodiment. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210368. [PMID: 36571116 PMCID: PMC9791494 DOI: 10.1098/rstb.2021.0368] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 02/07/2022] [Indexed: 12/27/2022] Open
Abstract
How are abstract concepts such as 'freedom' and 'democracy' represented in the mind? One prominent proposal suggests that abstract concepts are grounded in emotion. Supporting this 'affective embodiment' account, abstract concepts are rated to be more strongly positive or more strongly negative than concrete concepts. This paper demonstrates that this finding generalizes across languages by synthesizing rating data from Cantonese, Mandarin Chinese, Croatian, Dutch, French, German, Indonesian, Italian, Polish and Spanish. However, a deeper look at the same data suggests that the idea of emotional grounding only characterizes a small subset of abstract concepts. Moreover, when the concreteness/abstractness dimension is not operationalized using concreteness ratings, it is actually found that concrete concepts are rated as more emotional than abstract ones. Altogether, these results suggest limitations to the idea that emotion is an important factor in the grounding of abstract concepts. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Bodo Winter
- Department of English Language and Linguistics, University of Birmingham, Birmingham B15 2TT, UK
| |
Collapse
|
38
|
Borghi AM, Fernyhough C. Concepts, abstractness and inner speech. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210371. [PMID: 36571134 PMCID: PMC9791492 DOI: 10.1098/rstb.2021.0371] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2021] [Accepted: 06/23/2022] [Indexed: 12/27/2022] Open
Abstract
We explore the role of inner speech (covert self-directed talk) during the acquisition and use of concepts differing in abstractness. Following Vygotsky, inner speech results from the internalization of linguistically mediated interactions that regulate cognition and behaviour. When we acquire and process abstract concepts, uncertainties about word meaning might lead us to search actively for their meaning. Inner speech might play a role in this searching process and be differentially involved in concept learning compared with use of known concepts. Importantly, inner speech comes in different varieties-e.g. it can be expanded or condensed (with the latter involving syntactic and semantic forms of abbreviation). Do we use inner speech differently with concepts varying in abstractness? Which kinds of inner speech do we preferentially use with different kinds of abstract concepts (e.g. emotions versus numbers)? What other features of inner speech, such as dialogicality, might facilitate our use of concepts varying in abstractness (by allowing us to monitor the limits of our knowledge in simulated social exchanges, through a process we term inner social metacognition)? In tackling these questions, we address the possibility that different varieties of inner speech are flexibly used during the acquisition of concepts and their everyday use. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Anna M. Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome and Institute of Cognitive Sciences and Technologies, Italian National Research Council, Rome 00185, Italy
| | - Charles Fernyhough
- Department of Psychology, Durham University, South Road, Durham DH1 3LE, UK
| |
Collapse
|
39
|
Barbieri E, Thompson CK, Higgins J, Caplan D, Kiran S, Rapp B, Parrish T. Treatment-induced neural reorganization in aphasia is language-domain specific: Evidence from a large-scale fMRI study. Cortex 2023; 159:75-100. [PMID: 36610109 PMCID: PMC9931666 DOI: 10.1016/j.cortex.2022.11.008] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2021] [Revised: 08/14/2022] [Accepted: 11/29/2022] [Indexed: 12/23/2022]
Abstract
Studies investigating the effects of language intervention on the re-organization of language networks in chronic aphasia have resulted in mixed findings, likely related to-among other factors-the language function targeted during treatment. The present study investigated the effects of the type of treatment provided on neural reorganization. Seventy individuals with chronic stroke-induced aphasia, recruited from three research laboratories and meeting criteria for agrammatism, anomia or dysgraphia were assigned to either treatment (N = 51) or control (N = 19) groups. Participants in the treatment group received 12-weeks of language intervention targeting sentence comprehension/production, naming, or spelling. At baseline and post-testing, all participants performed an fMRI story comprehension task, with blocks of auditorily-presented stories alternated with blocks of reversed speech. Participants in the treatment, but not control, group significantly improved in the treated language domain. FMRI region-of-interest (ROI) analyses, conducted within regions that were either active (or homologous to active) regions in a group of 22 healthy participants on the story comprehension task, revealed a significant increase in activation from pre-to post-treatment in right-hemisphere homologues of these regions for participants in the sentence and spelling, but not naming, treatment groups, not predicted by left-hemisphere lesion size. For the sentence (but not the spelling) treatment group, activation changes within right-hemisphere homologues of language regions were positively associated with changes in measures of verb and sentence comprehension. These findings support previous research pointing to recruitment of right hemisphere tissue as a viable route for language recovery and suggest that sentence-level treatment may promote greater neuroplasticity on naturalistic, language comprehension tasks, compared to word-level treatment.
Collapse
Affiliation(s)
- Elena Barbieri
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Communication Sciences and Disorders, School of Communication, Northwestern University, 70 Arts Circle Drive, Evanston, IL 60208, USA.
| | - Cynthia K Thompson
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Communication Sciences and Disorders, School of Communication, Northwestern University, 70 Arts Circle Drive, Evanston, IL 60208, USA; Department of Neurology, Feinberg School of Medicine, Northwestern University, 303 East Chicago Avenue, Chicago, IL 60611, USA
| | - James Higgins
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N Michigan Avenue, Chicago, IL 60611, USA
| | - David Caplan
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Neurology, Massachusetts General Hospital, Harvard Medical School, 15 Parkman Street, Boston, MA 02114, USA
| | - Swathi Kiran
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Speech, Language, And Hearing, College of Health & Rehabilitation, Boston University, 635 Commonwealth Avenue, Boston, MA 02215, USA
| | - Brenda Rapp
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Cognitive Science, Krieger School of Arts & Sciences, Johns Hopkins Univeristy, 3400 N Charles Street, Baltimore, MD 21218, USA
| | - Todd Parrish
- Center for the Neurobiology of Language Recovery, Northwestern University, 2240 Campus Drive, Evanston, IL 60208, USA; Department of Radiology, Feinberg School of Medicine, Northwestern University, 737 N Michigan Avenue, Chicago, IL 60611, USA
| |
Collapse
|
40
|
Abstract
It is well-established that both phonological and semantic knowledge influence verbal working memory. However, the focus has primarily been on understanding phonological effects despite evidence of semantic influences. Articulatory suppression is a well-established task for preventing phonological processing. Methods to prevent semantic processing have rarely been used in the past, highlighting a need for developing a semantic interference task. We, therefore, conceptualised two novel tasks - an animacy categorisation and semantic relatedness judgement task. This study explored the impact of phonological (articulatory suppression) and semantic loads (animacy categorisation and semantic relatedness judgement) on immediate and delayed sentence recall. Additionally, sentence concreteness (concrete vs. abstract sentences) indexed semantic knowledge in verbal working memory. Across two studies, immediate recall revealed that articulatory suppression (preventing phonological processing) increased the size of the concreteness effect, while the novel semantic tasks (preventing semantic processing) reduced it suggesting that our semantic tasks were indeed imposing a semantic load. Further, relative long-term performance showed that more new words were remembered in articulatory suppression, whereas recall was disproportionately impaired in the semantic relatedness task. Our experimental paradigm offers phonological and semantic suppression tasks that can be used in parallel to investigate the interactions between working memory and language.
Collapse
Affiliation(s)
- Theresa Pham
- School of Communication Sciences and Disorders, University of Western Ontario, London, Canada
| | - Lisa M D Archibald
- School of Communication Sciences and Disorders, University of Western Ontario, London, Canada
| |
Collapse
|
41
|
del Rocío Hernández-Castañón V, Castillo-Ávila AA, Reyes-Meza V, Bianchi-Berthouze N, Morán AL, Orihuela-Espina F. Effect of the level of task abstraction on the transfer of knowledge from virtual environments in cognitive and motor tasks. Front Behav Neurosci 2023; 17:1162744. [PMID: 37143922 PMCID: PMC10152967 DOI: 10.3389/fnbeh.2023.1162744] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/09/2023] [Accepted: 03/27/2023] [Indexed: 05/06/2023] Open
Abstract
Introduction Virtual environments are increasingly being used for training. It is not fully understood what elements of virtual environments have the most impact and how the virtual training is integrated by the brain on the sought-after skill transference to the real environment. In virtual training, we analyzed how the task level of abstraction modulates the brain activity and the subsequent ability to execute it in the real environment and how this learning generalizes to other tasks. The training of a task under a low level of abstraction should lead to a higher transfer of skills in similar tasks, but the generalization of learning would be compromised, whereas a higher level of abstraction facilitates generalization of learning to different tasks but compromising specific effectiveness. Methods A total of 25 participants were trained and subsequently evaluated on a cognitive and a motor task following four training regimes, considering real vs. virtual training and low vs. high task abstraction. Performance scores, cognitive load, and electroencephalography signals were recorded. Transfer of knowledge was assessed by comparing performance scores in the virtual vs. real environment. Results The performance to transfer the trained skills showed higher scores in the same task under low abstraction, but the ability to generalize the trained skills was manifested by higher scores under high level of abstraction in agreement with our hypothesis. Spatiotemporal analysis of the electroencephalography revealed higher initial demands of brain resources which decreased as skills were acquired. Discussion Our results suggest that task abstraction during virtual training influences how skills are assimilated at the brain level and modulates its manifestation at the behavioral level. We expect this research to provide supporting evidence to improve the design of virtual training tasks.
Collapse
Affiliation(s)
- Viviana del Rocío Hernández-Castañón
- Department of Computational Sciences, Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, Mexico
- *Correspondence: Viviana del Rocío Hernández-Castañón
| | - Arlem Aleida Castillo-Ávila
- Department of Computational Sciences, Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, Mexico
| | - Verónica Reyes-Meza
- Centro Tlaxcala de Biología de la Conducta, Universidad Autónoma de Tlaxcala, Tlaxcala, Mexico
| | | | - Alberto L. Morán
- Faculty of Sciences, Autonomous University of Baja California, Ensenada, Mexico
| | - Felipe Orihuela-Espina
- Department of Computational Sciences, Instituto Nacional de Astrofísica, Óptica y Electrónica, Puebla, Mexico
- School of Computer Sciences, University of Birmingham, Birmingham, United Kingdom
| |
Collapse
|
42
|
Sokolowski HM, Matejko AA, Ansari D. The role of the angular gyrus in arithmetic processing: a literature review. Brain Struct Funct 2023; 228:293-304. [PMID: 36376522 DOI: 10.1007/s00429-022-02594-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 10/30/2022] [Indexed: 11/16/2022]
Abstract
Since the pioneering work of the early 20th century neuropsychologists, the angular gyrus (AG), particularly in the left hemisphere, has been associated with numerical and mathematical processing. The association between the AG and numerical and mathematical processing has been substantiated by neuroimaging research. In the present review article, we will examine what is currently known about the role of the AG in numerical and mathematical processing with a particular focus on arithmetic. Specifically, we will examine the role of the AG in the retrieval of arithmetic facts in both typically developing children and adults. The review article will consider alternative accounts that posit that the involvement of the AG is not specific to arithmetic processing and will consider how numerical and mathematical processing and their association with the AG overlap with other neurocognitive processes. The review closes with a discussion of future directions to further characterize the relationship between the angular gyrus and arithmetic processing.
Collapse
Affiliation(s)
- H Moriah Sokolowski
- Rotman Research Institute, Baycrest Hospital, North York, ON, M6A 2E1, Canada.,Numerical Cognition Laboratory, Department of Psychology & Brain and Mind Institute, University of Western Ontario, London, ON, N6A 3K, Canada
| | - Anna A Matejko
- Department of Psychology, Durham University, Durham, DH1 3LE, UK
| | - Daniel Ansari
- Numerical Cognition Laboratory, Department of Psychology & Brain and Mind Institute, University of Western Ontario, London, ON, N6A 3K, Canada.
| |
Collapse
|
43
|
The role of the angular gyrus in semantic cognition: a synthesis of five functional neuroimaging studies. Brain Struct Funct 2023; 228:273-291. [PMID: 35476027 DOI: 10.1007/s00429-022-02493-y] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2021] [Accepted: 04/04/2022] [Indexed: 01/07/2023]
Abstract
Semantic knowledge is central to human cognition. The angular gyrus (AG) is widely considered a key brain region for semantic cognition. However, the role of the AG in semantic processing is controversial. Key controversies concern response polarity (activation vs. deactivation) and its relation to task difficulty, lateralization (left vs. right AG), and functional-anatomical subdivision (PGa vs. PGp subregions). Here, we combined the fMRI data of five studies on semantic processing (n = 172) and analyzed the response profiles from the same anatomical regions-of-interest for left and right PGa and PGp. We found that the AG was consistently deactivated during non-semantic conditions, whereas response polarity during semantic conditions was inconsistent. However, the AG consistently showed relative response differences between semantic and non-semantic conditions, and between different semantic conditions. A combined analysis across all studies revealed that AG responses could be best explained by separable effects of task difficulty and semantic processing demand. Task difficulty effects were stronger in PGa than PGp, regardless of hemisphere. Semantic effects were stronger in left than right AG, regardless of subregion. These results suggest that the AG is engaged in both domain-general task-difficulty-related processes and domain-specific semantic processes. In semantic processing, we propose that left AG acts as a "multimodal convergence zone" that binds different semantic features associated with the same concept, enabling efficient access to task-relevant features.
Collapse
|
44
|
Borghi AM, Shaki S, Fischer MH. Abstract concepts: external influences, internal constraints, and methodological issues. PSYCHOLOGICAL RESEARCH 2022; 86:2370-2388. [PMID: 35788903 PMCID: PMC9674746 DOI: 10.1007/s00426-022-01698-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
There is a longstanding and widely held misconception about the relative remoteness of abstract concepts from concrete experiences. This review examines the current evidence for external influences and internal constraints on the processing, representation, and use of abstract concepts, like truth, friendship, and number. We highlight the theoretical benefit of distinguishing between grounded and embodied cognition and then ask which roles do perception, action, language, and social interaction play in acquiring, representing and using abstract concepts. By reviewing several studies, we show that they are, against the accepted definition, not detached from perception and action. Focussing on magnitude-related concepts, we also discuss evidence for cultural influences on abstract knowledge and explore how internal processes such as inner speech, metacognition, and inner bodily signals (interoception) influence the acquisition and retrieval of abstract knowledge. Finally, we discuss some methodological developments. Specifically, we focus on the importance of studies that investigate the time course of conceptual processing and we argue that, because of the paramount role of sociality for abstract concepts, new methods are necessary to study concepts in interactive situations. We conclude that bodily, linguistic, and social constraints provide important theoretical limitations for our theories of conceptual knowledge.
Collapse
Affiliation(s)
- Anna M Borghi
- Department of Dynamic and Clinical Psychology, and Health Studies, Sapienza University of Rome, 00185, Rome, Italy.
- Institute of Cognitive Sciences and Technologies, Italian National Research Council, 00185, Rome, Italy.
| | - Samuel Shaki
- Department of Behavioral Sciences, Ariel University, 44837, Ariel, Israel
| | | |
Collapse
|
45
|
Garcia A, Cohen RA, Porges EC, Williamson JB, Woods AJ. Functional connectivity of brain networks during semantic processing in older adults. Front Aging Neurosci 2022; 14:814882. [PMID: 36337702 PMCID: PMC9627037 DOI: 10.3389/fnagi.2022.814882] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/14/2021] [Accepted: 09/14/2022] [Indexed: 12/03/2022] Open
Abstract
The neural systems underlying semantic processing have been characterized with functional neuroimaging in young adults. Whether the integrity of these systems degrade with advanced age remains unresolved. The current study examined functional connectivity during abstract and concrete word processing. Thirty-eight adults, aged 55–91, engaged in semantic association decision tasks during a mixed event-related block functional magnetic resonance imaging (fMRI) paradigm. During the semantic trials, the task required participants to make a judgment as to whether pairs were semantically associated. During the rhyme trials, the task required participants to determine if non-word pairs rhymed. Seeds were placed in putative semantic hubs of the left anterior middle temporal gyrus (aMTG) and the angular gyrus (AG), and also in the left inferior frontal gyrus (IFG), an area considered important for semantic control. Greater connectivity between aMTG, AG, and IFG and multiple cortical areas occurred during semantic processing. Connectivity from the three seeds differed during semantic processing: the left AG and aMTG were strongly connected with frontal, parietal, and occipital areas bilaterally, whereas the IFG was most strongly connected with other frontal cortical areas and the AG in the ipsilateral left hemisphere. Notably, the strength and extent of connectivity differed for abstract and concrete semantic processing; connectivity from the left aMTG and AG to bilateral cortical areas was greater during abstract processing, whereas IFG connectivity with left cortical areas was greater during concrete processing. With advanced age, greater connectivity occurred only between the left AG and supramarginal gyrus during the processing of concrete word-pairs, but not abstract word-pairs. Among older adults, robust functional connectivity of the aMTG, AG, and IFG to widely distributed bilateral cortical areas occurs during abstract and concrete semantic processing in a manner consistent with reports from past studies of young adults. There was not a significant degradation of functional connectivity during semantic processing between the ages of 55 and 85 years. As the study focused on semantic functioning in older adults, a comparison group of young adults was not included, limiting generalizability. Future longitudinal neuroimaging studies that compare functional connectivity of young and older adults under different semantic demands will be valuable.
Collapse
|
46
|
Massot-Tarrús A, Mirsattari SM. Roles of fMRI and Wada tests in the presurgical evaluation of language functions in temporal lobe epilepsy. Front Neurol 2022; 13:884730. [PMID: 36247757 PMCID: PMC9562037 DOI: 10.3389/fneur.2022.884730] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2022] [Accepted: 08/26/2022] [Indexed: 11/21/2022] Open
Abstract
Surgical treatment of pharmacoresistant temporal lobe epilepsy (TLE) carries risks for language function that can significantly affect the quality of life. Predicting the risks of decline in language functions before surgery is, consequently, just as important as predicting the chances of becoming seizure-free. The intracarotid amobarbital test, generally known as the Wada test (WT), has been traditionally used to determine language lateralization and to estimate their potential decline after surgery. However, the test is invasive and it does not localize the language functions. Therefore, other noninvasive methods have been proposed, of which functional magnetic resonance (fMRI) has the greatest potential. Functional MRI allows localization of language areas. It has good concordance with the WT for language lateralization, and it is of predictive value for postsurgical naming outcomes. Consequently, fMRI has progressively replaced WT for presurgical language evaluation. The objective of this manuscript is to review the most relevant aspects of language functions in TLE and the current role of fMRI and WT in the presurgical evaluation of language. First, we will provide context by revising the language network distribution and the effects of TLE on them. Then, we will assess the functional outcomes following various forms of TLE surgery and measures to reduce postoperative language decline. Finally, we will discuss the current indications for WT and fMRI and the potential usefulness of the resting-state fMRI technique.
Collapse
Affiliation(s)
| | - Seyed M. Mirsattari
- Department of Clinical Neurological Sciences, Western University, London, ON, Canada
- Department of Medical Biophysics, Western University, London, ON, Canada
- Department of Medical Imaging, Western University, London, ON, Canada
- Department of Psychology, Western University, London, ON, Canada
| |
Collapse
|
47
|
Wu W, Morales M, Patel T, Pickering MJ, Hoffman P. Modulation of brain activity by psycholinguistic information during naturalistic speech comprehension and production. Cortex 2022; 155:287-306. [DOI: 10.1016/j.cortex.2022.08.002] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Revised: 06/23/2022] [Accepted: 08/01/2022] [Indexed: 11/25/2022]
|
48
|
Urquiza-Haas EG, Kotrschal K. Human-Animal Similarity and the Imageability of Mental State Concepts for Mentalizing Animals. JOURNAL OF COGNITION AND CULTURE 2022. [DOI: 10.1163/15685373-12340133] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
Abstract
Abstract
The attribution of mental states (MS) to other species typically follows a scala naturae pattern. However, “simple” mental states, including emotions, sensing, and feelings are attributed to a wider range of animals as compared to the so-called “higher” cognitive abilities. We propose that such attributions are based on the perceptual quality (i.e. imageability) of mental representations related to MS concepts. We hypothesized that the attribution of highly imaginable MS is more dependent on the familiarity of participants with animals when compared to the attribution of MS low in imageability. In addition, we also assessed how animal agreeableness, familiarity with animals, and the type of human-animal interaction related to the judged similarity of animals to humans. Sixty-one participants (19 females, 42 males) with a rural (n = 20) and urban (n = 41) background rated twenty-six wild and domestic animals for their perceived similarity with humans and ability to experience a set of MS: (1) Highly imageable MS: joy, anger, and fear, and (2) MS low in imageability: capacity to plan and deceive. Results show that more agreeable and familiar animals were considered more human-like. Primates, followed by carnivores, suines, ungulates, and rodents were rated more human-like than xenarthrans, birds, arthropods, and reptiles. Higher MS ratings were given to more similar animals and more so if the MS attributed were high in imageability. Familiarity with animals was only relevant for the attribution of the MS high in imageability.
Collapse
Affiliation(s)
- Esmeralda G. Urquiza-Haas
- PhD candidate, Department of Cognitive Biology and Department of Behavioural Biology, University of Vienna Vienna Austria
| | - Kurt Kotrschal
- Retired Professor, Department of Behavioural Biology, University of Vienna Vienna Austria
| |
Collapse
|
49
|
Doricchi F, Lasaponara S, Pazzaglia M, Silvetti M. Left and right temporal-parietal junctions (TPJs) as "match/mismatch" hedonic machines: A unifying account of TPJ function. Phys Life Rev 2022; 42:56-92. [PMID: 35901654 DOI: 10.1016/j.plrev.2022.07.001] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 07/06/2022] [Indexed: 11/17/2022]
Abstract
Experimental and theoretical studies have tried to gain insights into the involvement of the Temporal Parietal Junction (TPJ) in a broad range of cognitive functions like memory, attention, language, self-agency and theory of mind. Recent investigations have demonstrated the partition of the TPJ in discrete subsectors. Nonetheless, whether these subsectors play different roles or implement an overarching function remains debated. Here, based on a review of available evidence, we propose that the left TPJ codes both matches and mismatches between expected and actual sensory, motor, or cognitive events while the right TPJ codes mismatches. These operations help keeping track of statistical contingencies in personal, environmental, and conceptual space. We show that this hypothesis can account for the participation of the TPJ in disparate cognitive functions, including "humour", and explain: a) the higher incidence of spatial neglect in right brain damage; b) the different emotional reactions that follow left and right brain damage; c) the hemispheric lateralisation of optimistic bias mechanisms; d) the lateralisation of mechanisms that regulate routine and novelty behaviours. We propose that match and mismatch operations are aimed at approximating "free energy", in terms of the free energy principle of decision-making. By approximating "free energy", the match/mismatch TPJ system supports both information seeking to update one's own beliefs and the pleasure of being right in one's own' current choices. This renewed view of the TPJ has relevant clinical implications because the misfunctioning of TPJ-related "match" and "mismatch" circuits in unilateral brain damage can produce low-dimensional deficits of active-inference and predictive coding that can be associated with different neuropsychological disorders.
Collapse
Affiliation(s)
- Fabrizio Doricchi
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy.
| | - Stefano Lasaponara
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy
| | - Mariella Pazzaglia
- Dipartimento di Psicologia 39, Università degli Studi di Roma 'La Sapienza', Roma, Italy; Fondazione Santa Lucia IRCCS, Roma, Italy
| | - Massimo Silvetti
- Computational and Translational Neuroscience Lab (CTNLab), Institute of Cognitive Sciences and Technologies, National Research Council (CNR), Rome, Italy
| |
Collapse
|
50
|
Williams KA, Numssen O, Hartwigsen G. Task-specific network interactions across key cognitive domains. Cereb Cortex 2022; 32:5050-5071. [PMID: 35158372 PMCID: PMC9667178 DOI: 10.1093/cercor/bhab531] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Revised: 12/21/2021] [Accepted: 12/22/2021] [Indexed: 12/27/2022] Open
Abstract
Human cognition is organized in distributed networks in the brain. Although distinct specialized networks have been identified for different cognitive functions, previous work also emphasizes the overlap of key cognitive domains in higher level association areas. The majority of previous studies focused on network overlap and dissociation during resting states whereas task-related network interactions across cognitive domains remain largely unexplored. A better understanding of network overlap and dissociation during different cognitive tasks may elucidate flexible (re-)distribution of resources during human cognition. The present study addresses this issue by providing a broad characterization of large-scale network dynamics in three key cognitive domains. Combining prototypical tasks of the larger domains of attention, language, and social cognition with whole-brain multivariate activity and connectivity approaches, we provide a spatiotemporal characterization of multiple large-scale, overlapping networks that differentially interact across cognitive domains. We show that network activity and interactions increase with increased cognitive complexity across domains. Interaction patterns reveal a common core structure across domains as well as dissociable domain-specific network activity. The observed patterns of activation and deactivation of overlapping and strongly coupled networks provide insight beyond region-specific activity within a particular cognitive domain toward a network perspective approach across diverse key cognitive functions.
Collapse
Affiliation(s)
- Kathleen A Williams
- Address correspondence to Kathleen A. Williams, Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany.
| | - Ole Numssen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| | - Gesa Hartwigsen
- Lise Meitner Research Group Cognition and Plasticity, Max Planck Institute for Human Cognitive and Brain Sciences, 04103 Leipzig, Germany
| |
Collapse
|