1
|
Magnotti JF, Patterson JS, Schnur TT. Using predictive validity to compare associations between brain damage and behavior. Hum Brain Mapp 2023; 44:4738-4753. [PMID: 37417774 PMCID: PMC10400786 DOI: 10.1002/hbm.26413] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2022] [Revised: 05/15/2023] [Accepted: 06/19/2023] [Indexed: 07/08/2023] Open
Abstract
Lesion-behavior mapping (LBM) provides a statistical map of the association between voxel-wise brain damage and individual differences in behavior. To understand whether two behaviors are mediated by damage to distinct regions, researchers often compare LBM weight outputs by either the Overlap method or the Correlation method. However, these methods lack statistical criteria to determine whether two LBM are distinct versus the same and are disconnected from a major goal of LBMs: predicting behavior from brain damage. Without such criteria, researchers may draw conclusions from numeric differences between LBMs that are irrelevant to predicting behavior. We developed and validated a predictive validity comparison method (PVC) that establishes a statistical criterion for comparing two LBMs using predictive accuracy: two LBMs are distinct if and only if they provide unique predictive power for the behaviors being assessed. We applied PVC to two lesion-behavior stroke data sets, demonstrating its utility for determining when behaviors arise from the same versus different lesion patterns. Using region-of-interest-based simulations derived from proportion damage from a large data set (n = 131), PVC accurately detected when behaviors were mediated by different regions (high sensitivity) versus the same region (high specificity). Both the Overlap method and Correlation method performed poorly on the simulated data. By objectively determining whether two behavioral deficits can be explained by single versus distinct patterns of brain damage, PVC provides a critical advance in establishing the brain bases of behavior. We have developed and released a GUI-driven web app to encourage widespread adoption.
Collapse
Affiliation(s)
- John F. Magnotti
- Department of NeurosurgeryBaylor College of MedicineHoustonTexasUSA
- Department of NeurosurgeryPerelman School of Medicine at the University of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | | | - Tatiana T. Schnur
- Department of NeurosurgeryBaylor College of MedicineHoustonTexasUSA
- Department of NeuroscienceBaylor College of MedicineHoustonTexasUSA
| |
Collapse
|
2
|
van Grinsven EE, Smits AR, van Kessel E, Raemaekers MAH, de Haan EHF, Huenges Wajer IMC, Ruijters VJ, Philippens MEP, Verhoeff JJC, Ramsey NF, Robe PAJT, Snijders TJ, van Zandvoort MJE. The impact of etiology in lesion-symptom mapping - A direct comparison between tumor and stroke. Neuroimage Clin 2022; 37:103305. [PMID: 36610310 PMCID: PMC9850191 DOI: 10.1016/j.nicl.2022.103305] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 12/19/2022] [Accepted: 12/22/2022] [Indexed: 12/25/2022]
Abstract
INTRODUCTION Lesion-symptom mapping is a key tool in understanding the relationship between brain structures and behavior. However, the behavioral consequences of lesions from different etiologies may vary because of how they affect brain tissue and how they are distributed. The inclusion of different etiologies would increase the statistical power but has been critically debated. Meanwhile, findings from lesion studies are a valuable resource for clinicians and used across different etiologies. Therefore, the main objective of the present study was to directly compare lesion-symptom maps for memory and language functions from two populations, a tumor versus a stroke population. METHODS Data from two different studies were combined. Both the brain tumor (N = 196) and stroke (N = 147) patient populations underwent neuropsychological testing and an MRI, pre-operatively for the tumor population and within three months after stroke. For this study, we selected two internationally widely used standardized cognitive tasks, the Rey Auditory Verbal Learning Test and the Verbal Fluency Test. We used a state-of-the-art machine learning-based, multivariate voxel-wise approach to produce lesion-symptom maps for these cognitive tasks for both populations separately and combined. RESULTS Our lesion-symptom mapping results for the separate patient populations largely followed the expected neuroanatomical pattern based on previous literature. Substantial differences in lesion distribution hindered direct comparison. Still, in brain areas with adequate coverage in both groups, considerable LSM differences between the two populations were present for both memory and fluency tasks. Post-hoc analyses of these locations confirmed that the cognitive consequences of focal brain damage varied between etiologies. CONCLUSION The differences in the lesion-symptom maps between the stroke and tumor population could partly be explained by differences in lesion volume and topography. Despite these methodological limitations, both the lesion-symptom mapping results and the post-hoc analyses confirmed that etiology matters when investigating the cognitive consequences of lesions with lesion-symptom mapping. Therefore, caution is advised with generalizing lesion-symptom results across etiologies.
Collapse
Affiliation(s)
- E E van Grinsven
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands.
| | - A R Smits
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands; Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands
| | - E van Kessel
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - M A H Raemaekers
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - E H F de Haan
- Department of Psychology, University of Amsterdam, Amsterdam, the Netherlands; St. Hugh's College, Oxford University, UK
| | - I M C Huenges Wajer
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands; Department of Experimental Psychology and Helmholtz Institute, Utrecht University, the Netherlands
| | - V J Ruijters
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - M E P Philippens
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, the Netherlands
| | - J J C Verhoeff
- Department of Radiotherapy, University Medical Center Utrecht, Utrecht, the Netherlands
| | - N F Ramsey
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - P A J T Robe
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - T J Snijders
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands
| | - M J E van Zandvoort
- Department of Neurology & Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht University, Utrecht, the Netherlands; Department of Experimental Psychology and Helmholtz Institute, Utrecht University, the Netherlands
| |
Collapse
|
3
|
Kirkman MA, Hunn BHM, Thomas MSC, Tolmie AK. Influences on cognitive outcomes in adult patients with gliomas: A systematic review. Front Oncol 2022; 12:943600. [PMID: 36033458 PMCID: PMC9407441 DOI: 10.3389/fonc.2022.943600] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2022] [Accepted: 07/14/2022] [Indexed: 11/13/2022] Open
Abstract
People with brain tumors, including those previously treated, are commonly affected by a range of neurocognitive impairments involving executive function, memory, attention, and social/emotional functioning. Several factors are postulated to underlie this relationship, but evidence relating to many of these factors is conflicting and does not fully explain the variation in cognitive outcomes seen in the literature and in clinical practice. To address this, we performed a systematic literature review to identify and describe the range of factors that can influence cognitive outcomes in adult patients with gliomas. A literature search was performed of Ovid MEDLINE, PsychINFO, and PsycTESTS from commencement until September 2021. Of 9,998 articles identified through the search strategy, and an additional 39 articles identified through other sources, 142 were included in our review. The results confirmed that multiple factors influence cognitive outcomes in patients with gliomas. The effects of tumor characteristics (including location) and treatments administered are some of the most studied variables but the evidence for these is conflicting, which may be the result of methodological and study population differences. Tumor location and laterality overall appear to influence cognitive outcomes, and detection of such an effect is contingent upon administration of appropriate cognitive tests. Surgery appears to have an overall initial deleterious effect on cognition with a recovery in most cases over several months. A large body of evidence supports the adverse effects of radiotherapy on cognition, but the role of chemotherapy is less clear. To contrast, baseline cognitive status appears to be a consistent factor that influences cognitive outcomes, with worse baseline cognition at diagnosis/pre-treatment correlated with worse long-term outcomes. Similarly, much evidence indicates that anti-epileptic drugs have a negative effect on cognition and genetics also appear to have a role. Evidence regarding the effect of age on cognitive outcomes in glioma patients is conflicting, and there is insufficient evidence for gender and fatigue. Cognitive reserve, brain reserve, socioeconomic status, and several other variables discussed in this review, and their influence on cognition and recovery, have not been well-studied in the context of gliomas and are areas for focus in future research. Systematic Review Registration https://www.crd.york.ac.uk/prospero/, identifier CRD42017072976.
Collapse
Affiliation(s)
- Matthew A. Kirkman
- Department of Psychology and Human Development, University College London (UCL) Institute of Education, UCL, London, United Kingdom
- Department of Neurosurgery, Queen’s Medical Centre, Nottingham University Hospitals National Health Service (NHS) Trust, Nottingham, United Kingdom
| | - Benjamin H. M. Hunn
- Department of Neurosurgery, Royal Melbourne Hospital, Melbourne, VIC, Australia
- Department of Neurosurgery, Royal Hobart Hospital, Hobart, TAS, Australia
- School of Medicine, University of Tasmania, Hobart, TAS, Australia
| | - Michael S. C. Thomas
- Department of Psychological Sciences, Birkbeck, University of London, London, United Kingdom
| | - Andrew K. Tolmie
- Department of Psychology and Human Development, University College London (UCL) Institute of Education, UCL, London, United Kingdom
| |
Collapse
|
4
|
Arbula S, Della Puppa A, De Pellegrin S, Denaro L, D'Avella D, Semenza C, Corbetta M, Vallesi A. Rule Perseveration during Task-Switching in Brain Tumor: A Severe Form of Task-Setting Impairment. J Cogn Neurosci 2021; 33:1766-1783. [PMID: 34375415 DOI: 10.1162/jocn_a_01674] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/04/2023]
Abstract
It has been proposed that at least two distinct processes are engaged during task-switching: reconfiguration of the currently relevant task-set and interference resolution arising from the competing task-set. Whereas in healthy individuals the two are difficult to disentangle, their disruption is thought to cause different impairments in brain-damaged patients. Yet, the observed deficits are inconsistent across studies and do not allow drawing conclusions regarding their independence. Forty-one brain tumor patients were tested on a task-switching paradigm. We compared their performance between switch and repeat trials (switch cost) to assess rule reconfiguration, and between trials requiring the same response (congruent) and a different response for the two tasks (incongruent) to assess interference control. In line with previous studies, we found the greatest proportion of errors on incongruent trials, suggesting an interference control impairment. However, a closer look at the distribution of errors between two task rules revealed a rule perseveration impairment: Patients with high error rate on incongruent trials often applied only one task rule throughout the task and less frequently switched to the alternative one. Multivariate lesion-symptom mapping analysis unveiled the relationship between lesions localized in left orbitofrontal and posterior subcortical regions and perseveration scores, measured as absolute difference in accuracy between two task rules. This finding points to a more severe task-setting impairment, not reflected as a mere switching deficit, but instead as a difficulty in creating multiple stable task representations, in line with recent accounts of OFC functions suggesting its critical role in representing task states.
Collapse
Affiliation(s)
| | - Alessandro Della Puppa
- Neurosurgery, Department of NEUROFARBA, University of Florence, Italy.,University Hospital of Careggi, Florence, Italy
| | | | - Luca Denaro
- University Hospital of Padova, Padova, Italy.,Department of Neuroscience & Padua Neuroscience Center, University of Padova, Italy
| | - Domenico D'Avella
- University Hospital of Padova, Padova, Italy.,Department of Neuroscience & Padua Neuroscience Center, University of Padova, Italy
| | - Carlo Semenza
- Department of Neuroscience & Padua Neuroscience Center, University of Padova, Italy
| | - Maurizio Corbetta
- University Hospital of Padova, Padova, Italy.,IRCCS San Camillo Hospital, Venice, Italy
| | - Antonino Vallesi
- Department of Neuroscience & Padua Neuroscience Center, University of Padova, Italy.,IRCCS San Camillo Hospital, Venice, Italy
| |
Collapse
|
5
|
Vallesi A. The Quest for Hemispheric Asymmetries Supporting and Predicting Executive Functioning. J Cogn Neurosci 2021; 33:1679-1697. [PMID: 33135967 DOI: 10.1162/jocn_a_01646] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/27/2022]
Abstract
This narrative review addresses the neural bases of two executive functions: criterion setting, that is, the capacity to flexibly set up and select task rules and associations between stimuli, responses, and nonresponses, and monitoring, that is, the process of continuously evaluating whether task rules are being applied optimally. There is a documented tendency for criterion setting and monitoring to differentially recruit left and right lateral prefrontal regions and connected networks, respectively, above and beyond the specific task context. This model, known as the ROtman-Baycrest Battery to Investigate Attention (ROBBIA) model, initially sprung from extensive neuropsychological work led by Don Stuss. In subsequent years, multimodal lines of empirical investigation on both healthy individuals and patients with brain damage, coming from functional neuroimaging, EEG, neurostimulation, individual difference approaches, and, again, neuropsychology, so to "complete the circle," corroborated the functional mapping across the two hemispheres as predicted by the model. More recent electrophysiological evidence has further shown that hemispheric differences in intrinsic prefrontal dynamics are able to predict cognitive performance in tasks tapping these domain-general functions. These empirical contributions will be presented together with contrasting evidence, limits, and possible future directions to better fine-tune this model and extend its scope to new fields.
Collapse
|
6
|
Mole J, Foley J, Shallice T, Cipolotti L. The left frontal lobe is critical for the AH4 fluid intelligence test. INTELLIGENCE 2021. [DOI: 10.1016/j.intell.2021.101564] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|