1
|
Kiselica AM, Karr JE, Mikula CM, Ranum RM, Benge JF, Medina LD, Woods SP. Recent Advances in Neuropsychological Test Interpretation for Clinical Practice. Neuropsychol Rev 2024; 34:637-667. [PMID: 37594687 DOI: 10.1007/s11065-023-09596-1] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2021] [Accepted: 04/28/2023] [Indexed: 08/19/2023]
Abstract
Much attention in the field of clinical neuropsychology has focused on adapting to the modern healthcare environment by advancing telehealth and promoting technological innovation in assessment. Perhaps as important (but less discussed) are advances in the development and interpretation of normative neuropsychological test data. These techniques can yield improvement in diagnostic decision-making and treatment planning with little additional cost. Brooks and colleagues (Can Psychol 50: 196-209, 2009) eloquently summarized best practices in normative data creation and interpretation, providing a practical overview of norm development, measurement error, the base rates of low scores, and methods for assessing change. Since the publication of this seminal work, there have been several important advances in research on development and interpretation of normative neuropsychological test data, which may be less familiar to the practicing clinician. Specifically, we provide a review of the literature on regression-based normed scores, item response theory, multivariate base rates, summary/factor scores, cognitive intraindividual variability, and measuring change over time. For each topic, we include (1) an overview of the method, (2) a rapid review of the recent literature, (3) a relevant case example, and (4) a discussion of limitations and controversies. Our goal was to provide a primer for use of normative neuropsychological test data in neuropsychological practice.
Collapse
Affiliation(s)
- Andrew M Kiselica
- Department of Health Psychology, University of Missouri, 115 Business Loop 70 W, Columbia, MO, 65203, USA.
| | - Justin E Karr
- Department of Psychology, University of Kentucky, Lexington, KY, USA
| | - Cynthia M Mikula
- Institute of Human Nutrition, Columbia University, New York, NY, USA
| | - Rylea M Ranum
- Department of Health Psychology, University of Missouri, 115 Business Loop 70 W, Columbia, MO, 65203, USA
| | - Jared F Benge
- Department of Neurology, University of Texas-Austin, TX, Austin, USA
| | - Luis D Medina
- Department of Psychology, University of Houston, Houston, TX, USA
| | | |
Collapse
|
2
|
Hamilton CA, Gallagher P, Ciafone J, Barnett N, Barker SAH, Donaghy PC, O'Brien JT, Taylor JP, Thomas AJ. Sustained attention in mild cognitive impairment with Lewy bodies and Alzheimer's disease. J Int Neuropsychol Soc 2024; 30:421-427. [PMID: 38017617 DOI: 10.1017/s1355617723000772] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
OBJECTIVE Attentional impairments are common in dementia with Lewy bodies and its prodromal stage of mild cognitive impairment (MCI) with Lewy bodies (MCI-LB). People with MCI may be capable of compensating for subtle attentional deficits in most circumstances, and so these may present as occasional lapses of attention. We aimed to assess the utility of a continuous performance task (CPT), which requires sustained attention for several minutes, for measuring attentional performance in MCI-LB in comparison to Alzheimer's disease (MCI-AD), and any performance deficits which emerged with sustained effort. METHOD We included longitudinal data on a CPT sustained attention task for 89 participants with MCI-LB or MCI-AD and 31 healthy controls, estimating ex-Gaussian response time parameters, omission and commission errors. Performance trajectories were estimated both cross-sectionally (intra-task progress from start to end) and longitudinally (change in performance over years). RESULTS While response times in successful trials were broadly similar, with slight slowing associated with clinical parkinsonism, those with MCI-LB made considerably more errors. Omission errors were more common throughout the task in MCI-LB than MCI-AD (OR 2.3, 95% CI: 1.1-4.7), while commission errors became more common after several minutes of sustained attention. Within MCI-LB, omission errors were more common in those with clinical parkinsonism (OR 1.9, 95% CI: 1.3-2.9) or cognitive fluctuations (OR 4.3, 95% CI: 2.2-8.8). CONCLUSIONS Sustained attention deficits in MCI-LB may emerge in the form of attentional lapses leading to omissions, and a breakdown in inhibitory control leading to commission errors.
Collapse
Affiliation(s)
- Calum A Hamilton
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Peter Gallagher
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Joanna Ciafone
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Nicola Barnett
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Sally A H Barker
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Paul C Donaghy
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - John T O'Brien
- Department of Psychiatry, University of Cambridge, Cambridge, UK
| | - John-Paul Taylor
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Alan J Thomas
- Translational and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
| |
Collapse
|
3
|
Ridgely NC, Woods SP, Webber TA, Mustafa AI, Evans D. Cognitive Intra-individual Variability in the Laboratory Is Associated With Greater Executive Dysfunction in the Daily Lives of Older Adults With HIV. Cogn Behav Neurol 2024; 37:32-39. [PMID: 37871277 PMCID: PMC10948322 DOI: 10.1097/wnn.0000000000000358] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Accepted: 05/30/2023] [Indexed: 10/25/2023]
Abstract
BACKGROUND Executive dysfunction, which is common among persons with HIV (PWH), can have an adverse impact on health behaviors and quality of life. Intra-individual variability (IIV) is a measure of within-person variability across cognitive tests that is higher in PWH and is thought to reflect cognitive dyscontrol. OBJECTIVE To assess whether cognitive IIV in the laboratory is associated with self-reported executive dysfunction in daily life among older PWH. METHOD Participants included 71 PWH aged ≥50 years who completed six subtests from the Cogstate battery and two subscales from the Frontal Systems Behavior Scale (FrSBe; self-report version). Cognitive IIV was calculated from the Cogstate as the coefficient of variation derived from age-adjusted normative T scores. RESULTS Cognitive IIV as measured by the Cogstate showed a significant, positive, medium-sized association with current FrSBe ratings of executive dysfunction but not disinhibition. CONCLUSION Higher cognitive IIV in the laboratory as measured by the Cogstate may be related to the expression of HIV-associated symptoms of executive dysfunction in daily life for older PWH.
Collapse
|
4
|
Kiselica AM, Kaser AN, Weitzner DS, Mikula CM, Boone A, Woods SP, Wolf TJ, Webber TA. Development and Validity of Norms for Cognitive Dispersion on the Uniform Data Set 3.0 Neuropsychological Battery. Arch Clin Neuropsychol 2024:acae005. [PMID: 38364295 DOI: 10.1093/arclin/acae005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Revised: 11/14/2023] [Accepted: 12/15/2023] [Indexed: 02/18/2024] Open
Abstract
OBJECTIVE Cognitive dispersion indexes intraindividual variability in performance across a battery of neuropsychological tests. Measures of dispersion show promise as markers of cognitive dyscontrol and everyday functioning difficulties; however, they have limited practical applicability due to a lack of normative data. This study aimed to develop and evaluate normed scores for cognitive dispersion among older adults. METHOD We analyzed data from 4,283 cognitively normal participants aged ≥50 years from the Uniform Data Set (UDS) 3.0. We describe methods for calculating intraindividual standard deviation (ISD) and coefficient of variation (CoV), as well as associated unadjusted scaled scores and demographically adjusted z-scores. We also examined the ability of ISD and CoV scores to differentiate between cognitively normal individuals (n = 4,283) and those with cognitive impairment due to Lewy body disease (n = 282). RESULTS We generated normative tables to map raw ISD and CoV scores onto a normal distribution of scaled scores. Cognitive dispersion indices were associated with age, education, and race/ethnicity but not sex. Regression equations were used to develop a freely accessible Excel calculator for deriving demographically adjusted normed scores for ISD and CoV. All measures of dispersion demonstrated excellent diagnostic utility when evaluated by the area under the curve produced from receiver operating characteristic curves. CONCLUSIONS Results of this study provide evidence for the clinical utility of sample-based and demographically adjusted normative standards for cognitive dispersion on the UDS 3.0. These standards can be used to guide interpretation of intraindividual variability among older adults in clinical and research settings.
Collapse
Affiliation(s)
- Andrew M Kiselica
- Department of Health Psychology, University of Missouri, Columbia, MO, USA
| | - Alyssa N Kaser
- Department of Psychiatry, University of Texas Southwestern Medical Center, Dallas, TX, USA
| | | | - Cynthia M Mikula
- Institute of Human Nutrition, Columbia University, New York, NY, USA
| | - Anna Boone
- Department of Occupational Therapy, University of Missouri, Columbia, MO, USA
| | | | - Timothy J Wolf
- Department of Occupational Therapy, University of Missouri, Columbia, MO, USA
| | - Troy A Webber
- Mental Health Care Line, Michael E. DeBakey VA Medical Center, Houston, TX, USA
- Department of Psychiatry and Behavioral Sciences, Baylor College of Medicine, Houston, TX, USA
| |
Collapse
|
5
|
Webber TA, Lorkiewicz SA, Kiselica AM, Woods SP. Ecological validity of cognitive fluctuations in dementia with Lewy bodies. J Int Neuropsychol Soc 2024; 30:35-46. [PMID: 37057867 PMCID: PMC10576013 DOI: 10.1017/s1355617723000255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 04/15/2023]
Abstract
OBJECTIVES Cognitive fluctuations are a core clinical feature of dementia with Lewy bodies (DLB), but their contribution to the everyday functioning difficulties evident DLB are not well understood. The current study evaluated whether intraindividual variability across a battery of neurocognitive tests (intraindividual variability-dispersion) and daily cognitive fluctuations as measured by informant report are associated with worse daily functioning in DLB. METHODS The study sample included 97 participants with consensus-defined DLB from the National Alzheimer's Coordinating Center (NACC). Intraindividual variability-dispersion was measured using the coefficient of variation, which divides the standard deviation of an individual's performance scores across 12 normed neurocognitive indices from the NACC neuropsychological battery by that individual's performance mean. Informants reported on daily cognitive fluctuations using the Mayo Fluctuations Scale (MFS) and on daily functioning using the functional activities questionnaire (FAQ). RESULTS Logistic regression identified a large univariate association of intraindividual variability-dispersion and presence of daily cognitive fluctuations on the MFS (Odds Ratio = 73.27, 95% Confidence Interval = 1.38, 3,895.05). Multiple linear regression demonstrated that higher intraindividual variability-dispersion and presence of daily cognitive fluctuations as assessed by the MFS were significantly and independently related to worse daily functioning (FAQ scores). CONCLUSIONS Among those with DLB, informant-rated daily cognitive fluctuations and cognitive fluctuations measured in the clinic (as indexed by intraindividual variability-dispersion across a battery of tests) were independently associated with poorer everyday functioning. These data demonstrate ecological validity in measures of cognitive fluctuations in DLB.
Collapse
Affiliation(s)
- Troy A. Webber
- Mental Health Care Line, Michael E. DeBakey VA Medical Center, Houston, TX, USA
- Department of Psychiatry/Behavioral Sciences, Baylor College of Medicine, Houston, TX, USA
| | - Sara A. Lorkiewicz
- Mental Health Care Line, Michael E. DeBakey VA Medical Center, Houston, TX, USA
| | | | - Steven P. Woods
- Department of Psychology, University of Houston, Houston, TX, USA
| |
Collapse
|
6
|
Wootton O, Dalvie S, MacGinty R, Ngqengelele L, Susser ES, Gur RC, Stein DJ. Predictors of within-individual variability in cognitive performance in schizophrenia in a South African case-control study. Acta Neuropsychiatr 2023:1-7. [PMID: 37340804 PMCID: PMC10733548 DOI: 10.1017/neu.2023.28] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/22/2023]
Abstract
INTRODUCTION Cognitive dysfunction in schizophrenia may be assessed by measuring within-individual variability (WIV) in performance across a range of cognitive tests. Previous studies have found increased WIV in people with schizophrenia, but no studies have been conducted in low- to middle-income countries where the different sociocultural context may affect WIV. We sought to address this gap by exploring the relationship between WIV and a range of clinical and demographic variables in a large study of people with schizophrenia and matched controls in South Africa. METHODS 544 people with schizophrenia and 861 matched controls completed an adapted version of The University of Pennsylvania Computerized Neurocognitive Battery (PennCNB). Demographic and clinical information was collected using the Structured Clinical Interview for DSM-IV Diagnoses. Across-task WIV for performance speed and accuracy on the PennCNB was calculated. Multivariate linear regression was used to assess the relationship between WIV and a diagnosis of schizophrenia in the whole sample, and WIV and selected demographic and clinical variables in people with schizophrenia. RESULTS Increased WIV of performance speed across cognitive tests was significantly associated with a diagnosis of schizophrenia. In people with schizophrenia, increased speed WIV was associated with older age, a lower level of education and a lower score on the Global Assessment of Functioning scale. Increased accuracy WIV was significantly associated with a younger age in people with schizophrenia. CONCLUSIONS Measurements of WIV of performance speed can add to the knowledge gained from studies of cognitive dysfunction in schizophrenia in resource-limited settings.
Collapse
Affiliation(s)
- Olivia Wootton
- Department of Psychiatry and Neuroscience Institute, University of Cape Town, South Africa
| | - Shareefa Dalvie
- Department of Psychiatry and Neuroscience Institute, University of Cape Town, South Africa
- Biomedical Research and Innovation Platform, South African Medical Research Council, South Africa
| | - Rae MacGinty
- Department of Paediatrics and Child Health, University of Cape Town, South Africa
| | - Linda Ngqengelele
- Department of Psychiatry and Neuroscience Institute, University of Cape Town, South Africa
| | - Ezra S. Susser
- Department of Epidemiology, Mailman School of Public Health, Columbia University
- New York State Psychiatric Institute, New York, NY, United States
| | - Ruben C. Gur
- Brain Behavior Laboratories, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine
| | - Dan J. Stein
- Department of Psychiatry and Neuroscience Institute, University of Cape Town, South Africa
- SAMRC Unit on Risk & Resilience in Mental Disorders, South Africa
| |
Collapse
|