1
|
Sherry NS, Kissinger-Knox A, Manderino L, Eagle S, Mucha A, Collins MW, Kontos AP. Evidence for a multidomain clinical assessment of mild traumatic brain injury in older adults. APPLIED NEUROPSYCHOLOGY. ADULT 2025; 32:849-856. [PMID: 37289077 DOI: 10.1080/23279095.2023.2218512] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
BACKGROUND There are few guidelines on the appropriate clinical tools to evaluate mTBI in older adults. OBJECTIVE We aimed to investigate the utility of a multidomain assessment to differentiate older adults with mTBI from controls. METHODS Participants included 68 older adults (37% male) aged 60-76 (M = 66.24, SD = 4.50) years. Thirty-four patients were diagnosed with a mTBI at a specialty mTBI clinic within 90 days of injury, and age- and sex-matched to 34 community controls. Participants completed the following assessments: Post-Concussion Symptom Scale (PCSS), Short Fall Efficacy Scale-International (Short FES-I), Generalized Anxiety Disorder-7 Item Scale (GAD-7), Geriatric Depression Scale-5 Item (GDS-5), Wide Range Achievement Test-Fourth Edition (WRAT-4) reading subtest, subtests of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), clock drawing, and Vestibular/Ocular Motor Screening for Concussion (VOMS). Independent-samples t-tests or chi-squared analyses were used to compare assessment results between groups. A logistic regression (LR) was conducted to determine which combination of assessments best identified the mTBI group from controls. RESULTS The mTBI group endorsed significantly more symptoms of concussion (p < .001), balance concerns (p < .001), anxiety (p < .001), and depression (p = 0.04), and performed worse on cognitive (p < .001), vestibular (p < .001), and oculomotor (p = .004) screening relative to controls. The LR (p < .001; r2 = 0.90) correctly identified 98.5% of older adults and retained concussion (p = .01) and depression (p = .02) symptoms, and cognitive (p = .03) and vestibular (p = .04) screening in the final model. DISCUSSION The current findings support a multidomain assessment model of care for evaluating mTBI in older adults.
Collapse
Affiliation(s)
- Natalie S Sherry
- Department of Neurological Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| | - Alicia Kissinger-Knox
- Department of Physical Medicine and Rehabilitation, Spaulding Rehabilitation Hospital, Charlestown, MA, USA
- Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, USA
| | - Lisa Manderino
- Department of Orthopaedic Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | - Shawn Eagle
- Department of Neurological Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| | - Anne Mucha
- Centers for Rehab Services, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | - Michael W Collins
- Department of Orthopaedic Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| | - Anthony P Kontos
- Department of Orthopaedic Surgery, University of Pittsburgh, Pittsburgh, PA, USA
| |
Collapse
|
2
|
Hromas G, Rolin S, Davis JJ. Racial differences in positive findings on embedded performance validity tests. APPLIED NEUROPSYCHOLOGY. ADULT 2025; 32:28-36. [PMID: 36416227 PMCID: PMC10203055 DOI: 10.1080/23279095.2022.2146504] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
INTRODUCTION Embedded performance validity tests (PVTs) may show increased positive findings in racially diverse examinees. This study examined positive findings in an older adult sample of African American (AA) and European American (EA) individuals recruited as part of a study on aging and cognition. METHOD The project involved secondary analysis of deidentified National Alzheimer's Coordinating Center data (N = 22,688). Exclusion criteria included diagnosis of dementia (n = 5,550), mild cognitive impairment (MCI; n = 5,160), impaired but not MCI (n = 1,126), other race (n = 864), and abnormal Mini Mental State Examination (MMSE < 25; n = 135). The initial sample included 9,853 participants (16.4% AA). Propensity score matching matched AA and EA participants on age, education, sex, and MMSE score. The final sample included 3,024 individuals with 50% of participants identifying as AA. Premorbid ability estimates were calculated based on demographics. Failure rates on five raw score and six age-adjusted scaled score PVTs were examined by race. RESULTS Age, education, sex, MMSE, and premorbid ability estimate were not significantly different by race. Thirteen percent of AA and 3.8% of EA participants failed two or more raw score PVTs (p < .0001). On age-adjusted PVTs, 20.6% of AA and 5.9% of EA participants failed two or more (p < .0001). CONCLUSIONS PVT failure rates were significantly higher among AA participants. Findings indicate a need for cautious interpretation of embedded PVTs with underrepresented groups. Adjustments to embedded PVT cutoffs may need to be considered to improve diagnostic accuracy.
Collapse
Affiliation(s)
- Gabrielle Hromas
- Department of Neurology, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Summer Rolin
- Department of Rehabilitation Medicine, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| | - Jeremy J Davis
- Department of Neurology, University of Texas Health Science Center at San Antonio, San Antonio, TX, USA
| |
Collapse
|
3
|
Mindlis I, Ravdin LD, Reid MC, Kiosses D. Correlates of neurocognitive performance in older adults with chronic pain and negative emotions: baseline data from the problem adaptation therapy for pain (PATH-pain) randomized controlled trial. FRONTIERS IN PAIN RESEARCH 2024; 5:1498283. [PMID: 39736898 PMCID: PMC11683135 DOI: 10.3389/fpain.2024.1498283] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2024] [Accepted: 12/03/2024] [Indexed: 01/01/2025] Open
Abstract
Chronic pain is highly prevalent among older adults, is associated with cognitive deficits, and is commonly treated in primary care. We sought to document the extent of impairment across specific neurocognitive domains and its correlates among older adults with chronic pain in primary care. We analyzed baseline data from the Problem Adaptation Therapy for Pain trial, which examined a psychosocial intervention to improve emotion regulation in 100 adults ≥ 60 years with comorbid chronic pain and negative emotions, who did not have evidence of moderate-to-severe cognitive impairment. Questionnaires on comorbidities, depressive symptoms, pain intensity, and pain-related disability were administered along with the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) and the Montreal Cognitive Assessment (MoCA). Multiple regression assessed the relationship between demographic and clinical characteristics with specific neurocognitive domains. Over half of participants (56%) had mild-to-moderate cognitive impairment (<26 on the MoCA). Across domains, participants scored the lowest in visuospatial/constructional (M = 86.2; SD = 15.7), and 15%-23% scored at least one standard deviation below the mean for immediate and delayed memory, visuospatial/constructional, and attention. In adjusted models, greater medical comorbidities were associated with poorer performance on the total RBANS, immediate memory, and attention. Cognitive deficits in older adults with chronic pain in primary care are substantial, with varying levels of deficits by neurocognitive domain. Future research should examine synergistic effects of chronic pain and comorbidities on cognition, and the impact of cognitive deficits on older adults' ability to engage in pain interventions and self-management behaviors.
Collapse
Affiliation(s)
- Irina Mindlis
- Division of Geriatrics and Palliative Medicine, Weill Cornell Medicine, New York, NY, United States
| | - Lisa D. Ravdin
- Department of Neurology, Weill Cornell Medicine, New York, NY, United States
| | - M. Carrington Reid
- Division of Geriatrics and Palliative Medicine, Weill Cornell Medicine, New York, NY, United States
| | - Dimitris Kiosses
- Department of Psychiatry, Weill-Cornell Institute of Geriatric Psychiatry, Weill Cornell Medicine, White Plains, NY, United States
| |
Collapse
|
4
|
Gradwohl BD, Mangum RW, Noyes ET, Spencer RJ. Using supplemental memory measures to refine interpretation of the repeatable battery for the assessment of neuropsychological status. APPLIED NEUROPSYCHOLOGY. ADULT 2024; 31:274-281. [PMID: 35007455 DOI: 10.1080/23279095.2021.2020792] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) is frequently used as a cognitive screening measure or as part of a comprehensive neuropsychological battery. Augmenting the current memory subtests of the RBANS to reflect clinically meaningful distinctions in memory performance may improve its clinical utility, allowing users to generate additional hypotheses and refine clinical interpretations. We pilot four supplementary memory measures to use with the RBANS, adapted from paradigms commonly used by other neuropsychological tests. We also provide several new theoretically derived memory indices to supplement the standard Delayed Memory Index. The new subtests correlated significantly with the standard memory measures, and the new indices demonstrated good reliability and diagnostic accuracy. This study provides preliminary support for supplementing the RBANS to allow for more nuanced interpretations of memory performance.
Collapse
Affiliation(s)
- Brian D Gradwohl
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA
- Department of Psychiatry, University of Michigan Michigan Medicine, Ann Arbor, MI, USA
| | - Ryan W Mangum
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA
- Department of Psychiatry, University of Michigan Michigan Medicine, Ann Arbor, MI, USA
| | - Emily T Noyes
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA
| | - Robert J Spencer
- Mental Health Service, VA Ann Arbor Healthcare System, Ann Arbor, MI, USA
- Department of Psychiatry, University of Michigan Michigan Medicine, Ann Arbor, MI, USA
| |
Collapse
|
5
|
Considine CM, Rossetti MA, Anderson K, Del Bene VA, Anderson SA, Celka AS, Edmondson MC, Sheese ALN, Piccolino A, Teixeira AL, Stout JC. Huntington study group's neuropsychology working group position on best practice recommendations for the clinical neuropsychological evaluation of patients with Huntington disease. Clin Neuropsychol 2024; 38:984-1006. [PMID: 37849335 DOI: 10.1080/13854046.2023.2267789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2023] [Accepted: 10/02/2023] [Indexed: 10/19/2023]
Abstract
Objective: Neuropsychological evaluation is critical to detection and management of cognitive and neuropsychiatric changes associated with Huntington disease (HD). Accurate assessment of non-motor complications of HD is critical given the prominent impact on functional disability, frequently commensurate with or exceeding that of motor symptoms. The increasing emphasis on developing disease-modifying therapies targeting cognitive decline in HD requires consensus on clinical neuropsychological assessment methods. The Neuropsychology Working Group (NPWG) of the Huntington Study Group (HSG) sought to provide evidence and consensus-based, practical guidelines for the evaluation of cognitive and neuropsychiatric symptoms associated with HD. Method: The NPWG recruited a multi-disciplinary group of neuropsychologists, neurologists, and psychiatrists to inform best practices in assessing, diagnosing, and treating the non-motor symptoms in HD. A review was circulated among the NPWG, and in an iterative process informed by reviewed literature, best practices in neuropsychological evaluation of patients with HD were identified. Results: A brief review of the available literature and rational for a clinical consensus battery is offered. Conclusion: Clinical neuropsychologists are uniquely positioned to both detect and characterize the non-motor symptoms in HD, and further, provide neurologists and allied health professions with clinically meaningful information that impacts functional outcomes and quality of life. The NPWG provides guidance on best practices to clinical neuropsychologists in this statement. A companion paper operationalizing clinical application of previous research-based non-motor diagnostic criteria for HD is forthcoming, which also advises on non-motor symptom screening methods for the non-neuropsychologist working with HD.
Collapse
Affiliation(s)
- Ciaran M Considine
- Department of Neurology, Vanderbilt University School of Medicine, Nashville, TN, USA
| | - M Agustina Rossetti
- Department of Neurology, University of Virginia School of Medicine, Charlottesville, VA, USA
| | - Kendra Anderson
- Department of Neurology, McGovern Medical School UT Health, The University of Texas Health Science Center, Houston, TX, USA
| | - Victor A Del Bene
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | - Sharlet A Anderson
- Department of Neurological Sciences, Rush University Medical Center, Chicago, IL, USA
| | - Andrea S Celka
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | | | - Amelia L Nelson Sheese
- Department of Neurological Sciences, University of Nebraska Medical Center College of Medicine, Omaha, NE, USA
| | - Adam Piccolino
- Psychology, Piccolino Psychological Services, Burnsville, MN, USA
| | - Antonio L Teixeira
- Department of Neurology, University of Alabama at Birmingham Heersink School of Medicine, Birmingham, AL, USA
| | - Julie C Stout
- Turner Institute for Brain and Mental Health, and School of Psychological Science, Monash University, Melbourne, Australia
| |
Collapse
|
6
|
Raudeberg R, Karr JE, Iverson GL, Hammar Å. Examining the repeatable battery for the assessment of neuropsychological status validity indices in people with schizophrenia spectrum disorders. Clin Neuropsychol 2023; 37:101-118. [PMID: 33522847 DOI: 10.1080/13854046.2021.1876169] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Objective: We examined the frequency of possible invalid test scores on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) in patients with schizophrenia spectrum disorders, and whether there was an association between scores on the embedded RBANS performance validity tests (PVTs) and self-reported symptoms of apathy as measured by the Initiate Scale of the Behavior Rating Inventory of Executive Function-Adult Version (BRIEF-A). Methods: Participants included 250 patients (M = 24.4 years-old, SD = 5.7) with schizophrenia spectrum disorders. Base rates of RBANS Effort Index (EI), Effort Scale (ES), and Performance Validity Index (PVI) test scores were computed. Spearman correlations were used to examine the associations between the RBANS PVTs, the RBANS Index scores, and the BRIEF-A Initiate Scale. Regression analyses were used to investigate how well the RBANS PVTs predicted scores on the BRIEF-A Initiate Scale. Results: The frequency of invalid scores on the EI (>3) and the PVI (<42) in participants with schizophrenia spectrum disorders was 6%. The frequency of invalid ES scores (<12) was 28% in the patients compared to 15% in the U.S. standardization sample. There was a small significant correlation between the EI and the BRIEF-A Initiate Scale (rho=.158, p<.05). Conclusions: The rates of invalid scores were similar to previously published studies. Invalid scores on the BRIEF-A were uncommon. Apathy measured with the BRIEF-A Initiate Scale was not associated with performance on the RBANS validity measures or with measures of cognition.
Collapse
Affiliation(s)
- Rune Raudeberg
- Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway
| | - Justin E Karr
- Department of Psychology, University of Kentucky, Lexington, Kentucky, USA
| | - Grant L Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School; Spaulding Rehabilitation Hospital and Spaulding Research Institute; & Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, Massachusetts, USA
| | - Åsa Hammar
- Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway.,Division of Psychiatry, Haukeland University Hospital, Bergen, Norway
| |
Collapse
|
7
|
Jurick SM, Eglit GML, Delis DC, Bondi MW, Jak AJ. D-KEFS trail making test as an embedded performance validity measure. J Clin Exp Neuropsychol 2022; 44:62-72. [DOI: 10.1080/13803395.2022.2073334] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Affiliation(s)
- S. M. Jurick
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - G. M. L. Eglit
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - D. C. Delis
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - M. W. Bondi
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| | - A. J. Jak
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California, USA
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
- Research Service, VA San Diego Healthcare System, San Diego, California, USA
| |
Collapse
|
8
|
Binder L, Salinsky MC, Storzbach D, Tadrous-Furnanz SK. RBANS Validity Measures and the TOMM in Veterans Undergoing Seizure Monitoring. Arch Clin Neuropsychol 2021; 36:613-619. [PMID: 33051666 DOI: 10.1093/arclin/acaa079] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2020] [Revised: 05/28/2020] [Accepted: 09/07/2020] [Indexed: 11/14/2022] Open
Abstract
OBJECTIVE To assess the validity of embedded measures of performance validity, the effort index (EI) and effort scale (ES) of the repeatable battery for the assessment of neuropsychological status (RBANS), in Veterans with seizures; to compare the frequency of failure on the test of memory malingering (TOMM) in patients with epileptic versus psychogenic nonepileptic seizures (PNES). METHODS Seizure diagnosis was established for 309 participants in epilepsy monitoring units using conventional diagnostic criteria who completed both the TOMM and RBANS. The criterion for performance invalidity was failure on any trial of the TOMM. We examined multiple EI and ES cutoffs to establish optimal sensitivity and specificity. RESULTS An RBANS EI cutoff score of greater than three was optimal with specificity of .98, sensitivity of.19, and positive Likelihood Ratio of 10 but was not useful when below this cutoff. Confidence intervals indicate the need for confirmation of a failed EI with another performance validity test (PVT). No ES cutoff had sufficient specificity for clinical use. Invalid TOMM performance but not invalid RBANS performance was significantly more common in persons with PNES than in persons with epileptic seizures. CONCLUSIONS In Veterans undergoing seizure monitoring, the RBANS EI was useful as a screen when positive that requires confirmation with another PVT. The RBANS ES was not useful. Invalid performance on the TOMM was more common in persons with PNES than in persons with epileptic seizures.
Collapse
Affiliation(s)
- Laurence Binder
- Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA
| | - Martin C Salinsky
- Department of Neurology, Oregon Health and Science University, Portland, OR, USA.,Department of Neurology, Portland VA Healthcare System, Portland, OR, USA
| | - Daniel Storzbach
- Department of Psychiatry, Oregon Health and Science University, Portland, OR, USA.,Portland VA Healthcare System Neuropsychology Clinic, Portland, OR, USA
| | | |
Collapse
|
9
|
Garrett KD, Perry W, Williams B, Korinek L, Bazzo DEJ. Cognitive Screening Tools for Late Career Physicians: A Critical Review. J Geriatr Psychiatry Neurol 2021; 34:171-180. [PMID: 32419575 DOI: 10.1177/0891988720924712] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 01/05/2023]
Abstract
Screening measures are widely used in medicine to assess the increased probability that members of a defined population have a particular condition and therefore require more extensive assessment. The rationale for prospective screening of late career physicians (LCPs) is drawn from the following circumstances: Senior physicians-prone to the vicissitudes of aging-comprise nearly a third of the US physician workforce, physicians are poor at self-evaluation, data suggest many have clinically relevant cognitive decline, and screening is an evidence-based, method to detect individuals at risk and determine whether a comprehensive evaluation is necessary. A handful of professional organizations (eg, surgeons, obstetricians, and a growing number of medical staff credentialing committees) have developed policies in this arena. This focused review compares cognitive screening methods used or recommended for LCPs, with particular attention to the psychometric properties, ease of operational implementation, and appropriate application to physicians-a population selected for high cognitive reserve and skills. Further, we identify gaps in knowledge and practice, including the need for more career-span normative data on physicians' cognitive and work performance. Stakeholders can improve rehabilitation and other supports to LCPs in transition, calling upon the unique expertise of those neuropsychologists who are trained on conducting fitness for duty evaluations, as well as rehabilitation professionals who can assist in developing modifications to practice when indicated or facilitate graceful transitions to retirement when necessary.
Collapse
Affiliation(s)
- Kelly Davis Garrett
- 7061Intermountain Healthcare and Rocky Mountain Neurology Clinic, Salt Lake City, UT, USA
| | - William Perry
- Physician Assessment and Clinical Education, 12220University of California at San Diego, San Diego, CA, USA
| | - Betsy Williams
- Professional Renewal Center, Lawrence, KS, USA.,Department of Psychiatry School of Medicine, 4202University of Kansas, USA
| | - Lauri Korinek
- Center for Personalized Education for Professionals, Denver, CO, USA
| | - David E J Bazzo
- Physician Assessment and Clinical Education, 12220University of California at San Diego, San Diego, CA, USA
| |
Collapse
|
10
|
A Meta-Analysis of Neuropsychological Effort Test Performance in Psychotic Disorders. Neuropsychol Rev 2020; 30:407-424. [PMID: 32766940 DOI: 10.1007/s11065-020-09448-2] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2019] [Accepted: 07/15/2020] [Indexed: 12/28/2022]
Abstract
Psychotic disorders are characterized by a generalized neurocognitive deficit (i.e., performance 1.5 SD below controls across neuropsychological domains with no specific profile of differential deficits). A motivational account of the generalized neurocognitive deficit has been proposed, which attributes poor neuropsychological testing performance to low effort. However, findings are inconsistent regarding effort test failure rate in individuals with psychotic disorders across studies (0-72%), and moderators are unclear, making it difficult to know whether the motivational explanation is viable. To address these issues, a meta-analysis was performed on data from 2205 individuals with psychotic disorders across 19 studies with 24 independent effects. Effort failure rate was examined along with moderators of effort test type, forensic status, IQ, positive symptoms, negative symptoms, diagnosis, age, gender, education, and antipsychotic use. The pooled weighted effort test failure rate was 18% across studies and there was a moderate pooled association between effort failure rate and global neurocognitive performance (r = .57). IQ and education significantly moderated failure rate. Collectively, these findings suggest that a nontrivial proportion of individuals with a psychotic disorder fail effort testing, and failure rate is associated with global neuropsychological impairment. However, given that effort tests are not immune to the effects of IQ in psychotic disorders, these results cannot attest to the viability of the motivational account of the generalized neurocognitive deficit. Furthermore, the significant moderating effect of IQ and education on effort test performance suggests that effort tests have questionable validity in this population and should be interpreted with caution.
Collapse
|
11
|
Martin PK, Schroeder RW, Olsen DH. Performance validity in the dementia clinic: Specificity of validity tests when used individually and in aggregate across levels of cognitive impairment severity. Clin Neuropsychol 2020; 36:165-188. [DOI: 10.1080/13854046.2020.1778790] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Affiliation(s)
- Phillip K. Martin
- Department of Psychiatry and Behavioral Sciences, University of Kansas School of Medicine – Wichita, Wichita, KS, USA
| | - Ryan W. Schroeder
- Department of Psychiatry and Behavioral Sciences, University of Kansas School of Medicine – Wichita, Wichita, KS, USA
| | | |
Collapse
|
12
|
McGuire C, Crawford S, Evans JJ. Effort Testing in Dementia Assessment: A Systematic Review. Arch Clin Neuropsychol 2019; 34:114-131. [PMID: 29579143 DOI: 10.1093/arclin/acy012] [Citation(s) in RCA: 26] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2017] [Accepted: 01/30/2018] [Indexed: 11/14/2022] Open
Abstract
Objective Interpretation of neuropsychological test data is only valid when appropriate effort has been exerted. Research, however, suggests that neuropsychologists do not always formally test for effort and that this may especially be the case in the context of dementia assessment. This review systematically examined the literature that has investigated the use of both purpose-built and embedded effort-sensitive indices in dementia, mild cognitive impairment (MCI), and healthy control samples. The aim was to determine which tests of effort are most sensitive to suboptimal effort and least sensitive to the type of cognitive impairment seen in dementia. Methods A systematic search of databases was conducted to October 2017. There was no start date. Results Twenty-five studies were included for review. The studies were divided into two categories according to methodology. One category of studies (n = 5) was reviewed using a tailored methodological quality rating checklist whilst the remaining studies (n = 20) were reviewed using the Crowe Critical Appraisal Tool (CCAT). Conclusions The results of this review suggest that PVTs which take a hierarchical approach to effort testing such as the WMT, MSVT, and NV-MSVT are preferable for use with older adults who are under investigation for possible dementia. These tests go above and beyond the traditional pass/fail approach of more traditional tests of effort because they allow the examiner to analyze the examinee's profile of scores. The methodological limitations and challenges involved in this field of research are discussed.
Collapse
Affiliation(s)
- Claire McGuire
- NHS Greater Glasgow & Clyde, Older People's Psychology Service, Eastwood Health and Care Centre, Drumby Crescent, Clarkston, UK
| | - Stephanie Crawford
- NHS Greater Glasgow & Clyde, Older People's Psychology Service, Crown House, 30 King Street, Greenock, UK
| | - Jonathan J Evans
- Mental Health and Wellbeing, University of Glasgow, The Academic Centre, Gartnavel Royal Hospital, 1055 Great Western Road, Glasgow, UK
| |
Collapse
|
13
|
Davis JJ. Performance validity in older adults: Observed versus predicted false positive rates in relation to number of tests administered. J Clin Exp Neuropsychol 2018; 40:1013-1021. [PMID: 29779432 PMCID: PMC6141322 DOI: 10.1080/13803395.2018.1472221] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022]
Abstract
INTRODUCTION This study examined false positive rates on embedded performance validity tests (PVTs) in older adults grouped by cognitive status. METHOD The research design involved secondary analysis of data from the National Alzheimer's Coordinating Center database. Participants (N = 22,688) were grouped by cognitive status: normal (n = 10,319), impaired (n = 1,194), amnestic or nonamnestic mild cognitive impairment (MCI; n = 5,414), and dementia (n = 5,761). Neuropsychological data were used to derive 5 PVTs. RESULTS False positive rates on individual PVTs ranged from 3.3 to 26.3% with several embedded PVTs showing acceptable specificity across groups. The proportion of participants failing two or more PVTs varied by cognitive status: normal (1.9%), impaired (6.6%), MCI (13.2%), and dementia (52.8%). Comparison of observed and predicted false positive rates at different specificity levels (.85 or .90) demonstrated significant differences in all comparisons. In normal and impaired groups, predicted rates were higher than observed rates. In the MCI group, predicted and observed comparisons varied: Predicted rates were higher with specificity at .85 and lower with specificity at .90. In the dementia group, predicted rates underestimated observed rates. CONCLUSIONS Despite elevated false positives in conditions involving severe cognitive compromise, several measures retain acceptable specificity regardless of cognitive status. Predicted false positive rates based on the number of PVTs administered were not observed empirically. These findings do not support the utility of simulated data in predicting false positive rates in older adults.
Collapse
Affiliation(s)
- Jeremy J Davis
- a Division of Physical Medicine & Rehabilitation , University of Utah School of Medicine , Salt Lake City , UT , USA
| |
Collapse
|
14
|
Goette WF, Goette HE. A meta-analysis of the accuracy of embedded performance validity indicators from the repeatable battery for the assessment of neuropsychological status. Clin Neuropsychol 2018; 33:1044-1068. [PMID: 30472924 DOI: 10.1080/13854046.2018.1538429] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Objective: Meta-analyze the embedded performance validity tests of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS), emphasizing two topics: diagnostic accuracy and relationships with demographics. Method: Literature was identified through a review of PsycINFO, PubMed, and Google Scholar. Bivariate linear mixed models were used for diagnostic accuracy analyses. Random-effects analysis of correlations with demographic variables was also used for the Effort Index. Results: Diagnostic accuracy analyses utilized 12 studies of the Effort Index (EI; N = 1469) and 6 studies of the Effort Scale (ES; N = 854). The EI was found to have a sensitivity of .44 (95% CI: .28 - .62), specificity of .87 (95% CI: .78 - .93), and diagnostic odds ratio (DOR) of 5.41 (95% CI: 3.74 - 7.58). The ES produced a sensitivity of .67 (95% CI: .50 - .81), specificity of .72 (95% CI: .53 - .85), and DOR of 5.97 (95% CI: 1.70 - 15.30). Meta-analysis of correlations utilized 14 samples of the EI (N = 3781), but insufficient data were available for the ES. Correlations between the EI and age (r = .10, 95% CI: .05 - .16), education (r = -.11, 95% CI: -.18 to -.04), and the RBANS Total Scale (r = -.45, 95% CI: -.62 to -.24) were significant. These results appeared to be robust to publication bias. Conclusion: Results support use of the EI over the ES; however, the latter is comparatively less studied and did not have similar variability in reported cut-off scores. ES accuracy statistics were significantly predicted by sample variables, which may be related to its relatively fewer studies. Both measures should be used cautiously in the context of genuine cognitive impairment.
Collapse
Affiliation(s)
- William F Goette
- a Department of Psychology and Counseling , The University of Texas at Tyler , Tyler , Texas , USA
| | - Haley E Goette
- b Department of History , The University of Texas at Tyler , Tyler , Texas , USA
| |
Collapse
|
15
|
Riordan P, Lahr G. Classification accuracy of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Effort Index (EI) and Effort Scale (ES) relative to the Test Of Memory Malingering (TOMM) in a mixed clinical sample. APPLIED NEUROPSYCHOLOGY-ADULT 2018; 27:82-86. [DOI: 10.1080/23279095.2018.1485678] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Affiliation(s)
- Patrick Riordan
- Neuropsychology Department, Loyola University Medical Center, Maywood, Illinois, USA
| | - Genessa Lahr
- Neuropsychology Department, Loyola University Medical Center, Maywood, Illinois, USA
| |
Collapse
|
16
|
RBANS Validity Indices: a Systematic Review and Meta-Analysis. Neuropsychol Rev 2018; 28:269-284. [DOI: 10.1007/s11065-018-9377-5] [Citation(s) in RCA: 28] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2017] [Accepted: 05/01/2018] [Indexed: 11/27/2022]
|
17
|
Bayan SM, Nitch S, Kinney D, Kaminetskaya M. Exploratory analysis of CVLT-II forced-choice recognition and RBANS EI base rates for forensically-committed, psychotic-disordered inpatients: Implications on clinical decision-making. APPLIED NEUROPSYCHOLOGY-ADULT 2016; 25:71-81. [PMID: 27827539 DOI: 10.1080/23279095.2016.1247092] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
Within the inpatient forensic setting, requests for a neuropsychological evaluation are common to determine cognitive strengths and weaknesses. However, variable effort proves to be a prominent issue in this setting. Thus, assessment of effort becomes an essential component of a neuropsychological evaluation. The California Verbal Learning Test, 2nd Edition (CVLT-II) and the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) are widely utilized cognitive measures in the inpatient setting. The purpose of this study is to establish the local base rates and predictive abilities of the CVLT-II Forced-Choice Recognition (FCR) measure and RBANS Effort Index (EI). Participants included 56 and 595 forensically-committed, psychotic-disordered inpatients who completed the CVLT-II FCR and RBANS EI, respectively. Results indicated that the estimated local base rate for a positive CVLT-II FCR score was 8%, which resulted in 97% negative predictive power and 50% positive predictive power. The estimated local base rate for a positive RBANS EI score was 16%, which resulted in 91.7% negative predictive power and 57.1% positive predictive power. Given their low sensitivity and predictive power, the results suggest that much more confidence can be placed in negative FCR and EI results as opposed to positive findings.
Collapse
Affiliation(s)
- Stacey M Bayan
- a Department of State Hospitals-Patton, Psychology , San Bernardino , California , USA
| | - Steve Nitch
- a Department of State Hospitals-Patton, Psychology , San Bernardino , California , USA
| | - Dominique Kinney
- a Department of State Hospitals-Patton, Psychology , San Bernardino , California , USA
| | - Marina Kaminetskaya
- a Department of State Hospitals-Patton, Psychology , San Bernardino , California , USA
| |
Collapse
|
18
|
Carter KR, Scott JG, Adams RL, Linck J. Base rate comparison of suboptimal scores on the RBANS effort scale and effort index in Parkinson’s disease. Clin Neuropsychol 2016; 30:1118-25. [DOI: 10.1080/13854046.2016.1206145] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/21/2022]
Affiliation(s)
- Kirstine R. Carter
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - James G. Scott
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Russell L. Adams
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - John Linck
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| |
Collapse
|
19
|
Lippa SM, Lange RT, Bhagwat A, French LM. Clinical utility of embedded performance validity tests on the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) following mild traumatic brain injury. APPLIED NEUROPSYCHOLOGY-ADULT 2016; 24:73-80. [DOI: 10.1080/23279095.2015.1100617] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/22/2022]
|
20
|
Batty RA, Francis A, Thomas N, Hopwood M, Ponsford J, Rossell SL. A brief neurocognitive assessment of patients with psychosis following traumatic brain injury (PFTBI): Use of the Repeatable battery for the Assessment of Neuropsychological Status (RBANS). Psychiatry Res 2016; 237:27-36. [PMID: 26921048 DOI: 10.1016/j.psychres.2016.01.062] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/04/2015] [Revised: 11/02/2015] [Accepted: 01/27/2016] [Indexed: 11/25/2022]
Abstract
Patients who develop psychosis following a traumatic brain injury (PFTBI) show impaired neurocognition; however, the degree of impairment has not been empirically investigated using a standardised battery. We administered the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) to patients with PFTBI (n=10), and to three groups of controls: traumatic brain injury (TBI) (n=10), schizophrenia (n=23), and nonclinical controls (n=23). The results confirmed that the cognitive neuropsychological profile of dually-diagnosed patients with PFTBI is significantly and substantially impaired. Seventy per cent of patients with PFTBI received a neuropsychological classification between the "extremely low" and "low average" ranges. Group-wise analyses on the RBANS indices indicated that patients with PFTBI had the lowest (Immediate Memory, Attention, Delayed Memory, Total Score), or equal lowest (visuospatial, equivalent with schizophrenia patients) scores, with the exception of the Language Index where no group differences were shown (however, the mean PFTBI score on the Language Index was two standard deviations below the RBANS normative score). These findings provide novel evidence of impaired cognitive neuropsychological processing in patients with PFTBI using a standardised and replicable battery.
Collapse
Affiliation(s)
- Rachel A Batty
- Brain and Psychological Sciences Research Centre (BPsyC), Swinburne University of Technology, Melbourne, Victoria, Australia; Monash-Alfred Psychiatry Research Centre (MAPrc), Melbourne, Victoria, Australia; RMIT University, Bundoora, Victoria, Australia.
| | | | - Neil Thomas
- Brain and Psychological Sciences Research Centre (BPsyC), Swinburne University of Technology, Melbourne, Victoria, Australia; Monash-Alfred Psychiatry Research Centre (MAPrc), Melbourne, Victoria, Australia
| | - Malcolm Hopwood
- University of Melbourne, Department of Psychiatry, Albert Road Clinic, Melbourne, Victoria, Australia
| | - Jennie Ponsford
- Monash-Epworth Rehabilitation Research Centre, Epworth Hospital, Richmond, Victoria, Australia
| | - Susan L Rossell
- Brain and Psychological Sciences Research Centre (BPsyC), Swinburne University of Technology, Melbourne, Victoria, Australia; Monash-Alfred Psychiatry Research Centre (MAPrc), Melbourne, Victoria, Australia
| |
Collapse
|
21
|
Jones A. Repeatable Battery for the Assessment of Neuropsychological Status: Effort Index Cutoff Scores for Psychometrically Defined Malingering Groups in a Military Sample. Arch Clin Neuropsychol 2016; 31:273-83. [DOI: 10.1093/arclin/acw006] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/28/2016] [Indexed: 11/12/2022] Open
|
22
|
Lippa SM, Agbayani KA, Hawes S, Jokic E, Caroselli JS. Effort in acute traumatic brain injury: considering more than pass/fail. Rehabil Psychol 2015; 59:306-12. [PMID: 25133905 DOI: 10.1037/a0037217] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
PURPOSE/OBJECTIVE Performance validity is often conceptualized as a dichotomous process. Effort likely lies on a continuum, however, and psychologists' tendency to rely on pass/fail descriptors of one's effort may not be the only approach. The current study aims to show that when performance validity is considered on a continuum, it may provide clinical information related to cognitive functioning. RESEARCH METHOD/DESIGN Forty-four patients with moderate or severe traumatic brain injury were evaluated with the Repeatable Battery for the Assessment of Neuropsychological Status upon their emergence from posttraumatic amnesia. From this data, previously developed effort index scores and "other cognitive functions" index scores were calculated. RESULTS Performance on the effort index significantly accounted for the patients' performance on a cognitive composite score after considering education and severity of injury. CONCLUSIONS/IMPLICATIONS Findings suggest that more in-depth analysis of validity test performance is beneficial to gauge a patient's level of effort and is important to consider when interpreting results and in treatment planning.
Collapse
Affiliation(s)
- Sara M Lippa
- Department of Psychology/Neuropsychology, TIRR Memorial Hermann Hospital
| | | | - Samuel Hawes
- Department of Psychology/Neuropsychology, TIRR Memorial Hermann Hospital
| | - Emily Jokic
- Department of Psychology/Neuropsychology, TIRR Memorial Hermann Hospital
| | - Jerome S Caroselli
- Department of Psychology/Neuropsychology, TIRR Memorial Hermann Hospital
| |
Collapse
|
23
|
Burton RL, Enright J, O'Connell ME, Lanting S, Morgan D. RBANS embedded measures of suboptimal effort in dementia: effort scale has a lower failure rate than the effort index. Arch Clin Neuropsychol 2014; 30:1-6. [PMID: 25472686 DOI: 10.1093/arclin/acu070] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
Abstract
The importance of evaluating effort in neuropsychological assessments has been widely acknowledged, but measuring effort in the context of dementia remains challenging due to the impact of dementia severity on effort measure scores. Two embedded measures have been developed for the repeatable battery for the assessment of neuropsychological status (RBANS; Randolph, C., Tierney, M. C., Mohr, E., & Chase, T. N. (1998). The repeatable battery for the assessment of neuropsychological status (RBANS): Preliminary clinical validity. Journal of Clinical and Experimental Neuropsychology, 20 (3), 310-319): the Effort Index (EI; Silverberg, N. D., Wertheimer, J. C., & Fichtenberg, N. L. (2007). An effort index for the repeatable battery for the assessment of neuropsychological status (RBANS). Clinical Neuropsychologist, 21 (5), 841-854) and the Effort Scale (ES; Novitski, J., Steele, S., Karantzoulis, S., & Randolph, C. (2012). The repeatable battery for the assessment of neuropsychological status effort scale. Archives of Clinical Neuropsychology, 27 (2), 190-195). We explored failure rates on these effort measures in a non-litigating mixed dementia sample (N = 145). Failure rate on the EI was high (48%) and associated with dementia severity. In contrast, failure on the ES was 14% but differed based on type of dementia. ES failure was low (4%) when dementia was due to Alzheimer disease (AD), but high (31%) for non-AD dementias. These data raise concerns about use of the RBANS embedded effort measures in dementia evaluations.
Collapse
Affiliation(s)
- Rachel L Burton
- Department of Psychology, University of Saskatchewan, Saskatoon, SK, Canada S7N 5A5
| | - Joe Enright
- Department of Psychology, University of Saskatchewan, Saskatoon, SK, Canada S7N 5A5
| | - Megan E O'Connell
- Department of Psychology, University of Saskatchewan, Saskatoon, SK, Canada S7N 5A5
| | - Shawnda Lanting
- Department of Neuropsychology, Copeman Health Clinic, Vancouver, BC, Canada V6Z 2L4 School of Kinesiology, University of British Columbia, Vancouver, BC, Canada V6T 1Z1
| | - Debra Morgan
- Canadian Centre for Health and Safety in Agriculture, Saskatoon, SK, Canada S7N 5E5
| |
Collapse
|
24
|
Ortega A, Piefke M, Markowitsch HJ. A Bayesian latent group analysis for detecting poor effort in a sample of cognitively impaired patients. J Clin Exp Neuropsychol 2014; 36:659-67. [PMID: 24911397 DOI: 10.1080/13803395.2014.926863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Using a Bayesian latent group analysis in a simulation design, we recently showed a high diagnostic accuracy when assessing effort in the context of malingered memory deficits. We here further evaluate our Bayesian model in a sample of cognitively impaired patients. The main analysis showed both high sensitivity and specificity, thus corroborating a high diagnostic accuracy of the model. Additional analysis showed variations on effort estimates after changes in malingering base rates. Variations affected sensitivity, but not specificity, which is in line with typical findings in malingering research. These data suggest that Bayesian analyses may complement and improve existing effort measures.
Collapse
Affiliation(s)
- Alonso Ortega
- a Physiological Psychology , Bielefeld University , Bielefeld , Germany
| | | | | |
Collapse
|
25
|
Diagnostic Accuracy of a Bayesian Latent Group Analysis for the Detection of Malingering-Related Poor Effort. Clin Neuropsychol 2013; 27:1019-42. [DOI: 10.1080/13854046.2013.806677] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
|
26
|
Thaler NS, Scott JG, Duff K, Mold J, Adams RL. RBANS Cluster Profiles in a Geriatric Community-Dwelling Sample. Clin Neuropsychol 2013; 27:794-807. [DOI: 10.1080/13854046.2013.783121] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
|
27
|
Bortnik KE, Horner MD, Bachman DL. Performance on Standard Indexes of Effort Among Patients with Dementia. APPLIED NEUROPSYCHOLOGY-ADULT 2013; 20:233-242. [DOI: 10.1080/09084282.2012.695757] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Affiliation(s)
- Kirsty E. Bortnik
- a Fuller Graduate School of Psychology and Department of Psychiatry and Behavioral Sciences , Medical University of South Carolina , Charleston , South Carolina
| | - Michael David Horner
- b Neuropsychology Clinic, Ralph H. Johnson Department of Veterans Affairs Medical Center, and Department of Psychiatry and Behavioral Sciences , Medical University of South Carolina , Charleston , South Carolina
| | - David L. Bachman
- b Neuropsychology Clinic, Ralph H. Johnson Department of Veterans Affairs Medical Center, and Department of Psychiatry and Behavioral Sciences , Medical University of South Carolina , Charleston , South Carolina
| |
Collapse
|
28
|
Moore RC, Davine T, Harmell AL, Cardenas V, Palmer BW, Mausbach BT. Using the repeatable battery for the assessment of neuropsychological status (RBANS) effort index to predict treatment group attendance in patients with schizophrenia. J Int Neuropsychol Soc 2013; 19:198-205. [PMID: 23234753 PMCID: PMC3568222 DOI: 10.1017/s1355617712001221] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
In a psychosocial treatment study, knowing which participants are likely to put forth adequate effort to maximize their treatment, such as attending group sessions and completing homework assignments, and knowing which participants need additional motivation before engagement in treatment is a crucial component to treatment success. This study examined the ability of the Repeatable Battery for Assessment of Neuropsychological Status (RBANS) Effort Index (EI), a newly developed measure of suboptimal effort that is embedded within the RBANS, to predict group attendance in a sample of 128 middle-aged and older adults with schizophrenia. This study was the first to evaluate the EI with a schizophrenia sample. While the EI literature recommends a cutoff score of >3 to be considered indicative of poor effort, a cutoff of >4 was identified as the optimal cutoff for this sample. Receiver Operating Characteristics curve analyses were conducted to determine if the EI could predict participants who had high versus low attendance. Results indicated that the EI was successfully able to discriminate between group attendance, and this measure of effort appears to be most valuable as a tool to identify participants who will have high attendance. Of interest, overall cognitive functioning and symptoms of psychopathology were not predictive of group attendance.
Collapse
Affiliation(s)
- Raeanne C. Moore
- Department of Psychiatry, University of California, San Diego, La Jolla, California
| | - Taylor Davine
- Department of Psychology, San Diego State University, San Diego, California
| | - Alexandrea L. Harmell
- Department of Psychiatry, University of California, San Diego, La Jolla, California
- Joint Doctoral Program in Clinical Psychology, University of California, San Diego/San Diego State University, San Diego, California
| | - Veronica Cardenas
- Department of Psychiatry, University of California, San Diego, La Jolla, California
| | - Barton W. Palmer
- Department of Psychiatry, University of California, San Diego, La Jolla, California
| | - Brent T. Mausbach
- Department of Psychiatry, University of California, San Diego, La Jolla, California
| |
Collapse
|
29
|
Sieck BC, Smith MM, Duff K, Paulsen JS, Beglinger LJ. Symptom validity test performance in the Huntington Disease Clinic. Arch Clin Neuropsychol 2012; 28:135-43. [PMID: 23266566 DOI: 10.1093/arclin/acs109] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/14/2022] Open
Abstract
Symptom validity tests (SVTs) are often used in neuropsychological assessment; however, recent studies indicate that cognitive impairment/dementia may contribute to failing scores on some effort tests. The purpose of this study was to characterize how individuals with Huntington disease (HD) perform on three SVTs and to examine the relationship between SVT performance and demographic and clinical variables. Results indicate that while the majority of HD patients passed the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) Effort Index (EI; 82% of n = 121) and the Test of Memory Malingering (92% of n = 36), failure of these SVTs was associated with poorer cognitive and adaptive functioning, and greater motor impairment. Results showed that less than one-third passed the RBANS Effort Scale (ES; 30% of n = 43) and few clinical and demographic variables were correlated with this SVT performance. Although some SVTs may be better suited to HD, cognitive ability should be considered when evaluating effort in HD.
Collapse
Affiliation(s)
- Barbara C Sieck
- Department of Psychiatry, University of Iowa Carver College of Medicine, Iowa City, IA 52242-1000, USA
| | | | | | | | | |
Collapse
|
30
|
Young JC, Baughman BC, Roper BL. Validation of the repeatable battery for the assessment of neuropsychological status--effort index in a veteran sample. Clin Neuropsychol 2012; 26:688-99. [PMID: 22533826 DOI: 10.1080/13854046.2012.679624] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
The RBANS Effort Index (RBANS-EI; Silverberg, Wertheimer, & Fichtenberg, 2007) is an embedded measure of effort within a frequently employed neuropsychological screening battery. While it has been criticized for inadequate specificity in older non-litigating samples (Hook, Marquine, & Hoelzle, 2009; Warren et al., 2010), the RBANS-EI has yet to be investigated in a non-geriatric veteran sample. Archival data were collected from 85 veterans who completed the RBANS and WMT within either a routine neuropsychological evaluation (n = 66) or compensation evaluation (n = 19). At a cutoff of >3 RBANS-EI exhibited strong specificity (.94) yet limited sensitivity (.31) in the prediction of WMT performance. Examination of RBANS-EI component subtests found that List Recognition <17 had strong specificity (.90) and moderate sensitivity (.52) in discriminating WMT performance groups. In contrast, Digit Span performance was comparable between those passing and failing the WMT. Present findings indicate that both the RBANS-EI and List Recognition subtest may be useful in detecting suboptimal effort yet raise questions regarding the Digit Span component of the RBANS-EI.
Collapse
|
31
|
Ryan JJ, Turpin DM, Kreiner DS. Specificity of the 21-Item Test in two elderly samples. NEUROPSYCHOLOGY, DEVELOPMENT, AND COGNITION. SECTION B, AGING, NEUROPSYCHOLOGY AND COGNITION 2012; 19:723-40. [PMID: 22263873 DOI: 10.1080/13825585.2011.646941] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/14/2022]
Abstract
The purpose of this study was to measure the specificity of the 21-Item Test for detecting malingering in an elderly sample. The 21-Item Test was administered to 20 community-dwelling elderly individuals with means for age, education, and Short Portable Mental Status Questionnaire (SPMSQ) error scores of 76.25 years (SD = 7.19), 14.30 years (SD = 3.89), and 0.30 (SD = 4.70). None of these healthy elderly participants were cognitively impaired. A second group of 53 nursing home residents had means for age, education, and SPMSQ error scores of 82.79 years (SD = 8.56), 11.14 years (SD = 2.46), and 3.17 (SD = 2.46). Approximately 60% of the nursing home participants had cognitive impairment based on the SPMSQ. The cut offs provided by Iverson (1998 , 21 Item Test Research Manual) for interpretation of the forced-choice component of the 21-Item Test were insensitive to age and relatively insensitive to cognitive deficits. Specificity was 100% since no elderly participant from either group scored in the range indicative of sub-optimal effort or biased responding.
Collapse
Affiliation(s)
- Joseph J Ryan
- Psychological Science, University of Central Missouri, Warrensburg, MO 64093, USA.
| | | | | |
Collapse
|
32
|
O'Mahar KM, Duff K, Scott JG, Linck JF, Adams RL, Mold JW. Brief report: the temporal stability of the Repeatable Battery for the Assessment of Neuropsychological Status Effort Index in geriatric samples. Arch Clin Neuropsychol 2012; 27:114-8. [PMID: 22075575 PMCID: PMC3286195 DOI: 10.1093/arclin/acr072] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/29/2011] [Indexed: 11/13/2022] Open
Abstract
The Effort Index (EI) of the Repeatable Battery for the Assessment of Neuropsychological Status (RBANS) was developed to identify inadequate effort. Although researchers have examined its validity, the reliability of the EI has not been evaluated. The current study examined the temporal stability of the EI across 1 year in two independent samples of older adults. One sample consisted of 445 cognitively intact older adults (mean age = 72.89; 59% having 12-15 years of education) and the second sample consisted of 51 individuals diagnosed with amnestic Mild Cognitive Impairment (mean age = 82.41; 41% having 12-15 years of education). For both samples, the EI was found to have low stability (Spearman's ρ = .32-.36). When participants were divided into those whose EI stayed stable or improved versus those whose EI worsened (i.e., declining effort) on retesting, it was observed that individuals with lower baseline RBANS Total scores tended to worsen on the EI across time. Overall, the findings suggest low temporal stability of the EI in two geriatric samples. In particular, individuals with poorer cognition at baseline could present with poorer effort across time. These findings also suggest the need to further examine the temporal stability of other effort measures.
Collapse
Affiliation(s)
- Kerry M. O'Mahar
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - Kevin Duff
- Department of Neurology, University of Utah, Salt Lake City, UT, USA
| | - James G. Scott
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | | | - Russell L. Adams
- Department of Psychiatry and Behavioral Sciences, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| | - James W. Mold
- Department of Family and Preventative Medicine, University of Oklahoma Health Sciences Center, Oklahoma City, OK, USA
| |
Collapse
|