1
|
Schmitter-Edgecombe M, Cunningham R, McAlister C, Arrotta K, Weakley A. The night out task and scoring application: an ill-structured, open-ended clinic-based test representing cognitive capacities used in everyday situations. Arch Clin Neuropsychol 2021; 36:537-553. [PMID: 33089318 DOI: 10.1093/arclin/acaa080] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2020] [Revised: 08/07/2020] [Accepted: 09/07/2020] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE The night out task (NOT) was developed as a naturalistic, open-ended, multitasking measure that requires individuals to complete eight subtasks comparable to those encountered during real-world functioning (e.g., pack travel bag, prepare tea). We examined psychometric properties and administration feasibility of this direct observation measure within a clinic-like setting using a tablet-based coding application. METHOD A sample of 148 community-dwelling older adults (82% cognitively healthy; 18% mild cognitive impairment) and 57 younger adults completed the NOT along with other neurocognitive tests and questionnaires. RESULTS Inter-rater reliability across NOT primary (i.e., time, accuracy, efficiency) and process-related (e.g., error-types, self-corrections) variables was mostly excellent. NOT primary measures showed expected patterns of convergent and discriminant validity with measures of cognition, demographics, and well-being. External validity was established by the NOT ability to distinguish between age and diagnostic (cognitively healthy vs. mild cognitive impairment) groups. Demonstrating incremental validity, the NOT primary variables (execution time in particular) were predictive of self-reported functional abilities and completion quality of in-home everyday tasks over and earlier variables such as demographics, cognition, and mobility. CONCLUSIONS These findings suggest that the NOT and its app interface, which allows for continuous logging of observations, are a feasible in-clinic measure to assess cognitive capacities important for real-world functioning. With further validation, the NOT may allow for earlier detection of functional difficulties. Understanding errors and strategies used during NOT performance could also have implications for individualized interventions.
Collapse
Affiliation(s)
| | - Reanne Cunningham
- Department of Psychology, Washington State University, Pullman, WA, USA
| | - Courtney McAlister
- Mayo Clinic School of Medicine, Mayo Clinic Health System, La Crosse, WI, USA
| | - Kayela Arrotta
- Neurological Institute, Cleveland Clinic, Cleveland, OH, USA
| | - Alyssa Weakley
- Neurology Department, School of Medicine, University of California, Davis, Sacramento, CA, USA
| |
Collapse
|
2
|
Omer E, Elbaum T, Braw Y. Identifying Feigned Cognitive Impairment: Investigating the Utility of Diffusion Model Analyses. Assessment 2020; 29:198-208. [PMID: 32988242 DOI: 10.1177/1073191120962317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Forced-choice performance validity tests are routinely used for the detection of feigned cognitive impairment. The drift diffusion model deconstructs performance into distinct cognitive processes using accuracy and response time measures. It thereby offers a unique approach for gaining insight into examinees' speed-accuracy trade-offs and the cognitive processes that underlie their performance. The current study is the first to perform such analyses using a well-established forced-choice performance validity test. To achieve this aim, archival data of healthy participants, either simulating cognitive impairment in the Word Memory Test or performing it to the best of their ability, were analyzed using the EZ-diffusion model (N = 198). The groups differed in the three model parameters, with drift rate emerging as the best predictor of group membership. These findings provide initial evidence for the usefulness of the drift diffusion model in clarifying the cognitive processes underlying feigned cognitive impairment and encourage further research.
Collapse
|
3
|
Lai FHY, Dawson D, Yan EWH, Ho ECW, Tsui JWM, Fan SHU, Lee ATK. The validity, reliability and clinical utility of a performance-based executive function assessment in people with mild to moderate dementia. Aging Ment Health 2020; 24:1496-1504. [PMID: 30990085 DOI: 10.1080/13607863.2019.1599818] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Objective: Performance-based evaluation of executive function by using real-world daily living activities is an important area of study. This approach has been used extensively in evaluating patients after stroke or traumatic brain injury and patients with schizophrenia. Most important is the fact that until now, there has been no validated performance-based evaluation of executive function in people with dementia.Methods: To address that knowledge gap, this study recruited 80 patients diagnosed with dementia and 80 demographically matched healthy controls. The participants were administered tests for evaluating their performance-based executive function (Chinese Multiple Errands Test), their instrumental activities of daily living (Lawton Instrumental Activities of Daily Living Scale, Chinese Version), and their functional disability (Chinese Version of the Disability Assessment for Dementia), along with a cognitive screening test (Montreal Cognitive Assessment, Hong Kong Version) and a neuropsychological test of executive function (Trail-making Test).Results: The Chinese Multiple Errands Test demonstrated excellent inter-rater reliability, test-retest reliability and high internal consistency. Results revealed that the healthy controls out-performed the dementia patients in the performance-based executive function and cognitive screening, but not in the instrumental activities of daily living tests. Additionally, the performance efficiency scores of the older adults with dementia on the Chinese Multiple Errands Test correlated significantly with their performance results on the neuropsychological test of executive function and on the tests of functional disability and cognitive function.Conclusion: Our results indicated that the Chinese Multiple Errands Test is a reliable and valid instrument for assessing executive function in Chinese older people with dementia.
Collapse
Affiliation(s)
- Frank Ho-Yin Lai
- Department of Rehabilitation Sciences, The Hong Kong Polytechnic University, Hung Hom, Hong Kong
| | - Deirdre Dawson
- Department of Occupational Science & Occupational Therapy, Rehabilitation Sciences Institute, University of Toronto, Rotman Research Institute, Baycrest Health Sciences, Toronto, Ontario, Canada
| | | | - Eric Chun-Wui Ho
- Occupational Therapy Department, Pamela Youde Nethersole Eastern Hospital, Chai Wan, Hong Kong
| | | | | | - Alice Tsz-Kiu Lee
- Occupational Therapy Department, TWGHs Jockey Club Rehabilitation Complex, Aberdeen, Hong Kong
| |
Collapse
|
4
|
Rotenberg S, Ruthralingam M, Hnatiw B, Neufeld K, Yuzwa KE, Arbel I, Dawson DR. Measurement Properties of the Multiple Errands Test: A Systematic Review. Arch Phys Med Rehabil 2020; 101:1628-42. [DOI: 10.1016/j.apmr.2020.01.019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2019] [Revised: 12/22/2019] [Accepted: 01/01/2020] [Indexed: 01/13/2023]
|
5
|
Tomer E, Lupu T, Golan L, Wagner M, Braw Y. Eye tracking as a mean to detect feigned cognitive impairment in the word memory test. Appl Neuropsychol Adult 2018; 27:49-61. [PMID: 30183408 DOI: 10.1080/23279095.2018.1480483] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/28/2022]
Abstract
Eye movements showed initial promise for the detection of deception and may be harder to consciously manipulate than conventional accuracy measures. Therefore, we integrated an eye-tracker with the Word Memory Test (WMT) and tested its usefulness for the detection of feigned cognitive impairment. As part of the study, simulators (n = 44) and honest controls (n = 41) performed WMT's immediate-recognition (IR) subtest while their eye movements were recorded. In comparison to the control group, simulators spent less time gazing at relevant stimuli, spent more time gazing at irrelevant stimuli, and had a lower saccade rate. Group classification using a scale that combined the eye movement measures and the WMT's accuracy measure showed tentative promise (i.e., it enhanced classification compared to the use of the accuracy measure as the sole predictor of group membership). Overall, integration of an eye-tracker with the WMT was found to be feasible and the eye movement measures showed initial promise for the detection of feigned cognitive impairment. Moreover, eye movement measures proved useful in enhancing our understanding of strategies utilized by the simulators and the cognitive processes that affect their behavior. While the findings are clearly preliminary, we hope that they will encourage further research of these promising psychophysiological measures.
Collapse
Affiliation(s)
- Elbaum Tomer
- Department of Psychology, Ariel University, Ariel, Israel
| | - Tamar Lupu
- Department of Psychology, Ariel University, Ariel, Israel
| | - Lior Golan
- Department of Psychology, Ariel University, Ariel, Israel
| | - Michael Wagner
- Department of Psychology, Ariel University, Ariel, Israel
| | - Yoram Braw
- Department of Psychology, Ariel University, Ariel, Israel.,Emotion and Cognition Research Center, Shalvata Mental Health Center, Hod HaSharon, Israel
| |
Collapse
|
6
|
Failla MD, Juengst SB, Graham KM, Arenth PM, Wagner AK. Effects of Depression and Antidepressant Use on Cognitive Deficits and Functional Cognition Following Severe Traumatic Brain Injury. J Head Trauma Rehabil 2016; 31:E62-73. [PMID: 26828711 DOI: 10.1097/HTR.0000000000000214] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/12/2023]
Abstract
OBJECTIVE To use a Rehabilomics framework to evaluate relations hips between post-traumatic brain injury (TBI) depression (PTD) and potential associated factors, including antidepressant use, on cognitive recovery following severe TBI. PARTICIPANTS Severe TBI survivors (n = 154), recruited from a level 1 trauma center. DESIGN Prospective cohort study with assessments at 6 and 12 months postinjury. MAIN MEASURES Patient Health Questionnaire-9 (PTD symptoms); cognitive composite score from a neuropsychological assessment battery (cognitive impairment); and Functional Independence Measure-Cognition (FIM-Cog, self-reported functional cognition). RESULTS Individuals with and without PTD did not differ with respect to cognitive impairment. However, antidepressant use, regardless of PTD status, was associated with cognitive impairment. Individuals with PTD reported lower FIM-Cog scores at both time points compared with those without PTD. In a post hoc longitudinal analysis, individuals with late-onset PTD had worse cognitive impairment. CONCLUSION These results suggest that antidepressant use impairs cognition among individuals without PTD. Also, PTD did not directly affect cognitive impairment but may affect functional cognitive limitations through self-evaluation and apathy/motivation factors.
Collapse
|
7
|
Lupu T, Elbaum T, Wagner M, Braw Y. Enhanced detection of feigned cognitive impairment using per item response time measurements in the Word Memory Test. Applied Neuropsychology: Adult 2017; 25:532-542. [DOI: 10.1080/23279095.2017.1341410] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Affiliation(s)
- T. Lupu
- Department of Psychology, Ariel University, Ariel, Israel
| | - T. Elbaum
- Department of Psychology, Ariel University, Ariel, Israel
| | - M. Wagner
- Department of Psychology, Ariel University, Ariel, Israel
| | - Y. Braw
- Department of Psychology, Ariel University, Ariel, Israel
| |
Collapse
|
8
|
Liu Z, Dong J, Zhao X, Chen X, Lippa SM, Caroselli JS, Fang X. Assessment of feigned cognitive impairment in severe traumatic brain injury patients with the Forced-choice Graphics Memory Test. Brain Behav 2016; 6:e00593. [PMID: 28032009 PMCID: PMC5166992 DOI: 10.1002/brb3.593] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/01/2016] [Revised: 08/07/2016] [Accepted: 09/04/2016] [Indexed: 11/24/2022] Open
Abstract
INTRODUCTION The Forced-choice Graphics Memory Test (FGMT) is a newly developed measure to assess feigned cognitive impairment. This study investigated the ability and reliability of FGMT for identification of malingering in patients with traumatic brain injury (TBI). METHODS The FGMT was administered to 40 healthy volunteers instructed to respond validly (Healthy Control, H-C), 40 healthy volunteers instructed to feign cognitive impairment (Healthy Malingering, H-M), 40 severe TBI patients who responded validly (TBI control, TBI-C), and 30 severe TBI patients who evidenced invalid performance (TBI malingering, TBI-M). RESULTS Both malingering groups (H-M and TBI-M) performed much more poorly than the nonmalingering groups (H-C and TBI-C). The FGMT overall total score, score on easy items, and score on hard items differed significantly across the four groups. The total score showed the highest classification accuracy in differentiating malingering from nonmalingering. A cutoff of less than 18 (total items) successfully identified 95% of TBI-C and 93.3% of TBI-M participants. The FGMT also demonstrated high test-retest reliability and internal consistency. FGMT scores were not affected by TBI patients' education, gender, age, or intelligence. CONCLUSION Our results suggest that the FGMT can be used as a fast and reliable tool for identification of feigned cognitive impairment in patients with TBI.
Collapse
Affiliation(s)
- Zilong Liu
- Department of Forensic Medicine Tongji Medical College Huazhong University of Science and Technology Wuhan Hubei China
| | - Juan Dong
- Department of Forensic Medicine Tongji Medical College Huazhong University of Science and Technology Wuhan Hubei China
| | - Xiaohong Zhao
- Department of Forensic Medicine Tongji Medical College Huazhong University of Science and Technology Wuhan Hubei China
| | - Xiaorui Chen
- Department of Forensic Medicine Tongji Medical College Huazhong University of Science and Technology Wuhan Hubei China
| | - Sara M Lippa
- Defense and Veterans Brain Injury Center Walter Reed National Military Medical Center Bethesda MD USA
| | - Jerome S Caroselli
- Department of Psychology/Neuropsychology TIRR Memorial Hermann Hospital Houston TX USA
| | - Xiang Fang
- Department of Neurology University of Texas Medical Branch Galveston TX USA
| |
Collapse
|
9
|
Robertson K, Schmitter-Edgecombe M. Naturalistic tasks performed in realistic environments: a review with implications for neuropsychological assessment. Clin Neuropsychol 2016; 31:16-42. [DOI: 10.1080/13854046.2016.1208847] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
Affiliation(s)
- Kayela Robertson
- Department of Psychology, Washington State University, Pullman, WA, USA
| | | |
Collapse
|
10
|
Merten T, Dandachi-FitzGerald B, Hall V, Schmandd BA, Santamaríae P, González-Ordi H. Symptom validity assessment in European countries: Development and state of the art. Clínica y Salud 2013. [DOI: 10.1016/s1130-5274(13)70014-8] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|