Neuropsychological Tests are Poor at Assessing the Frontal Lobes, Executive Functions, and Neurobehavioral Symptoms of Traumatically Brain-Injured Patients

The limitations and challenges in the assessment of executive dysfunction associated with real-world functioning: The opportunity of serious games

Nowadays, there is a broad range of methods for detecting and evaluating executive dysfunction ranging from clinical interview to neuropsychological evaluation. Nevertheless, a critical issue of these assessments is the lack of correspondence of the neuropsychological test's results with real-world functioning. This paper proposes serious games as a new framework to improve the neuropsychological assessment of real-world functioning. We briefly discuss the contribution and limitations of current methods of evaluation of executive dysfunction (paper-and-pencil tests, naturalistic observation methods, and Information and Communications Technologies) to inform on daily life functioning. Then, we analyze what are the limitations of these methods to predict real-world performance: (1) A lack of appropriate instruments to investigate the complexity of real-world functioning, (2) the vast majority of neuropsychological tests assess well-structured tasks, and (3) measurement of behaviors are based on simplistic data collection and statistical analysis. This work shows how serious games offer an opportunity to develop more efficient tools to detect executive dysfunction in everyday life contexts. Serious games provide meaningful narrative stories and virtual or real environments that immerse the user in natural and social environments with social interactions. In those highly interactive game environments, the player needs to adapt his/her behavioral performance to novel and ill-structured tasks which are suited for collecting user interaction evidence. Serious games offer a novel opportunity to develop better tools to improve diagnosis of the executive dysfunction in everyday life contexts. However, more research is still needed to implement serious games in everyday clinical practice.

Attaining the recesses of the cognitive space

Existing neuropsychological tests of executive function often manifest a difficulty pinpointing cognitive deficits when these are intermittent and come in the form of omissions. We discuss the hypothesis that two partially interrelated reasons for this failure stem from relative inability of neuropsychological tests to explore the cognitive space and to explicitly take into account strategic and opportunistic resource allocation decisions, and to address the temporal aspects of both behaviour and task-related brain function in data analysis. Criteria for tasks suitable for neuropsychological assessment of executive function, as well as appropriate ways to analyse and interpret observed behavioural data are suggested. It is proposed that experimental tasks should be devised which emphasize typical rather than optimal performance, and that analyses should quantify path-dependent fluctuations in performance levels rather than averaged behaviour. Some implications for experimental neuropsychology are illustrated for the case of planning and problem-solving abilities and with particular reference to cognitive impairment in closed-head injury.

Mental Fatigue after Mild Traumatic Brain Injury in Relation to Cognitive Tests and Brain Imaging Methods

Most people recover within months after a mild traumatic brain injury (TBI) or concussion, but some will suffer from long-term fatigue with a reduced quality of life and the inability to maintain their employment status or education. For many people, mental fatigue is one of the most distressing and long-lasting symptoms following an mTBI. No efficient treatment options can be offered. The best method for measuring fatigue today is with fatigue self-assessment scales, there being no objective clinical tests available for mental fatigue. The aim here is to provide a narrative review and identify fatigue in relation to cognitive tests and brain imaging methods. Suggestions for future research are presented.

Marrying Past and Present Neuropsychology: Is the Future of the Process-Based Approach Technology-Based?

A cognitive assessment strategy that is not limited to examining a set of summary test scores may be more helpful for early detection of emergent illness such as Alzheimer's disease (AD) and may permit a better understanding of cognitive functions and dysfunctions in those with AD and other dementia disorders. A revisit of the work already undertaken by Kaplan and colleagues using the Boston Process-Approach provides a solid basis for identifying new opportunities to capture data on neurocognitive processes, test-taking strategies and response styles. Thus, this critical review will combine traditional process-based assessment strategies with support provided or offered by newer technologies that have the potential to add value to data collection and interpretation. There is now considerable interest in neuropsychological test administration using computer/digital technology, both in research and in clinical settings. To add value, any computerized version of an existing cognitive test should respect the administration procedure for which normative data were obtained, should be time-saving in terms of scoring and interpretation, and should, we argue, facilitate gathering information about the processes and strategies followed in test completion. This article will offer an overview of the steps needed when implementing computerization of neuropsychological tests using a Process-Based Approach (PBA) to these technology-based adaptations and will discuss further developments in this area by linking it to future technological developments that may be possible in the area of neuropsychological assessment. Additionally, an overview of neuropsychological tests that may benefit from computerization will be presented, together with suggestions on the specific processes, strategies and features that may be captured with the aid of such computerization. Finally, hypotheses on how virtual reality could be an asset for the future of the PBA to neuropsychological assessment will also be discussed.

Usefulness of preschool and school versions of the Behavioral Rating Inventory of Executive Functions in the evaluation of the daily life executive function in myoclonic-atonic epilepsy

PURPOSE

Executive functions (EF) are high-order cognitive skills that have a major influence on quality of life, social skills, and school achievement. We aimed to screen EF daily life abilities in young patients with myoclonic-atonic epilepsy (MAE) using an ecological questionnaire and to correlate EF to epilepsy characteristics.

METHODS

Behavioral Rating Inventory of Executive Functions - Preschool (BRIEF-P) and BRIEF - for school-aged patients - parental questionnaires were proposed to patients with MAE and typically developing children (TDC) including Inhibit, Shift, Emotional control, Working memory (WM), Plan/Organize, Initiate, Organization of materials, and Monitor subscales. We included prospectively 12 patients with MAE and 44 TDC aged 3 to 5 years and seven patients with MAE and 21 TDC aged 6-7 years. We performed in addition for all patients an intellectual efficiency evaluation using WPPSI-IV (Wechsler intelligence scale for preschool children version IV) and collected demographics, age at onset of epilepsy, epilepsy duration, response to treatment, number and type of treatments including AEDs (antiepileptic drugs), and ketogenic diet.

RESULTS

Four out of 12 patients for BRIEF-P and 6/7 patients for BRIEF had pathological scores for at least one domain. Behavioral Rating Inventory of Executive Functions' questionnaires showed higher pathological scores for WM, Plan/Organize, Initiate, Monitor, and Metacognition Index in patients with MAE compared to TDC suggesting higher problems reported by parents. Working memory scores were higher in the group with MAE than TDC for both BRIEF-P and BRIEF. Response to treatment is a predictor of multiple BRIEF-P domains. Epilepsy duration predicts Shift and WM domains while age at onset predicts WM domain on BRIEF in this syndrome.

CONCLUSIONS

This study is the first to assess prospectively EF in young patients with MAE. We show everyday deficits in EF reported by parents. Metacognition and more specifically WM, appear to be a core deficit. Early evaluation of EF using both questionnaires and standardized tools is necessary for early detection of EF deficit and initiating tailored rehabilitation. Given the normal development before seizure onset and the absence of cerebral lesion in MAE, these results are in favor of the impact of epilepsy on EF.

Atypical event-related potentials revealed during the passive parts of a Go-NoGo task in autism spectrum disorder: a case-control study

Background

The core features of autism spectrum disorder (ASD) are easily recognizable in non-structured clinical and real-life situations. The features are often difficult to capture in structured laboratory settings, and the results from tests do not necessarily reflect symptom severity. We investigated neurophysiological processing in the passive parts of a cued Go-NoGo task, using the active parts of the test as a comparator.

Methods

Forty-nine adolescents diagnosed with ASD and 49 typically developing (TD) adolescents (age 12–21 years) were included. Daily life executive function was assessed with the Behavior Rating Inventory of Executive Function (BRIEF). We applied a visual cued Go-NoGo task and recorded event-related potentials (ERPs). We investigated occipital N1, a component related to early perception of visual stimuli, and P3a, a fronto-central component related to switching of attention, in the passive and active parts of the test.

Results

During the passive parts, the ASD group had statistically significantly longer N1 latency (p < 0.001, Cohens d = 0.75) and enhanced amplitude of P3a (p = 0.002, Cohens d = 0.64) compared to the TD, while no significant differences were observed in the active parts. Both components correlated significantly with the Behavioral Regulation Index of the BRIEF (partial correlation r = 0.35, p = 0.003).

Conclusion

Delayed N1 response, indicating altered visual perception, and enhanced P3a response, indicating increased neural activation related to attention allocation, were found during the passive parts of a Go-NoGo task in ASD participants. These abnormal ERP signals in the non-structured settings were associated with everyday executive function, suggesting that neurophysiolocal measures related to atypical control of alertness and “hyper-awareness” underlie daily life dysfunction in ASD. Assessments during passive settings have a potential to reveal core neurobiological substrates of ASD.

Electronic supplementary material

The online version of this article (10.1186/s13229-019-0259-3) contains supplementary material, which is available to authorized users.

Assessment of executive function using the Tinkertoy test

The Tinkertoy test (TTT) has often been used to assess executive function. Despite its clinical importance, there are few published normative data for it. Thus, the primary aim of this study was to fill this gap. Moreover, as there exists a sex difference in many cognitive abilities and neuropsychological tests, a secondary aim was to examine whether sex influences TTT performance. We administered the TTT to 25 healthy men and 25 healthy women whose average age was 28 years. Performances were scored based upon Lezak's (1982) original TTT criteria. On average, our participants used 43 pieces to complete their construction (SD=8), with a range of 21-50, and their complexity scores ranged from 7 to 12, with a mean score of 9.68 (SD=1.35). Overall performance did not differ based on sex; yet, when examining individual scoring criteria, we found that men scored significantly higher on the symmetry measure. Efforts towards the development of adequate normative data for the TTT and different tests of executive functioning are crucial to neuropsychologists' and other healthcare providers' ability to reliably diagnose and treat disorders of cognition that affect executive function. The present data go some way towards enhancing the utility of the TTT.

Heading and unintentional head impacts have opposing associations with Patient Reported Outcomes in amateur soccer players

The effects of soccer-related head impacts, beyond overt concussions, on Patient Reported Outcomes (PROs) have not been explored to date. Generalized estimating equations were employed to determine the association between soccer-related head impacts (headers in the prior 2 weeks, unintentional head impacts in the prior 2 weeks, headers in the prior 12 months and lifetime concussions) on PROs including depression, anxiety, sleep disturbance and sleep impairment. Compared to players with no unintentional head impacts in the prior 2 weeks, players with one unintentional exposure reported more symptoms of anxiety (p = 0.002) and players with 2+ exposures reported more symptoms of depression (p = 0.006) and anxiety (p < 0.001). In contrast, players in the 3rd Quartile of 12 mo. headers reported less anxiety (p = 0.001), sleep disturbance (p = 0.002) and sleep impairment (p < 0.001) compared to those in the 1st quartile. Unintentional head impacts are associated with worse PROs while more headers are paradoxically associated with better PROs.

Brazilian Portuguese version of the Patient Competency Rating Scale (PCRS-R-BR): semantic adaptation and validity

This study describes the adaptation of a revised Brazilian version of the Patient Competency Rating Scale (PCRS-R-BR), which focuses on executive, mnemonic, and attention functions. Evidence of content-based and external validity is also reported. The cross-cultural adaptation was conducted in five phases: 1) translations and back translations; 2) item analysis by authors; 3) classification by experts; 4) revisions and reformulations by authors; 5) pilot study with a sample of patients with mild and moderate/severe traumatic brain injury (TBI). Data were analyzed descriptively, and the PCRS-R-BR scores of groups with mild vs. moderate/severe TBI were compared using the Mann-Whitney test. Patients and their relatives were divided into groups and compared using repeated-measures analysis. The results of the PCRS-R-BR questionnaire for relatives and discrepancy scores of patients with moderate/severe TBI revealed significantly more impairment than that found in the group of patients with mild TBI. There were significant differences between item and total scores of both groups of patients and relatives. Results indicated a high level of item content agreement between experts. This study found initial evidence of PCRS-R-BR content-based and external validity when the questionnaire was applied to patients with mild and moderate/severe TBI and their relatives.

Ecological validity of pediatric neuropsychological measures: current state and future directions

Neuropsychologists are increasingly requested to identify specific deficits in cognitive abilities and determine the ways in which these deficits will affect a client's everyday functioning. The demand for prescriptive diagnostic endeavors that provide recommendations for rehabilitation has drawn attention to the necessity of considering the ecological validity of instruments. Most of the current knowledge regarding the ecological validity of neuropsychological measures is the result of studies examining adult and older adult populations. The relationship of test performance and everyday functioning in children has been less examined and is, therefore, less understood. The purpose of this article is to provide a brief history of ecological validity in neuropsychology, discuss why this is an important consideration when working with child populations, and provide suggestions for continued research in this field.