Characterizing cognitive control abilities in children with 16p11.2 deletion using adaptive 'video game' technology: a pilot study

Health supervision for children and adolescents with 16p11.2 deletion syndrome

Rare genetic conditions are challenging for the primary care provider to manage without proper guidelines. This clinical review is designed to assist the pediatrician, family physician, or internist in the primary care setting to manage the complexities of 16p11.2 deletion syndrome. A multidisciplinary medical home with the primary care provider leading the care and armed with up-to-date guidelines will prove most helpful to the rare genetic patient population. A special focus on technology to fill gaps in deficits, review of case studies on novel medical treatments, and involvement with the educational system for advocacy with an emphasis on celebrating diversity will serve the rare genetic syndrome population well.

Identifying Game-Based Digital Biomarkers of Cognitive Risk for Adolescent Substance Misuse: Protocol for a Proof-of-Concept Study

BACKGROUND

Adolescents at risk for substance misuse are rarely identified early due to existing barriers to screening that include the lack of time and privacy in clinic settings. Games can be used for screening and thus mitigate these barriers. Performance in a game is influenced by cognitive processes such as working memory and inhibitory control. Deficits in these cognitive processes can increase the risk of substance use. Further, substance misuse affects these cognitive processes and may influence game performance, captured by in-game metrics such as reaction time or time for task completion. Digital biomarkers are measures generated from digital tools that explain underlying health processes and can be used to predict, identify, and monitor health outcomes. As such, in-game performance metrics may represent digital biomarkers of cognitive processes that can offer an objective method for assessing underlying risk for substance misuse.

OBJECTIVE

This is a protocol for a proof-of-concept study to investigate the utility of in-game performance metrics as digital biomarkers of cognitive processes implicated in the development of substance misuse.

METHODS

This study has 2 aims. In aim 1, using previously collected data from 166 adolescents aged 11-14 years, we extracted in-game performance metrics from a video game and are using machine learning methods to determine whether these metrics predict substance misuse. The extraction of in-game performance metrics was guided by literature review of in-game performance metrics and gameplay guidebooks provided by the game developers. In aim 2, using data from a new sample of 30 adolescents playing the same video game, we will test if metrics identified in aim 1 correlate with cognitive processes. Our hypothesis is that in-game performance metrics that are predictive of substance misuse in aim 1 will correlate with poor cognitive function in our second sample.

RESULTS

This study was funded by National Institute on Drug Abuse through the Center for Technology and Behavioral Health Pilot Core in May 2022. To date, we have extracted 285 in-game performance metrics. We obtained institutional review board approval on October 11, 2022. Data collection for aim 2 is ongoing and projected to end in February 2024. Currently, we have enrolled 12 participants. Data analysis for aim 2 will begin once data collection is completed. The results from both aims will be reported in a subsequent publication, expected to be published in late 2024.

CONCLUSIONS

Screening adolescents for substance use is not consistently done due to barriers that include the lack of time. Using games that provide an objective measure to identify adolescents at risk for substance misuse can increase screening rates, early identification, and intervention. The results will inform the utility of in-game performance metrics as digital biomarkers for identifying adolescents at high risk for substance misuse.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/46990.

Better together: novel methods for measuring and modeling development of executive function diversity while accounting for unity

INTRODUCTION

Executive functions (EFs) are linked to positive outcomes across the lifespan. Yet, methodological challenges have prevented precise understanding of the developmental trajectory of their organization.

METHODS

We introduce novel methods to address challenges for both measuring and modeling EFs using an accelerated longitudinal design with a large, diverse sample of students in middle childhood (N = 1,286; ages 8 to 14). We used eight adaptive assessments hypothesized to measure three EFs, working memory, context monitoring, and interference resolution. We deployed adaptive assessments to equate EF challenge across ages and a data-driven, network analytic approach to reveal the evolving diversity of EFs while simultaneously accounting for their unity.

RESULTS AND DISCUSSION

Using this methodological paradigm shift brought new precision and clarity to the development of these EFs, showing these eight tasks are organized into three stable components by age 10, but refinement of composition of these components continues through at least age 14.

Enhancing attention in children using an integrated cognitive-physical videogame: A pilot study

Inattention can negatively impact several aspects of a child's life, including at home and school. Cognitive and physical interventions are two promising non-pharmaceutical approaches used to enhance attention abilities, with combined approaches often being marketed to teachers, therapists, and parents typically without research validation. Here, we assessed the feasibility of incorporating an integrated, cognitive-physical, closed-loop video game (body-brain trainer or 'BBT') as an after-school program, and also evaluated if there were attention benefits following its use. Twenty-two children (7-12 years of age) with a range of attention abilities were recruited to participate in this proof of concept, single-arm, longitudinal study (24 sessions over 8 weeks, ~30 min/day). We interrogated attention abilities through a parent survey of their child's behaviors, in addition to objective performance-based and neural measures of attention. Here we observed 95% compliance as well as, significant improvements on the parent-based reports of inattention and on cognitive tests and neural measures of attention that were comparable in scale to previous work. Exploratory measures of other cognitive control abilities and physical fitness also showed similar improvement, with exploratory evaluation of retained benefits on the primary attention-related outcomes being present 1-year later. Lastly, there was no correlation between the baseline parent-rated inattention score and the improvement on the primary task-based measures of attention, suggesting that intervention-based benefits were not solely attained by those who stood the most to gain. These pilot findings warrant future research to replicate and extend these findings.

Improved executive function in patients with systemic lupus erythematosus following interactive digital training

OBJECTIVE

This study aimed to evaluate the sensitivity of a digital platform to assess attentional and executive function in systemic lupus erythematosus (SLE) patients, and to evaluate the impact of an at-home interactive digital treatment to improve cognitive dysfunction in this clinical population.

BACKGROUND

Deficits in attention and executive function are common in patients with SLE. Despite these cognitive difficulties, there are limited brief assessment techniques and few treatment options to improve cognitive abilities in patients with SLE. Interactive digital treatment approaches (use of video game-based software) have been successful in identifying and improving cognition in other clinical populations.

METHODS

Sixty SLE patients completed baseline neuropsychological tests (of attention, psychomotor speed, and executive function), a tablet-based digital platform (EVO^TM Monitor), and biobehavioral measures. The patients were randomized into treatment SLE (n = 30) or no contact control SLE (n = 30) groups, and returned 4 weeks later for follow-up cognitive, EVO Monitor, and biobehavioral testing. The SLE treatment group was trained on a tablet-based digital treatment (AKL-T01) and was instructed to complete 5 sessions at least 5 days per week for 4-weeks for a total of approximately 25 min of gameplay per day.

RESULTS

Systemic lupus erythematosus patients demonstrated impairment in visuomotor and processing speed, visual attention, and cognitive flexibility/sequencing skills at baseline. The video game-like treatment group (AKL-T01) had significant improvement in visuomotor speed (Trail Making A) and cognitive flexibility/sequencing (Trail Making B) compared to the control group at 4-week follow-up. The treatment group also demonstrated significant improvement in EVO Monitor multitasking at follow-up (with no change in controls). At baseline, a multitasking metric from EVO Monitor was associated with performance on tasks of cognitive flexibility (Trail Making B) and psychomotor speed (WAIS-IV Coding).

CONCLUSIONS

These findings provide evidence that SLE patients who participated in a 4-week interactive digital video game-like activity had significant improvement in motor speed and executive functions, and would benefit from participation in digital interventions designed to target frontoparietal networks of the brain. Preliminary findings also suggest specific metrics from EVO Monitor may also be useful to detect cognitive impairment and cognitive changes in patients with SLE.

Assessing Cognitive Function in Multiple Sclerosis With Digital Tools: Observational Study

Background

Cognitive impairment (CI) is one of the most prevalent symptoms of multiple sclerosis (MS). However, it is difficult to include cognitive assessment as part of MS standard care since the comprehensive neuropsychological examinations are usually time-consuming and extensive.

Objective

To improve access to CI assessment, we evaluated the feasibility and potential assessment sensitivity of a tablet-based cognitive battery in patients with MS.

Methods

In total, 53 participants with MS (24 [45%] with CI and 29 [55%] without CI) and 24 non-MS participants were assessed with a tablet-based cognitive battery (Adaptive Cognitive Evaluation [ACE]) and standard cognitive measures, including the Symbol Digit Modalities Test (SDMT) and the Paced Auditory Serial Addition Test (PASAT). Associations between performance in ACE and the SDMT/PASAT were explored, with group comparisons to evaluate whether ACE modules can capture group-level differences.

Results

Correlations between performance in ACE and the SDMT (R=–0.57, P<.001), as well as PASAT (R=–0.39, P=.01), were observed. Compared to non-MS and non-CI MS groups, the CI MS group showed a slower reaction time (CI MS vs non-MS: P<.001; CI MS vs non-CI MS: P=.004) and a higher attention cost (CI MS vs non-MS: P=.02; CI MS vs non-CI MS: P<.001).

Conclusions

These results provide preliminary evidence that ACE, a tablet-based cognitive assessment battery, provides modules that could potentially serve as a digital cognitive assessment for people with MS.

Trial Registration

ClinicalTrials.gov NCT03569618; https://clinicaltrials.gov/ct2/show/NCT03569618

A Virtual Reality Game (The Secret Trail of Moon) for Treating Attention-Deficit/Hyperactivity Disorder: Development and Usability Study

Background

Attention-deficit/hyperactivity disorder (ADHD) affects between 4% and 8% of children worldwide. The treatment of choice is multimodal treatment. Multimodal interventions for ADHD may be improved by incorporating new treatments, such as treatment via serious video games. The Secret Trail of Moon (TSTM) is a virtual reality serious video game that was designed for cognitive training related to core ADHD symptoms and executive dysfunction.

Objective

We aimed to describe the development and usability of TSTM.

Methods

The usability study included 37 children and adolescents who tested TSTM during the early usability stage (preinclusion) of a randomized controlled clinical trial for testing the effectiveness of TSTM. Chi-square tests were performed to compare patients with ADHD (ADHD combined subtype vs inattentive subtype) and to compare frequent and infrequent video game players in the second study. We used SPSS version 20 for Macintosh (IBM Corporation).

Results

A total of 31/37 (86%) and 30/37 (83%) of participants liked playing TSTM and wanted to continue playing TSTM, respectively. Further, 5/37 (14%) of participants reported that they experienced either perceived dizziness or virtual reality motion sickness. We found no statistically significant differences after comparing the ADHD combined subtype to the inattentive subtype and frequent video game players to infrequent video game players.

Conclusions

Serious video games, such as TSTM, may complement the current multimodal approach for treating ADHD.

Trial Registration

ClinicalTrials.gov NCT04355065; https://clinicaltrials.gov/ct2/show/NCT04355065

The Making and Evaluation of Digital Games Used for the Assessment of Attention: Systematic Review

Background

Serious games are now widely used in many contexts, including psychological research and clinical use. One area of growing interest is that of cognitive assessment, which seeks to measure different cognitive functions such as memory, attention, and perception. Measuring these functions at both the population and individual levels can inform research and indicate health issues. Attention is an important function to assess, as an accurate measure of attention can help diagnose many common disorders, such as attention-deficit/hyperactivity disorder and dementia. However, using games to assess attention poses unique problems, as games inherently manipulate attention through elements such as sound effects, graphics, and rewards, and research on adding game elements to assessments (ie, gamification) has shown mixed results. The process for developing cognitive tasks is robust, with high psychometric standards that must be met before these tasks are used for assessment. Although games offer more diverse approaches for assessment, there is no standard for how they should be developed or evaluated.

Objective

To better understand the field and provide guidance to interdisciplinary researchers, we aim to answer the question: How are digital games used for the cognitive assessment of attention made and measured?

Methods

We searched several databases for papers that described a digital game used to assess attention that could be deployed remotely without specialized hardware. We used Rayyan, a systematic review software, to screen the records before conducting a systematic review.

Results

The initial database search returned 49,365 papers. Our screening process resulted in a total of 74 papers that used a digital game to measure cognitive functions related to attention. Across the studies in our review, we found three approaches to making assessment games: gamifying cognitive tasks, creating custom games based on theories of cognition, and exploring potential assessment properties of commercial games. With regard to measuring the assessment properties of these games (eg, how accurately they assess attention), we found three approaches: comparison to a traditional cognitive task, comparison to a clinical diagnosis, and comparison to knowledge of cognition; however, most studies in our review did not evaluate the game’s properties (eg, if participants enjoyed the game).

Conclusions

Our review provides an overview of how games used for the assessment of attention are developed and evaluated. We further identified three barriers to advancing the field: reliance on assumptions, lack of evaluation, and lack of integration and standardization. We then recommend the best practices to address these barriers. Our review can act as a resource to help guide the field toward more standardized approaches and rigorous evaluation required for the widespread adoption of assessment games.

Application of an Adaptive, Digital, Game-Based Approach for Cognitive Assessment in Multiple Sclerosis: Observational Study

Background

Cognitive impairment is one of the most debilitating manifestations of multiple sclerosis. Currently, the assessment of cognition relies on a time-consuming and extensive neuropsychological examination, which is only available in some centers.

Objective

To enable simpler, more accessible cognitive screening, we sought to determine the feasibility and potential assessment sensitivity of an unsupervised, adaptive, video game–based digital therapeutic to assess cognition in multiple sclerosis.

Methods

A total of 100 people with multiple sclerosis (33 with cognitive impairment and 67 without cognitive impairment) and 24 adults without multiple sclerosis were tested with the tablet game (EVO Monitor) and standard measures, including the Brief International Cognitive Assessment for Multiple Sclerosis (which included the Symbol Digit Modalities Test [SDMT]) and Multiple Sclerosis Functional Composite 4 (which included the Timed 25-Foot Walk test). Patients with multiple sclerosis also underwent neurological evaluations and contributed recent structural magnetic resonance imaging scans. Group differences in EVO Monitor performance and the association between EVO Monitor performance and standard measures were investigated.

Results

Participants with multiple sclerosis and cognitive impairment showed worse performance in EVO Monitor compared with participants without multiple sclerosis (P=.01) and participants with multiple sclerosis without cognitive impairment (all P<.002). Regression analyses indicated that participants with a lower SDMT score showed lower performance in EVO Monitor (r=0.52, P<.001). Further exploratory analyses revealed associations between performance in EVO Monitor and walking speed (r=–0.45, P<.001) as well as brain volumetric data (left thalamic volume: r=0.47, P<.001; right thalamic volume: r=0.39, P=.002; left rostral middle frontal volume: r=0.28, P=.03; right rostral middle frontal volume: r=0.27, P=.03).

Conclusions

These findings suggest that EVO Monitor, an unsupervised, video game–based digital program integrated with adaptive mechanics, is a clinically valuable approach to measuring cognitive performance in patients with multiple sclerosis.

Trial Registration

ClinicalTrials.gov NCT03569618; https://clinicaltrials.gov/ct2/show/NCT03569618

Enhanced Attention Using Head-mounted Virtual Reality

Some evidence suggests that experiencing a given scenario using virtual reality (VR) may engage greater attentional resources than experiencing the same scenario on a 2D computer monitor. However, the underlying neural processes associated with these VR-related effects, especially those pertaining to current consumer-friendly head-mounted displays of virtual reality (HMD-VR), remain unclear. Here, two experiments were conducted to compare task performance and EEG-based neural metrics captured during a perceptual discrimination task presented on two different viewing platforms. Forty participants (20–25 years old) completed this task using both an HMD-VR and traditional computer monitor in a within-group, randomized design. Although Experiment I (n = 20) was solely behavioral in design, Experiment II (n = 20) utilized combined EEG recordings to interrogate the neural correlates underlying potential performance differences across platforms. These experiments revealed that (1) there was no significant difference in the amount of arousal measured between platforms and (2) selective attention abilities in HMD-VR environment were enhanced from both a behavioral and neural perspective. These findings suggest that the allocation of attentional resources in HMD-VR may be superior to approaches more typically used to assess these abilities (e.g., desktop/laptop/tablet computers with 2D screens).

Closed-Loop Attention Restoration Theory for Virtual Reality-Based Attentional Engagement Enhancement

Today, as media and technology multitasking becomes pervasive, the majority of young people face a challenge regarding their attentional engagement (that is, how well their attention can be maintained). While various approaches to improve attentional engagement exist, it is difficult to produce an effect in younger people, due to the inadequate attraction of these approaches themselves. Here, we show that a single 30-min engagement with an attention restoration theory (ART)-inspired closed-loop software program (Virtual ART) delivered on a consumer-friendly virtual reality head-mounted display (VR-HMD) could lead to improvements in both general attention level and the depth of engagement in young university students. These improvements were associated with positive changes in both behavioral (response time and response time variability) and key electroencephalography (EEG)-based neural metrics (frontal midline theta inter-trial coherence and parietal event-related potential P3b). All the results were based on the comparison of the standard Virtual ART tasks (control group, n = 15) and closed-loop Virtual ART tasks (treatment group, n = 15). This study provides the first case of EEG evidence of a VR-HMD-based closed-loop ART intervention generating enhanced attentional engagement.

A Game-Based Repeated Assessment for Cognitive Monitoring: Initial Usability and Adherence Study in a Summer Camp Setting

The current feasibility study examined the adherence, reliability, and assessment potential of an evidence-based game-like mobile Monitoring Tool (Akili Interactive Labs), to monitor 100 participants' cognition for eight sessions at a summer camp for children with special needs. A validated measure of attention was administered at baseline. In the last session, participants completed an exit questionnaire. The Monitoring Tool was found to be enjoyable, and showed a high rate of adherence. No Monitor-related adverse events were reported. Monitor metrics showed good reliability across repeated measurements, indicating it is stable over long-term cognitive monitoring. There was evidence that the Monitoring Tool was able to detect differences in cognition between the children diagnosed with attention deficit hyperactivity disorder and autism spectrum disorders.

Clinical Application of Chromosome Microarray Analysis in Han Chinese Children with Neurodevelopmental Disorders

Chromosome microarray analysis (CMA) is a cost-effective molecular cytogenetic technique that has been used as a first-line diagnostic test in neurodevelopmental disorders in the USA since 2011. The impact of CMA results on clinical practice in China is not yet well studied, so we aimed to better evaluate this phenomenon. We analyzed the CMA results from 434 patients in our clinic, and characterized their molecular diagnoses, clinical features, and follow-up clinical actions based on these results. The overall diagnostic yield for our patients was 13.6% (59 out of 434). This gave a detection rate of 14.7% for developmental delay/intellectual disability (DD/ID, 38/259) and 12% for autism spectrum disorders (ASDs, 21/175). Thirty-three recurrent (n ≥ 2) variants were found, distributed at six chromosomal loci involving known chromosome syndromes (such as DiGeorge, Williams Beuren, and Angelman/Prader-Willi syndromes). The spectrum of positive copy number variants in our study was comparable to that reported in Caucasian populations, but with specific characteristics. Parental origin tests indicated an effect involving a significant maternal transmission bias to sons. The majority of patients with positive results (94.9%) had benefits, allowing earlier diagnosis (36/59), prioritized full clinical management (28/59), medication changes (7/59), a changed prognosis (30/59), and prenatal genetic counseling (15/59). Our results provide information on de novo mutations in Chinese children with DD/ID and/or ASDs. Our data showed that microarray testing provides immediate clinical utility for patients. It is expected that the personalized medical care of children with developmental disabilities will lead to improved outcomes in long-term developmental potential. We advocate using the diagnostic yield of clinically actionable results to evaluate CMA as it provides information of both clinical validity and clinical utility.

A novel approach to training attention and gaze in ASD: A feasibility and efficacy pilot study

In addition to the social, communicative and behavioral symptoms that define the disorder, individuals with ASD have difficulty re-orienting attention quickly and accurately. Similarly, fast re-orienting saccadic eye movements are also inaccurate and more variable in both endpoint and timing. Atypical gaze and attention are among the earliest symptoms observed in ASD. Disruption of these foundation skills critically affects the development of higher level cognitive and social behavior. We propose that interventions aimed at these early deficits that support social and cognitive skills will be broadly effective. We conducted a pilot clinical trial designed to demonstrate the feasibility and preliminary efficacy of using gaze-contingent video games for low-cost in-home training of attention and eye movement. Eight adolescents with ASD participated in an 8-week training, with pre-, mid- and post-testing of eye movement and attention control. Six of the eight adolescents completed the 8 weeks of training and all six showed improvement in attention (orienting, disengagement) and eye movement control or both. All game systems remained intact for the duration of training and all participants could use the system independently. We delivered a robust, low-cost, gaze-contingent game system for home use that, in our pilot training sample, improved the attention orienting and eye movement performance of adolescent participants in 8 weeks of training. We are currently conducting a clinical trial to replicate these results and to examine what, if any, aspects of training transfer to more real-world tasks. © 2017 Wiley Periodicals, Inc. Develop Neurobiol 78: 546-554, 2018.