Aiding diagnosis of childhood attention-deficit/hyperactivity disorder of the inattentive presentation: Discriminant function analysis of multi-domain measures including EEG

Remote neurocognitive interventions for attention-deficit/hyperactivity disorder - Opportunities and challenges

Improving neurocognitive functions through remote interventions has been a promising approach to developing new treatments for attention-deficit/hyperactivity disorder (AD/HD). Remote neurocognitive interventions may address the shortcomings of the current prevailing pharmacological therapies for AD/HD, e.g., side effects and access barriers. Here we review the current options for remote neurocognitive interventions to reduce AD/HD symptoms, including cognitive training, EEG neurofeedback training, transcranial electrical stimulation, and external cranial nerve stimulation. We begin with an overview of the neurocognitive deficits in AD/HD to identify the targets for developing interventions. The role of neuroplasticity in each intervention is then highlighted due to its essential role in facilitating neuropsychological adaptations. Following this, each intervention type is discussed in terms of the critical details of the intervention protocols, the role of neuroplasticity, and the available evidence. Finally, we offer suggestions for future directions in terms of optimizing the existing intervention protocols and developing novel protocols.

Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry

BACKGROUND

The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation.

METHODS

Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses.

RESULTS

A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β =  - 2.75, p < .001, R²_adj = 0.40; r =  - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF₁₀ > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance.

CONCLUSIONS

Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.

Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review

IMPORTANCE

Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated.

OBJECTIVE

To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis.

EVIDENCE REVIEW

PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality.

FINDINGS

A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%).

CONCLUSIONS AND RELEVANCE

This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.

Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review

In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.

Comparing the Efficacy of Two School-Based Approaches of Neurocognitive Training for Enhancing Executive Functions

Neurocognitive training has been shown to improve a range of cognitive/executive functions and behavior in children. Delivering this training in a school context may enhance its ecological validity and improve training outcomes. The current study examined the efficacy of two school-based neurocognitive training approaches for enhancing executive functions (EF) in typically developing children: neurocognitive training with no teacher positive feedback (NCT), and neurocognitive training with teacher positive feedback (NCT-TPF). Using a randomized control design, 45 children were randomly allocated to the no-training control, NCT, or NCT-TPF group and completed pre- and post-training assessments on the core executive function (EF) domains of inhibitory control, working memory, and task switching. Teachers' subjective acceptance of the two training protocols was investigated to explore potential ecological validity. The two training groups completed six sessions of training in a kindergarten over a 3-week period. The results showed significant post-training improvements in an untrained inhibitory control task for both training groups when compared with the control group. Different effects were found for each group for the untrained task switching task. While reduced reaction time (RT) in correct Color and Shape trials at Time 2 were reported for the NCT-TPF group, there was no difference compared to the control group for the NCT group. The NCT group showed increased RT in Switch trials but reduced Shape errors compared to controls at Time 2, while these effects were not significant for the NCT-TPF group. An unexpected outcome was that children in both training conditions did not show a significant improvement in an untrained working memory task. Teachers' subjective acceptance consistently supported including positive feedback as part of NCT. While further research is needed, these results support use of neurocognitive training and/or neurocognitive training with teacher positive feedback for typically developing children in a school context.

A Systematic Review on Feature Extraction in Electroencephalography-Based Diagnostics and Therapy in Attention Deficit Hyperactivity Disorder

A systematic review on electroencephalographic (EEG)-based feature extraction strategies to diagnosis and therapy of attention deficit hyperactivity disorder (ADHD) in children is presented. The analysis is realized at an executive function level to improve the research of neurocorrelates of heterogeneous disorders such as ADHD. The Quality Assessment Tool for Quantitative Studies (QATQS) and field-weighted citation impact metric (Scopus) were used to assess the methodological rigor of the studies and their impact on the scientific community, respectively. One hundred and one articles, concerning the diagnostics and therapy of ADHD children aged from 8 to 14, were collected. Event-related potential components were mainly exploited for executive functions related to the cluster inhibition, whereas band power spectral density is the most considered EEG feature for executive functions related to the cluster working memory. This review identifies the most used (also by rigorous and relevant articles) EEG signal processing strategies for executive function assessment in ADHD.