Quantifying patterns of brain activity: Distinguishing unaffected siblings from participants with ADHD and healthy individuals

Structural or/and functional MRI-based machine learning techniques for attention-deficit/hyperactivity disorder diagnosis: A systematic review and meta-analysis

BACKGROUND

The aim of this study was to investigate the diagnostic value of ML techniques based on sMRI or/and fMRI for ADHD.

METHODS

We conducted a comprehensive search (from database creation date to March 2024) for relevant English articles on sMRI or/and fMRI-based ML techniques for diagnosing ADHD. The pooled sensitivity, specificity, positive likelihood ratio (LR+), negative likelihood ratio (LR-), summary receiver operating characteristic (SROC) curve and area under the curve (AUC) were calculated to assess the diagnostic value of sMRI or/and fMRI-based ML techniques. The I2 test was used to assess heterogeneity and the source of heterogeneity was investigated by performing a meta-regression analysis. Publication bias was assessed using the Deeks funnel plot asymmetry test.

RESULTS

Forty-three studies were included in the systematic review, 27 of which were included in our meta-analysis. The pooled sensitivity and specificity of sMRI or/and fMRI-based ML techniques for the diagnosis of ADHD were 0.74 (95 % CI 0.65-0.81) and 0.75 (95 % CI 0.67-0.81), respectively. SROC curve showed that AUC was 0.81 (95 % CI 0.77-0.84). Based on these findings, the sMRI or/and fMRI-based ML techniques have relatively good diagnostic value for ADHD.

LIMITATIONS

Our meta-analysis specifically focused on ML techniques based on sMRI or/and fMRI studies. Since EEG-based ML techniques are also used for diagnosing ADHD, further systematic analyses are necessary to explore ML methods based on multimodal medical data.

CONCLUSION

sMRI or/and fMRI-based ML technique is a promising objective diagnostic method for ADHD.

Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry

BACKGROUND

The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation.

METHODS

Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses.

RESULTS

A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β =  - 2.75, p < .001, R²_adj = 0.40; r =  - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF₁₀ > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance.

CONCLUSIONS

Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.

Machine learning in attention-deficit/hyperactivity disorder: new approaches toward understanding the neural mechanisms

Attention-deficit/hyperactivity disorder (ADHD) is a highly prevalent and heterogeneous neurodevelopmental disorder in children and has a high chance of persisting in adulthood. The development of individualized, efficient, and reliable treatment strategies is limited by the lack of understanding of the underlying neural mechanisms. Diverging and inconsistent findings from existing studies suggest that ADHD may be simultaneously associated with multivariate factors across cognitive, genetic, and biological domains. Machine learning algorithms are more capable of detecting complex interactions between multiple variables than conventional statistical methods. Here we present a narrative review of the existing machine learning studies that have contributed to understanding mechanisms underlying ADHD with a focus on behavioral and neurocognitive problems, neurobiological measures including genetic data, structural magnetic resonance imaging (MRI), task-based and resting-state functional MRI (fMRI), electroencephalogram, and functional near-infrared spectroscopy, and prevention and treatment strategies. Implications of machine learning models in ADHD research are discussed. Although increasing evidence suggests that machine learning has potential in studying ADHD, extra precautions are still required when designing machine learning strategies considering the limitations of interpretability and generalization.

Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review

IMPORTANCE

Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated.

OBJECTIVE

To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis.

EVIDENCE REVIEW

PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality.

FINDINGS

A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%).

CONCLUSIONS AND RELEVANCE

This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.

Mid-Luteal Olfactory Abilities Reveal Healthy Women’s Emotional and Cognitive Functions

Ovarian hormones modulate women’s physical and psychological states periodically. Although the olfactory function is increasingly recognized as a reflection of physical and mental health conditions in the clinic, the role of olfaction in emotional and cognitive functions for healthy individuals has yet to be elucidated, especially when taking the menstrual cycle into account. We carried out a comprehensive investigation to explore whether the menstrual cycle could modulate women’s olfactory function and whether healthy women’s emotional symptoms and behavioral impulsivity could be characterized by their olfactory abilities at a specific menstrual cycle stage. Twenty-nine healthy young women were evaluated repeatedly using a standard olfactory test battery during the late follicular and mid-luteal phases. Their emotional symptoms and behavioral impulsivity were separately quantified via psychometric scales and a stop-signal task. We observed enhanced olfactory discrimination performance during the mid-luteal phase than the late follicular phase. We also found that women’s better olfactory discrimination and worse olfactory threshold in the mid-luteal phase predicted fewer individual emotional symptoms and lower behavioral impulsivity, respectively. These relationships were nonetheless absent in the late follicular phase. Our data extend previous clinical observations of the coexistence of olfactory deficits and neuropsychiatric disorders, providing new insights into the significance of olfaction and ovarian hormones for emotional and cognitive functions.

Cortical Morphometric Abnormality and Its Association with Working Memory in Children with Attention-Deficit/Hyperactivity Disorder

OBJECTIVE

Attention-deficit/hyperactivity disorder (ADHD) is a common neurodevelopmental disorder in children and adolescents. The present study investigated the cortical morphology features and their relationship with working memory (WM).

METHODS

In the present study, a total of 36 medication naïve children with ADHD (aged from 8 to 15 years) and 36 age- and gendermatched healthy control (HC) children were included. The digit span test was used to evaluate WM. The magnetic resonance imaging (MRI) was used to examine the characteristics of cortical morphology. Firstly, we compared the cortical morphology features between two groups to identify the potential structural alterations of cortical volume, surface, thickness, and curvature in children with ADHD. Then, the correlation between the brain structural abnormalities and WM was further explored in children with ADHD.

RESULTS

Compared with the HC children, the children with ADHD showed reduced cortical volumes in the left lateral superior temporal gyrus (STG) (p=6.67×10-6) and left anterior cingulate cortex (ACC) (p=3.88×10-4). In addition, the cortical volume of left lateral STG was positively correlated with WM (r=0.36, p=0.029).

CONCLUSION

Though preliminary, these findings suggest that the reduced cortical volumes of left lateral STG may contribute to the pathogenesis of ADHD and correlate with WM in children with ADHD.

Discrepancies of polygenic effects on symptom dimensions between adolescents and adults with ADHD

A significant proportion of individuals with attention-deficit/hyperactivity disorder (ADHD) show persistence into adulthood. The genetic and neural correlates of ADHD in adolescents versus adults remain poorly characterized. We investigated ADHD polygenic risk score (PRS) in relation to previously identified gray matter (GM) patterns, neurocognitive, and symptom findings in the same ADHD sample (462 adolescents & 422 adults from the NeuroIMAGE and IMpACT cohorts). Significant effects of ADHD PRS were found on hyperactivity and impulsivity symptoms in adolescents, hyperactivity symptom in adults, but not GM volume components. A distinct PRS effect between adolescents and adults on individual ADHD symptoms is suggested.

Task-generic and task-specific connectivity modulations in the ADHD brain: an integrated analysis across multiple tasks

Attention-deficit/hyperactivity disorder (ADHD) is associated with altered functioning in multiple cognitive domains and neural networks. This paper offers an overarching biological perspective across these. We applied a novel strategy that extracts functional connectivity modulations in the brain across one (P_single), two (P_mix) or three (P_all) cognitive tasks and compared the pattern of modulations between participants with ADHD (n-89), unaffected siblings (n = 93) and controls (n = 84; total N = 266; age range = 8-27 years). Participants with ADHD had significantly fewer P_all connections (modulated regardless of task), but significantly more task-specific (P_single) connectivity modulations than the other groups. The amplitude of these P_single modulations was significantly higher in ADHD. Unaffected siblings showed a similar degree of P_all connectivity modulation as controls but a similar degree of P_single connectivity modulation as ADHD probands. P_all connections were strongly reproducible at the individual level in controls, but showed marked heterogeneity in both participants with ADHD and unaffected siblings. The pattern of reduced task-generic and increased task-specific connectivity modulations in ADHD may be interpreted as reflecting a less efficient functional brain architecture due to a reduction in the ability to generalise processing pathways across multiple cognitive domains. The higher amplitude of unique task-specific connectivity modulations in ADHD may index a more "effortful" coping strategy. Unaffected siblings displayed a task connectivity profile in between that of controls and ADHD probands, supporting an endophenotype view. Our approach provides a new perspective on the core neural underpinnings of ADHD.

Towards a brain-based predictome of mental illness

Neuroimaging-based approaches have been extensively applied to study mental illness in recent years and have deepened our understanding of both cognitively healthy and disordered brain structure and function. Recent advancements in machine learning techniques have shown promising outcomes for individualized prediction and characterization of patients with psychiatric disorders. Studies have utilized features from a variety of neuroimaging modalities, including structural, functional, and diffusion magnetic resonance imaging data, as well as jointly estimated features from multiple modalities, to assess patients with heterogeneous mental disorders, such as schizophrenia and autism. We use the term "predictome" to describe the use of multivariate brain network features from one or more neuroimaging modalities to predict mental illness. In the predictome, multiple brain network-based features (either from the same modality or multiple modalities) are incorporated into a predictive model to jointly estimate features that are unique to a disorder and predict subjects accordingly. To date, more than 650 studies have been published on subject-level prediction focusing on psychiatric disorders. We have surveyed about 250 studies including schizophrenia, major depression, bipolar disorder, autism spectrum disorder, attention-deficit hyperactivity disorder, obsessive-compulsive disorder, social anxiety disorder, posttraumatic stress disorder, and substance dependence. In this review, we present a comprehensive review of recent neuroimaging-based predictomic approaches, current trends, and common shortcomings and share our vision for future directions.

Structural brain alterations and their association with cognitive function and symptoms in Attention-deficit/Hyperactivity Disorder families

Gray matter disruptions have been found consistently in Attention-deficit/Hyperactivity Disorder (ADHD). The organization of these alterations into brain structural networks remains largely unexplored. We investigated 508 participants (281 males) with ADHD (N = 210), their unaffected siblings (N = 108), individuals with subthreshold ADHD (N = 49), and unrelated healthy controls (N = 141) with an age range from 7 to 18 years old from 336 families in the Dutch NeuroIMAGE project. Source based morphometry was used to examine structural brain network alterations and their association with symptoms and cognitive performance. Two networks showed significant reductions in individuals with ADHD compared to unrelated healthy controls after False Discovery Rate correction. Component A, mainly located in bilateral Crus I, showed a ADHD/typically developing difference with subthreshold cases being intermediate between ADHD and typically developing controls. The unaffected siblings were similar to controls. After correcting for IQ and medication status, component A showed a negative correlation with inattention symptoms across the entire sample. Component B included a maximum cluster in the bilateral insula, where unaffected siblings, similar to individuals with ADHD, showed significantly reduced loadings compared to controls; but no relationship with individual symptoms or cognitive measures was found for component B. This multivariate approach suggests that areas reflecting genetic liability within ADHD are partly separate from those areas modulating symptom severity.

Individual differences v. the average patient: mapping the heterogeneity in ADHD using normative models

BACKGROUND

The present paper presents a fundamentally novel approach to model individual differences of persons with the same biologically heterogeneous mental disorder. Unlike prevalent case-control analyses, that assume a clear distinction between patient and control groups and thereby introducing the concept of an 'average patient', we describe each patient's biology individually, gaining insights into the different facets that characterize persistent attention-deficit/hyperactivity disorder (ADHD).

METHODS

Using a normative modeling approach, we mapped inter-individual differences in reference to normative structural brain changes across the lifespan to examine the degree to which case-control analyses disguise differences between individuals.

RESULTS

At the level of the individual, deviations from the normative model were frequent in persistent ADHD. However, the overlap of more than 2% between participants with ADHD was only observed in few brain loci. On average, participants with ADHD showed significantly reduced gray matter in the cerebellum and hippocampus compared to healthy individuals. While the case-control differences were in line with the literature on ADHD, individuals with ADHD only marginally reflected these group differences.

CONCLUSIONS

Case-control comparisons, disguise inter-individual differences in brain biology in individuals with persistent ADHD. The present results show that the 'average ADHD patient' has limited informative value, providing the first evidence for the necessity to explore different biological facets of ADHD at the level of the individual and practical means to achieve this end.

Perceptual timing in children with attention-deficit/hyperactivity disorder (ADHD) as measured by computer-based experiments versus real-life tasks: protocol for a cross-sectional experimental study in an ambulatory setting

INTRODUCTION

The goal of this study is to get a better understanding of the fundamentals of perceptual timing deficits, that is, difficulties with estimating durations of explicitly attended temporal intervals, in children with attention-deficit/hyperactivity disorder (ADHD). Whereas these deficits were repeatedly demonstrated in laboratory studies using computer-based timing tasks, we will additionally implement a more practical task reflecting real-life activity. In doing so, the research questions of the planned study follow a hierarchically structured path 'from lab to life': Are the timing abilities of children with ADHD really disturbed both in the range of milliseconds and in the range of seconds? What causes these deficits? Do children with ADHD rather display a global perceptual timing deficit, or do different 'timing types' exist? Are timing deficits present during real-life activities as well, and are they based on the same mechanisms as in computerised tasks?

METHODS AND ANALYSES

A quasi-experimental study with two groups of male children aged 8-12 years (ADHD; controls) and with a cross-sectional design will be used to address our research questions. Statistical analyses of the dependent variables will comprise (repeated) measures analyses of variance, stepwise multiple regression analyses and latent class models. With an estimated dropout rate of 25%, power analysis indicated a sample size of 140 subjects (70 ADHD, 70 controls) to detect medium effect sizes.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the ethics committee of the Faculty of Medicine, University of Rostock. Results will be disseminated to researcher, clinician and patient communities in peer-reviewed journals and at scientific conferences, at a meeting of the local ADHD competence network and on our web page which will summarise the study results in an easily comprehensible manner.

TRIAL REGISTRATION NUMBER

DRKS00015760.

Classification Accuracy of Neuroimaging Biomarkers in Attention-Deficit/Hyperactivity Disorder: Effects of Sample Size and Circular Analysis

BACKGROUND

Motivated by an inconsistency between reports of high diagnosis-classification accuracies and known heterogeneity in attention-deficit/hyperactivity disorder (ADHD), this study assessed classification accuracy in studies of ADHD as a function of methodological factors that can bias results. We hypothesized that high classification results in ADHD diagnosis are inflated by methodological factors.

METHODS

We reviewed 69 studies (of 95 studies identified) that used neuroimaging features to predict ADHD diagnosis. Based on reported methods, we assessed the prevalence of circular analysis, which inflates classification accuracy, and evaluated the relationship between sample size and accuracy to test if small-sample models tend to report higher classification accuracy, also an indicator of bias.

RESULTS

Circular analysis was detected in 15.9% of ADHD classification studies, lack of independent test set was noted in 13%, and insufficient methodological detail to establish its presence was noted in another 11.6%. Accuracy of classification ranged from 60% to 80% in the 59.4% of reviewed studies that met criteria for independence of feature selection, model construction, and test datasets. Moreover, there was a negative relationship between accuracy and sample size, implying additional bias contributing to reported accuracies at lower sample sizes.

CONCLUSIONS

High classification accuracies in neuroimaging studies of ADHD appear to be inflated by circular analysis and small sample size. Accuracies on independent datasets were consistent with known heterogeneity of the disorder. Steps to resolve these issues, and a shift toward accounting for sample heterogeneity and prediction of future outcomes, will be crucial in future classification studies in ADHD.

Decreased olfactory discrimination is associated with impulsivity in healthy volunteers

In clinical populations, olfactory abilities parallel executive function, implicating shared neuroanatomical substrates within the ventral prefrontal cortex. In healthy individuals, the relationship between olfaction and personality traits or certain cognitive and behavioural characteristics remains unexplored. We therefore tested if olfactory function is associated with trait and behavioural impulsivity in nonclinical individuals. Eighty-three healthy volunteers (50 females) underwent quantitative assessment of olfactory function (odour detection threshold, discrimination, and identification). Each participant was rated for trait impulsivity index using the Barratt Impulsiveness Scale and performed a battery of tasks to assess behavioural impulsivity (Stop Signal Task, SST; Information Sampling Task, IST; Delay Discounting). Lower odour discrimination predicted high ratings in non-planning impulsivity (Barratt Non-Planning impulsivity subscale); both, lower odour discrimination and detection threshold predicted low inhibitory control (SST; increased motor impulsivity). These findings extend clinical observations to support the hypothesis that deficits in olfactory ability are linked to impulsive tendencies within the healthy population. In particular, the relationship between olfactory abilities and behavioural inhibitory control (in the SST) reinforces evidence for functional overlap between neural networks involved in both processes. These findings may usefully inform the stratification of people at risk of impulse-control-related problems and support planning early clinical interventions.

Refinement by integration: aggregated effects of multimodal imaging markers on adult ADHD

BACKGROUND

Attention-deficit/hyperactivity disorder (ADHD) is biologically heterogeneous, with different biological predispositions - mediated through developmental processes - converging upon a common clinical phenotype. Brain imaging studies have variably shown altered brain structure, activity and connectivity in children and adults with ADHD. Recent methodological developments allow for the integration of information across imaging modalities, potentially yielding a more coherent view regarding the biology underlying the disorder.

METHODS

We analyzed a sample of adults with persistent ADHD and healthy controls using an advanced multimodal linked independent component analysis approach. Diffusion and structural MRI data were fused to form imaging markers reflecting independent components that explain variation across modalities. We included these markers as predictors into logistic regression models on adult ADHD and put those into context with predictions of estimated intelligence, age and sex.

RESULTS

We included 87 adults with ADHD and 93 controls in our analysis. Participants' courses associated with all imaging markers explained 27.86% of the variance in adult ADHD. No single imaging modality dominated this result. Instead, it was explained by aggregation of relatively small effects across several modalities and markers. One of the top markers for adult ADHD was multimodal and linked to morphological and microstructural effects within anterior temporal brain regions; another was linked to cortical thickness. Several markers were also influenced by estimated intelligence, age and/or sex.

LIMITATIONS

Although complex analytical approaches, such as the one applied here, provide insight into otherwise hidden mechanisms, they also increase the complexity of interpretations.

CONCLUSION

No dominant imaging modality or marker characterizes structural brain phenotypes in adults with ADHD, but we can refine our characterization of the disorder by the integration of small effects across modalities.