Identifying disease-related subnetwork connectome biomarkers by sparse hypergraph learning

Hypergraph reconstruction from dynamics

A plethora of methods have been developed in the past two decades to infer the underlying network structure of an interconnected system from its collective dynamics. However, methods capable of inferring nonpairwise interactions are only starting to appear. Here, we develop an inference algorithm based on sparse identification of nonlinear dynamics (SINDy) to reconstruct hypergraphs and simplicial complexes from time-series data. Our model-free method does not require information about node dynamics or coupling functions, making it applicable to complex systems that do not have a reliable mathematical description. We first benchmark the new method on synthetic data generated from Kuramoto and Lorenz dynamics. We then use it to infer the effective connectivity in the brain from resting-state EEG data, which reveals significant contributions from non-pairwise interactions in shaping the macroscopic brain dynamics.

The diagnosis of ASD with MRI: a systematic review and meta-analysis

While diagnosing autism spectrum disorder (ASD) based on an objective test is desired, the current diagnostic practice involves observation-based criteria. This study is a systematic review and meta-analysis of studies that aim to diagnose ASD using magnetic resonance imaging (MRI). The main objective is to describe the state of the art of diagnosing ASD using MRI in terms of performance metrics and interpretation. Furthermore, subgroups, including different MRI modalities and statistical heterogeneity, are analyzed. Studies that dichotomously diagnose individuals with ASD and healthy controls by analyses progressing from magnetic resonance imaging obtained in a resting state were systematically selected by two independent reviewers. Studies were sought on Web of Science and PubMed, which were last accessed on February 24, 2023. The included studies were assessed on quality and risk of bias using the revised Quality Assessment of Diagnostic Accuracy Studies tool. A bivariate random-effects model was used for syntheses. One hundred and thirty-four studies were included comprising 159 eligible experiments. Despite the overlap in the studied samples, an estimated 4982 unique participants consisting of 2439 individuals with ASD and 2543 healthy controls were included. The pooled summary estimates of diagnostic performance are 76.0% sensitivity (95% CI 74.1-77.8), 75.7% specificity (95% CI 74.0-77.4), and an area under curve of 0.823, but uncertainty in the study assessments limits confidence. The main limitations are heterogeneity and uncertainty about the generalization of diagnostic performance. Therefore, comparisons between subgroups were considered inappropriate. Despite the current limitations, methods progressing from MRI approach the diagnostic performance needed for clinical practice. The state of the art has obstacles but shows potential for future clinical application.

Sampling inequalities affect generalization of neuroimaging-based diagnostic classifiers in psychiatry

BACKGROUND

The development of machine learning models for aiding in the diagnosis of mental disorder is recognized as a significant breakthrough in the field of psychiatry. However, clinical practice of such models remains a challenge, with poor generalizability being a major limitation.

METHODS

Here, we conducted a pre-registered meta-research assessment on neuroimaging-based models in the psychiatric literature, quantitatively examining global and regional sampling issues over recent decades, from a view that has been relatively underexplored. A total of 476 studies (n = 118,137) were included in the current assessment. Based on these findings, we built a comprehensive 5-star rating system to quantitatively evaluate the quality of existing machine learning models for psychiatric diagnoses.

RESULTS

A global sampling inequality in these models was revealed quantitatively (sampling Gini coefficient (G) = 0.81, p < .01), varying across different countries (regions) (e.g., China, G = 0.47; the USA, G = 0.58; Germany, G = 0.78; the UK, G = 0.87). Furthermore, the severity of this sampling inequality was significantly predicted by national economic levels (β =  - 2.75, p < .001, R²_adj = 0.40; r =  - .84, 95% CI: - .41 to - .97), and was plausibly predictable for model performance, with higher sampling inequality for reporting higher classification accuracy. Further analyses showed that lack of independent testing (84.24% of models, 95% CI: 81.0-87.5%), improper cross-validation (51.68% of models, 95% CI: 47.2-56.2%), and poor technical transparency (87.8% of models, 95% CI: 84.9-90.8%)/availability (80.88% of models, 95% CI: 77.3-84.4%) are prevailing in current diagnostic classifiers despite improvements over time. Relating to these observations, model performances were found decreased in studies with independent cross-country sampling validations (all p < .001, BF₁₀ > 15). In light of this, we proposed a purpose-built quantitative assessment checklist, which demonstrated that the overall ratings of these models increased by publication year but were negatively associated with model performance.

CONCLUSIONS

Together, improving sampling economic equality and hence the quality of machine learning models may be a crucial facet to plausibly translating neuroimaging-based diagnostic classifiers into clinical practice.

Evaluation of Risk of Bias in Neuroimaging-Based Artificial Intelligence Models for Psychiatric Diagnosis: A Systematic Review

IMPORTANCE

Neuroimaging-based artificial intelligence (AI) diagnostic models have proliferated in psychiatry. However, their clinical applicability and reporting quality (ie, feasibility) for clinical practice have not been systematically evaluated.

OBJECTIVE

To systematically assess the risk of bias (ROB) and reporting quality of neuroimaging-based AI models for psychiatric diagnosis.

EVIDENCE REVIEW

PubMed was searched for peer-reviewed, full-length articles published between January 1, 1990, and March 16, 2022. Studies aimed at developing or validating neuroimaging-based AI models for clinical diagnosis of psychiatric disorders were included. Reference lists were further searched for suitable original studies. Data extraction followed the CHARMS (Checklist for Critical Appraisal and Data Extraction for Systematic Reviews of Prediction Modeling Studies) and PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-analyses) guidelines. A closed-loop cross-sequential design was used for quality control. The PROBAST (Prediction Model Risk of Bias Assessment Tool) and modified CLEAR (Checklist for Evaluation of Image-Based Artificial Intelligence Reports) benchmarks were used to systematically evaluate ROB and reporting quality.

FINDINGS

A total of 517 studies presenting 555 AI models were included and evaluated. Of these models, 461 (83.1%; 95% CI, 80.0%-86.2%) were rated as having a high overall ROB based on the PROBAST. The ROB was particular high in the analysis domain, including inadequate sample size (398 of 555 models [71.7%; 95% CI, 68.0%-75.6%]), poor model performance examination (with 100% of models lacking calibration examination), and lack of handling data complexity (550 of 555 models [99.1%; 95% CI, 98.3%-99.9%]). None of the AI models was perceived to be applicable to clinical practices. Overall reporting completeness (ie, number of reported items/number of total items) for the AI models was 61.2% (95% CI, 60.6%-61.8%), and the completeness was poorest for the technical assessment domain with 39.9% (95% CI, 38.8%-41.1%).

CONCLUSIONS AND RELEVANCE

This systematic review found that the clinical applicability and feasibility of neuroimaging-based AI models for psychiatric diagnosis were challenged by a high ROB and poor reporting quality. Particularly in the analysis domain, ROB in AI diagnostic models should be addressed before clinical application.

Machine Learning and MRI-based Diagnostic Models for ADHD: Are We There Yet?

OBJECTIVE

Machine learning (ML) has been applied to develop magnetic resonance imaging (MRI)-based diagnostic classifiers for attention-deficit/hyperactivity disorder (ADHD). This systematic review examines this literature to clarify its clinical significance and to assess the implications of the various analytic methods applied.

METHODS

A comprehensive literature search on MRI-based diagnostic classifiers for ADHD was performed and data regarding the utilized models and samples were gathered.

RESULTS

We found that, although most studies reported the classification accuracies, they varied in choice of MRI modalities, ML models, cross-validation and testing methods, and sample sizes. We found that the accuracies of cross-validation methods inflated the performance estimation compared with those of a held-out test, compromising the model generalizability. Test accuracies have increased with publication year but were not associated with training sample sizes. Improved test accuracy over time was likely due to the use of better ML methods along with strategies to deal with data imbalances.

CONCLUSION

Ultimately, large multi-modal imaging datasets, and potentially the combination with other types of data, like cognitive data and/or genetics, will be essential to achieve the goal of developing clinically useful imaging classification tools for ADHD in the future.

Technologies to support the diagnosis and/or treatment of neurodevelopmental disorders: A systematic review

In recent years, there has been a great interest in utilizing technology in mental health research. The rapid technological development has encouraged researchers to apply technology as a part of a diagnostic process or treatment of Neurodevelopmental Disorders (NDDs). With the large number of studies being published comes an urgent need to inform clinicians and researchers about the latest advances in this field. Here, we methodically explore and summarize findings from studies published between August 2019 and February 2022. A search strategy led to the identification of 4108 records from PubMed and APA PsycInfo databases. 221 quantitative studies were included, covering a wide range of technologies used for diagnosis and/or treatment of NDDs, with the biggest focus on Autism Spectrum Disorder (ASD). The most popular technologies included machine learning, functional magnetic resonance imaging, electroencephalogram, magnetic resonance imaging, and neurofeedback. The results of the review indicate that technology-based diagnosis and intervention for NDD population is promising. However, given a high risk of bias of many studies, more high-quality research is needed.

The Altered Pattern of the Functional Connectome Related to Pathological Biomarkers in Individuals for Autism Spectrum Disorder Identification

Objective

Autism spectrum disorder (ASD) is a common neurodevelopmental disorder characterized by the development of multiple symptoms, with incidences rapidly increasing worldwide. An important step in the early diagnosis of ASD is to identify informative biomarkers. Currently, the use of functional brain network (FBN) is deemed important for extracting data on brain imaging biomarkers. Unfortunately, most existing studies have reported the utilization of the information from the connection to train the classifier; such an approach ignores the topological information and, in turn, limits its performance. Thus, effective utilization of the FBN provides insights for improving the diagnostic performance.

Methods

We propose the combination of the information derived from both FBN and its corresponding graph theory measurements to identify and distinguish ASD from normal controls (NCs). Specifically, a multi-kernel support vector machine (MK-SVM) was used to combine multiple types of information.

Results

The experimental results illustrate that the combination of information from multiple connectome features (i.e., functional connections and graph measurements) can provide a superior identification performance with an area under the receiver operating characteristic curve (ROC) of 0.9191 and an accuracy of 82.60%. Furthermore, the graph theoretical analysis illustrates that the significant nodal graph measurements and consensus connections exists mostly in the salience network (SN), default mode network (DMN), attention network, frontoparietal network, and social network.

Conclusion

This work provides insights into potential neuroimaging biomarkers that may be used for the diagnosis of ASD and offers a new perspective for the exploration of the brain pathophysiology of ASD through machine learning.

Construction and Multiple Feature Classification Based on a High-Order Functional Hypernetwork on fMRI Data

Resting-state functional connectivity hypernetworks, in which multiple nodes can be connected, are an effective technique for diagnosing brain disease and performing classification research. Conventional functional hypernetworks can characterize the complex interactions within the human brain in a static form. However, an increasing body of evidence demonstrates that even in a resting state, neural activity in the brain still exhibits transient and subtle dynamics. These dynamic changes are essential for understanding the basic characteristics underlying brain organization and may correlate significantly with the pathological mechanisms of brain diseases. Therefore, considering the dynamic changes of functional connections in the resting state, we proposed methodology to construct resting state high-order functional hyper-networks (rs-HOFHNs) for patients with depression and normal subjects. Meanwhile, we also introduce a novel property (the shortest path) to extract local features with traditional local properties (cluster coefficients). A subgraph feature-based method was introduced to characterize information relating to global topology. Two features, local features and subgraph features that showed significant differences after feature selection were subjected to multi-kernel learning for feature fusion and classification. Compared with conventional hyper network models, the high-order hyper network obtained the best classification performance, 92.18%, which indicated that better classification performance can be achieved if we needed to consider multivariate interactions and the time-varying characteristics of neural interaction simultaneously when constructing a network.

Machine learning with neuroimaging data to identify autism spectrum disorder: a systematic review and meta-analysis

PURPOSE

Autism Spectrum Disorder (ASD) is diagnosed through observation or interview assessments, which is time-consuming, subjective, and with questionable validity and reliability. Thus, we aimed to evaluate the role of machine learning (ML) with neuroimaging data to provide a reliable classification of ASD.

METHODS

A systematic search of PubMed, Scopus, and Embase was conducted to identify relevant publications. Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) was used to assess the studies' quality. A bivariate random-effects model meta-analysis was employed to evaluate the pooled sensitivity, the pooled specificity, and the diagnostic performance through the hierarchical summary receiver operating characteristic (HSROC) curve of ML with neuroimaging data in classifying ASD. Meta-regression was also performed.

RESULTS

Forty-four studies (5697 ASD and 6013 typically developing individuals [TD] in total) were included in the quantitative analysis. The pooled sensitivity for differentiating ASD from TD individuals was 86.25 95% confidence interval [CI] (81.24, 90.08), while the pooled specificity was 83.31 95% CI (78.12, 87.48) with a combined area under the HSROC (AUC) of 0.889. Higgins I² (> 90%) and Cochran's Q (p < 0.0001) suggest a high degree of heterogeneity. In the bivariate model meta-regression, a higher pooled specificity was observed in studies not using a brain atlas (90.91 95% CI [80.67, 96.00], p = 0.032). In addition, a greater pooled sensitivity was seen in studies recruiting both males and females (89.04 95% CI [83.84, 92.72], p = 0.021), and combining imaging modalities (94.12 95% [85.43, 97.76], p = 0.036).

CONCLUSION

ML with neuroimaging data is an exciting prospect in detecting individuals with ASD but further studies are required to improve its reliability for usage in clinical practice.

Brain imaging-based machine learning in autism spectrum disorder: methods and applications

Autism spectrum disorder (ASD) is a neurodevelopmental condition with early childhood onset and high heterogeneity. As the pathogenesis is still elusive, ASD diagnosis is comprised of a constellation of behavioral symptoms. Non-invasive brain imaging techniques, such as magnetic resonance imaging (MRI), provide a valuable objective measurement of the brain. Many efforts have been devoted to developing imaging-based diagnostic tools for ASD based on machine learning (ML) technologies. In this survey, we review recent advances that utilize machine learning approaches to classify individuals with and without ASD. First, we provide a brief overview of neuroimaging-based ASD classification studies, including the analysis of publications and general classification pipeline. Next, representative studies are highlighted and discussed in detail regarding different imaging modalities, methods and sample sizes. Finally, we highlight several common challenges and provide recommendations on future directions. In summary, identifying discriminative biomarkers for ASD diagnosis is challenging, and further establishing more comprehensive datasets and dissecting the individual and group heterogeneity will be critical to achieve better ADS diagnosis performance. Machine learning methods will continue to be developed and are poised to help advance the field in this regard.

Constructing Connectome Atlas by Graph Laplacian Learning

The recent development of neuroimaging technology and network theory allows us to visualize and characterize the whole-brain functional connectivity in vivo. The importance of conventional structural image atlas widely used in population-based neuroimaging studies has been well verified. Similarly, a "common" brain connectivity map (also called connectome atlas) across individuals can open a new pathway to interpreting disorder-related brain cognition and behaviors. However, the main obstacle of applying the classic image atlas construction approaches to the connectome data is that a regular data structure (such as a grid) in such methods breaks down the intrinsic geometry of the network connectivity derived from the irregular data domain (in the setting of a graph). To tackle this hurdle, we first embed the brain network into a set of graph signals in the Euclidean space via the diffusion mapping technique. Furthermore, we cast the problem of connectome atlas construction into a novel learning-based graph inference model. It can be constructed by iterating the following processes: (1) align all individual brain networks to a common space spanned by the graph spectrum bases of the latent common network, and (2) learn graph Laplacian of the common network that is in consensus with all aligned brain networks. We have evaluated our novel method for connectome atlas construction in comparison with non-learning-based counterparts. Based on experiments using network connectivity data from populations with neurodegenerative and neuropediatric disorders, our approach has demonstrated statistically meaningful improvement over existing methods.

Detecting High Frequency Oscillations for Stereoelectroencephalography in Epilepsy via Hypergraph Learning

Successful epilepsy surgeries depend highly on pre-operative localization of epileptogenic zones. Stereoelectroencephalography (SEEG) records interictal and ictal activities of the epilepsy in order to precisely find and localize epileptogenic zones in clinical practice. While it is difficult to find distinct ictal onset patterns generated the seizure onset zone from SEEG recordings in a confined region, high frequency oscillations are commonly considered as putative biomarkers for the identification of epileptogenic zones. Therefore, automatic and accurate detection of high frequency oscillations in SEEG signals is crucial for timely clinical evaluation. This work formulates the detection of high frequency oscillations as a signal segment classification problem and develops a hypergraph-based detector to automatically detect high frequency oscillations such that human experts can visually review SEEG signals. We evaluated our method on 4,000 signal segments from clinical SEEG recordings that contain both ictal and interictal data obtained from 19 patients who suffer from refractory focal epilepsy. The experimental results demonstrate the effectiveness of the proposed detector that can successfully localize interictal high frequency oscillations and outperforms multiple peer machine learning methods. In particular, the proposed detector achieved 90.7% in accuracy, 80.9% in sensitivity, and 96.9% in specificity.

A Two Consequent Multi-layers Deep Discriminative Approach for Classifying fMRI Images

Functional Magnetic Resonance Imaging (fMRI), for many decades acts as a potential aiding method for diagnosing medical problems. Several successful machine learning algorithms have been proposed in literature to extract valuable knowledge from fMRI. One of these algorithms is the convolutional neural network (CNN) that competent with high capabilities for learning optimal abstractions of fMRI. This is because the CNN learns features similarly to human brain where it preserves local structure and avoids distortion of the global feature space. Focusing on the achievements of using the CNN for the fMRI, and accordingly, the Deep Convolutional Auto-Encoder (DCAE) benefits from the data-driven approach with CNN’s optimal features to strengthen the fMRI classification. In this paper, a new two consequent multi-layers DCAE deep discriminative approach for classifying fMRI Images is proposed. The first DCAE is unsupervised sub-model that is composed of four CNN. It focuses on learning weights to utilize discriminative characteristics of the extracted features for robust reconstruction of fMRI with lower dimensional considering tiny details and refining by its deep multiple layers. Then the second DCAE is a supervised sub-model that focuses on training labels to reach an outperformed results. The proposed approach proved its effectiveness and improved literately reported results on a large brain disorder fMRI dataset.

Evaluation of gene-drug common module identification methods using pharmacogenomics data

Accurately identifying the interactions between genomic factors and the response of cancer drugs plays important roles in drug discovery, drug repositioning and cancer treatment. A number of studies revealed that interactions between genes and drugs were 'many-genes-to-many drugs' interactions, i.e. common modules, opposed to 'one-gene-to-one-drug' interactions. Such modules fully explain the interactions between complex biological regulatory mechanisms and cancer drugs. However, strategies for effectively and robustly identifying the underlying common modules among pharmacogenomics data remain to be improved. In this paper, we aim to provide a detailed evaluation of three categories of state-of-the-art common module identification techniques from a machine learning perspective, including non-negative matrix factorization (NMF), partial least squares (PLS) and network analyses. We first evaluate the performance of six methods, namely SNMNMF, NetNMF, SNPLS, O2PLS, NSBM and HOGMMNC, using two series of simulated data sets with different noise levels and outlier ratios. Then, we conduct experiments using a real world data set of 2091 genes and 101 drugs in 392 cancer cell lines and compare the real experimental results from the aspect of biological process term enrichment, gene-drug and drug-drug interactions. Finally, we present interesting findings from our evaluation study and discuss the advantages and drawbacks of each method. Supplementary information: Supplementary file is available at Briefings in Bioinformatics online.

Multi-Hypergraph Learning-Based Brain Functional Connectivity Analysis in fMRI Data

Recently, a hypergraph constructed from functional magnetic resonance imaging (fMRI) was utilized to explore brain functional connectivity networks (FCNs) for the classification of neurodegenerative diseases. Each edge of a hypergraph (called hyperedge) can connect any number of brain regions-of-interest (ROIs) instead of only two ROIs, and thus characterizes high-order relations among multiple ROIs that cannot be uncovered by a simple graph in the traditional graph based FCN construction methods. Unlike the existing hypergraph based methods where all hyperedges are assumed to have equal weights and only certain topological features are extracted from the hypergraphs, we propose a hypergraph learning based method for FCN construction in this paper. Specifically, we first generate hyperedges from fMRI time series based on sparse representation, then employ hypergraph learning to adaptively learn hyperedge weights, and finally define a hypergraph similarity matrix to represent the FCN. In our proposed method, weighting hyperedges results in better discriminative FCNs across subjects, and the defined hypergraph similarity matrix can better reveal the overall structure of brain network than using those hypergraph topological features. Moreover, we propose a multi-hypergraph learning based method by integrating multi-paradigm fMRI data, where the hyperedge weights associated with each fMRI paradigm are jointly learned and then a unified hypergraph similarity matrix is computed to represent the FCN. We validate the effectiveness of the proposed method on the Philadelphia Neurodevelopmental Cohort dataset for the classification of individuals' learning ability from three paradigms of fMRI data. Experimental results demonstrate that our proposed approach outperforms the traditional graph based methods (i.e., Pearson's correlation and partial correlation with the graphical Lasso) and the existing unweighted hypergraph based methods, which sheds light on how to optimize estimation of FCNs for cognitive and behavioral study.

Hypernetwork Construction and Feature Fusion Analysis Based on Sparse Group Lasso Method on fMRI Dataset

Recent works have shown that the resting-state brain functional connectivity hypernetwork, where multiple nodes can be connected, are an effective technique for brain disease diagnosis and classification research. The lasso method was used to construct hypernetworks by solving sparse linear regression models in previous research. But, constructing a hypernetwork based on the lasso method simply selects a single variable, in that it lacks the ability to interpret the grouping effect. Considering the group structure problem, the previous study proposed to create a hypernetwork based on the elastic net and the group lasso methods, and the results showed that the former method had the best classification performance. However, the highly correlated variables selected by the elastic net method were not necessarily in the active set in the group. Therefore, we extended our research to address this issue. Herein, we propose a new method that introduces the sparse group lasso method to improve the construction of the hypernetwork by solving the group structure problem of the brain regions. We used the traditional lasso, group lasso method, and sparse group lasso method to construct a hypernetwork in patients with depression and normal subjects. Meanwhile, other clustering coefficients (clustering coefficients based on pairs of nodes) were also introduced to extract features with traditional clustering coefficients. Two types of features with significant differences obtained after feature selection were subjected to multi-kernel learning for feature fusion and classification using each method, respectively. The network topology results revealed differences among the three networks, where hypernetwork using the lasso method was the strictest; the group lasso, most lenient; and the sgLasso method, moderate. The network topology of the sparse group lasso method was similar to that of the group lasso method but different from the lasso method. The classification results show that the sparse group lasso method achieves the best classification accuracy by using multi-kernel learning, which indicates that better classification performance can be achieved when the group structure exists and is properly extended.

Multimodal hyper-connectivity of functional networks using functionally-weighted LASSO for MCI classification

Recent works have shown that hyper-networks derived from blood-oxygen-level-dependent (BOLD) fMRI, where an edge (called hyper-edge) can be connected to more than two nodes, are effective biomarkers for MCI classification. Although BOLD fMRI is a high temporal resolution fMRI approach to assess alterations in brain networks, it cannot pinpoint to a single correlation of neuronal activity since BOLD signals are composite. In contrast, arterial spin labeling (ASL) is a lower temporal resolution fMRI technique for measuring cerebral blood flow (CBF) that can provide quantitative, direct brain network physiology measurements. This paper proposes a novel sparse regression algorithm for inference of the integrated hyper-connectivity networks from BOLD fMRI and ASL fMRI. Specifically, a least absolution shrinkage and selection operator (LASSO) algorithm, which is constrained by the functional connectivity derived from ASL fMRI, is employed to estimate hyper-connectivity for characterizing BOLD-fMRI-based functional interaction among multiple regions. An ASL-derived functional connectivity is constructed by using an Ultra-GroupLASSO-UOLS algorithm, where the combination of ultra-least squares (ULS) criterion with a group LASSO (GroupLASSO) algorithm is applied to detect the topology of ASL-based functional connectivity networks, and then an ultra-orthogonal least squares (UOLS) algorithm is used to estimate the connectivity strength. By combining the complementary characterization conveyed by rs-fMRI and ASL fMRI, our multimodal hyper-networks demonstrated much better discriminative characteristics than either the conventional pairwise connectivity networks or the unimodal hyper-connectivity networks. Experimental results on publicly available ADNI dataset demonstrate that the proposed method outperforms the existing single modality based sparse functional connectivity inference methods.