A deep learning-based method for improving reliability of multicenter diffusion kurtosis imaging with varied acquisition protocols

Harmonizing T1-Weighted Images to Improve Consistency of Brain Morphology Among Different Scanner Manufacturers in Alzheimer's disease

BACKGROUND

Brain MRI scanner variability can introduce bias in measurements. Harmonizing scanner variability is crucial.

PURPOSE

To develop a harmonization method aimed at removing scanner variability, and to evaluate the consistency of results in multicenter studies.

STUDY TYPE

Retrospective.

POPULATION

Multicenter data from 170 healthy participants (males/females = 98/72; age = 73.8 ± 7.3) and 170 Alzheimer's disease patients (males/females = 98/72; age = 76.2 ± 8.5) were compared with reference data from another 340 participants.

FIELD STRENGTH/SEQUENCE

3-T, magnetization prepared rapid gradient echo and turbo field echo; 1.5-T, inversion recovery prepared fast spoiled gradient echo T1-weighted sequences.

ASSESSMENT

Gray matter (GM) brain images, obtained through segmentation of T1-weighted images, were utilized to evaluate the performance of the harmonization method using common orthogonal basis extraction (HCOBE) and four other methods (removal of artificial voxel effect by linear regression, RAVEL; Z_score; general linear model, GLM; ComBat). Linear discriminant analysis (LDA) was used to access the effectiveness of different methods in reducing scanner variability. The performance of harmonization methods in preserving GM volumes heterogeneity was evaluated by the similarity of the relationship between GM proportion and age in the reference and multicenter data. Furthermore, the consistency of the harmonized multicenter data with the reference data were evaluated based on classification results (train/test = 7/3) and brain atrophy.

STATISTICAL TESTS

Two-sample t-tests, area under the curve (AUC), and Dice coefficients were used to analyze the consistency of results from the reference and harmonized multicenter data. A P-value <0.01 was considered statistically significant.

RESULTS

HCOBE reduced the scanner variability from 0.09 before harmonization to 0.003 (ideal: 0, RAVEL/Z_score/GLM/ComBat = 0.087/0.003/0.006/0.013). GM volumes showed no significant difference (P = 0.52) between the reference and HCOBE-harmonized multicenter data. Consistency evaluation showed that AUC values of 0.95 for both reference and HCOBE-harmonized multicenter data (RAVEL/Z_score/GLM/ComBat = 0.86/0.86/0.84/0.89), and the Dice coefficient increased from 0.73 before harmonization to 0.82 (ideal: 1, RAVEL/Z_score/GLM/ComBat = 0.39/0.64/0.59/0.74).

DATA CONCLUSION

HCOBE may help to remove scanner variability and could improve the consistency of results in multicenter studies.

LEVEL OF EVIDENCE

2 TECHNICAL EFFICACY STAGE: 1.

Robust fiber orientation distribution function estimation using deep constrained spherical deconvolution for diffusion-weighted magnetic resonance imaging

Purpose

Diffusion-weighted magnetic resonance imaging (DW-MRI) is a critical imaging method for capturing and modeling tissue microarchitecture at a millimeter scale. A common practice to model the measured DW-MRI signal is via fiber orientation distribution function (fODF). This function is the essential first step for the downstream tractography and connectivity analyses. With recent advantages in data sharing, large-scale multisite DW-MRI datasets are being made available for multisite studies. However, measurement variabilities (e.g., inter- and intrasite variability, hardware performance, and sequence design) are inevitable during the acquisition of DW-MRI. Most existing model-based methods [e.g., constrained spherical deconvolution (CSD)] and learning-based methods (e.g., deep learning) do not explicitly consider such variabilities in fODF modeling, which consequently leads to inferior performance on multisite and/or longitudinal diffusion studies.

Approach

In this paper, we propose a data-driven deep CSD method to explicitly constrain the scan-rescan variabilities for a more reproducible and robust estimation of brain microstructure from repeated DW-MRI scans. Specifically, the proposed method introduces a three-dimensional volumetric scanner-invariant regularization scheme during the fODF estimation. We study the Human Connectome Project (HCP) young adults test-retest group as well as the MASiVar dataset (with inter- and intrasite scan/rescan data). The Baltimore Longitudinal Study of Aging dataset is employed for external validation.

Results

From the experimental results, the proposed data-driven framework outperforms the existing benchmarks in repeated fODF estimation. By introducing the contrastive loss with scan/rescan data, the proposed method achieved a higher consistency while maintaining higher angular correlation coefficients with the CSD modeling. The proposed method is assessing the downstream connectivity analysis and shows increased performance in distinguishing subjects with different biomarkers.

Conclusion

We propose a deep CSD method to explicitly reduce the scan-rescan variabilities, so as to model a more reproducible and robust brain microstructure from repeated DW-MRI scans. The plug-and-play design of the proposed approach is potentially applicable to a wider range of data harmonization problems in neuroimaging.

Image harmonization: A review of statistical and deep learning methods for removing batch effects and evaluation metrics for effective harmonization

Magnetic resonance imaging and computed tomography from multiple batches (e.g. sites, scanners, datasets, etc.) are increasingly used alongside complex downstream analyses to obtain new insights into the human brain. However, significant confounding due to batch-related technical variation, called batch effects, is present in this data; direct application of downstream analyses to the data may lead to biased results. Image harmonization methods seek to remove these batch effects and enable increased generalizability and reproducibility of downstream results. In this review, we describe and categorize current approaches in statistical and deep learning harmonization methods. We also describe current evaluation metrics used to assess harmonization methods and provide a standardized framework to evaluate newly-proposed methods for effective harmonization and preservation of biological information. Finally, we provide recommendations to end-users to advocate for more effective use of current methods and to methodologists to direct future efforts and accelerate development of the field.

Machine Learning for Brain MRI Data Harmonisation: A Systematic Review

BACKGROUND

Magnetic Resonance Imaging (MRI) data collected from multiple centres can be heterogeneous due to factors such as the scanner used and the site location. To reduce this heterogeneity, the data needs to be harmonised. In recent years, machine learning (ML) has been used to solve different types of problems related to MRI data, showing great promise.

OBJECTIVE

This study explores how well various ML algorithms perform in harmonising MRI data, both implicitly and explicitly, by summarising the findings in relevant peer-reviewed articles. Furthermore, it provides guidelines for the use of current methods and identifies potential future research directions.

METHOD

This review covers articles published through PubMed, Web of Science, and IEEE databases through June 2022. Data from studies were analysed based on the criteria of Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA). Quality assessment questions were derived to assess the quality of the included publications.

RESULTS

a total of 41 articles published between 2015 and 2022 were identified and analysed. In the review, MRI data has been found to be harmonised either in an implicit (n = 21) or an explicit (n = 20) way. Three MRI modalities were identified: structural MRI (n = 28), diffusion MRI (n = 7) and functional MRI (n = 6).

CONCLUSION

Various ML techniques have been employed to harmonise different types of MRI data. There is currently a lack of consistent evaluation methods and metrics used across studies, and it is recommended that the issue be addressed in future studies. Harmonisation of MRI data using ML shows promises in improving performance for ML downstream tasks, while caution should be exercised when using ML-harmonised data for direct interpretation.

Deep Learning for Image Enhancement and Correction in Magnetic Resonance Imaging-State-of-the-Art and Challenges

Magnetic resonance imaging (MRI) provides excellent soft-tissue contrast for clinical diagnoses and research which underpin many recent breakthroughs in medicine and biology. The post-processing of reconstructed MR images is often automated for incorporation into MRI scanners by the manufacturers and increasingly plays a critical role in the final image quality for clinical reporting and interpretation. For image enhancement and correction, the post-processing steps include noise reduction, image artefact correction, and image resolution improvements. With the recent success of deep learning in many research fields, there is great potential to apply deep learning for MR image enhancement, and recent publications have demonstrated promising results. Motivated by the rapidly growing literature in this area, in this review paper, we provide a comprehensive overview of deep learning-based methods for post-processing MR images to enhance image quality and correct image artefacts. We aim to provide researchers in MRI or other research fields, including computer vision and image processing, a literature survey of deep learning approaches for MR image enhancement. We discuss the current limitations of the application of artificial intelligence in MRI and highlight possible directions for future developments. In the era of deep learning, we highlight the importance of a critical appraisal of the explanatory information provided and the generalizability of deep learning algorithms in medical imaging.

Magnetic Resonance Imaging Studies of Neurodegenerative Disease: From Methods to Translational Research

Neurodegenerative diseases (NDs) have become a significant threat to an aging human society. Numerous studies have been conducted in the past decades to clarify their pathologic mechanisms and search for reliable biomarkers. Magnetic resonance imaging (MRI) is a powerful tool for investigating structural and functional brain alterations in NDs. With the advantages of being non-invasive and non-radioactive, it has been frequently used in both animal research and large-scale clinical investigations. MRI may serve as a bridge connecting micro- and macro-level analysis and promoting bench-to-bed translational research. Nevertheless, due to the abundance and complexity of MRI techniques, exploiting their potential is not always straightforward. This review aims to briefly introduce research progress in clinical imaging studies and discuss possible strategies for applying MRI in translational ND research.

Data harmonisation for information fusion in digital healthcare: A state-of-the-art systematic review, meta-analysis and future research directions

Removing the bias and variance of multicentre data has always been a challenge in large scale digital healthcare studies, which requires the ability to integrate clinical features extracted from data acquired by different scanners and protocols to improve stability and robustness. Previous studies have described various computational approaches to fuse single modality multicentre datasets. However, these surveys rarely focused on evaluation metrics and lacked a checklist for computational data harmonisation studies. In this systematic review, we summarise the computational data harmonisation approaches for multi-modality data in the digital healthcare field, including harmonisation strategies and evaluation metrics based on different theories. In addition, a comprehensive checklist that summarises common practices for data harmonisation studies is proposed to guide researchers to report their research findings more effectively. Last but not least, flowcharts presenting possible ways for methodology and metric selection are proposed and the limitations of different methods have been surveyed for future research.

A deep learning-based multisite neuroimage harmonization framework established with a traveling-subject dataset

The accumulation of multisite large-sample MRI datasets collected during large brain research projects in the last decade has provided critical resources for understanding the neurobiological mechanisms underlying cognitive functions and brain disorders. However, the significant site effects observed in imaging data and their derived structural and functional features have prevented the derivation of consistent findings across multiple studies. The development of harmonization methods that can effectively eliminate complex site effects while maintaining biological characteristics in neuroimaging data has become a vital and urgent requirement for multisite imaging studies. Here, we propose a deep learning-based framework to harmonize imaging data obtained from pairs of sites, in which site factors and brain features can be disentangled and encoded. We trained the proposed framework with a publicly available traveling subject dataset from the Strategic Research Program for Brain Sciences (SRPBS) and harmonized the gray matter volume maps derived from eight source sites to a target site. The proposed framework significantly eliminated intersite differences in gray matter volumes. The embedded encoders successfully captured both the abstract textures of site factors and the concrete brain features. Moreover, the proposed framework exhibited outstanding performance relative to conventional statistical harmonization methods in terms of site effect removal, data distribution homogenization, and intrasubject similarity improvement. Finally, the proposed harmonization network provided fixable expandability, through which new sites could be linked to the target site via indirect schema without retraining the whole model. Together, the proposed method offers a powerful and interpretable deep learning-based harmonization framework for multisite neuroimaging data that can enhance reliability and reproducibility in multisite studies regarding brain development and brain disorders.

Application of diffusion kurtosis imaging to the study of edema in solid and peritumoral areas of glioma

OBJECTIVE

When gliomas grow in an infiltrative form, high-grade malignant glioma tissue extends beyond the contrast-enhancing tumor boundary, and this diffuse non-enhancing tumor infiltration is not visible on conventional MRI. The purpose of this study was to evaluate the of diffusion kurtosis imaging (DKI)-derived parameters in a group of patients with pre-operative gliomas, evaluating changes in the solid tumor and peritumoral edema area, and investigating their use for evaluating the recurrence and prognosis of gliomas.

METHODS

In this retrospective study, 51 patients with gliomas who underwent biopsy or surgery underwent DKI scans before surgery. DKI scans were performed to generate DKI parameter maps of the solid tumor and peritumoral edema areas. In the solid tumor area, the kurtosis parameters showed the highest area under the curve (AUC), sensitivity, and specificity for distinguishing high- and low-grade gliomas (all P < 0.01).

RESULTS

In the peritumoral edema area, significant differences were found between groups with grade III and IV gliomas (P < 0.05). DKI parameters were found to correlate with clinical Ki-67 scores within the solid tumor area (MK: R2 = 0.288, P < 0.001; Kr: R2 = 0.270, P < 0.001; Ka: R2 = 0.274, P < 0.001; MD: R2 = 0.223, P < 0.001; FA: R2 = 0.098, P < 0.01). No significant correlations were found between Ki-67 and kurtosis parameters of peritumoral edema.

CONCLUSIONS

In this study, DKI showed potential utility for studying solid tumor and peritumoral edema of high grade gliomas.

Recent advances of deep learning in psychiatric disorders

Deep learning (DL) is a recently proposed subset of machine learning methods that has gained extensive attention in the academic world, breaking benchmark records in areas such as visual recognition and natural language processing. Different from conventional machine learning algorithm, DL is able to learn useful representations and features directly from raw data through hierarchical nonlinear transformations. Because of its ability to detect abstract and complex patterns, DL has been used in neuroimaging studies of psychiatric disorders, which are characterized by subtle and diffuse alterations. Here, we provide a brief review of recent advances and associated challenges in neuroimaging studies of DL applied to psychiatric disorders. The results of these studies indicate that DL could be a powerful tool in assisting the diagnosis of psychiatric diseases. We conclude our review by clarifying the main promises and challenges of DL application in psychiatric disorders, and possible directions for future research.