Intensity warping for multisite MRI harmonization

Characterization of Portable Ultra-Low Field MRI Scanners for Multi-Center Structural Neuroimaging

The lower infrastructure requirements of portable ultra-low field MRI (ULF-MRI) systems have enabled their use in diverse settings such as intensive care units and remote medical facilities. The UNITY Project is an international neuroimaging network harnessing this technology, deploying portable ULF-MRI systems globally to expand access to MRI for studies into brain development. Given the wide range of environments where ULF-MRI systems may operate, there are external factors that might influence image quality. This work aims to introduce the quality control (QC) framework used by the UNITY Project to investigate how robust the systems are and how QC metrics compare between sites and over time. We present a QC framework using a commercially available phantom, scanned with 64 mT portable MRI systems at 17 sites across 12 countries on four continents. Using automated, open-source analysis tools, we quantify signal-to-noise, image contrast, and geometric distortions. Our results demonstrated that the image quality is robust to the varying operational environment, for example, electromagnetic noise interference and temperature. The Larmor frequency was significantly correlated to room temperature, as was image noise and contrast. Image distortions were less than 2.5 mm, with high robustness over time. Similar to studies at higher field, we found that changes in pulse sequence parameters from software updates had an impact on QC metrics. This study demonstrates that portable ULF-MRI systems can be deployed in a variety of environments for multi-center neuroimaging studies and produce robust results.

Harmonization of Structural Brain Connectivity through Distribution Matching

The increasing prevalence of multi-site diffusion-weighted magnetic resonance imaging (dMRI) studies potentially offers enhanced statistical power to investigate brain structure. However, these studies face challenges due to variations in scanner hardware and acquisition protocols. While several methods for dMRI data harmonization exist, few specifically address structural brain connectivity. We introduce a new distribution-matching approach to harmonizing structural brain connectivity across different sites and scanners. We evaluate our method using structural brain connectivity data from three distinct datasets (OASIS-3, ADNI-2, and PREVENT-AD), comparing its performance to the widely used ComBat method and the more recent CovBat approach. We examine the impact of harmonization on the correlation of brain connectivity with the Mini-Mental State Examination score and age. Our results demonstrate that our distribution-matching technique effectively harmonizes structural brain connectivity while maintaining non-negativity of the connectivity values, and produces correlation strengths and significance levels competitive with alternative approaches. Qualitative assessments illustrate the desired distributional alignment across datasets, while quantitative evaluations confirm competitive performance. This work contributes to the growing field of dMRI harmonization, potentially improving the reliability and comparability of structural connectivity studies that combine data from different sources in neuroscientific and clinical research.

Investigation of ComBat Harmonization on Radiomic and Deep Features from Multi-Center Abdominal MRI Data

ComBat harmonization has been developed to remove non-biological variations for data in multi-center research applying artificial intelligence (AI). We investigated the effectiveness of ComBat harmonization on radiomic and deep features extracted from large, multi-center abdominal MRI data. A retrospective study was conducted on T2-weighted (T2W) abdominal MRI data retrieved from individual patients with suspected or known chronic liver disease at three study sites. MRI data were acquired using systems from three manufacturers and two field strengths. Radiomic features and deep features were extracted using the PyRadiomics pipeline and a Swin Transformer. ComBat was used to harmonize radiomic and deep features across different manufacturers and field strengths. Student's t-test, ANOVA test, and Cohen's F score were applied to assess the difference in individual features before and after ComBat harmonization. Between two field strengths, 76.7%, 52.9%, and 26.7% of radiomic features, and 89.0%, 56.5%, and 0.1% of deep features from three manufacturers were significantly different. Among the three manufacturers, 90.1% and 75.0% of radiomic features and 89.3% and 84.1% of deep features from two field strengths were significantly different. After ComBat harmonization, there were no significant differences in radiomic and deep features among manufacturers or field strengths based on t-tests or ANOVA tests. Reduced Cohen's F scores were consistently observed after ComBat harmonization. ComBat harmonization effectively harmonizes radiomic and deep features by removing the non-biological variations due to system manufacturers and/or field strengths in large multi-center clinical abdominal MRI datasets.

Are white matter hyperintensities associated with neuroborreliosis? The answer is twofold

PURPOSE

Many consider white matter hyperintensities (WMHs) to be important imaging findings in neuroborreliosis. However, evidence regarding association with WMHs is of low quality. The objective was to investigate WMHs in neuroborreliosis visually and quantitatively.

MATERIALS AND METHODS

Patients underwent brain MRI within one month of diagnosis and six months after treatment. Healthy controls were recruited. WMHs were counted by visual rating and the volume was calculated from automatic segmentation. Biochemical markers and scores for clinical symptoms and findings were used to explore association with longitudinal volume change of WMHs.

RESULTS

The study included 74 patients (37 males) with early neuroborreliosis and 65 controls (30 males). Mean age (standard deviation) was 57.4 (13.5) and 57.7 (12.9) years, respectively. Baseline WMH lesion count was zero in 14 patients/16 controls, < 10 in 36/31, 10-20 in 9/7 and > 20 in 13/11, with no difference between groups (p = 0.90). However, from baseline to follow-up the patients had a small reduction in WMH volume and the controls a small increase, median difference 0.136 (95% confidence interval 0.051-0.251) ml. In patients, volume change was not associated with biochemical or clinical markers, but with degree of WMHs (p values 0.002-0.01).

CONCLUSION

WMH lesions were not more numerous in patients with neuroborreliosis compared to healthy controls. However, there was a small reduction of WMH volume from baseline to follow-up among patients, which was associated with higher baseline WMH severity, but not with disease burden or outcome. Overall, non-specific WMHs should not be considered suggestive of neuroborreliosis.

IGUANe: A 3D generalizable CycleGAN for multicenter harmonization of brain MR images

In MRI studies, the aggregation of imaging data from multiple acquisition sites enhances sample size but may introduce site-related variabilities that hinder consistency in subsequent analyses. Deep learning methods for image translation have emerged as a solution for harmonizing MR images across sites. In this study, we introduce IGUANe (Image Generation with Unified Adversarial Networks), an original 3D model that leverages the strengths of domain translation and straightforward application of style transfer methods for multicenter brain MR image harmonization. IGUANe extends CycleGAN by integrating an arbitrary number of domains for training through a many-to-one architecture. The framework based on domain pairs enables the implementation of sampling strategies that prevent confusion between site-related and biological variabilities. During inference, the model can be applied to any image, even from an unknown acquisition site, making it a universal generator for harmonization. Trained on a dataset comprising T1-weighted images from 11 different scanners, IGUANe was evaluated on data from unseen sites. The assessments included the transformation of MR images with traveling subjects, the preservation of pairwise distances between MR images within domains, the evolution of volumetric patterns related to age and Alzheimer's disease (AD), and the performance in age regression and patient classification tasks. Comparisons with other harmonization and normalization methods suggest that IGUANe better preserves individual information in MR images and is more suitable for maintaining and reinforcing variabilities related to age and AD. Future studies may further assess IGUANe in other multicenter contexts, either using the same model or retraining it for applications to different image modalities. Codes and the trained IGUANe model are available at https://github.com/RocaVincent/iguane_harmonization.git.

SiMix: A domain generalization method for cross-site brain MRI harmonization via site mixing

Brain magnetic resonance imaging (MRI) is widely used in clinical practice for disease diagnosis. However, MRI scans acquired at different sites can have different appearances due to the difference in the hardware, pulse sequence, and imaging parameter. It is important to reduce or eliminate such cross-site variations with brain MRI harmonization so that downstream image processing and analysis is performed consistently. Previous works on the harmonization problem require the data acquired from the sites of interest for model training. But in real-world scenarios there can be test data from a new site of interest after the model is trained, and training data from the new site is unavailable when the model is trained. In this case, previous methods cannot optimally handle the test data from the new unseen site. To address the problem, in this work we explore domain generalization for brain MRI harmonization and propose Site Mix (SiMix). We assume that images of travelling subjects are acquired at a few existing sites for model training. To allow the training data to better represent the test data from unseen sites, we first propose to mix the training images belonging to different sites stochastically, which substantially increases the diversity of the training data while preserving the authenticity of the mixed training images. Second, at test time, when a test image from an unseen site is given, we propose a multiview strategy that perturbs the test image with preserved authenticity and ensembles the harmonization results of the perturbed images for improved harmonization quality. To validate SiMix, we performed experiments on the publicly available SRPBS dataset and MUSHAC dataset that comprised brain MRI acquired at nine and two different sites, respectively. The results indicate that SiMix improves brain MRI harmonization for unseen sites, and it is also beneficial to the harmonization of existing sites.

Neuroimage analysis using artificial intelligence approaches: a systematic review

In the contemporary era, artificial intelligence (AI) has undergone a transformative evolution, exerting a profound influence on neuroimaging data analysis. This development has significantly elevated our comprehension of intricate brain functions. This study investigates the ramifications of employing AI techniques on neuroimaging data, with a specific objective to improve diagnostic capabilities and contribute to the overall progress of the field. A systematic search was conducted in prominent scientific databases, including PubMed, IEEE Xplore, and Scopus, meticulously curating 456 relevant articles on AI-driven neuroimaging analysis spanning from 2013 to 2023. To maintain rigor and credibility, stringent inclusion criteria, quality assessments, and precise data extraction protocols were consistently enforced throughout this review. Following a rigorous selection process, 104 studies were selected for review, focusing on diverse neuroimaging modalities with an emphasis on mental and neurological disorders. Among these, 19.2% addressed mental illness, and 80.7% focused on neurological disorders. It is found that the prevailing clinical tasks are disease classification (58.7%) and lesion segmentation (28.9%), whereas image reconstruction constituted 7.3%, and image regression and prediction tasks represented 9.6%. AI-driven neuroimaging analysis holds tremendous potential, transforming both research and clinical applications. Machine learning and deep learning algorithms outperform traditional methods, reshaping the field significantly.

Learning multi-site harmonization of magnetic resonance images without traveling human phantoms

Harmonization improves Magn. Reson. Imaging (MRI) data consistency and is central to effective integration of diverse imaging data acquired across multiple sites. Recent deep learning techniques for harmonization are predominantly supervised in nature and hence require imaging data of the same human subjects to be acquired at multiple sites. Data collection as such requires the human subjects to travel across sites and is hence challenging, costly, and impractical, more so when sufficient sample size is needed for reliable network training. Here we show how harmonization can be achieved with a deep neural network that does not rely on traveling human phantom data. Our method disentangles site-specific appearance information and site-invariant anatomical information from images acquired at multiple sites and then employs the disentangled information to generate the image of each subject for any target site. We demonstrate with more than 6,000 multi-site T1- and T2-weighted images that our method is remarkably effective in generating images with realistic site-specific appearances without altering anatomical details. Our method allows retrospective harmonization of data in a wide range of existing modern large-scale imaging studies, conducted via different scanners and protocols, without additional data collection.

Intersite brain MRI volumetric biases persist even in a harmonized multisubject study of multiple sclerosis

BACKGROUND AND PURPOSE

Multicenter study designs involving a variety of MRI scanners have become increasingly common. However, these present the issue of biases in image-based measures due to scanner or site differences. To assess these biases, we imaged 11 volunteers with multiple sclerosis (MS) with scan and rescan data at four sites.

METHODS

Images were acquired on Siemens or Philips scanners at 3 Tesla. Automated white matter lesion detection and whole-brain, gray and white matter, and thalamic volumetry were performed, as well as expert manual delineations of T1 magnetization-prepared rapid acquisition gradient echo and T2 fluid-attenuated inversion recovery lesions. Random-effect and permutation-based nonparametric modeling was performed to assess differences in estimated volumes within and across sites.

RESULTS

Random-effect modeling demonstrated model assumption violations for most comparisons of interest. Nonparametric modeling indicated that site explained >50% of the variation for most estimated volumes. This expanded to >75% when data from both Siemens and Philips scanners were included. Permutation tests revealed significant differences between average inter- and intrasite differences in most estimated brain volumes (P < .05). The automatic activation of spine coil elements during some acquisitions resulted in a shading artifact in these images. Permutation tests revealed significant differences between thalamic volume measurements from acquisitions with and without this artifact.

CONCLUSION

Differences in brain volumetry persisted across MR scanners despite protocol harmonization. These differences were not well explained by variance component modeling; however, statistical innovations for mitigating intersite differences show promise in reducing biases in multicenter studies of MS.

MISPEL: A supervised deep learning harmonization method for multi-scanner neuroimaging data

Large-scale data obtained from aggregation of already collected multi-site neuroimaging datasets has brought benefits such as higher statistical power, reliability, and robustness to the studies. Despite these promises from growth in sample size, substantial technical variability stemming from differences in scanner specifications exists in the aggregated data and could inadvertently bias any downstream analyses on it. Such a challenge calls for data normalization and/or harmonization frameworks, in addition to comprehensive criteria to estimate the scanner-related variability and evaluate the harmonization frameworks. In this study, we propose MISPEL (Multi-scanner Image harmonization via Structure Preserving Embedding Learning), a supervised multi-scanner harmonization method that is naturally extendable to more than two scanners. We also designed a set of criteria to investigate the scanner-related technical variability and evaluate the harmonization techniques. As an essential requirement of our criteria, we introduced a multi-scanner matched dataset of 3T T1 images across four scanners, which, to the best of our knowledge is one of the few datasets of this kind. We also investigated our evaluations using two popular segmentation frameworks: FSL and segmentation in statistical parametric mapping (SPM). Lastly, we compared MISPEL to popular methods of normalization and harmonization, namely White Stripe, RAVEL, and CALAMITI. MISPEL outperformed these methods and is promising for many other neuroimaging modalities.

Image data harmonization tools for the analysis of post-traumatic epilepsy development in preclinical multisite MRI studies

Preclinical MRI studies have been utilized for the discovery of biomarkers that predict post-traumatic epilepsy (PTE). However, these single site studies often lack statistical power due to limited and homogeneous datasets. Therefore, multisite studies, such as the Epilepsy Bioinformatics Study for Antiepileptogenic Therapy (EpiBioS4Rx), are developed to create large, heterogeneous datasets that can lead to more statistically significant results. EpiBioS4Rx collects preclinical data internationally across sites, including the United States, Finland, and Australia. However, in doing so, there are robust normalization and harmonization processes that are required to obtain statistically significant and generalizable results. This work describes the tools and procedures used to harmonize multisite, multimodal preclinical imaging data acquired by EpiBioS4Rx. There were four main harmonization processes that were utilized, including file format harmonization, naming convention harmonization, image coordinate system harmonization, and diffusion tensor imaging (DTI) metrics harmonization. By using Python tools and bash scripts, the file formats, file names, and image coordinate systems are harmonized across all the sites. To harmonize DTI metrics, values are estimated for each voxel in an image to generate a histogram representing the whole image. Then, the Quantitative Imaging Toolkit (QIT) modules are utilized to scale the mode to a value of one and depict the subsequent harmonized histogram. The standardization of file formats, naming conventions, coordinate systems, and DTI metrics are qualitatively assessed. The histograms of the DTI metrics were generated for all the individual rodents per site. For inter-site analysis, an average of the individual scans was calculated to create a histogram that represents each site. In order to ensure the analysis can be run at the level of individual animals, the sham and TBI cohort were analyzed separately, which depicted the same harmonization factor. The results demonstrate that these processes qualitatively standardize the file formats, naming conventions, coordinate systems, and DTI metrics of the data. This assists in the ability to share data across the study, as well as disseminate tools that can help other researchers to strengthen the statistical power of their studies and analyze data more cohesively.

Bayesian statistical modeling to predict observer-specific optimal windowing parameters in magnetic resonance imaging

Magnetic resonance (MR) images require a process known as windowing for optimizing the display conditions. However, the conventional windowing process often fails to achieve the preferred display conditions for observers due to various factors. This study proposes a novel framework for predicting the preferred windowing parameters for each observer using Bayesian statistical modeling. MR images obtained from 1000 patients were divided into training and test sets at a 7:3 ratio. The image intensity and windowing parameters were standardized using previously reported methods. Bayesian statistical modeling was utilized to predict the windowing parameters preferred by three MR imaging (MRI) operators. The performance of the proposed framework was evaluated by assessing the mean relative error (MRE), mean absolute error (MAE), and Pearson's correlation coefficient (ρ) of the test set. In addition, the naive method, which presumes that the average value of the windowing parameters for each acquisition sequence and body region in the training set is optimal, was also used for comparison. Three MRI operators and three radiologists conducted visual assessments. The mean MRE, MAE, and ρ values for the window level and width (WL/WW) in the proposed framework were 12.6 and 13.9, 42.9 and 85.4, and 0.98 and 0.98, respectively. These results outperformed those obtained using the naive method. The visual assessments revealed no significant differences between the original and predicted display conditions, indicating that the proposed framework accurately predicts individualized windowing parameters with the additional advantages of robustness and ease of use. Thus, the proposed framework can effectively predict the windowing parameters preferred by each observer.

Image harmonization: A review of statistical and deep learning methods for removing batch effects and evaluation metrics for effective harmonization

Magnetic resonance imaging and computed tomography from multiple batches (e.g. sites, scanners, datasets, etc.) are increasingly used alongside complex downstream analyses to obtain new insights into the human brain. However, significant confounding due to batch-related technical variation, called batch effects, is present in this data; direct application of downstream analyses to the data may lead to biased results. Image harmonization methods seek to remove these batch effects and enable increased generalizability and reproducibility of downstream results. In this review, we describe and categorize current approaches in statistical and deep learning harmonization methods. We also describe current evaluation metrics used to assess harmonization methods and provide a standardized framework to evaluate newly-proposed methods for effective harmonization and preservation of biological information. Finally, we provide recommendations to end-users to advocate for more effective use of current methods and to methodologists to direct future efforts and accelerate development of the field.

Cross-scanner harmonization methods for structural MRI may need further work: A comparison study

The clinical usefulness MRI biomarkers for aging and dementia studies relies on precise brain morphological measurements; however, scanner and/or protocol variations may introduce noise or bias. One approach to address this is post-acquisition scan harmonization. In this work, we evaluate deep learning (neural style transfer, CycleGAN and CGAN), histogram matching, and statistical (ComBat and LongComBat) methods. Participants who had been scanned on both GE and Siemens scanners (cross-sectional participants, known as Crossover (n = 113), and longitudinally scanned participants on both scanners (n = 454)) were used. The goal was to match GE MPRAGE (T1-weighted) scans to Siemens improved resolution MPRAGE scans. Harmonization was performed on raw native and preprocessed (resampled, affine transformed to template space) scans. Cortical thicknesses were measured using FreeSurfer (v.7.1.1). Distributions were checked using Kolmogorov-Smirnov tests. Intra-class correlation (ICC) was used to assess the degree of agreement in the Crossover datasets and annualized percent change in cortical thickness was calculated to evaluate the Longitudinal datasets. Prior to harmonization, the least agreement was found at the frontal pole (ICC = 0.72) for the raw native scans, and at caudal anterior cingulate (0.76) and frontal pole (0.54) for the preprocessed scans. Harmonization with NST, CycleGAN, and HM improved the ICCs of the preprocessed scans at the caudal anterior cingulate (>0.81) and frontal poles (>0.67). In the Longitudinal raw native scans, over- and under-estimations of cortical thickness were observed due to the changing of the scanners. ComBat matched the cortical thickness distributions throughout but was not able to increase the ICCs or remove the effects of scanner changeover in the Longitudinal datasets. CycleGAN and NST performed slightly better to address the cortical thickness variations between scanner change. However, none of the methods succeeded in harmonizing the Longitudinal dataset. CGAN was the worst performer for both datasets. In conclusion, the performance of the methods was overall similar and region dependent. Future research is needed to improve the existing approaches since none of them outperformed each other in terms of harmonizing the datasets at all ROIs. The findings of this study establish framework for future research into the scan harmonization problem.

Statistical Analysis of Multiplex Immunofluorescence and Immunohistochemistry Imaging Data

Advances in multiplexed single-cell immunofluorescence (mIF) and multiplex immunohistochemistry (mIHC) imaging technologies have enabled the analysis of cell-to-cell spatial relationships that promise to revolutionize our understanding of tissue-based diseases and autoimmune disorders. Multiplex images are collected as multichannel TIFF files; then denoised, segmented to identify cells and nuclei, normalized across slides with protein markers to correct for batch effects, and phenotyped; and then tissue composition and spatial context at the cellular level are analyzed. This chapter discusses methods and software infrastructure for image processing and statistical analysis of mIF/mIHC data.

A guide for researchers seeking training in retrospective data harmonization for population neuroscience studies of Alzheimer's disease and related dementias

Due to needs surrounding rigor and reproducibility, subgroup specific disease knowledge, and questions of external validity, data harmonization is an essential tool in population neuroscience of Alzheimer's disease and related dementias (ADRD). Systematic harmonization of data elements is necessary to pool information from heterogeneous samples, and such pooling allows more expansive evaluations of health disparities, more precise effect estimates, and more opportunities to discover effective prevention or treatment strategies. The key goal of this Tutorial in Population Neuroimaging Curriculum, Instruction, and Pedagogy article is to guide researchers in creating a customized population neuroscience of ADRD harmonization training plan to fit their needs or those of their mentees. We provide brief guidance for retrospective data harmonization of multiple data types in this area, including: (1) clinical and demographic, (2) neuropsychological, and (3) neuroimaging data. Core competencies and skills are reviewed, and resources are provided to fill gaps in training as well as data needs. We close with an example study in which harmonization is a critical tool. While several aspects of this tutorial focus specifically on ADRD, the concepts and resources are likely to benefit population neuroscientists working in a range of research areas.

Multi-site harmonization of MRI data uncovers machine-learning discrimination capability in barely separable populations: An example from the ABIDE dataset

Machine Learning (ML) techniques have been widely used in Neuroimaging studies of Autism Spectrum Disorders (ASD) both to identify possible brain alterations related to this condition and to evaluate the predictive power of brain imaging modalities. The collection and public sharing of large imaging samples has favored an even greater diffusion of the use of ML-based analyses. However, multi-center data collections may suffer the batch effect, which, especially in case of Magnetic Resonance Imaging (MRI) studies, should be curated to avoid confounding effects for ML classifiers and masking biases. This is particularly important in the study of barely separable populations according to MRI data, such as subjects with ASD compared to controls with typical development (TD). Here, we show how the implementation of a harmo- nization protocol on brain structural features unlocks the case-control ML separation capability in the analysis of a multi-center MRI dataset. This effect is demonstrated on the ABIDE data collection, involving subjects encompassing a wide age range. After data harmonization, the overall ASD vs. TD discrimination capability by a Random Forest (RF) classifier improves from a very low performance (AUC = 0.58 ± 0.04) to a still low, but reasonably significant AUC = 0.67 ± 0.03. The performances of the RF classifier have been evaluated also in the age-specific subgroups of children, adolescents and adults, obtaining AUC = 0.62 ± 0.02, AUC = 0.65 ± 0.03 and AUC = 0.69 ± 0.06, respectively. Specific and consistent patterns of anatomical differences related to the ASD condition have been identified for the three different age subgroups.

Data harmonisation for information fusion in digital healthcare: A state-of-the-art systematic review, meta-analysis and future research directions

Removing the bias and variance of multicentre data has always been a challenge in large scale digital healthcare studies, which requires the ability to integrate clinical features extracted from data acquired by different scanners and protocols to improve stability and robustness. Previous studies have described various computational approaches to fuse single modality multicentre datasets. However, these surveys rarely focused on evaluation metrics and lacked a checklist for computational data harmonisation studies. In this systematic review, we summarise the computational data harmonisation approaches for multi-modality data in the digital healthcare field, including harmonisation strategies and evaluation metrics based on different theories. In addition, a comprehensive checklist that summarises common practices for data harmonisation studies is proposed to guide researchers to report their research findings more effectively. Last but not least, flowcharts presenting possible ways for methodology and metric selection are proposed and the limitations of different methods have been surveyed for future research.

MAGNIMS recommendations for harmonization of MRI data in MS multicenter studies

•

Sharing data from cooperative studies is essential to develop new biomarkers in MS.

•

Differences in MRI acquisition, analysis, storage represent a substantial constraint.

•

We review the state of the art and developments in the harmonization of MRI.

•

We provide recommendations to harmonize large MRI datasets in the MS field.

There is an increasing need of sharing harmonized data from large, cooperative studies as this is essential to develop new diagnostic and prognostic biomarkers. In the field of multiple sclerosis (MS), the issue has become of paramount importance due to the need to translate into the clinical setting some of the most recent MRI achievements. However, differences in MRI acquisition parameters, image analysis and data storage across sites, with their potential bias, represent a substantial constraint. This review focuses on the state of the art, recent technical advances, and desirable future developments of the harmonization of acquisition, analysis and storage of large-scale multicentre MRI data of MS cohorts. Huge efforts are currently being made to achieve all the requirements needed to provide harmonized MRI datasets in the MS field, as proper management of large imaging datasets is one of our greatest opportunities and challenges in the coming years. Recommendations based on these achievements will be provided here. Despite the advances that have been made, the complexity of these tasks requires further research by specialized academical centres, with dedicated technical and human resources. Such collective efforts involving different professional figures are of crucial importance to offer to MS patients a personalised management while minimizing consumption of resources.

Quantifying and correcting slide-to-slide variation in multiplexed immunofluorescence images

MOTIVATION

Multiplexed imaging is a nascent single-cell assay with a complex data structure susceptible to technical variability that disrupts inference. These in situ methods are valuable in understanding cell-cell interactions, but few standardized processing steps or normalization techniques of multiplexed imaging data are available.

RESULTS

We implement and compare data transformations and normalization algorithms in multiplexed imaging data. Our methods adapt the ComBat and functional data registration methods to remove slide effects in this domain, and we present an evaluation framework to compare the proposed approaches. We present clear slide-to-slide variation in the raw, unadjusted data and show that many of the proposed normalization methods reduce this variation while preserving and improving the biological signal. Furthermore, we find that dividing multiplexed imaging data by its slide mean, and the functional data registration methods, perform the best under our proposed evaluation framework. In summary, this approach provides a foundation for better data quality and evaluation criteria in multiplexed imaging.

AVAILABILITY AND IMPLEMENTATION

Source code is provided at: https://github.com/statimagcoll/MultiplexedNormalization and an R package to implement these methods is available here: https://github.com/ColemanRHarris/mxnorm.

SUPPLEMENTARY INFORMATION

Supplementary data are available at Bioinformatics online.

Multimodal biological brain age prediction using magnetic resonance imaging and angiography with the identification of predictive regions

Biological brain age predicted using machine learning models based on high-resolution imaging data has been suggested as a potential biomarker for neurological and cerebrovascular diseases. In this work, we aimed to develop deep learning models to predict the biological brain age using structural magnetic resonance imaging and angiography datasets from a large database of 2074 adults (21-81 years). Since different imaging modalities can provide complementary information, combining them might allow to identify more complex aging patterns, with angiography data, for instance, showing vascular aging effects complementary to the atrophic brain tissue changes seen in T1-weighted MRI sequences. We used saliency maps to investigate the contribution of cortical, subcortical, and arterial structures to the prediction. Our results show that combining T1-weighted and angiography MR data led to a significantly improved brain age prediction accuracy, with a mean absolute error of 3.85 years comparing the predicted and chronological age. The most predictive brain regions included the lateral sulcus, the fourth ventricle, and the amygdala, while the brain arteries contributing the most to the prediction included the basilar artery, the middle cerebral artery M2 segments, and the left posterior cerebral artery. Our study proposes a framework for brain age prediction using multimodal imaging, which gives accurate predictions and allows identifying the most predictive regions for this task, which can serve as a surrogate for the brain regions that are most affected by aging.

A multi-scanner neuroimaging data harmonization using RAVEL and ComBat

Modern neuroimaging studies frequently combine data collected from multiple scanners and experimental conditions. Such data often contain substantial technical variability associated with image intensity scale (image intensity scales are not the same in different images) and scanner effects (images obtained from different scanners contain substantial technical biases). Here we evaluate and compare results of data analysis methods without any data transformation (RAW), with intensity normalization using RAVEL, with regional harmonization methods using ComBat, and a combination of RAVEL and ComBat. Methods are evaluated on a unique sample of 16 study participants who were scanned on both 1.5T and 3T scanners a few months apart. Neuroradiological evaluation was conducted for 7 different regions of interest (ROI's) pertinent to Alzheimer's disease (AD). Cortical measures and results indicate that: (1) RAVEL substantially improved the reproducibility of image intensities; (2) ComBat is preferred over RAVEL and the RAVEL-ComBat combination in terms of regional level harmonization due to more consistent harmonization across subjects and image-derived measures; (3) RAVEL and ComBat substantially reduced bias compared to analysis of RAW images, but RAVEL also resulted in larger variance; and (4) the larger root mean square deviation (RMSD) of RAVEL compared to ComBat is due mainly to its larger variance.

Multi-scanner Harmonization of Paired Neuroimaging Data via Structure Preserving Embedding Learning

Combining datasets from multiple sites/scanners has been becoming increasingly more prevalent in modern neuroimaging studies. Despite numerous benefits from the growth in sample size, substantial technical variability associated with site/scanner-related effects exists which may inadvertently bias subsequent downstream analyses. Such a challenge calls for a data harmonization procedure which reduces the scanner effects and allows the scans to be combined for pooled analyses. In this work, we present MISPEL (Multi-scanner Image harmonization via Structure Preserving Embedding Learning), a multi-scanner harmonization framework. Unlike existing techniques, MISPEL does not assume a perfect coregistration across the scans, and the framework is naturally extendable to more than two scanners. Importantly, we incorporate our multi-scanner dataset where each subject is scanned on four different scanners. This unique paired dataset allows us to define and aim for an ideal harmonization (e.g., each subject with identical brain tissue volumes on all scanners). We extensively view scanner effects under varying metrics and demonstrate how MISPEL significantly improves them.

A Contrast Augmentation Approach to Improve Multi-Scanner Generalization in MRI

Most data-driven methods are very susceptible to data variability. This problem is particularly apparent when applying Deep Learning (DL) to brain Magnetic Resonance Imaging (MRI), where intensities and contrasts vary due to acquisition protocol, scanner- and center-specific factors. Most publicly available brain MRI datasets originate from the same center and are homogeneous in terms of scanner and used protocol. As such, devising robust methods that generalize to multi-scanner and multi-center data is crucial for transferring these techniques into clinical practice. We propose a novel data augmentation approach based on Gaussian Mixture Models (GMM-DA) with the goal of increasing the variability of a given dataset in terms of intensities and contrasts. The approach allows to augment the training dataset such that the variability in the training set compares to what is seen in real world clinical data, while preserving anatomical information. We compare the performance of a state-of-the-art U-Net model trained for segmenting brain structures with and without the addition of GMM-DA. The models are trained and evaluated on single- and multi-scanner datasets. Additionally, we verify the consistency of test-retest results on same-patient images (same and different scanners). Finally, we investigate how the presence of bias field influences the performance of a model trained with GMM-DA. We found that the addition of the GMM-DA improves the generalization capability of the DL model to other scanners not present in the training data, even when the train set is already multi-scanner. Besides, the consistency between same-patient segmentation predictions is improved, both for same-scanner and different-scanner repetitions. We conclude that GMM-DA could increase the transferability of DL models into clinical scenarios.

Combining transcranial magnetic stimulation with functional magnetic resonance imaging for probing and modulating neural circuits relevant to affective disorders

Combining transcranial magnetic stimulation (TMS) with functional magnetic resonance imaging offers an unprecedented tool for studying how brain networks interact in vivo and how repetitive trains of TMS modulate those networks among patients diagnosed with affective disorders. TMS compliments neuroimaging by allowing the interrogation of causal control among brain circuits. Together with TMS, neuroimaging can provide valuable insight into the mechanisms underlying treatment effects and downstream circuit communication. Here we provide a background of the method, review relevant study designs, consider methodological and equipment options, and provide statistical recommendations. We conclude by describing emerging approaches that will extend these tools into exciting new applications. This article is categorized under: Psychology > Emotion and Motivation Psychology > Theory and Methods Neuroscience > Clinical Neuroscience.

Multi-site MRI harmonization via attention-guided deep domain adaptation for brain disorder identification

Structural magnetic resonance imaging (MRI) has shown great clinical and practical values in computer-aided brain disorder identification. Multi-site MRI data increase sample size and statistical power, but are susceptible to inter-site heterogeneity caused by different scanners, scanning protocols, and subject cohorts. Multi-site MRI harmonization (MMH) helps alleviate the inter-site difference for subsequent analysis. Some MMH methods performed at imaging level or feature extraction level are concise but lack robustness and flexibility to some extent. Even though several machine/deep learning-based methods have been proposed for MMH, some of them require a portion of labeled data in the to-be-analyzed target domain or ignore the potential contributions of different brain regions to the identification of brain disorders. In this work, we propose an attention-guided deep domain adaptation (AD2A) framework for MMH and apply it to automated brain disorder identification with multi-site MRIs. The proposed framework does not need any category label information of target data, and can also automatically identify discriminative regions in whole-brain MR images. Specifically, the proposed AD2A is composed of three key modules: (1) an MRI feature encoding module to extract representations of input MRIs, (2) an attention discovery module to automatically locate discriminative dementia-related regions in each whole-brain MRI scan, and (3) a domain transfer module trained with adversarial learning for knowledge transfer between the source and target domains. Experiments have been performed on 2572 subjects from four benchmark datasets with T1-weighted structural MRIs, with results demonstrating the effectiveness of the proposed method in both tasks of brain disorder identification and disease progression prediction.

Sparse deep neural networks on imaging genetics for schizophrenia case-control classification

Deep learning methods hold strong promise for identifying biomarkers for clinical application. However, current approaches for psychiatric classification or prediction do not allow direct interpretation of original features. In the present study, we introduce a sparse deep neural network (DNN) approach to identify sparse and interpretable features for schizophrenia (SZ) case–control classification. An L₀‐norm regularization is implemented on the input layer of the network for sparse feature selection, which can later be interpreted based on importance weights. We applied the proposed approach on a large multi‐study cohort with gray matter volume (GMV) and single nucleotide polymorphism (SNP) data for SZ classification. A total of 634 individuals served as training samples, and the classification model was evaluated for generalizability on three independent datasets of different scanning protocols (N = 394, 255, and 160, respectively). We examined the classification power of pure GMV features, as well as combined GMV and SNP features. Empirical experiments demonstrated that sparse DNN slightly outperformed independent component analysis + support vector machine (ICA + SVM) framework, and more effectively fused GMV and SNP features for SZ discrimination, with an average error rate of 28.98% on external data. The importance weights suggested that the DNN model prioritized to select frontal and superior temporal gyrus for SZ classification with high sparsity, with parietal regions further included with lower sparsity, echoing previous literature. The results validate the application of the proposed approach to SZ classification, and promise extended utility on other data modalities and traits which ultimately may result in clinically useful tools.

Deep learning-based unlearning of dataset bias for MRI harmonisation and confound removal

Increasingly large MRI neuroimaging datasets are becoming available, including many highly multi-site multi-scanner datasets. Combining the data from the different scanners is vital for increased statistical power; however, this leads to an increase in variance due to nonbiological factors such as the differences in acquisition protocols and hardware, which can mask signals of interest. We propose a deep learning based training scheme, inspired by domain adaptation techniques, which uses an iterative update approach to aim to create scanner-invariant features while simultaneously maintaining performance on the main task of interest, thus reducing the influence of scanner on network predictions. We demonstrate the framework for regression, classification and segmentation tasks with two different network architectures. We show that not only can the framework harmonise many-site datasets but it can also adapt to many data scenarios, including biased datasets and limited training labels. Finally, we show that the framework can be extended for the removal of other known confounds in addition to scanner. The overall framework is therefore flexible and should be applicable to a wide range of neuroimaging studies.