The NAIMS cooperative pilot project: Design, implementation and future directions

Constrained alternating minimization for parameter mapping (CAMP)

OBJECTIVE

To improve image quality in highly accelerated parameter mapping by incorporating a linear constraint that relates consecutive images.

APPROACH

In multi-echo T1 or T2 mapping, scan time is often shortened by acquiring undersampled but complementary measures of k-space at each TE or TI. However, residual undersampling artifacts from the individual images can then degrade the quality of the final parameter maps. In this work, a new reconstruction method, dubbed Constrained Alternating Minimization for Parameter mapping (CAMP), is introduced. This method simultaneously extracts T2 or T1* maps in addition to an image for each TE or TI from accelerated datasets, leveraging the constraints of the decay to improve the reconstructed image quality. The model enforces exponential decay through a linear constraint, resulting in a biconvex objective function that lends itself to alternating minimization. The method was tested in four in vivo volunteer experiments and validated in phantom studies and healthy subjects, using T2 and T1 mapping, with accelerations of up to 12.

MAIN RESULTS

CAMP is demonstrated for accelerated radial and Cartesian acquisitions in T2 and T1 mapping. The method is even applied to generate an entire T2 weighted image series from a single TSE dataset, despite the blockwise k-space sampling at each echo time. Experimental undersampled phantom and in vivo results processed with CAMP exhibit reduced artifacts without introducing bias.

SIGNIFICANCE

For a wide array of applications, CAMP linearizes the model cost function without sacrificing model accuracy so that the well-conditioned and highly efficient reconstruction algorithm improves the image quality of accelerated parameter maps.

Intersite brain MRI volumetric biases persist even in a harmonized multisubject study of multiple sclerosis

BACKGROUND AND PURPOSE

Multicenter study designs involving a variety of MRI scanners have become increasingly common. However, these present the issue of biases in image-based measures due to scanner or site differences. To assess these biases, we imaged 11 volunteers with multiple sclerosis (MS) with scan and rescan data at four sites.

METHODS

Images were acquired on Siemens or Philips scanners at 3 Tesla. Automated white matter lesion detection and whole-brain, gray and white matter, and thalamic volumetry were performed, as well as expert manual delineations of T1 magnetization-prepared rapid acquisition gradient echo and T2 fluid-attenuated inversion recovery lesions. Random-effect and permutation-based nonparametric modeling was performed to assess differences in estimated volumes within and across sites.

RESULTS

Random-effect modeling demonstrated model assumption violations for most comparisons of interest. Nonparametric modeling indicated that site explained >50% of the variation for most estimated volumes. This expanded to >75% when data from both Siemens and Philips scanners were included. Permutation tests revealed significant differences between average inter- and intrasite differences in most estimated brain volumes (P < .05). The automatic activation of spine coil elements during some acquisitions resulted in a shading artifact in these images. Permutation tests revealed significant differences between thalamic volume measurements from acquisitions with and without this artifact.

CONCLUSION

Differences in brain volumetry persisted across MR scanners despite protocol harmonization. These differences were not well explained by variance component modeling; however, statistical innovations for mitigating intersite differences show promise in reducing biases in multicenter studies of MS.

Multisite MRI reproducibility of lateral ventricular volume using the NAIMS cooperative pilot dataset

BACKGROUND AND PURPOSE

The North American Imaging in Multiple Sclerosis (NAIMS) multisite project identified interscanner reproducibility issues with T1-based whole brain volume (WBV). Lateral ventricular volume (LVV) acquired on T2-fluid-attenuated inverse recovery (FLAIR) scans has been proposed as a robust proxy measure. Therefore, we sought to determine the relative magnitude of scanner-induced T2-FLAIR-based LVV and T1-based WBV measurement errors in relation to clinically meaningful changes.

METHODS

This was a post hoc analysis of the NAIMS pilot dataset in which a relapsing-remitting MS patient with no intrastudy clinical or radiological activity was imaged twice on seven different Siemens scanners across the United States. LVV was determined using the automated NeuroSTREAM technique on T2-FLAIR and WBV was determined with SIENAX on high-resolution T1-MPRAGE. Average LVV and WBV were measured, and absolute intrascanner and interscanner coefficients of variation (CoVs) were calculated. The variabilities were compared to previously established annual pathological and clinically meaningful cutoffs of 0.40% for WBV and of 3.51% for LVV.

RESULTS

Mean LVV across all seven scan/rescan pairs was 45.87 ± 1.15 ml. Average LVV intrascanner CoV was 1.42% and interscanner CoV was 1.78%, both smaller than the reported annualized clinically meaningful cutoff of 3.51%. In contrast, intra- and interscanner CoVs for WBV (0.99% and 1.15%) were both higher than the established cutoff of 0.40%. Individually, 1/7 intrasite and 2/7 intersite pair-wise LVV comparisons were above the 3.51% cutoff, whereas 4/7 intrasite and 7/7 intersite WBV comparisons were above the 0.40% cutoff.

CONCLUSION

Fully automated LVV segmentation has higher absolute variability than WBV, but much lower relative variability compared to clinically relevant changes, and may therefore be a meaningful proxy outcome measure of neurodegeneration.

DeepGRAI (Deep Gray Rating via Artificial Intelligence): Fast, feasible, and clinically relevant thalamic atrophy measurement on clinical quality T2-FLAIR MRI in multiple sclerosis

BACKGROUND

Thalamic volume loss is a key marker of neurodegeneration in multiple sclerosis (MS). T2-FLAIR MRI is a common denominator in clinical routine MS imaging, but current methods for thalamic volumetry are not applicable to it.

OBJECTIVE

To develop and validate a robust algorithm to measure thalamic volume using clinical routine T2-FLAIR MRI.

METHODS

A dual-stage deep learning approach based on 3D U-net (DeepGRAI - Deep Gray Rating via Artificial Intelligence) was created and trained/validated/tested on 4,590 MRI exams (4288 2D-FLAIR, 302 3D-FLAIR) from 59 centers (80/10/10 train/validation/test split). As training/test targets, FIRST was used to generate thalamic masks from 3D T1 images. Masks were reviewed, corrected, and aligned into T2-FLAIR space. Additional validation was performed to assess inter-scanner reliability (177 subjects at 1.5 T and 3 T within one week) and scan-rescan-reliability (5 subjects scanned, repositioned, and then re-scanned). A longitudinal dataset including assessment of disability and cognition was used to evaluate the predictive value of the approach.

RESULTS

DeepGRAI automatically quantified thalamic volume in approximately 7 s per case, and has been made publicly available. Accuracy on T2-FLAIR relative to 3D T1 FIRST was 99.4% (r = 0.94, p < 0.001,TPR = 93.0%, FPR = 0.3%). Inter-scanner error was 3.21%. Scan-rescan error with repositioning was 0.43%. DeepGRAI-derived thalamic volume was associated with disability (r = -0.427,p < 0.001) and cognition (r = -0.537,p < 0.001), and was a significant predictor of longitudinal cognitive decline (R2 = 0.081, p = 0.024; comparatively, FIRST-derived volume was R2 = 0.080, p = 0.025).

CONCLUSIONS

DeepGRAI provides fast, reliable, and clinically relevant thalamic volume measurement on multicenter clinical-quality T2-FLAIR images. This indicates potential for real-world thalamic volumetry, as well as quantification on legacy datasets without 3D T1 imaging.

Intensity warping for multisite MRI harmonization

In multisite neuroimaging studies there is often unwanted technical variation across scanners and sites. These "scanner effects" can hinder detection of biological features of interest, produce inconsistent results, and lead to spurious associations. We propose mica (multisite image harmonization by cumulative distribution function alignment), a tool to harmonize images taken on different scanners by identifying and removing within-subject scanner effects. Our goals in the present study were to (1) establish a method that removes scanner effects by leveraging multiple scans collected on the same subject, and, building on this, (2) develop a technique to quantify scanner effects in large multisite studies so these can be reduced as a preprocessing step. We illustrate scanner effects in a brain MRI study in which the same subject was measured twice on seven scanners, and assess our method's performance in a second study in which ten subjects were scanned on two machines. We found that unharmonized images were highly variable across site and scanner type, and our method effectively removed this variability by aligning intensity distributions. We further studied the ability to predict image harmonization results for a scan taken on an existing subject at a new site using cross-validation.

Developing therapeutic strategies to promote myelin repair in multiple sclerosis

Introduction: Approved disease-modifying therapies for multiple sclerosis (MS) lessen inflammatory disease activity that causes relapses and MRI lesions. However, chronic inflammation and demyelination lead to axonal degeneration and neuronal loss, for which there currently is no effective treatment. There has been increasing interest in developing repair-promoting strategies, but there are important unanswered questions regarding the mechanisms and appropriate methods to evaluate these treatments. Areas covered: The rationale for remyelinating agents in MS is discussed, with an overview of both myelin physiology and endogenous repair mechanisms. This is followed by a discussion of the identification and development of potential remyelinating drugs. Potential biomarkers of remyelination are reviewed, including considerations regarding measuring remyelination in clinical trials. Information and data were obtained from a search of recent literature through PubMed. Peer-reviewed original articles and review articles were included. Expert opinion: There are several obstacles to the translation of potential remyelinating agents to clinical trials, particularly uncertainty regarding the most appropriate study population and method to monitor remyelination. Refinements in clinical trial design and outcome measurement, potentially via advanced imaging techniques, are needed to optimize detection of repair in patients with MS.

Imaging outcome measures of neuroprotection and repair in MS: A consensus statement from NAIMS

OBJECTIVE

To summarize current and emerging imaging techniques that can be used to assess neuroprotection and repair in multiple sclerosis (MS), and to provide a consensus opinion on the potential utility of each technique in clinical trial settings.

METHODS

Clinicians and scientists with expertise in the use of MRI in MS convened in Toronto, Canada, in November 2016 at a North American Imaging in Multiple Sclerosis (NAIMS) Cooperative workshop meeting. The discussion was compiled into a manuscript and circulated to all NAIMS members in attendance. Edits and feedback were incorporated until all authors were in agreement.

RESULTS

A wide spectrum of imaging techniques and analysis methods in the context of specific study designs were discussed, with a focus on the utility and limitations of applying each technique to assess neuroprotection and repair. Techniques were discussed under specific themes, and included conventional imaging, magnetization transfer ratio, diffusion tensor imaging, susceptibility-weighted imaging, imaging cortical lesions, magnetic resonance spectroscopy, PET, advanced diffusion imaging, sodium imaging, multimodal techniques, imaging of special regions, statistical considerations, and study design.

CONCLUSIONS

Imaging biomarkers of neuroprotection and repair are an unmet need in MS. There are a number of promising techniques with different strengths and limitations, and selection of a specific technique will depend on a number of factors, notably the question the trial seeks to answer. Ongoing collaborative efforts will enable further refinement and improved methods to image the effect of novel therapeutic agents that exert benefit in MS predominately through neuroprotective and reparative mechanisms.

Multisite reliability and repeatability of an advanced brain MRI protocol

BACKGROUND

MRI is the imaging modality of choice for diagnosis and intervention assessment in neurological disease. Its full potential has not been realized due in part to challenges in harmonizing advanced techniques across multiple sites.

PURPOSE

To develop a method for the assessment of reliability and repeatability of advanced multisite-multisession neuroimaging studies and specifically to assess the reliability of an advanced MRI protocol, including multiband fMRI and diffusion tensor MRI, in a multisite setting.

STUDY TYPE

Prospective.

POPULATION

Twice repeated measurement of a single subject with stable relapsing-remitting multiple sclerosis (MS) at seven institutions.

FIELD STRENGTH/SEQUENCE

A 3 T MRI protocol included higher spatial resolution anatomical scans, a variable flip-angle longitudinal relaxation rate constant (R₁ ≡ 1/T₁ ) measurement, quantitative magnetization transfer imaging, diffusion tensor imaging, and a resting-state fMRI (rsFMRI) series.

ASSESSMENT

Multiple methods of assessing intrasite repeatability and intersite reliability were evaluated for imaging metrics derived from each sequence.

STATISTICAL TESTS

Student's t-test, Pearson's r, and intraclass correlation coefficient (ICC) (2,1) were employed to assess repeatability and reliability. Two new statistical metrics are introduced that frame reliability and repeatability in the respective units of the measurements themselves.

RESULTS

Intrasite repeatability was excellent for quantitative R₁ , magnetization transfer ratio (MTR), and diffusion-weighted imaging (DWI) based metrics (r > 0.95). rsFMRI metrics were less repeatable (r = 0.8). Intersite reliability was excellent for R₁ , MTR, and DWI (ICC >0.9), and moderate for rsFMRI metrics (ICC∼0.4).

DATA CONCLUSION

From most reliable to least, using a new reliability metric introduced here, MTR > R₁ > DWI > rsFMRI; for repeatability, MTR > DWI > R₁ > rsFMRI. A graphical method for at-a-glance assessment of reliability and repeatability, effect sizes, and outlier identification in multisite-multisession neuroimaging studies is introduced.

LEVEL OF EVIDENCE

1 Technical Efficacy: Stage 2 J. Magn. Reson. Imaging 2019;50:878-888.

Statistical harmonization corrects site effects in functional connectivity measurements from multi-site fMRI data

Acquiring resting-state functional magnetic resonance imaging (fMRI) datasets at multiple MRI scanners and clinical sites can improve statistical power and generalizability of results. However, multi-site neuroimaging studies have reported considerable nonbiological variability in fMRI measurements due to different scanner manufacturers and acquisition protocols. These undesirable sources of variability may limit power to detect effects of interest and may even result in erroneous findings. Until now, there has not been an approach that removes unwanted site effects. In this study, using a relatively large multi-site (4 sites) fMRI dataset, we investigated the impact of site effects on functional connectivity and network measures estimated by widely used connectivity metrics and brain parcellations. The protocols and image acquisition of the dataset used in this study had been homogenized using identical MRI phantom acquisitions from each of the neuroimaging sites; however, intersite acquisition effects were not completely eliminated. Indeed, in this study, we found that the magnitude of site effects depended on the choice of connectivity metric and brain atlas. Therefore, to further remove site effects, we applied ComBat, a harmonization technique previously shown to eliminate site effects in multi-site diffusion tensor imaging (DTI) and cortical thickness studies. In the current work, ComBat successfully removed site effects identified in connectivity and network measures and increased the power to detect age associations when using optimal combinations of connectivity metrics and brain atlases. Our proposed ComBat harmonization approach for fMRI-derived connectivity measures facilitates reliable and efficient analysis of retrospective and prospective multi-site fMRI neuroimaging studies.

An Automated Statistical Technique for Counting Distinct Multiple Sclerosis Lesions

BACKGROUND AND PURPOSE

Lesion load is a common biomarker in multiple sclerosis, yet it has historically shown modest association with clinical outcome. Lesion count, which encapsulates the natural history of lesion formation and is thought to provide complementary information, is difficult to assess in patients with confluent (ie, spatially overlapping) lesions. We introduce a statistical technique for cross-sectionally counting pathologically distinct lesions.

MATERIALS AND METHODS

MR imaging was used to assess the probability of a lesion at each location. The texture of this map was quantified using a novel technique, and clusters resembling the center of a lesion were counted. Validity compared with a criterion standard count was demonstrated in 60 subjects observed longitudinally, and reliability was determined using 14 scans of a clinically stable subject acquired at 7 sites.

RESULTS

The proposed count and the criterion standard count were highly correlated (r = 0.97, P < .001) and not significantly different (t₅₉ = -.83, P = .41), and the variability of the proposed count across repeat scans was equivalent to that of lesion load. After accounting for lesion load and age, lesion count was negatively associated (t₅₈ = -2.73, P < .01) with the Expanded Disability Status Scale. Average lesion size had a higher association with the Expanded Disability Status Scale (r = 0.35, P < .01) than lesion load (r = 0.10, P = .44) or lesion count (r = -.12, P = .36) alone.

CONCLUSIONS

This study introduces a novel technique for counting pathologically distinct lesions using cross-sectional data and demonstrates its ability to recover obscured longitudinal information. The proposed count allows more accurate estimation of lesion size, which correlated more closely with disability scores than either lesion load or lesion count alone.