LST-AI: A deep learning ensemble for accurate MS lesion segmentation

Automated segmentation of brain white matter lesions is crucial for both clinical assessment and scientific research in multiple sclerosis (MS). Over a decade ago, we introduced an engineered lesion segmentation tool, LST. While recent lesion segmentation approaches have leveraged artificial intelligence (AI), they often remain proprietary and difficult to adopt. As an open-source tool, we present LST-AI, an advanced deep learning-based extension of LST that consists of an ensemble of three 3D U-Nets. LST-AI explicitly addresses the imbalance between white matter (WM) lesions and non-lesioned WM. It employs a composite loss function incorporating binary cross-entropy and Tversky loss to improve segmentation of the highly heterogeneous MS lesions. We train the network ensemble on 491 MS pairs of T1-weighted and FLAIR images, collected in-house from a 3T MRI scanner, and expert neuroradiologists manually segmented the utilized lesion maps for training. LST-AI also includes a lesion location annotation tool, labeling lesions as periventricular, infratentorial, and juxtacortical according to the 2017 McDonald criteria, and, additionally, as subcortical. We conduct evaluations on 103 test cases consisting of publicly available data using the Anima segmentation validation tools and compare LST-AI with several publicly available lesion segmentation models. Our empirical analysis shows that LST-AI achieves superior performance compared to existing methods. Its Dice and F1 scores exceeded 0.62, outperforming LST, SAMSEG (Sequence Adaptive Multimodal SEGmentation), and the popular nnUNet framework, which all scored below 0.56. Notably, LST-AI demonstrated exceptional performance on the MSSEG-1 challenge dataset, an international WM lesion segmentation challenge, with a Dice score of 0.65 and an F1 score of 0.63-surpassing all other competing models at the time of the challenge. With increasing lesion volume, the lesion detection rate rapidly increased with a detection rate of >75% for lesions with a volume between 10 mm3 and 100 mm3. Given its higher segmentation performance, we recommend that research groups currently using LST transition to LST-AI. To facilitate broad adoption, we are releasing LST-AI as an open-source model, available as a command-line tool, dockerized container, or Python script, enabling diverse applications across multiple platforms.

Quantitative susceptibility mapping in multiple sclerosis: A systematic review and meta-analysis

BACKGROUND

Quantitative susceptibility mapping (QSM) is a quantitative measure based on magnetic resonance imaging sensitive to iron and myelin content. This makes QSM a promising non-invasive tool for multiple sclerosis (MS) in research and clinical practice.

OBJECTIVE

We performed a systematic review and meta-analysis on the use of QSM in MS.

METHODS

Our review was prospectively registered on PROSPERO (CRD42022309563). We searched five databases for studies published between inception and 30th April 2023. We identified 83 English peer-reviewed studies that applied QSM images on MS cohorts. Fifty-five included studies had at least one of the following outcome measures: deep grey matter QSM values in MS, either compared to healthy controls (HC) (k = 13) or correlated with the score on the Expanded Disability Status Scale (EDSS) (k = 7), QSM lesion characteristics (k = 22) and their clinical correlates (k = 17), longitudinal correlates (k = 11), histological correlates (k = 7), or correlates with other imaging techniques (k = 12). Two meta-analyses on deep grey matter (DGM) susceptibility data were performed, while the remaining findings could only be analyzed descriptively.

RESULTS

After outlier removal, meta-analyses demonstrated a significant increase in the basal ganglia susceptibility (QSM values) in MS compared to HC, caudate (k = 9, standardized mean difference (SDM) = 0.54, 95 % CI = 0.39-0.70, I2 = 46 %), putamen (k = 9, SDM = 0.38, 95 % CI = 0.19-0.57, I2 = 59 %), and globus pallidus (k = 9, SDM = 0.48, 95 % CI = 0.28-0.67, I2 = 60 %), whereas thalamic QSM values exhibited a significant reduction (k = 12, SDM = -0.39, 95 % CI = -0.66--0.12, I2 = 84 %); these susceptibility differences in MS were independent of age. Further, putamen QSM values positively correlated with EDSS (k = 4, r = 0.36, 95 % CI = 0.16-0.53, I2 = 0 %). Regarding rim lesions, four out of seven studies, representing 73 % of all patients, reported rim lesions to be associated with more severe disability. Moreover, lesion development from initial detection to the inactive stage is paralleled by increasing, plateauing (after about two years), and gradually decreasing QSM values, respectively. Only one longitudinal study provided clinical outcome measures and found no association. Histological data suggest iron content to be the primary source of QSM values in DGM and at the edges of rim lesions; further, when also considering data from myelin water imaging, the decrease of myelin is likely to drive the increase of QSM values within WM lesions.

CONCLUSIONS

We could provide meta-analytic evidence for DGM susceptibility changes in MS compared to HC; basal ganglia susceptibility is increased and, in the putamen, associated with disability, while thalamic susceptibility is decreased. Beyond these findings, further investigations are necessary to establish the role of QSM in MS for research or even clinical routine.

Intensity scaling of conventional brain magnetic resonance images avoiding cerebral reference regions: A systematic review

BACKGROUND

Conventional brain magnetic resonance imaging (MRI) produces image intensities that have an arbitrary scale, hampering quantification. Intensity scaling aims to overcome this shortfall. As neurodegenerative and inflammatory disorders may affect all brain compartments, reference regions within the brain may be misleading. Here we summarize approaches for intensity scaling of conventional T1-weighted (w) and T2w brain MRI avoiding reference regions within the brain.

METHODS

Literature was searched in the databases of Scopus, PubMed, and Web of Science. We included only studies that avoided reference regions within the brain for intensity scaling and provided validating evidence, which we divided into four categories: 1) comparative variance reduction, 2) comparative correlation with clinical parameters, 3) relation to quantitative imaging, or 4) relation to histology.

RESULTS

Of the 3825 studies screened, 24 fulfilled the inclusion criteria. Three studies used scaled T1w images, 2 scaled T2w images, and 21 T1w/T2w-ratio calculation (with double counts). A robust reduction in variance was reported. Twenty studies investigated the relation of scaled intensities to different types of quantitative imaging. Statistically significant correlations with clinical or demographic data were reported in 8 studies. Four studies reporting the relation to histology gave no clear picture of the main signal driver of conventional T1w and T2w MRI sequences.

CONCLUSIONS

T1w/T2w-ratio calculation was applied most often. Variance reduction and correlations with other measures suggest a biologically meaningful signal harmonization. However, there are open methodological questions and uncertainty on its biological underpinning. Validation evidence on other scaling methods is even sparser.

LST-AI: a Deep Learning Ensemble for Accurate MS Lesion Segmentation

Automated segmentation of brain white matter lesions is crucial for both clinical assessment and scientific research in multiple sclerosis (MS). Over a decade ago, we introduced an engineered lesion segmentation tool, LST. While recent lesion segmentation approaches have leveraged artificial intelligence (AI), they often remain proprietary and difficult to adopt. As an open-source tool, we present LST-AI, an advanced deep learning-based extension of LST that consists of an ensemble of three 3D-UNets. LST-AI explicitly addresses the imbalance between white matter (WM) lesions and non-lesioned WM. It employs a composite loss function incorporating binary cross-entropy and Tversky loss to improve segmentation of the highly heterogeneous MS lesions. We train the network ensemble on 491 MS pairs of T1w and FLAIR images, collected in-house from a 3T MRI scanner, and expert neuroradiologists manually segmented the utilized lesion maps for training. LST-AI additionally includes a lesion location annotation tool, labeling lesion location according to the 2017 McDonald criteria (periventricular, infratentorial, juxtacortical, subcortical). We conduct evaluations on 103 test cases consisting of publicly available data using the Anima segmentation validation tools and compare LST-AI with several publicly available lesion segmentation models. Our empirical analysis shows that LST-AI achieves superior performance compared to existing methods. Its Dice and F1 scores exceeded 0.62, outperforming LST, SAMSEG (Sequence Adaptive Multimodal SEGmentation), and the popular nnUNet framework, which all scored below 0.56. Notably, LST-AI demonstrated exceptional performance on the MSSEG-1 challenge dataset, an international WM lesion segmentation challenge, with a Dice score of 0.65 and an F1 score of 0.63-surpassing all other competing models at the time of the challenge. With increasing lesion volume, the lesion detection rate rapidly increased with a detection rate of >75% for lesions with a volume between 10mm3 and 100mm3. Given its higher segmentation performance, we recommend that research groups currently using LST transition to LST-AI. To facilitate broad adoption, we are releasing LST-AI as an open-source model, available as a command-line tool, dockerized container, or Python script, enabling diverse applications across multiple platforms.

Cortical Thin Patch Fraction Reflects Disease Burden in MS: The Mosaic Approach

BACKGROUND AND PURPOSE

GM pathology plays an essential role in MS disability progression, emphasizing the importance of neuroradiologic biomarkers to capture the heterogeneity of cortical disease burden. This study aimed to assess the validity of a patch-wise, individual interpretation of cortical thickness data to identify GM pathology, the "mosaic approach," which was previously suggested as a biomarker for assessing and localizing atrophy.

MATERIALS AND METHODS

We investigated the mosaic approach in a cohort of 501 patients with MS with respect to 89 internal and 651 external controls. The resulting metric of the mosaic approach is the so-called thin patch fraction, which is an estimate of overall cortical disease burden per patient. We evaluated the mosaic approach with respect to the following: 1) discrimination between patients with MS and controls, 2) classification between different MS phenotypes, and 3) association with established biomarkers reflecting MS disease burden, using general linear modeling.

RESULTS

The thin patch fraction varied significantly between patients with MS and healthy controls and discriminated among MS phenotypes. Furthermore, the thin patch fraction was associated with disease burden, including the Expanded Disability Status Scale, cognitive and fatigue scores, and lesion volume.

CONCLUSIONS

This study demonstrates the validity of the mosaic approach as a neuroradiologic biomarker in MS. The output of the mosaic approach, namely the thin patch fraction, is a candidate biomarker for assessing and localizing cortical GM pathology. The mosaic approach can furthermore enhance the development of a personalized cortical MS biomarker, given that the thin patch fraction provides a feature on which artificial intelligence methods can be trained. Most important, we showed the validity of the mosaic approach when referencing data with respect to external control MR imaging repositories.

A Genetic Risk Variant for Multiple Sclerosis Severity is Associated with Brain Atrophy

The minor allele of the genetic variant rs10191329 in the DYSF-ZNF638 locus is associated with unfavorable long-term clinical outcomes in multiple sclerosis patients. We investigated if rs10191329 is associated with brain atrophy measured by magnetic resonance imaging in a discovery cohort of 748 and a replication cohort of 360 people with relapsing multiple sclerosis. We observed an association with 28% more brain atrophy per rs10191329*A allele. Our results encourage stratification for rs10191329 in clinical trials. Unraveling the underlying mechanisms may enhance our understanding of pathophysiology and identify treatment targets. ANN NEUROL 2023;94:1080-1085.

Benefits of a mosaic approach for assessing cortical atrophy in individual multiple sclerosis patients

OBJECTIVE

Cortical gray matter (GM) atrophy plays a central role in multiple sclerosis (MS) pathology. However, it is not commonly assessed in clinical routine partly because a number of methodological problems hamper the development of a robust biomarker to quantify GM atrophy. In previous work, we have demonstrated the clinical utility of the "mosaic approach" (MAP) to assess individual GM atrophy in the motor neuron disease spectrum and frontotemporal dementia. In this study, we investigated the clinical utility of MAP in MS, comparing this novel biomarker to existing methods for computing GM atrophy in single patients. We contrasted the strategies based on correlations with established biomarkers reflecting MS disease burden.

METHODS

We analyzed T1-weighted MPRAGE magnetic resonance imaging data from 465 relapsing-remitting MS patients and 89 healthy controls. We inspected how variations of existing strategies to estimate individual GM atrophy ("standard approaches") as well as variations of MAP (i.e., different parcellation schemes) impact downstream analysis results, both on a group and an individual level. We interpreted individual cortical disease burden as single metric reflecting the fraction of significantly atrophic data points with respect to the control group. In addition, we evaluated the correlations to lesion volume (LV) and Expanded Disability Status Scale (EDSS).

RESULTS

We found that the MAP method yielded highest correlations with both LV and EDSS as compared to all other strategies. Although the parcellation resolution played a minor role in terms of absolute correlations with clinical variables, higher resolutions provided more clearly defined statistical brain maps which may facilitate clinical interpretability.

CONCLUSION

This study provides evidence that MAP yields high potential for a clinically relevant biomarker in MS, outperforming existing methods to compute cortical disease burden in single patients. Of note, MAP outputs brain maps illustrating individual cortical disease burden which can be directly interpreted in daily clinical routine.

Association of retinal vessel pathology and brain atrophy in relapsing-remitting multiple sclerosis

Background

Optical coherence tomography angiography (OCTA) allows non-invasive assessment of retinal vessel structures. Thinning and loss of retinal vessels is evident in eyes of patients with multiple sclerosis (MS) and might be associated with a proinflammatory disease phenotype and worse prognosis. We investigated whether changes of the retinal vasculature are linked to brain atrophy and disability in MS.

Material and methods

This study includes one longitudinal observational cohort (n=79) of patients with relapsing-remitting MS. Patients underwent annual assessment of the expanded disability status scale (EDSS), timed 25-foot walk, symbol digit modalities test (SDMT), retinal optical coherence tomography (OCT), OCTA, and brain MRI during a follow-up duration of at least 20 months. We investigated intra-individual associations between changes in the retinal architecture, vasculature, brain atrophy and disability. Eyes with a history of optic neuritis (ON) were excluded.

Results

We included 79 patients with a median disease duration of 12 (interquartile range 2 - 49) months and a median EDSS of 1.0 (0 - 2.0). Longitudinal retinal axonal and ganglion cell loss were linked to grey matter atrophy, cortical atrophy, and volume loss of the putamen. We observed an association between vessel loss of the superficial vascular complex (SVC) and both grey and white matter atrophy. Both observations were independent of retinal ganglion cell loss. Moreover, patients with worsening of the EDSS and SDMT revealed a pronounced longitudinal rarefication of the SVC and the deep vascular complex.

Discussion

ON-independent narrowing of the retinal vasculature might be linked to brain atrophy and disability in MS. Our findings suggest that retinal OCTA might be a new tool for monitoring neurodegeneration during MS.

18F-FET PET radiomics-based survival prediction in glioblastoma patients receiving radio(chemo)therapy

Background

Quantitative image analysis based on radiomic feature extraction is an emerging field for survival prediction in oncological patients. 18F-Fluorethyltyrosine positron emission tomography (18F-FET PET) provides important diagnostic and grading information for brain tumors, but data on its use in survival prediction is scarce. In this study, we aim at investigating survival prediction based on multiple radiomic features in glioblastoma patients undergoing radio(chemo)therapy.

Methods

A dataset of 37 patients with glioblastoma (WHO grade 4) receiving radio(chemo)therapy was analyzed. Radiomic features were extracted from pre-treatment 18F-FET PET images, following intensity rebinning with a fixed bin width. Principal component analysis (PCA) was applied for variable selection, aiming at the identification of the most relevant features in survival prediction. Random forest classification and prediction algorithms were optimized on an initial set of 25 patients. Testing of the implemented algorithms was carried out in different scenarios, which included additional 12 patients whose images were acquired with a different scanner to check the reproducibility in prediction results.

Results

First order intensity variations and shape features were predominant in the selection of most important radiomic signatures for survival prediction in the available dataset. The major axis length of the 18F-FET-PET volume at tumor to background ratio (TBR) 1.4 and 1.6 correlated significantly with reduced probability of survival. Additional radiomic features were identified as potential survival predictors in the PTV region, showing 76% accuracy in independent testing for both classification and regression.

Conclusions

18F-FET PET prior to radiation provides relevant information for survival prediction in glioblastoma patients. Based on our preliminary analysis, radiomic features in the PTV can be considered a robust dataset for survival prediction.