Technical and clinical validation of commercial automated volumetric MRI tools for dementia diagnosis-a systematic review

The use of an anterior-posterior atrophy index to distinguish Alzheimer's disease from frontotemporal disorders: an automated volumetric MRI Study

BACKGROUND

Alzheimer's disease (AD) and frontotemporal dementia (FTD) require different treatments. Since clinical presentation can be nuanced, imaging biomarkers aid in diagnosis. Automated software such as Neuroreader (NR) provides volumetric imaging data, and indices between anterior and posterior brain areas have proven useful in distinguishing dementia subtypes in research cohorts. Existing indices are complex and require further validation in clinical settings.

PURPOSE

To provide initial validation for a simplified anterior-posterior index (API) from NR in distinguishing FTD and AD in a clinical cohort.

MATERIAL AND METHODS

A retrospective chart review was completed. We derived a simplified API: API = (logVA/VP-μ)/σ where V A is weighted volume of frontal and temporal lobes and V P of parietal and occipital lobes. μ and σ are the mean and standard deviation of logVA/VP computed for AD participants. Receiver operating characteristic (ROC) curves and regression analyses assessed the efficacy of the API versus brain areas in predicting diagnosis of AD versus FTD.

RESULTS

A total of 39 participants with FTD and 78 participants with AD were included. The API had an excellent performance in distinguishing AD from FTD with an area under the ROC curve of 0.82 and a positive association with diagnostic classification on logistic regression analysis (B = 1.491, P < 0.001).

CONCLUSION

The API successfully distinguished AD and FTD with excellent performance. The results provide preliminary validation of the API in a clinical setting.

A deep learning model for brain segmentation across pediatric and adult populations

Automated quantification of brain tissues on MR images has greatly contributed to the diagnosis and follow-up of neurological pathologies across various life stages. However, existing solutions are specifically designed for certain age ranges, limiting their applicability in monitoring brain development from infancy to late adulthood. This retrospective study aims to develop and validate a brain segmentation model across pediatric and adult populations. First, we trained a deep learning model to segment tissues and brain structures using T1-weighted MR images from 390 patients (age range: 2-81 years) across four different datasets. Subsequently, the model was validated on a cohort of 280 patients from six distinct test datasets (age range: 4-90 years). In the initial experiment, the proposed deep learning-based pipeline, icobrain-dl, demonstrated segmentation accuracy comparable to both pediatric and adult-specific models across diverse age groups. Subsequently, we evaluated intra- and inter-scanner variability in measurements of various tissues and structures in both pediatric and adult populations computed by icobrain-dl. Results demonstrated significantly higher reproducibility compared to similar brain quantification tools, including childmetrix, FastSurfer, and the medical device icobrain v5.9 (p-value< 0.01). Finally, we explored the potential clinical applications of icobrain-dl measurements in diagnosing pediatric patients with Cerebral Visual Impairment and adult patients with Alzheimer's Disease.

Removing outliers from the normative database improves regional atrophy detection in single-subject voxel-based morphometry

PURPOSE

Single-subject voxel-based morphometry (VBM) compares an individual T1-weighted MRI to a sample of normal MRI in a normative database (NDB) to detect regional atrophy. Outliers in the NDB might result in reduced sensitivity of VBM. The primary aim of the current study was to propose a method for outlier removal ("NDB cleaning") and to test its impact on the performance of VBM for detection of Alzheimer's disease (AD) and frontotemporal lobar degeneration (FTLD).

METHODS

T1-weighted MRI of 81 patients with biomarker-confirmed AD (n = 51) or FTLD (n = 30) and 37 healthy subjects with simultaneous FDG-PET/MRI were included as test dataset. Two different NDBs were used: a scanner-specific NDB (37 healthy controls from the test dataset) and a non-scanner-specific NDB comprising 164 normal T1-weighted MRI from 164 different MRI scanners. Three different quality metrics based on leave-one-out testing of the scans in the NDB were implemented. A scan was removed if it was an outlier with respect to one or more quality metrics. VBM maps generated with and without NDB cleaning were assessed visually for the presence of AD or FTLD.

RESULTS

Specificity of visual interpretation of the VBM maps for detection of AD or FTLD was 100% in all settings. Sensitivity was increased by NDB cleaning with both NDBs. The effect was statistically significant for the multiple-scanner NDB (from 0.47 [95%-CI 0.36-0.58] to 0.61 [0.49-0.71]).

CONCLUSION

NDB cleaning has the potential to improve the sensitivity of VBM for the detection of AD or FTLD without increasing the risk of false positive findings.

Towards validation in clinical routine: a comparative analysis of visual MTA ratings versus the automated ratio between inferior lateral ventricle and hippocampal volumes in Alzheimer's disease diagnosis

PURPOSE

To assess the performance of the inferior lateral ventricle (ILV) to hippocampal (Hip) volume ratio on brain MRI, for Alzheimer's disease (AD) diagnostics, comparing it to individual automated ILV and hippocampal volumes, and visual medial temporal lobe atrophy (MTA) consensus ratings.

METHODS

One-hundred-twelve subjects (mean age ± SD, 66.85 ± 13.64 years) with varying degrees of cognitive decline underwent MRI using a Philips Ingenia 3T. The MTA scale by Scheltens, rated on coronal 3D T1-weighted images, was determined by three experienced radiologists, blinded to diagnosis and sex. Automated volumetry was computed by icobrain dm (v. 5.10) for total, left, right hippocampal, and ILV volumes. The ILV/Hip ratio, defined as the percentage ratio between ILV and hippocampal volumes, was calculated and compared against a normative reference population (n = 1903). Inter-rater agreement, association, classification accuracy, and clinical interpretability on patient level were reported.

RESULTS

Visual MTA scores showed excellent inter-rater agreement. Ordinal logistic regression and correlation analyses demonstrated robust associations between automated brain segmentations and visual MTA ratings, with the ILV/Hip ratio consistently outperforming individual hippocampal and ILV volumes. Pairwise classification accuracy showed good performance without statistically significant differences between the ILV/Hip ratio and visual MTA across disease stages, indicating potential interchangeability. Comparison to the normative population and clinical interpretability assessments showed commensurability in classifying MTA "severity" between visual MTA and ILV/Hip ratio measurements.

CONCLUSION

The ILV/Hip ratio shows the highest correlation to visual MTA, in comparison to automated individual ILV and hippocampal volumes, offering standardized measures for diagnostic support in different stages of cognitive decline.

Growing importance of brain morphometry analysis in the clinical routine: The hidden impact of MR sequence parameters

Volumetric assessment based on structural MRI is increasingly recognized as an auxiliary tool to visual reading, also in examinations acquired in the clinical routine. However, MRI acquisition parameters can significantly influence these measures, which must be considered when interpreting the results on an individual patient level. This Technical Note shall demonstrate the problem. Using data from a dedicated experiment, we show the influence of two crucial sequence parameters on the GM/WM contrast and their impact on the measured volumes. A simulated contrast derived from acquisition parameters TI/TR may serve as surrogate and is highly correlated (r=0.96) with the measured contrast.

Normal cohorts in automated brain atrophy estimation: how many healthy subjects to include?

OBJECTIVES

This study investigates the influence of normal cohort (NC) size and the impact of different NCs on automated MRI-based brain atrophy estimation.

METHODS

A pooled NC of 3945 subjects (NCpool) was retrospectively created from five publicly available cohorts. Voxel-wise gray matter volume atrophy maps were calculated for 48 Alzheimer's disease (AD) patients (55-82 years) using veganbagel and dynamic normal templates with an increasing number of healthy subjects randomly drawn from NCpool (initially three, and finally 100 subjects). Over 100 repeats of the process, the mean over a voxel-wise standard deviation of gray matter z-scores was established and plotted against the number of subjects in the templates. The knee point of these curves was defined as the minimum number of subjects required for consistent brain atrophy estimation. Atrophy maps were calculated using each NC for AD patients and matched healthy controls (HC). Two readers rated the extent of mesiotemporal atrophy to discriminate AD/HC.

RESULTS

The maximum knee point was at 15 subjects. For 21 AD/21 HC, a sufficient number of subjects were available in each NC for validation. Readers agreed on the AD diagnosis in all cases (Kappa for the extent of atrophy, 0.98). No differences in diagnoses between NCs were observed (intraclass correlation coefficient, 0.91; Cochran's Q, p = 0.19).

CONCLUSION

At least 15 subjects should be included in age- and sex-specific normal templates for consistent brain atrophy estimation. In the study's context, qualitative interpretation of regional atrophy allows reliable AD diagnosis with a high inter-reader agreement, irrespective of the NC used.

CLINICAL RELEVANCE STATEMENT

The influence of normal cohorts (NCs) on automated brain atrophy estimation, typically comparing individual scans to NCs, remains largely unexplored. Our study establishes the minimum number of NC-subjects needed and demonstrates minimal impact of different NCs on regional atrophy estimation.

KEY POINTS

• Software-based brain atrophy estimation often relies on normal cohorts for comparisons. • At least 15 subjects must be included in an age- and sex-specific normal cohort. • Using different normal cohorts does not influence regional atrophy estimation.

Comparison of Quantitative Hippocampal Volumes and Structured Scoring Scales in Predicting Alzheimer Disease Diagnosis

BACKGROUND AND PURPOSE

Brain imaging plays an important role in investigating patients with cognitive decline and ruling out secondary causes of dementia. This study compares the diagnostic value of quantitative hippocampal volumes derived from automated volumetric software and structured scoring scales in differentiating Alzheimer disease, mild cognitive impairment, and subjective cognitive decline.

MATERIALS AND METHODS

Retrospectively, we reviewed images and medical records of adult patients who underwent MR imaging with a dementia protocol (2018-2021). Patients with postscanning diagnoses of Alzheimer disease, mild cognitive impairment, and subjective cognitive decline based on the International Statistical Classification of Diseases and Related Health Problems, 10th revision, were included. Diagnostic performances of automated normalized total hippocampal volume and structured manually assigned medial temporal atrophy and entorhinal cortical atrophy scores were assessed using multivariate logistic regression and receiver operating characteristic curve analysis.

RESULTS

We evaluated 328 patients (Alzheimer disease, n = 118; mild cognitive impairment, n = 172; subjective cognitive decline, n = 38). Patients with Alzheimer disease had lower normalized total hippocampal volume (median, 0.35%), higher medial temporal atrophy (median, 3), and higher entorhinal cortical atrophy (median, 2) scores than those with subjective cognitive decline (P < .001) and mild cognitive impairment (P < .001). For discriminating Alzheimer disease from subjective cognitive decline, an entorhinal cortical atrophy cutoff value of 2 had a higher specificity (87%) compared with normalized total hippocampal volume (74%) and medial temporal atrophy (66%), but a lower sensitivity (69%) than normalized total hippocampal volume (84%) and medial temporal atrophy (84%). In discriminating Alzheimer disease from mild cognitive impairment, an entorhinal cortical atrophy cutoff value of 3 had a specificity (66%), similar to that of normalized total hippocampal volume (67%) but higher than medial temporal atrophy (54%), and its sensitivity (69%) was also similar to that of normalized total hippocampal volume (71%) but lower than that of medial temporal atrophy (84%).

CONCLUSIONS

Entorhinal cortical atrophy and medial temporal atrophy may be useful adjuncts in discriminating Alzheimer disease from subjective cognitive decline, with reduced cost and implementation challenges compared with automated volumetric software.

From basic sciences and engineering to epileptology: A translational approach

Collaborative efforts between basic scientists, engineers, and clinicians are enabling translational epileptology. In this article, we summarize the recent advances presented at the International Conference for Technology and Analysis of Seizures (ICTALS 2022): (1) novel developments of structural magnetic resonance imaging; (2) latest electroencephalography signal-processing applications; (3) big data for the development of clinical tools; (4) the emerging field of hyperdimensional computing; (5) the new generation of artificial intelligence (AI)-enabled neuroprostheses; and (6) the use of collaborative platforms to facilitate epilepsy research translation. We highlight the promise of AI reported in recent investigations and the need for multicenter data-sharing initiatives.

Challenges of implementing computer-aided diagnostic models for neuroimages in a clinical setting

Advances in artificial intelligence have cultivated a strong interest in developing and validating the clinical utilities of computer-aided diagnostic models. Machine learning for diagnostic neuroimaging has often been applied to detect psychological and neurological disorders, typically on small-scale datasets or data collected in a research setting. With the collection and collation of an ever-growing number of public datasets that researchers can freely access, much work has been done in adapting machine learning models to classify these neuroimages by diseases such as Alzheimer's, ADHD, autism, bipolar disorder, and so on. These studies often come with the promise of being implemented clinically, but despite intense interest in this topic in the laboratory, limited progress has been made in clinical implementation. In this review, we analyze challenges specific to the clinical implementation of diagnostic AI models for neuroimaging data, looking at the differences between laboratory and clinical settings, the inherent limitations of diagnostic AI, and the different incentives and skill sets between research institutions, technology companies, and hospitals. These complexities need to be recognized in the translation of diagnostic AI for neuroimaging from the laboratory to the clinic.

Software compatibility analysis for quantitative measures of [18F]flutemetamol amyloid PET burden in mild cognitive impairment

RATIONALE

Amyloid-β (Aβ) pathology is one of the earliest detectable brain changes in Alzheimer's disease pathogenesis. In clinical practice, trained readers will visually categorise positron emission tomography (PET) scans as either Aβ positive or negative. However, adjunct quantitative analysis is becoming more widely available, where regulatory approved software can currently generate metrics such as standardised uptake value ratios (SUVr) and individual Z-scores. Therefore, it is of direct value to the imaging community to assess the compatibility of commercially available software packages. In this collaborative project, the compatibility of amyloid PET quantification was investigated across four regulatory approved software packages. In doing so, the intention is to increase visibility and understanding of clinically relevant quantitative methods.

METHODS

Composite SUVr using the pons as the reference region was generated from [¹⁸F]flutemetamol (GE Healthcare) PET in a retrospective cohort of 80 amnestic mild cognitive impairment (aMCI) patients (40 each male/female; mean age = 73 years, SD = 8.52). Based on previous autopsy validation work, an Aβ positivity threshold of ≥ 0.6 SUVr_pons was applied. Quantitative results from MIM Software's MIMneuro, Syntermed's NeuroQ, Hermes Medical Solutions' BRASS and GE Healthcare's CortexID were analysed using intraclass correlation coefficient (ICC), percentage agreement around the Aβ positivity threshold and kappa scores.

RESULTS

Using an Aβ positivity threshold of ≥ 0.6 SUVr_pons, 95% agreement was achieved across the four software packages. Two patients were narrowly classed as Aβ negative by one software package but positive by the others, and two patients vice versa. All kappa scores around the same Aβ positivity threshold, both combined (Fleiss') and individual software pairings (Cohen's), were ≥ 0.9 signifying "almost perfect" inter-rater reliability. Excellent reliability was found between composite SUVr measurements for all four software packages, with an average measure ICC of 0.97 and 95% confidence interval of 0.957-0.979. Correlation coefficient analysis between the two software packages reporting composite z-scores was strong (r² = 0.98).

CONCLUSION

Using an optimised cortical mask, regulatory approved software packages provided highly correlated and reliable quantification of [¹⁸F]flutemetamol amyloid PET with a ≥ 0.6 SUVr_pons positivity threshold. In particular, this work could be of interest to physicians performing routine clinical imaging rather than researchers performing more bespoke image analysis. Similar analysis is encouraged using other reference regions as well as the Centiloid scale, when it has been implemented by more software packages.

Development and validation of deep learning-based automatic brain segmentation for East Asians: A comparison with Freesurfer

Purpose

To develop and validate deep learning-based automatic brain segmentation for East Asians with comparison to data for healthy controls from Freesurfer based on a ground truth.

Methods

A total of 30 healthy participants were enrolled and underwent T1-weighted magnetic resonance imaging (MRI) using a 3-tesla MRI system. Our Neuro I software was developed based on a three-dimensional convolutional neural networks (CNNs)-based, deep-learning algorithm, which was trained using data for 776 healthy Koreans with normal cognition. Dice coefficient (D) was calculated for each brain segment and compared with control data by paired t-test. The inter-method reliability was assessed by intraclass correlation coefficient (ICC) and effect size. Pearson correlation analysis was applied to assess the relationship between D values for each method and participant ages.

Results

The D values obtained from Freesurfer (ver6.0) were significantly lower than those from Neuro I. The histogram of the Freesurfer results showed remarkable differences in the distribution of D values from Neuro I. Overall, D values obtained by Freesurfer and Neuro I showed positive correlations, but the slopes and intercepts were significantly different. It was showed the largest effect sizes ranged 1.07-3.22, and ICC also showed significantly poor to moderate correlations between the two methods (0.498 ≤ ICC ≤ 0.688). For Neuro I, D values resulted in reduced residuals when fitting data to a line of best fit, and indicated consistent values corresponding to each age, even in young and older adults.

Conclusion

Freesurfer and Neuro I were not equivalent when compared to a ground truth, where Neuro I exhibited higher performance. We suggest that Neuro I is a useful alternative for the assessment of the brain volume.

Validity Assessment of an Automated Brain Morphometry Tool for Patients with De Novo Memory Symptoms

BACKGROUND AND PURPOSE

Automated volumetric analysis of structural MR imaging allows quantitative assessment of brain atrophy in neurodegenerative disorders. We compared the brain segmentation performance of the AI-Rad Companion brain MR imaging software against an in-house FreeSurfer 7.1.1/Individual Longitudinal Participant pipeline.

MATERIALS AND METHODS

T1-weighted images of 45 participants with de novo memory symptoms were selected from the OASIS-4 database and analyzed through the AI-Rad Companion brain MR imaging tool and the FreeSurfer 7.1.1/Individual Longitudinal Participant pipeline. Correlation, agreement, and consistency between the 2 tools were compared among the absolute, normalized, and standardized volumes. Final reports generated by each tool were used to compare the rates of detection of abnormality and the compatibility of radiologic impressions made using each tool, compared with the clinical diagnoses.

RESULTS

We observed strong correlation, moderate consistency, and poor agreement between absolute volumes of the main cortical lobes and subcortical structures measured by the AI-Rad Companion brain MR imaging tool compared with FreeSurfer. The strength of the correlations increased after normalizing the measurements to the total intracranial volume. Standardized measurements differed significantly between the 2 tools, likely owing to differences in the normative data sets used to calibrate each tool. When considering the FreeSurfer 7.1.1/Individual Longitudinal Participant pipeline as a reference standard, the AI-Rad Companion brain MR imaging tool had a specificity of 90.6%-100% and a sensitivity of 64.3%-100% in detecting volumetric abnormalities. There was no difference between the rate of compatibility of radiologic and clinical impressions when using the 2 tools.

CONCLUSIONS

The AI-Rad Companion brain MR imaging tool reliably detects atrophy in cortical and subcortical regions implicated in the differential diagnosis of dementia.

Handgrip Strength Is Related to Hippocampal and Lobar Brain Volumes in a Cohort of Cognitively Impaired Older Adults with Confirmed Amyloid Burden

BACKGROUND

Strength and mobility are essential for activities of daily living. With aging, weaker handgrip strength, mobility, and asymmetry predict poorer cognition. We therefore sought to quantify the relationship between handgrip metrics and volumes quantified on brain magnetic resonance imaging (MRI).

OBJECTIVE

To model the relationships between handgrip strength, mobility, and MRI volumetry.

METHODS

We selected 38 participants with Alzheimer's disease dementia: biomarker evidence of amyloidosis and impaired cognition. Handgrip strength on dominant and non-dominant hands was measured with a hand dynamometer. Handgrip asymmetry was calculated. Two-minute walk test (2MWT) mobility evaluation was combined with handgrip strength to identify non-frail versus frail persons. Brain MRI volumes were quantified with Neuroreader. Multiple regression adjusting for age, sex, education, handedness, body mass index, and head size modeled handgrip strength, asymmetry and 2MWT with brain volumes. We modeled non-frail versus frail status relationships with brain structures by analysis of covariance.

RESULTS

Higher non-dominant handgrip strength was associated with larger volumes in the hippocampus (p = 0.02). Dominant handgrip strength was related to higher frontal lobe volumes (p = 0.02). Higher 2MWT scores were associated with larger hippocampal (p = 0.04), frontal (p = 0.01), temporal (p = 0.03), parietal (p = 0.009), and occipital lobe (p = 0.005) volumes. Frailty was associated with reduced frontal, temporal, and parietal lobe volumes.

CONCLUSION

Greater handgrip strength and mobility were related to larger hippocampal and lobar brain volumes. Interventions focused on improving handgrip strength and mobility may seek to include quantified brain volumes on MR imaging as endpoints.

Increased Resolution of Structural MRI at 3T Improves Estimation of Regional Cortical Degeneration in Individual Dementia Patients Using Surface Thickness Maps

BACKGROUND

Objective measurement of regional cortical atrophy in individual patients would be a highly desirable adjunct for diagnosis of degenerative dementias.

OBJECTIVE

We hypothesized that increasing the resolution of magnetic resonance scans would improve the sensitivity of cortical atrophy detection for individual patients.

METHODS

46 participants including 8 semantic-variant primary progressive aphasia (svPPA), seven posterior cortical atrophy (PCA), and 31 cognitively unimpaired participants underwent clinical assessment and 3.0T brain scans. SvPPA and PCA were chosen because there is overwhelming prior knowledge of the expected atrophy pattern. Two sets of T1-weighted images with 0.8 mm3 (HighRes) and conventional 1.0 mm3 (ConvRes) resolution were acquired. The cortical ribbon was segmented using FreeSurfer software to obtain surface-based thickness maps. Inter-sequence performance was assessed in terms of cortical thickness and sub-cortical volume reproducibility, signal-to-noise and contrast-to-noise ratios. For clinical cases, diagnostic effect size (Cohen's d) and lesion distribution (z-score and t-value maps) were compared between HighRes and ConvRes scans.

RESULTS

The HighRes scans produced higher image quality scores at 90 seconds extra scan time. The effect size of cortical thickness differences between patients and cognitively unimpaired participants was 15-20% larger for HighRes scans. HighRes scans showed more robust patterns of atrophy in expected regions in each and every individual patient.

CONCLUSIONS

HighRes T1-weighted scans showed superior precision for identifying the severity of cortical atrophy in individual patients, offering a proof-of-concept for clinical translation. Studying svPPA and PCA, two syndromes with well-defined focal atrophy patterns, offers a method to clinically validate and contrast automated algorithms.

Commercial volumetric MRI reporting tools in multiple sclerosis: a systematic review of the evidence

PURPOSE

MRI is integral to the diagnosis of multiple sclerosis (MS) and is important for clinical prognostication. Quantitative volumetric reporting tools (QReports) can improve the accuracy and objectivity of MRI-based assessments. Several QReports are commercially available; however, validation can be difficult to establish and does not currently follow a common pathway. To aid evidence-based clinical decision-making, we performed a systematic review of commercial QReports for use in MS including technical details and published reports of validation and in-use evaluation.

METHODS

We categorized studies into three types of testing: technical validation, for example, comparison to manual segmentation, clinical validation by clinicians or interpretation of results alongside clinician-rated variables, and in-use evaluation, such as health economic assessment.

RESULTS

We identified 10 companies, which provide MS lesion and brain segmentation and volume quantification, and 38 relevant publications. Tools received regulatory approval between 2006 and 2020, contextualize results to normative reference populations, ranging from 620 to 8000 subjects, and require T1- and T2-FLAIR-weighted input sequences for longitudinal assessment of whole-brain volume and lesions. In MS, six QReports provided evidence of technical validation, four companies have conducted clinical validation by correlating results with clinical variables, only one has tested their QReport by clinician end-users, and one has performed a simulated in-use socioeconomic evaluation.

CONCLUSION

We conclude that there is limited evidence in the literature regarding clinical validation and in-use evaluation of commercial MS QReports with a particular lack of clinician end-user testing. Our systematic review provides clinicians and institutions with the available evidence when considering adopting a quantitative reporting tool for MS.

Impact of normative brain volume reports on the diagnosis of neurodegenerative dementia disorders in neuroradiology: A real-world, clinical practice study

Background: Normative brain volume reports (NBVR) are becoming more available in the work-up of patients with suspected dementia disorders, potentially leveraging the value of structural MRI in clinical settings. The present study aims to investigate the impact of NBVRs on the diagnosis of neurodegenerative dementia disorders in real-world clinical practice.

Methods: We retrospectively analyzed data of 112 memory clinic patients, who were consecutively referred for MRI and 18F-fluorodeoxyglucose (FDG) positron emission tomography (PET) during a 12-month period. Structural MRI was assessed by two residents with 2 and 3 years of neuroimaging experience. Statements and diagnostic confidence regarding the presence of a neurodegenerative disorder in general (first level) and Alzheimer’s disease (AD) pattern in particular (second level) were recorded without and with NBVR information. FDG-PET served as the reference standard.

Results: Overall, despite a trend towards increased accuracy, the impact of NBVRs on diagnostic accuracy was low and non-significant. We found a significant drop of sensitivity (0.75–0.58; p < 0.001) and increase of specificity (0.62–0.85; p < 0.001) for rater 1 at identifying patients with neurodegenerative dementia disorders. Diagnostic confidence increased for rater 2 (p < 0.001).

Conclusions: Overall, NBVRs had a limited impact on diagnostic accuracy in real-world clinical practice. Potentially, NBVR might increase diagnostic specificity and confidence of neuroradiology residents. To this end, a well-defined framework for integration of NBVR in the diagnostic process and improved algorithms of NBVR generation are essential.

Quantification of amyloid PET for future clinical use: a state-of-the-art review

Amyloid-β (Aβ) pathology is one of the earliest detectable brain changes in Alzheimer's disease (AD) pathogenesis. The overall load and spatial distribution of brain Aβ can be determined in vivo using positron emission tomography (PET), for which three fluorine-18 labelled radiotracers have been approved for clinical use. In clinical practice, trained readers will categorise scans as either Aβ positive or negative, based on visual inspection. Diagnostic decisions are often based on these reads and patient selection for clinical trials is increasingly guided by amyloid status. However, tracer deposition in the grey matter as a function of amyloid load is an inherently continuous process, which is not sufficiently appreciated through binary cut-offs alone. State-of-the-art methods for amyloid PET quantification can generate tracer-independent measures of Aβ burden. Recent research has shown the ability of these quantitative measures to highlight pathological changes at the earliest stages of the AD continuum and generate more sensitive thresholds, as well as improving diagnostic confidence around established binary cut-offs. With the recent FDA approval of aducanumab and more candidate drugs on the horizon, early identification of amyloid burden using quantitative measures is critical for enrolling appropriate subjects to help establish the optimal window for therapeutic intervention and secondary prevention. In addition, quantitative amyloid measurements are used for treatment response monitoring in clinical trials. In clinical settings, large multi-centre studies have shown that amyloid PET results change both diagnosis and patient management and that quantification can accurately predict rates of cognitive decline. Whether these changes in management reflect an improvement in clinical outcomes is yet to be determined and further validation work is required to establish the utility of quantification for supporting treatment endpoint decisions. In this state-of-the-art review, several tools and measures available for amyloid PET quantification are summarised and discussed. Use of these methods is growing both clinically and in the research domain. Concurrently, there is a duty of care to the wider dementia community to increase visibility and understanding of these methods.

Practical methods for segmentation and calculation of brain volume and intracranial volume: a guide and comparison

BACKGROUND

Accurate segmentation and calculation of total brain volume (BV) and intracranial volume (ICV) (further-volumetry) may serve various clinical tasks and research studies in neuroscience. Manual segmentation is extremely time consuming. There is a relative lack of published broad recommendations and comparisons of tools for automated volumetry, especially for users without expertise in computer science, for settings with limited resources, and when neuroimaging quality is suboptimal due to clinical circumstances. Our objective is to decrease the barrier to entry for research and clinical groups to perform volumetric cranial imaging analysis using free and reliable software tools.

METHODS

Automated volumetry from computed tomography (CT)/magnetic resonance imaging (MRI) scans was accomplished using 3D Slicer (v. 4.11.0), FreeSurfer (v. 7.1.1), and volBrain (v. 1.0) in a cohort of 39 patients with ischemic middle cerebral artery territory brain infarcts in the acute stage. Visual inspection for accuracy was also performed. Statistical analysis included coefficient of determination (R2) and Bland-Altman (B-A) plots. A multifaceted comparison between 3D Slicer, FreeSurfer, and volBrain from practical user perspective was performed to compile a list of distinguishing features.

RESULTS

BV: FreeSurfer, 3D Slicer, and volBrain provide similar estimations when high quality T1-MRI scans with 1 mm slices (3D scans) are available, whereas 3 mm and thicker slices (2D scans) introduce a dispersion in results. ICV: the most accurate volumetry is provided by 3D Slicer using CT scans. volBrain uses T1-MRIs and also provides good results which agree with 3D Slicer. Both of these methods may be more trustworthy than T1 MRI-derived FreeSurfer calculations.

CONCLUSIONS

All three studied tools of automated intracranial and brain volumetry-3D Slicer, FreeSurfer, and volBrain-are free, reliable, require no complex programming, but still have certain limitations and significant differences. Based on our investigation findings, the readers should be able to select the right volumetry tool and neuroimaging study, and then follow provided step-by-step instructions to accomplish specific volumetry tasks.

Machine Learning Tools for Image-Based Glioma Grading and the Quality of Their Reporting: Challenges and Opportunities

Technological innovation has enabled the development of machine learning (ML) tools that aim to improve the practice of radiologists. In the last decade, ML applications to neuro-oncology have expanded significantly, with the pre-operative prediction of glioma grade using medical imaging as a specific area of interest. We introduce the subject of ML models for glioma grade prediction by remarking upon the models reported in the literature as well as by describing their characteristic developmental workflow and widely used classifier algorithms. The challenges facing these models-including data sources, external validation, and glioma grade classification methods -are highlighted. We also discuss the quality of how these models are reported, explore the present and future of reporting guidelines and risk of bias tools, and provide suggestions for the reporting of prospective works. Finally, this review offers insights into next steps that the field of ML glioma grade prediction can take to facilitate clinical implementation.

Validation of an automatic tool for the rapid measurement of brain atrophy and white matter hyperintensity: QyScore®

OBJECTIVES

QyScore® is an imaging analysis tool certified in Europe (CE marked) and the US (FDA cleared) for the automatic volumetry of grey and white matter (GM and WM respectively), hippocampus (HP), amygdala (AM), and white matter hyperintensity (WMH). Here we compare QyScore® performances with the consensus of expert neuroradiologists.

METHODS

Dice similarity coefficient (DSC) and the relative volume difference (RVD) for GM, WM volumes were calculated on 50 3DT1 images. DSC and the F1 metrics were calculated for WMH on 130 3DT1 and FLAIR images. For each index, we identified thresholds of reliability based on current literature review results. We hypothesized that DSC/F1 scores obtained using QyScore® markers would be higher than the threshold. In contrast, RVD scores would be lower. Regression analysis and Bland-Altman plots were obtained to evaluate QyScore® performance in comparison to the consensus of three expert neuroradiologists.

RESULTS

The lower bound of the DSC/F1 confidence intervals was higher than the threshold for the GM, WM, HP, AM, and WMH, and the higher bounds of the RVD confidence interval were below the threshold for the WM, GM, HP, and AM. QyScore®, compared with the consensus of three expert neuroradiologists, provides reliable performance for the automatic segmentation of the GM and WM volumes, and HP and AM volumes, as well as WMH volumes.

CONCLUSIONS

QyScore® represents a reliable medical device in comparison with the consensus of expert neuroradiologists. Therefore, QyScore® could be implemented in clinical trials and clinical routine to support the diagnosis and longitudinal monitoring of neurological diseases.

KEY POINTS

• QyScore® provides reliable automatic segmentation of brain structures in comparison with the consensus of three expert neuroradiologists. • QyScore® automatic segmentation could be performed on MRI images using different vendors and protocols of acquisition. In addition, the fast segmentation process saves time over manual and semi-automatic methods. • QyScore® could be implemented in clinical trials and clinical routine to support the diagnosis and longitudinal monitoring of neurological diseases.

Comparing two artificial intelligence software packages for normative brain volumetry in memory clinic imaging

Purpose

To compare two artificial intelligence software packages performing normative brain volumetry and explore whether they could differently impact dementia diagnostics in a clinical context.

Methods

Sixty patients (20 Alzheimer’s disease, 20 frontotemporal dementia, 20 mild cognitive impairment) and 20 controls were included retrospectively. One MRI per subject was processed by software packages from two proprietary manufacturers, producing two quantitative reports per subject. Two neuroradiologists assigned forced-choice diagnoses using only the normative volumetry data in these reports. They classified the volumetric profile as “normal,” or “abnormal”, and if “abnormal,” they specified the most likely dementia subtype. Differences between the packages’ clinical impact were assessed by comparing (1) agreement between diagnoses based on software output; (2) diagnostic accuracy, sensitivity, and specificity; and (3) diagnostic confidence. Quantitative outputs were also compared to provide context to any diagnostic differences.

Results

Diagnostic agreement between packages was moderate, for distinguishing normal and abnormal volumetry (K = .41–.43) and for specific diagnoses (K = .36–.38). However, each package yielded high inter-observer agreement when distinguishing normal and abnormal profiles (K = .73–.82). Accuracy, sensitivity, and specificity were not different between packages. Diagnostic confidence was different between packages for one rater. Whole brain intracranial volume output differed between software packages (10.73%, p < .001), and normative regional data interpreted for diagnosis correlated weakly to moderately (r_s = .12–.80).

Conclusion

Different artificial intelligence software packages for quantitative normative assessment of brain MRI can produce distinct effects at the level of clinical interpretation. Clinics should not assume that different packages are interchangeable, thus recommending internal evaluation of packages before adoption.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00234-022-02898-w.