Multicentre evaluation of the INTERPRET decision support system 2.0 for brain tumour classification

Clinical Decision Support Systems for Brain Tumour Diagnosis and Prognosis: A Systematic Review

CDSSs are being continuously developed and integrated into routine clinical practice as they assist clinicians and radiologists in dealing with an enormous amount of medical data, reduce clinical errors, and improve diagnostic capabilities. They assist detection, classification, and grading of brain tumours as well as alert physicians of treatment change plans. The aim of this systematic review is to identify various CDSSs that are used in brain tumour diagnosis and prognosis and rely on data captured by any imaging modality. Based on the 2020 preferred reporting items for systematic reviews and meta-analyses (PRISMA) protocol, the literature search was conducted in PubMed and Engineering Village Compendex databases. Different types of CDSSs identified through this review include Curiam BT, FASMA, MIROR, HealthAgents, and INTERPRET, among others. This review also examines various CDSS tool types, system features, techniques, accuracy, and outcomes, to provide the latest evidence available in the field of neuro-oncology. An overview of such CDSSs used to support clinical decision-making in the management and treatment of brain tumours, along with their benefits, challenges, and future perspectives has been provided. Although a CDSS improves diagnostic capabilities and healthcare delivery, there is lack of specific evidence to support these claims. The absence of empirical data slows down both user acceptance and evaluation of the actual impact of CDSS on brain tumour management. Instead of emphasizing the advantages of implementing CDSS, it is important to address its potential drawbacks and ethical implications. By doing so, it can promote the responsible use of CDSS and facilitate its faster adoption in clinical settings.

The role of artificial intelligence in paediatric neuroradiology

Imaging plays a fundamental role in the managing childhood neurologic, neurosurgical and neuro-oncological disease. Employing multi-parametric MRI techniques, such as spectroscopy and diffusion- and perfusion-weighted imaging, to the radiophenotyping of neuroradiologic conditions is becoming increasingly prevalent, particularly with radiogenomic analyses correlating imaging characteristics with molecular biomarkers of disease. However, integration into routine clinical practice remains elusive. With modern multi-parametric MRI now providing additional data beyond anatomy, informing on histology, biology and physiology, such metric-rich information can present as information overload to the treating radiologist and, as such, information relevant to an individual case can become lost. Artificial intelligence techniques are capable of modelling the vast radiologic, biological and clinical datasets that accompany childhood neurologic disease, such that this information can become incorporated in upfront prognostic modelling systems, with artificial intelligence techniques providing a plausible approach to this solution. This review examines machine learning approaches than can be used to underpin such artificial intelligence applications, with exemplars for each machine learning approach from the world literature. Then, within the specific use case of paediatric neuro-oncology, we examine the potential future contribution for such artificial intelligence machine learning techniques to offer solutions for patient care in the form of decision support systems, potentially enabling personalised medicine within this domain of paediatric radiologic practice.

Deep learning magnetic resonance spectroscopy fingerprints of brain tumours using quantum mechanically synthesised data

Metabolic fingerprints are valuable biomarkers for diseases that are associated with metabolic disorders. 1H magnetic resonance spectroscopy (MRS) is a unique noninvasive diagnostic tool that can depict the metabolic fingerprint based solely on the proton signal of different molecules present in the tissue. However, its performance is severely hindered by low SNR, field inhomogeneities and overlapping spectra of metabolites, which affect the quantification of metabolites. Consequently, MRS is rarely included in routine clinical protocols and has not been proven in multi-institutional trials. This work proposes an alternative approach, where instead of quantifying metabolites' concentration, deep learning (DL) is used to model the complex nonlinear relationship between diseases and their spectroscopic metabolic fingerprint (pattern). DL requires large training datasets, acquired (ideally) with the same protocol/scanner, which are very rarely available. To overcome this limitation, a novel method is proposed that can quantum mechanically synthesise MRS data for any scanner/acquisition protocol. The proposed methodology is applied to the challenging clinical problem of differentiating metastasis from glioblastoma brain tumours on data acquired across multiple institutions. DL algorithms were trained on the augmented synthetic spectra and tested on two independent datasets acquired by different scanners, achieving a receiver operating characteristic area under the curve of up to 0.96 and 0.97, respectively.

Review of Medical Decision Support and Machine-Learning Methods

Machine-learning methods can assist with the medical decision-making processes at the both the clinical and diagnostic levels. In this article, we first review historical milestones and specific applications of computer-based medical decision support tools in both veterinary and human medicine. Next, we take a mechanistic look at 3 archetypal learning algorithms—naive Bayes, decision trees, and neural network—commonly used to power these medical decision support tools. Last, we focus our discussion on the data sets used to train these algorithms and examine methods for validation, data representation, transformation, and feature selection. From this review, the reader should gain some appreciation for how these decision support tools have and can be used in medicine along with insight on their inner workings.

Evaluation of the INTERPRET decision-support system: can it improve the diagnostic value of magnetic resonance spectroscopy of the brain?

Purpose

We evaluated in a clinical setting the INTERPRET decision-support system (DSS), a software generated to aid in MRS analysis to achieve a specific diagnosis for brain lesions.

Methods

The material consisted of 100 examinations of focal intracranial lesions with confirmed diagnoses. MRS was obtained at 1.5 T using TE 20–30 ms. Data were processed with the LCModel for conventional analysis. The INTERPRET DSS 3.1. was used to obtain specific diagnoses. MRI and MRS were reviewed by one interpreter. DSS analysis was made by another interpreter, in 80 cases by two interpreters. The diagnoses were compared with the definitive diagnoses. For comparisons between DSS, conventional MRS analysis, and MRI, the diagnoses were categorised: high-grade tumour, low-grade tumour, non-neoplastic lesion.

Results

Interobserver agreement in choosing the diagnosis from the INTERPRET database was 75%. The diagnosis was correct in 38/100 cases, incorrect in 57 cases. No good match was found in 5/100 cases. The diagnostic category was correct with DSS/conventional MRS/MRI in 67/58/52 cases, indeterminate in 5/8/20 cases, incorrect in 28/34/28 cases. Results with DSS were not significantly better than with conventional MRS analysis. All definitive diagnoses did not exist in the INTERPRET database. In the 61 adult patients with the diagnosis included in the database, DSS/conventional MRS/MRI yielded a correct diagnosis category in 48/32/29 cases (DSS vs conventional MRS: p = 0.002, DSS vs MRI: p = 0.0004).

Conclusion

Use of the INTERPRET DSS did not improve MRS categorisation of the lesions in the unselected clinical cases. In adult patients with lesions existing in the INTERPRET database, DSS improved the results, which indicates the potential of this software with an extended database.

Electronic supplementary material

The online version of this article (10.1007/s00234-018-2129-7) contains supplementary material, which is available to authorized users.

Clinical applications of in vivo magnetic resonance spectroscopy in oncology

Magnetic resonance spectroscopy (MRS) can be performed in vivo using commercial MRI systems to obtain biochemical information about tissues and cancers. Applications in brain, prostate and breast aid lesion detection and characterisation (differential diagnosis), treatment planning and response assessment. Multi-centre clinical trials have been performed in all these tissues. Single centre studies have been performed in many other tissues including cervix, uterus, musculoskeletal and liver. While generally MRS is used to study endogenous metabolites it has also been used in drug studies, for example those that include 19F as part of their structure. Recently the hyperpolarisation of compounds enriched with 13C such as [1-13C] pyruvate has been demonstrated in animal models and now in preliminary clinical studies, permitting the monitoring of biochemical processes with unprecedented sensitivity. This review briefly introduces the underlying methods and then discusses the current status of these applications.

Classification of brain tumours from MR spectra: the INTERPRET collaboration and its outcomes

The INTERPRET project was a multicentre European collaboration, carried out from 2000 to 2002, which developed a decision-support system (DSS) for helping neuroradiologists with no experience of MRS to utilize spectroscopic data for the diagnosis and grading of human brain tumours. INTERPRET gathered a large collection of MR spectra of brain tumours and pseudo-tumoural lesions from seven centres. Consensus acquisition protocols, a standard processing pipeline and strict methods for quality control of the aquired data were put in place. Particular emphasis was placed on ensuring the diagnostic certainty of each case, for which all cases were evaluated by a clinical data validation committee. One outcome of the project is a database of 304 fully validated spectra from brain tumours, pseudotumoural lesions and normal brains, along with their associated images and clinical data, which remains available to the scientific and medical community. The second is the INTERPRET DSS, which has continued to be developed and clinically evaluated since the project ended. We also review here the results of the post-INTERPRET period. We evaluate the results of the studies with the INTERPRET database by other consortia or research groups. A summary of the clinical evaluations that have been performed on the post-INTERPRET DSS versions is also presented. Several have shown that diagnostic certainty can be improved for certain tumour types when the INTERPRET DSS is used in conjunction with conventional radiological image interpretation. About 30 papers concerned with the INTERPRET single-voxel dataset have so far been published. We discuss stengths and weaknesses of the DSS and the lessons learned. Finally we speculate on how the INTERPRET concept might be carried into the future.