Imaging biomarkers and radiomics in pediatric oncology: a view from the PRIMAGE (PRedictive In silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers) project

This review paper presents the practical development of imaging biomarkers in the scope of the PRIMAGE (PRedictive In silico Multiscale Analytics to support cancer personalized diaGnosis and prognosis, Empowered by imaging biomarkers) project, as a noninvasive and reliable way to improve the diagnosis and prognosis in pediatric oncology. The PRIMAGE project is a European multi-center research initiative that focuses on developing medical imaging-derived artificial intelligence (AI) solutions designed to enhance overall management and decision-making for two types of pediatric cancer: neuroblastoma and diffuse intrinsic pontine glioma. To allow this, the PRIMAGE project has created an open-cloud platform that combines imaging, clinical, and molecular data together with AI models developed from this data, creating a comprehensive decision support environment for clinicians managing patients with these two cancers. In order to achieve this, a standardized data processing and analysis workflow was implemented to generate robust and reliable predictions for different clinical endpoints. Magnetic resonance (MR) image harmonization and registration was performed as part of the workflow. Subsequently, an automated tool for the detection and segmentation of tumors was trained and internally validated. The Dice similarity coefficient obtained for the independent validation dataset was 0.997, indicating compatibility with the manual segmentation variability. Following this, radiomics and deep features were extracted and correlated with clinical endpoints. Finally, reproducible and relevant imaging quantitative features were integrated with clinical and molecular data to enrich both the predictive models and a set of visual analytics tools, making the PRIMAGE platform a complete clinical decision aid system. In order to ensure the advancement of research in this field and to foster engagement with the wider research community, the PRIMAGE data repository and platform are currently being integrated into the European Federation for Cancer Images (EUCAIM), which is the largest European cancer imaging research infrastructure created to date.

A deep learning-based application for COVID-19 diagnosis on CT: The Imaging COVID-19 AI initiative

BACKGROUND

Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19).

OBJECTIVES

To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity.

METHODS

The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected.

RESULTS

A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user.

CONCLUSION

We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.

Machine Learning Models and Multiparametric Magnetic Resonance Imaging for the Prediction of Pathologic Response to Neoadjuvant Chemotherapy in Breast Cancer

Simple Summary

Achieving pathological complete response (pCR) to neoadjuvant chemotherapy (NAC) in breast cancer (BC) is crucial, as pCR is a surrogate marker for survival. However, only 10–30% of patients achieve it. It is therefore essential to develop tools that enable to accurately predict response. Recently, different studies have demonstrated the feasibility of applying machine learning approaches to non-invasively predict pCR before NAC administration from magnetic resonance imaging (MRI) data. Some of those models are based on radiomics, an emerging field that allows the automated extraction of clinically relevant information from radiologic images. However, the research is still at an early stage and further data are needed. Here, we determine whether the combination of imaging data (radiomic features and perfusion/diffusion imaging biomarkers) extracted from multiparametric MRIs and clinical variables can improve pCR prediction to NAC compared to models only including imaging or clinical data, potentially avoiding unnecessary treatment and delays to surgery.

Abstract

Background: Most breast cancer (BC) patients fail to achieve pathological complete response (pCR) after neoadjuvant chemotherapy (NAC). The aim of this study was to evaluate whether imaging features (perfusion/diffusion imaging biomarkers + radiomic features) extracted from pre-treatment multiparametric (mp)MRIs were able to predict, alone or in combination with clinical data, pCR to NAC. Methods: Patients with stage II-III BC receiving NAC and undergoing breast mpMRI were retrospectively evaluated. Imaging features were extracted from mpMRIs performed before NAC. Three different machine learning models based on imaging features, clinical data or imaging features + clinical data were trained to predict pCR. Confusion matrices and performance metrics were obtained to assess model performance. Statistical analyses were conducted to evaluate differences between responders and non-responders. Results: Fifty-eight patients (median [range] age, 52 [45–58] years) were included, of whom 12 showed pCR. The combined model improved pCR prediction compared to clinical and imaging models, yielding 91.5% of accuracy with no false positive cases and only 17% false negative results. Changes in different parameters between responders and non-responders suggested a possible increase in vascularity and reduced tumour heterogeneity in patients with pCR, with the percentile 25th of time-to-peak (TTP), a classical perfusion parameter, being able to discriminate both groups in a 75% of the cases. Conclusions: A combination of mpMRI-derived imaging features and clinical variables was able to successfully predict pCR to NAC. Specific patient profiles according to tumour vascularity and heterogeneity might explain pCR differences, where TTP could emerge as a putative surrogate marker for pCR.