Radiomics with artificial intelligence for precision medicine in radiation therapy

Performance Comparison of 10 State-of-the-Art Machine Learning Algorithms for Outcome Prediction Modeling of Radiation-Induced Toxicity

Purpose

To evaluate the efficacy of prominent machine learning algorithms in predicting normal tissue complication probability using clinical data obtained from 2 distinct disease sites and to create a software tool that facilitates the automatic determination of the optimal algorithm to model any given labeled data set.

Methods and Materials

We obtained 3 sets of radiation toxicity data (478 patients) from our clinic: gastrointestinal toxicity, radiation pneumonitis, and radiation esophagitis. These data comprised clinicopathological and dosimetric information for patients diagnosed with non-small cell lung cancer and anal squamous cell carcinoma. Each data set was modeled using 11 commonly employed machine learning algorithms (elastic net, least absolute shrinkage and selection operator [LASSO], random forest, random forest regression, support vector machine, extreme gradient boosting, light gradient boosting machine, k-nearest neighbors, neural network, Bayesian-LASSO, and Bayesian neural network) by randomly dividing the data set into a training and test set. The training set was used to create and tune the model, and the test set served to assess it by calculating performance metrics. This process was repeated 100 times by each algorithm for each data set. Figures were generated to visually compare the performance of the algorithms. A graphical user interface was developed to automate this whole process.

Results

LASSO achieved the highest area under the precision-recall curve (0.807 ± 0.067) for radiation esophagitis, random forest for gastrointestinal toxicity (0.726 ± 0.096), and the neural network for radiation pneumonitis (0.878 ± 0.060). The area under the curve was 0.754 ± 0.069, 0.889 ± 0.043, and 0.905 ± 0.045, respectively. The graphical user interface was used to compare all algorithms for each data set automatically. When averaging the area under the precision-recall curve across all toxicities, Bayesian-LASSO was the best model.

Conclusions

Our results show that there is no best algorithm for all data sets. Therefore, it is important to compare multiple algorithms when training an outcome prediction model on a new data set. The graphical user interface created for this study automatically compares the performance of these 11 algorithms for any data set.

Artificial intelligence application in the diagnosis and treatment of bladder cancer: advance, challenges, and opportunities

Bladder cancer (BC) is a serious and common malignant tumor of the urinary system. Accurate and convenient diagnosis and treatment of BC is a major challenge for the medical community. Due to the limited medical resources, the existing diagnosis and treatment protocols for BC without the assistance of artificial intelligence (AI) still have certain shortcomings. In recent years, with the development of AI technologies such as deep learning and machine learning, the maturity of AI has made it more and more applied to the medical field, including improving the speed and accuracy of BC diagnosis and providing more powerful treatment options and recommendations related to prognosis. Advances in medical imaging technology and molecular-level research have also contributed to the further development of such AI applications. However, due to differences in the sources of training information and algorithm design issues, there is still room for improvement in terms of accuracy and transparency for the broader use of AI in clinical practice. With the popularization of digitization of clinical information and the proposal of new algorithms, artificial intelligence is expected to learn more effectively and analyze similar cases more accurately and reliably, promoting the development of precision medicine, reducing resource consumption, and speeding up diagnosis and treatment. This review focuses on the application of artificial intelligence in the diagnosis and treatment of BC, points out some of the challenges it faces, and looks forward to its future development.

Prediction of lymphovascular invasion in invasive breast cancer based on clinical-MRI radiomics features

OBJECTIVE

We aim to develop a predictive model for lymphovascular invasion (LVI) in patients with invasive breast cancer (IBC), using magnetic resonance imaging (MRI)-based radiomics features.

METHODS

A total of 204 patients with IBC admitted to our hospital were included in this retrospective study. The data was split into training and validation sets at a 7:3 ratio. Feature normalization was conducted, followed by feature selection using ANOVA, correlation analysis, and LASSO in the training set. The final step involved building a logistic regression model. The LVI prediction models were established by single sequence image and combined different sequence images as follows: A: prediction model based on the optimal sequence in the 7-phase enhanced MRI scans; B: prediction model based on the optimal sequences in the sequences T1WI, T2WI, and DWI; and C: the combined model based on the optimal sequences selected from A and B. Subjects' work characteristic curves (ROC) and decision curves (DCA) were plotted to determine the extent to which they predicted LVI performance in the training and validation sets. Simultaneously, nomogram models were constructed by integrating radiomics features and independent risk factors. In addition, an additional 16 patients from the center between January and August 2024 were collected as the Nomogram external validation set. The ROC and DCA were used to evaluate the performance of the model.

RESULTS

In the enhanced images, Model A built based on the enhanced 2-phase achieved the best average AUC, with a validation set of 0.764. Model B built based on the T2WI had better results, with a validation set of 0.693. Model C built by combining enhanced 2-phase and T2WI sequences had a mean AUC of 0.705 in the validation set. In addition, the tumor size, whether the tumor boundary was clear or not, and whether there was a coelom in the tumor tissue had a statistically significant effect on the LVI of IBC, and a clinical-radiomics nomogram was established. DCAs as well as Nomogram also indicate that Model A has good clinical utility. The AUC of the nomogram in the training set, internal validation set, and external validation set were 0.703, 0.615, and 0.609, respectively. The DCA also showed that the radiomics nomogram combined with clinical factors had good predictive ability for LVI.

CONCLUSION

In IBC, MRI radiomics can serve as a noninvasive predictor of LVI. The clinical-MRI radiomics model, as an efficient visual prognostic tool, shows promise in forecasting LVI. This highlights the significant potential of pre-radiomics prediction in enhancing treatment strategies.

Role of Artificial intelligence model in prediction of low back pain using T2 weighted MRI of Lumbar spine

Background

Low back pain (LBP), the primary cause of disability, is the most common musculoskeletal disorder globally and the primary cause of disability. Magnetic resonance imaging (MRI) studies are inconclusive and less sensitive for identifying and classifying patients with LBP. Hence, this study aimed to investigate the role of artificial intelligence (AI) models in the prediction of LBP using T2 weighted MRI image of the lumbar spine.

Methods

This was a prospective case-control study. A total of 200 MRI patients (100 cases and controls each) referred for lumbar spine and whole spine screening were included. The scans were performed using 3.0 Tesla MRI (United Imaging Healthcare). T2 weighted images of the lumbar spine were segmented to extract radiomic features. Machine learning (ML) models, such as random forest, decision tree, logistic regression, K-nearest neighbors, adaboost, and deep learning methods (DL), such as ResNet and GoogleNet, were used, and performance measures were calculated.

Results

Our study showed that Random forest and AdaBoost are the most reliable ML models for predicting LBP. Random forest showed high performance with area under curve (AUC) values from 0.83 to 0.88 across all lumbar vertebrae and L2-L3, L3-L4, and L4-L5 intervertebral discs (IVDs), with AUCs of 0.88 the highest at L5-S1 IVD (0.92). Adaboost demonstrated high performance at the L2-L5 vertebrae with AUC values of 0.82 to 0.90, with the highest AUC (0.97) at the L5-S1 IVD. Among the DL models, GoogleNet outperformed the other models at 30 epochs with an accuracy of 0.85, followed by ResNet 18 (30 epochs) with an accuracy of 0.84.

Conclusion

The study demonstrated that ML and DL models can effectively predict LBP from MRI T2 weighted image of the lumbar spine. ML and DL models could also enhance the diagnostic accuracy of LBP, potentially leading to better patient management and outcomes.

Advancements in AI based healthcare techniques with FOCUS ON diagnostic techniques

Since the past decade, the interest towards more precise and efficient healthcare techniques with special emphasis on diagnostic techniques has increased. Artificial Intelligence has proved to be instrumental in development of various such techniques. The various types of AI like ML, NLP, RPA etc. are being used, which have streamlined and organised the Electronic Health Records (EHR) along with aiding the healthcare provider with decision making and sample and data analysis. This article also deals with the 3 major categories of diagnostic techniques - Imaging based, Pathology based and Preventive diagnostic techniques and what all changes and modifications were brought upon them, due to use of AI. Due to such a high demand, the investment in AI based healthcare techniques has increased substantially, with predicted market size of almost 188 billon USD by 2030. In India itself, AI in healthcare is expected to raise the GDP by 25 billion USD by 2028. But there are also several challenges associated with this like unavailability of quality data, black box issue etc. One of the major challenges is the ethical considerations and issues during use of medical records as it is a very sensitive document. Due to this, there is several trust issues associated with adoption of AI by many organizations. These challenges have also been discussed in this article. Need for further development in the AI based diagnostic techniques is also done in the article. Alongside, the production of such techniques and devices which are easy to use and simple to incorporate into the daily workflows have immense scope in the upcoming times. The increasing scope of Clinical Decision Support System, Telemedicine etc. make AI a promising field in the healthcare and diagnostics arena. Concluding the article, it can be said that despite the presence of various challenges to the implementation and usage, the future prospects for AI in healthcare is immense and work needs to be done in order to ensure the availability of resources for same so that high level of accuracy can be achieved and better health outcomes can be provided to patients. Ethical concerns need to be addressed for smooth implementation and to reduce the burden of the developers, which has been discussed in this narrative review article.

The Role of Artificial Intelligence on Tumor Boards: Perspectives from Surgeons, Medical Oncologists and Radiation Oncologists

The integration of multidisciplinary tumor boards (MTBs) is fundamental in delivering state-of-the-art cancer treatment, facilitating collaborative diagnosis and management by a diverse team of specialists. Despite the clear benefits in personalized patient care and improved outcomes, the increasing burden on MTBs due to rising cancer incidence and financial constraints necessitates innovative solutions. The advent of artificial intelligence (AI) in the medical field offers a promising avenue to support clinical decision-making. This review explores the perspectives of clinicians dedicated to the care of cancer patients-surgeons, medical oncologists, and radiation oncologists-on the application of AI within MTBs. Additionally, it examines the role of AI across various clinical specialties involved in cancer diagnosis and treatment. By analyzing both the potential and the challenges, this study underscores how AI can enhance multidisciplinary discussions and optimize treatment plans. The findings highlight the transformative role that AI may play in refining oncology care and sustaining the efficacy of MTBs amidst growing clinical demands.

Radiomics for clinical decision support in radiation oncology

Radiomics is a promising tool for the development of quantitative biomarkers to support clinical decision-making. It has been shown to improve the prediction of response to treatment and outcome in different settings, particularly in the field of radiation oncology by optimising the dose delivery solutions and reducing the rate of radiation-induced side effects, leading to a fully personalised approach. Despite the promising results offered by radiomics at each of these stages, standardised methodologies, reproducibility and interpretability of results are still lacking, limiting the potential clinical impact of these tools. In this review, we briefly describe the principles of radiomics and the most relevant applications of radiomics at each stage of cancer management in the framework of radiation oncology. Furthermore, the integration of radiomics into clinical decision support systems is analysed, defining the challenges and offering possible solutions for translating radiomics into a clinically applicable tool.

Predicting vertebral compression fracture prior to spinal SBRT using radiomics from planning CT

PURPOSE

The purpose of the study was to develop a predictive model for vertebral compression fracture (VCF) prior to spinal stereotactic body radiation therapy (SBRT) using radiomics features extracted from pre-treatment planning CT images.

METHODS

A retrospective analysis was conducted on 85 patients (114 spinal lesions) who underwent spinal SBRT. Radiomics features were extracted from pre-treatment planning CT images and used to develop a predictive model using a classification algorithm selected from nine different machine learning algorithms. Four different models were trained, including clinical features only, clinical and radiomics features, radiomics and dosimetric features, and all features. Model performance was evaluated using accuracy, precision, recall, F1-score, and area under the curve (AUC).

RESULTS

The model that used all features (radiomics, clinical, and dosimetric) showed the highest performance with an AUC of 0.871. The radiomics and dosimetric features model had the superior performance in terms of accuracy, precision, recall, and F1-score.

CONCLUSION

The developed predictive model based on radiomics features extracted from pre-treatment planning CT images can accurately predict the likelihood of VCF prior to spinal SBRT. This model has significant implications for treatment planning and preventive measures for patients undergoing spinal SBRT. Future research can focus on improving model performance by incorporating new data and external validation using independent data sets.

Applications of artificial intelligence for machine- and patient-specific quality assurance in radiation therapy: current status and future directions

Machine- and patient-specific quality assurance (QA) is essential to ensure the safety and accuracy of radiotherapy. QA methods have become complex, especially in high-precision radiotherapy such as intensity-modulated radiation therapy (IMRT) and volumetric modulated arc therapy (VMAT), and various recommendations have been reported by AAPM Task Groups. With the widespread use of IMRT and VMAT, there is an emerging demand for increased operational efficiency. Artificial intelligence (AI) technology is quickly growing in various fields owing to advancements in computers and technology. In the radiotherapy treatment process, AI has led to the development of various techniques for automated segmentation and planning, thereby significantly enhancing treatment efficiency. Many new applications using AI have been reported for machine- and patient-specific QA, such as predicting machine beam data or gamma passing rates for IMRT or VMAT plans. Additionally, these applied technologies are being developed for multicenter studies. In the current review article, AI application techniques in machine- and patient-specific QA have been organized and future directions are discussed. This review presents the learning process and the latest knowledge on machine- and patient-specific QA. Moreover, it contributes to the understanding of the current status and discusses the future directions of machine- and patient-specific QA.

A new era in the science and care of kidney diseases

Notable progress in basic, translational and clinical nephrology research has been made over the past five decades. Nonetheless, many challenges remain, including obstacles to the early detection of kidney disease, disparities in access to care and variability in responses to existing and emerging therapies. Innovations in drug development, research technologies, tissue engineering and regenerative medicine have the potential to improve patient outcomes. Exciting prospects include the availability of new drugs to slow or halt the progression of chronic kidney disease, the development of bioartificial kidneys that mimic healthy kidney functions, and tissue engineering techniques that could enable transplantable kidneys to be created from the cells of the recipient, removing the risk of rejection. Cell and gene therapies have the potential to be applied for kidney tissue regeneration and repair. In addition, about 30% of kidney disease cases are monogenic and could potentially be treated using these genetic medicine approaches. Systemic diseases that involve the kidney, such as diabetes mellitus and hypertension, might also be amenable to these treatments. Continued investment, communication, collaboration and translation of innovations are crucial to realize their full potential. In addition, increasing sophistication in exploring large datasets, implementation science, and qualitative methodologies will improve the ability to deliver transformational kidney health strategies.

A novel CT-based radiomics model for predicting response and prognosis of chemoradiotherapy in esophageal squamous cell carcinoma

No clinically relevant biomarker has been identified for predicting the response of esophageal squamous cell carcinoma (ESCC) to chemoradiotherapy (CRT). Herein, we established a CT-based radiomics model with artificial intelligence (AI) to predict the response and prognosis of CRT in ESCC. A total of 44 ESCC patients (stage I-IV) were enrolled in this study; training (n = 27) and validation (n = 17) cohorts. First, we extracted a total of 476 radiomics features from three-dimensional CT images of cancer lesions in training cohort, selected 110 features associated with the CRT response by ROC analysis (AUC ≥ 0.7) and identified 12 independent features, excluding correlated features by Pearson's correlation analysis (r ≥ 0.7). Based on the 12 features, we constructed 5 prediction models of different machine learning algorithms (Random Forest (RF), Ridge Regression, Naive Bayes, Support Vector Machine, and Artificial Neural Network models). Among those, the RF model showed the highest AUC in the training cohort (0.99 [95%CI 0.86-1.00]) as well as in the validation cohort (0.92 [95%CI 0.71-0.99]) to predict the CRT response. Additionally, Kaplan-Meyer analysis of the validation cohort and all the patient data showed significantly longer progression-free and overall survival in the high-prediction score group compared with the low-prediction score group in the RF model. Univariate and multivariate analyses revealed that the radiomics prediction score and lymph node metastasis were independent prognostic biomarkers for CRT of ESCC. In conclusion, we have developed a CT-based radiomics model using AI, which may have the potential to predict the CRT response as well as the prognosis for ESCC patients with non-invasiveness and cost-effectiveness.

Radiomics based predictive modeling of rectal toxicity in prostate cancer patients undergoing radiotherapy: CT and MRI comparison

BACKGROUND

Rectal toxicity is one of the common side effects after radiotherapy in prostate cancer patients. Radiomics is a non-invasive and low-cost method for developing models of predicting radiation toxicity that does not have the limitations of previous methods. These models have been developed using individual patients' information and have reliable and acceptable performance. This study was conducted by evaluating the radiomic features of computed tomography (CT) and magnetic resonance (MR) images and using machine learning (ML) methods to predict radiation-induced rectal toxicity.

METHODS

Seventy men with pathologically confirmed prostate cancer, eligible for three-dimensional radiation therapy (3DCRT) participated in this prospective trial. Rectal wall CT and MR images were used to extract first-order, shape-based, and textural features. The least absolute shrinkage and selection operator (LASSO) was used for feature selection. Classifiers such as Random Forest (RF), Decision Tree (DT), Logistic Regression (LR), and K-Nearest Neighbors (KNN) were used to create models based on radiomic, dosimetric, and clinical data alone or in combination. The area under the curve (AUC) of the receiver operating characteristic curve (ROC), accuracy, sensitivity, and specificity were used to assess each model's performance.

RESULTS

The best outcomes were achieved by the radiomic features of MR images in conjunction with clinical and dosimetric data, with a mean of AUC: 0.79, accuracy: 77.75%, specificity: 82.15%, and sensitivity: 67%.

CONCLUSIONS

This research showed that as radiomic signatures for predicting radiation-induced rectal toxicity, MR images outperform CT images.

Radiomics and machine learning analysis by computed tomography and magnetic resonance imaging in colorectal liver metastases prognostic assessment

OBJECTIVE

The aim of this study was the evaluation radiomics analysis efficacy performed using computed tomography (CT) and magnetic resonance imaging in the prediction of colorectal liver metastases patterns linked to patient prognosis: tumor growth front; grade; tumor budding; mucinous type. Moreover, the prediction of liver recurrence was also evaluated.

METHODS

The retrospective study included an internal and validation dataset; the first was composed by 119 liver metastases from 49 patients while the second consisted to 28 patients with single lesion. Radiomic features were extracted using PyRadiomics. Univariate and multivariate approaches including machine learning algorithms were employed.

RESULTS

The best predictor to identify tumor growth was the Wavelet_HLH_glcm_MaximumProbability with an accuracy of 84% and to detect recurrence the best predictor was wavelet_HLH_ngtdm_Complexity with an accuracy of 90%, both extracted by T1-weigthed arterial phase sequence. The best predictor to detect tumor budding was the wavelet_LLH_glcm_Imc1 with an accuracy of 88% and to identify mucinous type was wavelet_LLH_glcm_JointEntropy with an accuracy of 92%, both calculated on T2-weigthed sequence. An increase statistically significant of accuracy (90%) was obtained using a linear weighted combination of 15 predictors extracted by T2-weigthed images to detect tumor front growth. An increase statistically significant of accuracy at 93% was obtained using a linear weighted combination of 11 predictors by the T1-weigthed arterial phase sequence to classify tumor budding. An increase statistically significant of accuracy at 97% was obtained using a linear weighted combination of 16 predictors extracted on CT to detect recurrence. An increase statistically significant of accuracy was obtained in the tumor budding identification considering a K-nearest neighbors and the 11 significant features extracted T1-weigthed arterial phase sequence.

CONCLUSIONS

The results confirmed the Radiomics capacity to recognize clinical and histopathological prognostic features that should influence the choice of treatments in colorectal liver metastases patients to obtain a more personalized therapy.

Prognostic Assessment of Gastropancreatic Neuroendocrine Neoplasm: Prospects and Limits of Radiomics

Neuroendocrine neoplasms (NENs) are a group of lesions originating from cells of the diffuse neuroendocrine system. NENs may involve different sites, including the gastrointestinal tract (GEP-NENs). The incidence and prevalence of GEP-NENs has been constantly rising thanks to the increased diagnostic power of imaging and immuno-histochemistry. Despite the plethora of biochemical markers and imaging techniques, the prognosis and therapeutic choice in GEP-NENs still represents a challenge, mainly due to the great heterogeneity in terms of tumor lesions and clinical behavior. The concept that biomedical images contain information about tissue heterogeneity and pathological processes invisible to the human eye is now well established. From this substrate comes the idea of radiomics. Computational analysis has achieved promising results in several oncological settings, and the use of radiomics in different types of GEP-NENs is growing in the field of research, yet with conflicting results. The aim of this narrative review is to provide a comprehensive update on the role of radiomics on GEP-NEN management, focusing on the main clinical aspects analyzed by most existing reports: predicting tumor grade, distinguishing NET from other tumors, and prognosis assessment.

Patient Graph Deep Learning to Predict Breast Cancer Molecular Subtype

Breast cancer is a heterogeneous disease consisting of a diverse set of genomic mutations and clinical characteristics. The molecular subtypes of breast cancer are closely tied to prognosis and therapeutic treatment options. We investigate using deep graph learning on a collection of patient factors from multiple diagnostic disciplines to better represent breast cancer patient information and predict molecular subtype. Our method models breast cancer patient data into a multi-relational directed graph with extracted feature embeddings to directly represent patient information and diagnostic test results. We develop a radiographic image feature extraction pipeline to produce vector representation of breast cancer tumors in DCE-MRI and an autoencoder-based genomic variant embedding method to map variant assay results to a low-dimensional latent space. We leverage related-domain transfer learning to train and evaluate a Relational Graph Convolutional Network to predict the probabilities of molecular subtypes for individual breast cancer patient graphs. Our work found that utilizing information from multiple multimodal diagnostic disciplines improved the model's prediction results and produced more distinct learned feature representations for breast cancer patients. This research demonstrates the capabilities of graph neural networks and deep learning feature representation to perform multimodal data fusion and representation in the breast cancer domain.

A CT-based radiomics nomogram for differentiating ovarian cystadenomas and endometriotic cysts

AIM

To construct and validate a computed tomography (CT)-based radiomics nomogram integrating radiomics signature and clinical factors to distinguish ovarian cystadenomas and endometriotic cysts.

MATERIALS AND METHODS

A total of 287 patients with ovarian cystadenomas (n=196) or endometriotic cysts (n=91) were divided randomly into a training cohort (n=200) and a validation cohort (n=87). Radiomics features based on the portal venous phase of CT images were extracted by PyRadiomics. The least absolute shrinkage and selection operation regression was applied to select the significant features and develop the radiomics signature. A radiomics score (rad-score) was calculated. The clinical model was built by the significant clinical factors. Multivariate logistic regression analysis was employed to construct the radiomics nomogram based on significant clinical factors and rad-score. The diagnostic performances of the radiomics nomogram, radiomics signature, and clinical model were evaluated and compared in the training and validation cohorts. Diagnostic confusion matrices of these models were calculated for the validation cohort and compared with those of the radiologists.

RESULTS

Seventeen radiomics features from CT images were used to build the radiomics signature. The radiomics nomogram incorporating cancer antigen 125 (CA-125) level and rad-score showed the best performance in both the training and validation cohorts with AUCs of 0.925 (95% confidence interval [CI]: 0.885-0.965), and 0.942 (95% CI: 0.891-0.993), respectively. The accuracy of radiomics nomogram in the confusion matrix outperformed the radiologists.

CONCLUSIONS

The radiomics nomogram performed well for differentiating ovarian cystadenomas and endometriotic cysts, and may help in clinical decision-making process.

Ultrasonography-based radiomics and computer-aided diagnosis in thyroid nodule management: performance comparison and clinical strategy optimization

Objectives

To compare ultrasonography (US) feature-based radiomics and computer-aided diagnosis (CAD) models for predicting malignancy in thyroid nodules, and to evaluate their utility for thyroid nodule management.

Methods

This prospective study included 262 thyroid nodules obtained between January 2022 and June 2022. All nodules previously underwent standardized US image acquisition, and the nature of the nodules was confirmed by the pathological results. The CAD model exploited two vertical US images of the thyroid nodule to differentiate the lesions. The least absolute shrinkage and operator algorithm (LASSO) was applied to choose radiomics features with excellent predictive properties for building a radiomics model. Ultimately, the area under the receiver operating characteristic curve (AUC) and calibration curves were assessed to compare diagnostic performance between the models. DeLong's test was used to analyze the difference between groups. Both models were used to revise the American College of Radiology Thyroid Imaging Reporting and Data Systems (ACR TI-RADS) to provide biopsy recommendations, and their performance was compared with the original recommendations.

Results

Of the 262 thyroid nodules, 157 were malignant, and the remaining 105 were benign. The diagnostic performance of radiomics, CAD, and ACR TI-RADS models had an AUC of 0.915 (95% confidence interval (CI): 0.881-0.947), 0.814 (95% CI: 0.766-0.863), and 0.849 (95% CI: 0.804-0.894), respectively. DeLong's test showed a statistically significant between the AUC values of models (p < 0.05). Calibration curves showed good agreement in each model. When both models were applied to revise the ACR TI-RADS, our recommendations significantly improved the performance. The revised recommendations based on radiomics and CAD showed an increased sensitivity, accuracy, positive predictive value, and negative predictive value, and decreased unnecessary fine-needle aspiration rates. Furthermore, the radiomics model's improvement scale was more pronounced (33.3-16.7% vs. 33.3-9.7%).

Conclusion

The radiomics strategy and CAD system showed good diagnostic performance for discriminating thyroid nodules and could be used to optimize the ACR TI-RADS recommendation, which successfully reduces unnecessary biopsies, especially in the radiomics model.

Artificial Intelligence in CT and MR Imaging for Oncological Applications

Cancer care increasingly relies on imaging for patient management. The two most common cross-sectional imaging modalities in oncology are computed tomography (CT) and magnetic resonance imaging (MRI), which provide high-resolution anatomic and physiological imaging. Herewith is a summary of recent applications of rapidly advancing artificial intelligence (AI) in CT and MRI oncological imaging that addresses the benefits and challenges of the resultant opportunities with examples. Major challenges remain, such as how best to integrate AI developments into clinical radiology practice, the vigorous assessment of quantitative CT and MR imaging data accuracy, and reliability for clinical utility and research integrity in oncology. Such challenges necessitate an evaluation of the robustness of imaging biomarkers to be included in AI developments, a culture of data sharing, and the cooperation of knowledgeable academics with vendor scientists and companies operating in radiology and oncology fields. Herein, we will illustrate a few challenges and solutions of these efforts using novel methods for synthesizing different contrast modality images, auto-segmentation, and image reconstruction with examples from lung CT as well as abdome, pelvis, and head and neck MRI. The imaging community must embrace the need for quantitative CT and MRI metrics beyond lesion size measurement. AI methods for the extraction and longitudinal tracking of imaging metrics from registered lesions and understanding the tumor environment will be invaluable for interpreting disease status and treatment efficacy. This is an exciting time to work together to move the imaging field forward with narrow AI-specific tasks. New AI developments using CT and MRI datasets will be used to improve the personalized management of cancer patients.

3D Visualization, Skeletonization and Branching Analysis of Blood Vessels in Angiogenesis

Angiogenesis is the process of new blood vessels growing from existing vasculature. Visualizing them as a three-dimensional (3D) model is a challenging, yet relevant, task as it would be of great help to researchers, pathologists, and medical doctors. A branching analysis on the 3D model would further facilitate research and diagnostic purposes. In this paper, a pipeline of vision algorithms is elaborated to visualize and analyze blood vessels in 3D from formalin-fixed paraffin-embedded (FFPE) granulation tissue sections with two different staining methods. First, a U-net neural network is used to segment blood vessels from the tissues. Second, image registration is used to align the consecutive images. Coarse registration using an image-intensity optimization technique, followed by finetuning using a neural network based on Spatial Transformers, results in an excellent alignment of images. Lastly, the corresponding segmented masks depicting the blood vessels are aligned and interpolated using the results of the image registration, resulting in a visualized 3D model. Additionally, a skeletonization algorithm is used to analyze the branching characteristics of the 3D vascular model. In summary, computer vision and deep learning is used to reconstruct, visualize and analyze a 3D vascular model from a set of parallel tissue samples. Our technique opens innovative perspectives in the pathophysiological understanding of vascular morphogenesis under different pathophysiological conditions and its potential diagnostic role.

Colorectal liver metastases patients prognostic assessment: prospects and limits of radiomics and radiogenomics

In this narrative review, we reported un up-to-date on the role of radiomics to assess prognostic features, which can impact on the liver metastases patient treatment choice. In the liver metastases patients, the possibility to assess mutational status (RAS or MSI), the tumor growth pattern and the histological subtype (NOS or mucinous) allows a better treatment selection to avoid unnecessary therapies. However, today, the detection of these features require an invasive approach. Recently, radiomics analysis application has improved rapidly, with a consequent growing interest in the oncological field. Radiomics analysis allows the textural characteristics assessment, which are correlated to biological data. This approach is captivating since it should allow to extract biological data from the radiological images, without invasive approach, so that to reduce costs and time, avoiding any risk for the patients. Several studies showed the ability of Radiomics to identify mutational status, tumor growth pattern and histological type in colorectal liver metastases. Although, radiomics analysis in a non-invasive and repeatable way, however features as the poor standardization and generalization of clinical studies results limit the translation of this analysis into clinical practice. Clear limits are data-quality control, reproducibility, repeatability, generalizability of results, and issues related to model overfitting.

Post-Surgical Imaging Assessment in Rectal Cancer: Normal Findings and Complications

Rectal cancer (RC) is one of the deadliest malignancies worldwide. Surgery is the most common treatment for RC, performed in 63.2% of patients. The type of surgical approach chosen aims to achieve maximum residual function with the lowest risk of recurrence. The selection is made by a multidisciplinary team that assesses the characteristics of the patient and the tumor. Total mesorectal excision (TME), including both low anterior resection (LAR) and abdominoperineal resection (APR), is still the standard of care for RC. Radical surgery is burdened by a 31% rate of major complications (Clavien-Dindo grade 3-4), such as anastomotic leaks and a risk of a permanent stoma. In recent years, less-invasive techniques, such as local excision, have been tested. These additional procedures could mitigate the morbidity of rectal resection, while providing acceptable oncologic results. The "watch and wait" approach is not a globally accepted model of care but encouraging results on selected groups of patients make it a promising strategy. In this plethora of treatments, the radiologist is called upon to distinguish a physiological from a pathological postoperative finding. The aim of this narrative review is to identify the main post-surgical complications and the most effective imaging techniques.

Immunotherapy Assessment: A New Paradigm for Radiologists

Immunotherapy denotes an exemplar change in an oncological setting. Despite the effective application of these treatments across a broad range of tumors, only a minority of patients have beneficial effects. The efficacy of immunotherapy is affected by several factors, including human immunity, which is strongly correlated to genetic features, such as intra-tumor heterogeneity. Classic imaging assessment, based on computed tomography (CT) or magnetic resonance imaging (MRI), which is useful for conventional treatments, has a limited role in immunotherapy. The reason is due to different patterns of response and/or progression during this kind of treatment which differs from those seen during other treatments, such as the possibility to assess the wide spectrum of immunotherapy-correlated toxic effects (ir-AEs) as soon as possible. In addition, considering the unusual response patterns, the limits of conventional response criteria and the necessity of using related immune-response criteria are clear. Radiomics analysis is a recent field of great interest in a radiological setting and recently it has grown the idea that we could identify patients who will be fit for this treatment or who will develop ir-AEs.

Artificial Intelligence in Pharmaceutical and Healthcare Research

Artificial intelligence (AI) is a branch of computer science that allows machines to work efficiently, can analyze complex data. The research focused on AI has increased tremendously, and its role in healthcare service and research is emerging at a greater pace. This review elaborates on the opportunities and challenges of AI in healthcare and pharmaceutical research. The literature was collected from domains such as PubMed, Science Direct and Google scholar using specific keywords and phrases such as ‘Artificial intelligence’, ‘Pharmaceutical research’, ‘drug discovery’, ‘clinical trial’, ‘disease diagnosis’, etc. to select the research and review articles published within the last five years. The application of AI in disease diagnosis, digital therapy, personalized treatment, drug discovery and forecasting epidemics or pandemics was extensively reviewed in this article. Deep learning and neural networks are the most used AI technologies; Bayesian nonparametric models are the potential technologies for clinical trial design; natural language processing and wearable devices are used in patient identification and clinical trial monitoring. Deep learning and neural networks were applied in predicting the outbreak of seasonal influenza, Zika, Ebola, Tuberculosis and COVID-19. With the advancement of AI technologies, the scientific community may witness rapid and cost-effective healthcare and pharmaceutical research as well as provide improved service to the general public.

Risk Assessment and Pancreatic Cancer: Diagnostic Management and Artificial Intelligence

Pancreatic cancer (PC) is one of the deadliest cancers, and it is responsible for a number of deaths almost equal to its incidence. The high mortality rate is correlated with several explanations; the main one is the late disease stage at which the majority of patients are diagnosed. Since surgical resection has been recognised as the only curative treatment, a PC diagnosis at the initial stage is believed the main tool to improve survival. Therefore, patient stratification according to familial and genetic risk and the creation of screening protocol by using minimally invasive diagnostic tools would be appropriate. Pancreatic cystic neoplasms (PCNs) are subsets of lesions which deserve special management to avoid overtreatment. The current PC screening programs are based on the annual employment of magnetic resonance imaging with cholangiopancreatography sequences (MR/MRCP) and/or endoscopic ultrasonography (EUS). For patients unfit for MRI, computed tomography (CT) could be proposed, although CT results in lower detection rates, compared to MRI, for small lesions. The actual major limit is the incapacity to detect and characterize the pancreatic intraepithelial neoplasia (PanIN) by EUS and MR/MRCP. The possibility of utilizing artificial intelligence models to evaluate higher-risk patients could favour the diagnosis of these entities, although more data are needed to support the real utility of these applications in the field of screening. For these motives, it would be appropriate to realize screening programs in research settings.

A review of radiomics and genomics applications in cancers: the way towards precision medicine

The application of radiogenomics in oncology has great prospects in precision medicine. Radiogenomics combines large volumes of radiomic features from medical digital images, genetic data from high-throughput sequencing, and clinical-epidemiological data into mathematical modelling. The amalgamation of radiomics and genomics provides an approach to better study the molecular mechanism of tumour pathogenesis, as well as new evidence-supporting strategies to identify the characteristics of cancer patients, make clinical decisions by predicting prognosis, and improve the development of individualized treatment guidance. In this review, we summarized recent research on radiogenomics applications in solid cancers and presented the challenges impeding the adoption of radiomics in clinical practice. More standard guidelines are required to normalize radiomics into reproducible and convincible analyses and develop it as a mature field.

SARS-CoV-2: Has artificial intelligence stood the test of time

ABSTRACT

Artificial intelligence (AI) has proven time and time again to be a game-changer innovation in every walk of life, including medicine. Introduced by Dr. Gunn in 1976 to accurately diagnose acute abdominal pain and list potential differentials, AI has since come a long way. In particular, AI has been aiding in radiological diagnoses with good sensitivity and specificity by using machine learning algorithms. With the coronavirus disease 2019 pandemic, AI has proven to be more than just a tool to facilitate healthcare workers in decision making and limiting physician-patient contact during the pandemic. It has guided governments and key policymakers in formulating and implementing laws, such as lockdowns and travel restrictions, to curb the spread of this viral disease. This has been made possible by the use of social media to map severe acute respiratory syndrome coronavirus 2 hotspots, laying the basis of the "smart lockdown" strategy that has been adopted globally. However, these benefits might be accompanied with concerns regarding privacy and unconsented surveillance, necessitating authorities to develop sincere and ethical government-public relations.

Application in medicine: Has artificial intelligence stood the test of time

ABSTRACT

Artificial intelligence (AI) has proven time and time again to be a game-changer innovation in every walk of life, including medicine. Introduced by Dr. Gunn in 1976 to accurately diagnose acute abdominal pain and list potential differentials, AI has since come a long way. In particular, AI has been aiding in radiological diagnoses with good sensitivity and specificity by using machine learning algorithms. With the coronavirus disease 2019 pandemic, AI has proven to be more than just a tool to facilitate healthcare workers in decision making and limiting physician-patient contact during the pandemic. It has guided governments and key policymakers in formulating and implementing laws, such as lockdowns and travel restrictions, to curb the spread of this viral disease. This has been made possible by the use of social media to map severe acute respiratory syndrome coronavirus 2 hotspots, laying the basis of the "smart lockdown" strategy that has been adopted globally. However, these benefits might be accompanied with concerns regarding privacy and unconsented surveillance, necessitating authorities to develop sincere and ethical government-public relations.

Machine learning application in personalised lung cancer recurrence and survivability prediction

Machine learning is an important artificial intelligence technique that is widely applied in cancer diagnosis and detection. More recently, with the rise of personalised and precision medicine, there is a growing trend towards machine learning applications for prognosis prediction. However, to date, building reliable prediction models of cancer outcomes in everyday clinical practice is still a hurdle. In this work, we integrate genomic, clinical and demographic data of lung adenocarcinoma (LUAD) and squamous cell carcinoma (LUSC) patients from The Cancer Genome Atlas (TCGA) and introduce copy number variation (CNV) and mutation information of 15 selected genes to generate predictive models for recurrence and survivability. We compare the accuracy and benefits of three well-established machine learning algorithms: decision tree methods, neural networks and support vector machines. Although the accuracy of predictive models using the decision tree method has no significant advantage, the tree models reveal the most important predictors among genomic information (e.g. KRAS, EGFR, TP53), clinical status (e.g. TNM stage and radiotherapy) and demographics (e.g. age and gender) and how they influence the prediction of recurrence and survivability for both early stage LUAD and LUSC. The machine learning models have the potential to help clinicians to make personalised decisions on aspects such as follow-up timeline and to assist with personalised planning of future social care needs.

Precision Medicine in Lung Cancer Theranostics: Paving the Way from Traditional Technology to Advance Era

Precision medicine for lung cancer theranostics is an advanced model combining prevention, diagnosis, and treatment for individual or specific population diseases to match individual patient differences. It involves collection and integration of genome, transcriptome, proteome, and metabolome features of lung cancer patients, combined with clinical characteristics. Subsequently, large data and artificial intelligence (AI) analysis have emerged to identify the most suitable therapeutic targets and personal treatment strategies for treatment of patients with lung cancer. We review the development and challenges associated with diagnosis and therapy of lung cancer from traditional technology, including immunotherapy prediction markers, liquid biopsy, surgery, and tumor immune microenvironment and patient-derived xenograft models, to AI in the era of precision medicine. AI has improved precision medicine and the predictive ability and accuracy of patient outcomes. Finally, we discuss some opportunities and challenges for lung cancer theranostics. Precision medicine in lung cancer can help us find the optimum treatment dose and time for a specific patient, which can advance the development of lung cancer therapeutics.

Training radiomics-based CNNs for clinical outcome prediction: Challenges, strategies and findings

Radiological images play a central role in radiotherapy, especially in target volume delineation. Radiomic feature extraction has demonstrated its potential for predicting patient outcome and cancer risk assessment prior to treatment. However, inherent methodological challenges such as severe class imbalance, small training sample size, multi-centre data and weak correlation of image representations to outcomes are yet to be addressed adequately. Current radiomic analysis relies on segmented images (e.g., of tumours) for feature extraction, leading to loss of important context information in surrounding tissue. In this work, we examine the correlation between radiomics and clinical outcomes by combining two data modalities: pre-treatment computerized tomography (CT) imaging data and contours of segmented gross tumour volumes (GTVs). We focus on a clinical head & neck cancer dataset and design an efficient convolutional neural network (CNN) architecture together with appropriate machine learning strategies to cope with the challenges. During the training process on two cohorts, our algorithm learns to produce clinical outcome predictions by automatically extracting radiomic features. Test results on two other cohorts show state-of-the-art performance in predicting different clinical endpoints (i.e., distant metastasis: AUC = 0.91; loco-regional failure: AUC = 0.78; overall survival: AUC = 0.70 on segmented CT data) compared to prior studies. Furthermore, we also conduct extensive experiments both on the whole CT dataset and a combination of CT and GTV contours to investigate different learning strategies for this task. For example, further experiments indicate that overall survival prediction significantly improves to 0.83 AUC by combining CT and GTV contours as inputs, and the combination provides more intuitive visual explanations for patient outcome predictions.

Improving the Efficacy of Deep-Learning Models for Heart Beat Detection on Heterogeneous Datasets

Deep learning (DL) has greatly contributed to bioelectric signal processing, in particular to extract physiological markers. However, the efficacy and applicability of the results proposed in the literature is often constrained to the population represented by the data used to train the models. In this study, we investigate the issues related to applying a DL model on heterogeneous datasets. In particular, by focusing on heart beat detection from electrocardiogram signals (ECG), we show that the performance of a model trained on data from healthy subjects decreases when applied to patients with cardiac conditions and to signals collected with different devices. We then evaluate the use of transfer learning (TL) to adapt the model to the different datasets. In particular, we show that the classification performance is improved, even with datasets with a small sample size. These results suggest that a greater effort should be made towards the generalizability of DL models applied on bioelectric signals, in particular, by retrieving more representative datasets.

Radiomics Predicts for Distant Metastasis in Locally Advanced Human Papillomavirus-Positive Oropharyngeal Squamous Cell Carcinoma

Simple Summary

There is strong evidence that locally advanced human papillomavirus positive (HPV+) oropharyngeal squamous cell carcinoma (OPSCC) carries a significantly better prognosis than HPV negative OPSCC, suggesting the possibility of treatment de-escalation and, therefore, toxicity reduction in this patient population. The lack of success in clinical trials towards this end presses the need to risk stratify locally advanced HPV+ OPSCC patients who can safely have treatment de-escalated. The present study had recourse to radiomics for this purpose and showed that radiomics has the ability to discriminate patients with locally advanced HPV+ OPSCC who went on to develop distant metastasis after completion of definitive chemoradiation or radiation alone. The implications of this study aid in demonstrating the potential pivotal role of radiomics in predictive risk assessment and personalizing therapy for this patient population.

Abstract

(1) Background and purpose: clinical trials have unsuccessfully tried to de-escalate treatment in locally advanced human papillomavirus positive (HPV+) oropharyngeal squamous cell carcinoma (OPSCC) with the goal of reducing treatment toxicity. The aim of this study was to explore the role of radiomics for risk stratification in this patient population to guide treatment. (2) Methods: the study population consisted of 225 patients with locally advanced HPV+ OPSCC treated with curative-intent radiation or chemoradiation therapy. Appearance of distant metastasis was used as the endpoint event. Radiomics data were extracted from the gross tumor volumes (GTVs) identified on the planning CT, with gray level being discretized using three different bin widths (8, 16, and 32). The data extracted for the groups with and without distant metastasis were subsequently balanced using three different algorithms including synthetic minority over-sampling technique (SMOTE), adaptive synthetic sampling (ADASYN), and borderline SMOTE. From these different combinations, a total of nine radiomics datasets were derived. Top features that minimized redundancy while maximizing relevance to the endpoint were selected individually and collectively for the nine radiomics datasets to build support vector machine (SVM) based predictive classifiers. Performance of the developed classifiers was evaluated by receiver operating characteristic (ROC) curve analysis. (3) Results: of the 225 locally advanced HPV+ OPSCC patients being studied, 9.3% had developed distant metastases at last follow-up. SVM classifiers built for the nine radiomics dataset using either their own respective top features or the top consensus ones were all able to differentiate the two cohorts at a level of excellence or beyond, with ROC area under curve (AUC) ranging from 0.84 to 0.95 (median = 0.90). ROC comparisons further revealed that the majority of the built classifiers did not distinguish the two cohorts significantly better than each other. (4) Conclusions: radiomics demonstrated discriminative ability in distinguishing patients with locally advanced HPV+ OPSCC who went on to develop distant metastasis after completion of definitive chemoradiation or radiation alone and may serve to risk stratify this patient population with the purpose of guiding the appropriate therapy.

A deep learning- and CT image-based prognostic model for the prediction of survival in non-small cell lung cancer

OBJECTIVE

To assist clinicians in arranging personalized treatment, planning follow-up programs and extending survival times for non-small cell lung cancer (NSCLC) patients, a method of deep learning combined with computed tomography (CT) imaging for survival prediction was designed.

METHODS

Data were collected from 484 patients from four research centers. The data from 344 patients were utilized to build the A_CNN survival prognosis model to classify 2-year overall survival time ranges (730 days cut-off). Data from 140 patients, including independent internal and external test sets, were utilized for model testing. First, a series of preprocessing techniques were used to process the original CT images and generate training and test data sets from the axial, coronal, and sagittal planes. Second, the structure of the A_CNN model was designed based on asymmetric convolution, bottleneck blocks, the uniform cross-entropy (UC) loss function, and other advanced techniques. After that, the A_CNN model was trained, and numerous comparative experiments were designed to obtain the best prognostic survival model. Last, the model performance was evaluated, and the predicted survival curves were analyzed.

RESULTS

The A_CNN survival prognosis model yielded a high patient-level accuracy of 88.8%, a patch-level accuracy of 82.9%, and an area under the receiver operating characteristic (ROC) curve (AUC) of 0.932. When tested on an external data set, the maximum patient-level accuracy was 80.0%.

CONCLUSIONS

The results suggest that using a deep learning method can improve prognosis in patients with NSCLC and has important application value in establishing individualized prognostic models.

Machine learning for dose-volume histogram based clinical decision-making support system in radiation therapy plans for brain tumors

•

Extraction, analysis, and interpretation of historical treatment planning data is valuable but very time-consuming.

•

Proposed machine learning model classifies radiotherapy plans based on their treatment planning objectives and trade-offs.

•

Application of double nested cross-validation enabled to build a robust model that achieved 94% accuracy on a testing data.

•

Model reasoning investigated with SHAP values showed consistency with clinical observations.

Purpose

To create and investigate a novel, clinical decision-support system using machine learning (ML).

Methods and Materials

The ML model was developed based on 79 radiotherapy plans of brain tumor patients that were prescribed a total dose of 60 Gy delivered with volumetric-modulated arc therapy (VMAT). Structures considered for analysis included planning target volume (PTV), brainstem, cochleae, and optic chiasm. The model aimed to classify the target variable that included class-0 corresponding to plans for which the PTV treatment planning objective was met and class-1 that was associated with plans for which the PTV objective was not met due to the priority trade-off to meet one or more organs-at-risk constraints. Several models were evaluated using double-nested cross-validation and an area-under-the-curve (AUC) metric, with the highest performing one selected for further investigation. The model predictions were explained with Shapely additive explanation (SHAP) interaction values.

Results

The highest-performing model was Logistic Regression achieving an accuracy of 93.8 ± 4.1% and AUC of 0.98 ± 0.02 on the testing data. The SHAP analysis indicated that the ΔD_99% metric for PTV had the greatest influence on the model predictions. The least important feature was ΔD_MAX for the left and right cochleae.

Conclusions

The trained model achieved satisfactory accuracy and can be used by medical physicists in a data-driven quality assurance program as well as by radiation oncologists to support their decision-making process in terms of treatment plan approval and potential plan modifications. Model explanation analysis showed that the model relies on clinically valid logic when making predictions.

A Comprehensive Review on Radiomics and Deep Learning for Nasopharyngeal Carcinoma Imaging

Nasopharyngeal carcinoma (NPC) is one of the most common malignant tumours of the head and neck, and improving the efficiency of its diagnosis and treatment strategies is an important goal. With the development of the combination of artificial intelligence (AI) technology and medical imaging in recent years, an increasing number of studies have been conducted on image analysis of NPC using AI tools, especially radiomics and artificial neural network methods. In this review, we present a comprehensive overview of NPC imaging research based on radiomics and deep learning. These studies depict a promising prospect for the diagnosis and treatment of NPC. The deficiencies of the current studies and the potential of radiomics and deep learning for NPC imaging are discussed. We conclude that future research should establish a large-scale labelled dataset of NPC images and that studies focused on screening for NPC using AI are necessary.

Preselection of robust radiomic features does not improve outcome modelling in non-small cell lung cancer based on clinical routine FDG-PET imaging

Background

Radiomics is a promising tool for identifying imaging-based biomarkers. Radiomics-based models are often trained on single-institution datasets; however, multi-centre imaging datasets are preferred for external generalizability owing to the influence of inter-institutional scanning differences and acquisition settings. The study aim was to determine the value of preselection of robust radiomic features in routine clinical positron emission tomography (PET) images to predict clinical outcomes in locally advanced non-small cell lung cancer (NSCLC).

Methods

A total of 1404 primary tumour radiomic features were extracted from pre-treatment [¹⁸F]fluorodeoxyglucose (FDG)-PET scans of stage IIIA/N2 or IIIB NSCLC patients using a training cohort (n = 79; prospective Swiss multi-centre randomized phase III trial SAKK 16/00; 16 centres) and an internal validation cohort (n = 31; single centre). Robustness studies investigating delineation variation, attenuation correction and motion were performed (intraclass correlation coefficient threshold > 0.9). Two 12-/24-month event-free survival (EFS) and overall survival (OS) logistic regression models were trained using standardized imaging: (1) with robust features alone and (2) with all available features. Models were then validated using fivefold cross-validation, and validation on a separate single-centre dataset. Model performance was assessed using area under the receiver operating characteristic curve (AUC).

Results

Robustness studies identified 179 stable features (13%), with 25% stable features for 3D versus 4D acquisition, 31% for attenuation correction and 78% for delineation. Univariable analysis found no significant robust features predicting 12-/24-month EFS and 12-month OS (p value > 0.076). Prognostic models without robust preselection performed well for 12-month EFS in training (AUC = 0.73) and validation (AUC = 0.74). Patient stratification into two risk groups based on 12-month EFS was significant for training (p value = 0.02) and validation cohorts (p value = 0.03).

Conclusions

A PET-based radiomics model using a standardized, multi-centre dataset to predict EFS in locally advanced NSCLC was successfully established and validated with good performance. Prediction models with robust feature preselection were unsuccessful, indicating the need for a standardized imaging protocol.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13550-021-00809-3.

Texture Analysis of Computed Tomography Images in the Lung of Patients With Breast Cancer

OBJECTIVE

The aim of this study was to investigate whether the texture features of lung computed tomography images were altered by primary breast cancer without pulmonary metastasis.

METHODS

Texture analysis was performed on the regions of interest of lung computed tomography images from 36 patients with breast cancer and 36 healthy controls. Texture parameters between subjects with different clinical stages and hormone receptor (HR) statuses in patients with breast cancer were analyzed.

RESULTS

Three texture parameters (mean, SD, and variance) were significantly different between patients with breast cancer and healthy controls and between preoperative and postoperative stages in patients with breast cancer. All 3 parameters showed an increasing trend under the tumor-bearing state. These parameters were significantly higher in the stage III + IV group than in the stage I + II group. The variance parameter was significantly higher in the HR-negative group than in the HR-positive group.

CONCLUSIONS

Texture analysis may serve as a novel additional tool for discovering conventionally invisible changes in the lung tissue of patients with breast cancer.

The perceptions of medical physicists towards relevance and impact of artificial intelligence

Artificial intelligence (AI) is an innovative tool with the potential to impact medical physicists' clinical practices, research, and the profession. The relevance of AI and its impact on the clinical practice and routine of professionals in medical physics were evaluated by medical physicists and researchers in this field. An online survey questionnaire was designed for distribution to professionals and students in medical physics around the world. In addition to demographics questions, we surveyed opinions on the role of AI in medical physicists' practices, the possibility of AI threatening/disrupting the medical physicists' practices and career, the need for medical physicists to acquire knowledge on AI, and the need for teaching AI in postgraduate medical physics programmes. The level of knowledge of medical physicists on AI was also consulted. A total of 1019 respondents from 94 countries participated. More than 85% of the respondents agreed that AI would play an essential role in medical physicists' practices. AI should be taught in the postgraduate medical physics programmes, and that more applications such as quality control (QC), treatment planning would be performed by AI. Half of the respondents thought AI would not threaten/disrupt the medical physicists' practices. AI knowledge was mainly acquired through self-taught and work-related activities. Nonetheless, many (40%) reported that they have no skill in AI. The general perception of medical physicists was that AI is here to stay, influencing our practices. Medical physicists should be prepared with education and training for this new reality.

Contrast-enhanced CT radiomics features to predict recurrence of locally advanced oesophageal squamous cell cancer within 2 years after trimodal therapy: A case-control study

Radiomics transforms the medical images into high-dimensional quantitative features and provides potential information about tumor phenotypes and heterogeneity. We conducted a retrospective analysis to explore and validate radiomics model based on contrast-enhanced computed tomography (CECT) to predict recurrence of locally advanced oesophageal squamous cell cancer (SCC) within 2 years after trimodal therapy. This study collected CECT and clinical data of consecutive 220 patients with pathology-confirmed locally advanced oesophageal SCC (154 in the training cohort and 66 in the validation cohort). Univariate statistical test and the least absolute shrinkage and selection operator method were performed to select the optimal radiomics features. Logistic regression was conducted to build radiomics model, clinical model, and combined model of both the radiomics and clinical features. Predictive performance was judged by the area under receiver operating characteristics curve (AUC), accuracy, and F1-score in the training and validation cohorts. Ten optimal radiomics features and/or 7 clinical features were selected to build radiomics model, clinical model, and the combined model. The integrated model of radiomics and clinical features was superior to radiomics model or clinical model in predicting recurrence of locally advanced oesophageal SCC within 2 years in the training (AUC: 0.879 vs 0.815 or 0.763; accuracy: 0.844 vs 0.773 or 0.740; and F1-score: 0.886 vs 0.839 or 0.815, respectively) and validation (AUC: 0.857 vs 0.720 or 0.750; accuracy: 0.788 vs 0.700 or 0.697; and F1-score: 0.851 vs 0.800 or 0.787, respectively) cohorts. The combined model of radiomics and clinical features shows better performance than the radiomics or clinical model to predict the recurrence of locally advanced oesophageal SCC within 2 years after trimodal therapy.

Future artificial intelligence tools and perspectives in medicine

PURPOSE OF REVIEW

Artificial intelligence has become popular in medical applications, specifically as a clinical support tool for computer-aided diagnosis. These tools are typically employed on medical data (i.e., image, molecular data, clinical variables, etc.) and used the statistical and machine-learning methods to measure the model performance. In this review, we summarized and discussed the most recent radiomic pipeline used for clinical analysis.

RECENT FINDINGS

Currently, limited management of cancers benefits from artificial intelligence, mostly related to a computer-aided diagnosis that avoids a biopsy analysis that presents additional risks and costs. Most artificial intelligence tools are based on imaging features, known as radiomic analysis that can be refined into predictive models in noninvasively acquired imaging data. This review explores the progress of artificial intelligence-based radiomic tools for clinical applications with a brief description of necessary technical steps. Explaining new radiomic approaches based on deep-learning techniques will explain how the new radiomic models (deep radiomic analysis) can benefit from deep convolutional neural networks and be applied on limited data sets.

SUMMARY

To consider the radiomic algorithms, further investigations are recommended to involve deep learning in radiomic models with additional validation steps on various cancer types.

Development and validation of an MRI-based radiomic nomogram to distinguish between good and poor responders in patients with locally advanced rectal cancer undergoing neoadjuvant chemoradiotherapy

PURPOSE

In the clinical management of patients with locally advanced rectal cancer (LARC), the early identification of poor and good responders after neoadjuvant chemoradiotherapy (N-CRT) is essential. Therefore, we developed and validated predictive models including MRI findings from the structured report template, clinical and radiomics parameters to differentiate between poor and good responders in patients with locally advanced rectal cancer who underwent neoadjuvant chemoradiotherapy.

METHODS

Preoperative multiparametric MRI from 183 patients with locally advanced rectal cancer (122 in the training cohort, 61 in the validation cohort) was included in this retrospective study. After preprocessing, radiomic features were extracted and two methods of feature selection was applied to reduce the number of radiomics features. Logistic regression (LR) and random forest (RF) machine learning classifiers were trained to identify good responders from poor responders. Multivariable logistic regression analysis was used to incorporate the radiomic signature and clinical risk factors into a nomogram. Classifier performance was evaluated using the area under the curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV).

RESULTS

For the differentiation of poor and good responders, the radiomics model with an LR classifier achieved AUCs of 0.869 and 0.842 for the training and validation cohorts, respectively. The nomogram showed the highest reproducibility and prognostic ability in the training and validation cohorts, with AUCs of 0.923 (95% confidence interval, 0.872-0.975) and 0.898 (0.819-0.978), respectively. Additionally, the nomogram achieved significant risk stratification of patients in respect to progression free survival (PFS).

CONCLUSIONS

The nomogram accurately differentiated good and poor responders in patients with LARC undergoing N-CRT, and showed significant performance for predicting PFS.

A Nomogram Based on CT Deep Learning Signature: A Potential Tool for the Prediction of Overall Survival in Resected Non-Small Cell Lung Cancer Patients

PURPOSE

To develop and further validate a deep learning signature-based nomogram from computed tomography (CT) images for prediction of the overall survival (OS) in resected non-small cell lung cancer (NSCLC) patients.

PATIENTS AND METHODS

A total of 1792 deep learning features were extracted from non-enhanced and venous-phase CT images for each NSCLC patient in training cohort (n=231). Then, a deep learning signature was built with the least absolute shrinkage and selection operator (LASSO) Cox regression model for OS estimation. At last, a nomogram was constructed with the signature and other independent clinical risk factors. The performance of nomogram was assessed by discrimination, calibration and clinical usefulness. In addition, in order to quantify the improvement in performance added by deep learning signature, the net reclassification improvement (NRI) was calculated. The results were validated in external validation cohort (n=77).

RESULTS

A deep learning signature with 9 selected features was significantly associated with OS in both training cohort (hazard ratio [HR]=5.455, 95% CI: 3.393-8.769, P<0.001) and external validation cohort (HR=3.029, 95% CI: 1.673-5.485, P=0.004). The nomogram combining deep learning signature with clinical risk factors of TNM stage, lymphatic vessel invasion and differentiation grade showed favorable discriminative ability with C-index of 0.800 as well as a good calibration, which was validated in external validation cohort (C-index=0.723). Additional value of deep learning signature to the nomogram was statistically significant (NRI=0.093, P=0.027 for training cohort; NRI=0.106, P=0.040 for validation cohort). Decision curve analysis confirmed the clinical usefulness of this nomogram in predicting OS.

CONCLUSION

The deep learning signature-based nomogram is a robust tool for prognostic prediction in resected NSCLC patients.

Deep Neural Networks and Transfer Learning on a Multivariate Physiological Signal Dataset

While Deep Neural Networks (DNNs) and Transfer Learning (TL) have greatly contributed to several medical and clinical disciplines, the application to multivariate physiological datasets is still limited. Current examples mainly focus on one physiological signal and can only utilise applications that are customised for that specific measure, thus it limits the possibility of transferring the trained DNN to other domains. In this study, we composed a dataset (n=813) of six different types of physiological signals (Electrocardiogram, Electrodermal activity, Electromyogram, Photoplethysmogram, Respiration and Acceleration). Signals were collected from 232 subjects using four different acquisition devices. We used a DNN to classify the type of physiological signal and to demonstrate how the TL approach allows the exploitation of the efficiency of DNNs in other domains. After the DNN was trained to optimally classify the type of signal, the features that were automatically extracted by the DNN were used to classify the type of device used for the acquisition using a Support Vector Machine. The dataset, the code and the trained parameters of the DNN are made publicly available to encourage the adoption of DNN and TL in applications with multivariate physiological signals.

Artificial intelligence in the diagnosis and management of hepatocellular carcinoma

Despite recent improvements in therapeutic interventions, hepatocellular carcinoma is still associated with a poor prognosis in patients with an advanced disease at diagnosis. Recently, significant progress has been made in image recognition through advances in the field of artificial intelligence (AI) (or machine learning), especially deep learning. AI is a multidisciplinary field that draws on the fields of computer science and mathematics for developing and implementing computer algorithms capable of maximizing the predictive accuracy from static or dynamic data sources using analytic or probabilistic models. Because of the multifactorial and complex nature of liver diseases, the machine learning approach to integrate multiple factors would appear to be an advantageous approach to improve the likelihood of making a precise diagnosis and predicting the response of treatment and prognosis of liver diseases. In this review, we attempted to summarize the potential use of AI in the diagnosis and management of liver diseases, especially hepatocellular carcinoma.

[Artificial intelligence in oncological radiology : A (p)review]

BACKGROUND

Artificial intelligence (AI) has the potential to fundamentally change medicine within the coming decades. Radiological imaging is one of the primary fields of its clinical application.

OBJECTIVES

In this article, we summarize previous AI developments with a focus on oncological radiology. Based on selected examples, we derive scenarios for developments in the next 10 years.

MATERIALS AND METHODS

This work is based on a review of various literature and product databases, publications by regulatory authorities, reports, and press releases.

CONCLUSIONS

The clinical use of AI applications is still in an early stage of development. The large number of research publications shows the potential of the field. Several certified products have already become available to users. However, for a widespread adoption of AI applications in clinical routine, several fundamental prerequisites are still awaited. These include the generation of evidence justifying the use of algorithms through representative clinical studies, adjustments to the framework for approval processes and dedicated education and teaching resources for its users. It is expected that use of AI methods will increase, thus, creating new opportunities for improved diagnostics, therapy, and more efficient workflows.

Robust radiogenomics approach to the identification of EGFR mutations among patients with NSCLC from three different countries using topologically invariant Betti numbers

OBJECTIVES

To propose a novel robust radiogenomics approach to the identification of epidermal growth factor receptor (EGFR) mutations among patients with non-small cell lung cancer (NSCLC) using Betti numbers (BNs).

MATERIALS AND METHODS

Contrast enhanced computed tomography (CT) images of 194 multi-racial NSCLC patients (79 EGFR mutants and 115 wildtypes) were collected from three different countries using 5 manufacturers' scanners with a variety of scanning parameters. Ninety-nine cases obtained from the University of Malaya Medical Centre (UMMC) in Malaysia were used for training and validation procedures. Forty-one cases collected from the Kyushu University Hospital (KUH) in Japan and fifty-four cases obtained from The Cancer Imaging Archive (TCIA) in America were used for a test procedure. Radiomic features were obtained from BN maps, which represent topologically invariant heterogeneous characteristics of lung cancer on CT images, by applying histogram- and texture-based feature computations. A BN-based signature was determined using support vector machine (SVM) models with the best combination of features that maximized a robustness index (RI) which defined a higher total area under receiver operating characteristics curves (AUCs) and lower difference of AUCs between the training and the validation. The SVM model was built using the signature and optimized in a five-fold cross validation. The BN-based model was compared to conventional original image (OI)- and wavelet-decomposition (WD)-based models with respect to the RI between the validation and the test.

RESULTS

The BN-based model showed a higher RI of 1.51 compared with the models based on the OI (RI: 1.33) and the WD (RI: 1.29).

CONCLUSION

The proposed model showed higher robustness than the conventional models in the identification of EGFR mutations among NSCLC patients. The results suggested the robustness of the BN-based approach against variations in image scanner/scanning parameters.

Radiomics and Digital Image Texture Analysis in Oncology (Review)

One of the most promising areas of diagnosis and prognosis of diseases is radiomics, a science combining radiology, mathematical modeling, and deep machine learning. The main concept of radiomics is image biomarkers (IBMs), the parameters characterizing various pathological changes and calculated based on the analysis of digital image texture. IBMs are used for quantitative assessment of digital imaging results (CT, MRI, ultrasound, PET). The use of IBMs in the form of "virtual biopsy" is of particular relevance in oncology. The article provides the basic concepts of radiomics identifying the main stages of obtaining IBMs: data collection and preprocessing, tumor segmentation, data detection and extraction, modeling, statistical processing, and data validation. The authors have analyzed the possibilities of using IBMs in oncology, describing the currently known features and advantages of using radiomics and image texture analysis in the diagnosis and prognosis of cancer. The limitations and problems associated with the use of radiomics data are considered. Although the novel effective tool for performing virtual biopsy of human tissue is at the development stage, quite a few projects have already been implemented, and medical software packages for radiomics analysis of digital images have been created.

Radiomic features based on Hessian index for prediction of prognosis in head-and-neck cancer patients

This study demonstrated the usefulness of radiomic features based on the Hessian index of differential topology for the prediction of prognosis prior to treatment in head-and-neck (HN) cancer patients. The Hessian index, which can indicate tumor heterogeneity with convex, concave, and other points (saddle points), was calculated as the number of negative eigenvalues of the Hessian matrix at each voxel on computed tomography (CT) images. Three types of signatures were constructed in a training cohort (n = 126), one type each from CT conventional features, Hessian index features, and combined features from the conventional and index feature sets. The prognostic value of the signatures were evaluated using statistically significant difference (p value, log-rank test) to compare the survival curves of low- and high-risk groups. In a test cohort (n = 68), the p values of the models built with conventional, index, combined features, and clinical variables were 2.95 [Formula: see text] 10-2, 1.85 [Formula: see text] 10-2, 3.17 [Formula: see text] 10-2, and 1.87 [Formula: see text] 10-3, respectively. When the features were integrated with clinical variables, the p values of conventional, index, and combined features were 3.53 [Formula: see text] 10-3, 1.28 [Formula: see text] 10-3, and 1.45 [Formula: see text] 10-3, respectively. This result indicates that index features could provide more prognostic information than conventional features and further increase the prognostic value of clinical variables in HN cancer patients.

Artificial intelligence (AI) and interventional radiotherapy (brachytherapy): state of art and future perspectives

Purpose

Artificial intelligence (AI) plays a central role in building decision supporting systems (DSS), and its application in healthcare is rapidly increasing. The aim of this study was to define the role of AI in healthcare, with main focus on radiation oncology (RO) and interventional radiotherapy (IRT, brachytherapy).

Artificial intelligence in interventional radiation therapy

AI in RO has a large impact in providing clinical decision support, data mining and advanced imaging analysis, automating repetitive tasks, optimizing time, and modelling patients and physicians' behaviors in heterogeneous contexts. Implementing AI and automation in RO and IRT can successfully facilitate all the steps of treatment workflow, such as patient consultation, target volume delineation, treatment planning, and treatment delivery.

Conclusions

AI may contribute to improve clinical outcomes through the application of predictive models and DSS optimization. This approach could lead to reducing time-consuming repetitive tasks, healthcare costs, and improving treatment quality assurance and patient's assistance in IRT.