Detection of epithelial growth factor receptor (EGFR) mutations on CT images of patients with lung adenocarcinoma using radiomics and/or multi-level residual convolutionary neural networks

Comprehensive Potential of Artificial Intelligence for Predicting PD-L1 Expression and EGFR Mutations in Lung Cancer: A Systematic Review and Meta-Analysis

OBJECTIVE

To evaluate the methodological quality and the predictive performance of artificial intelligence (AI) for predicting programmed death ligand 1 (PD-L1) expression and epidermal growth factor receptors (EGFR) mutations in lung cancer (LC) based on systematic review and meta-analysis.

METHODS

AI studies based on PET/CT, CT, PET, and immunohistochemistry (IHC)-whole-slide image (WSI) were included to predict PD-L1 expression or EGFR mutations in LC. The modified Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool was used to evaluate the methodological quality. A comprehensive meta-analysis was conducted to analyze the overall area under the curve (AUC). The Cochrane diagnostic test and I2 statistics were used to assess the heterogeneity of the meta-analysis.

RESULTS

A total of 45 AI studies were included, of which 10 were used to predict PD-L1 expression and 35 were used to predict EGFR mutations. Based on the analysis using the QUADAS-2 tool, 37 studies achieved a high-quality score of 7. In the meta-analysis of PD-L1 expression levels, the overall AUCs for PET/CT, CT, and IHC-WSI were 0.80 (95% confidence interval [CI], 0.77-0.84), 0.74 (95% CI, 0.69-0.77), and 0.95 (95% CI, 0.93-0.97), respectively. For EGFR mutation status, the overall AUCs for PET/CT, CT, and PET were 0.85 (95% CI, 0.81-0.88), 0.83 (95% CI, 0.80-0.86), and 0.75 (95% CI, 0.71-0.79), respectively. The Cochrane Diagnostic Test revealed an I2 value exceeding 50%, indicating substantial heterogeneity in the PD-L1 and EGFR meta-analyses. When AI was combined with clinicopathological features, the enhancement in predicting PD-L1 expression was not substantial, whereas the prediction of EGFR mutations showed improvement compared to the CT and PET models, albeit not significantly so compared to the PET/CT models.

CONCLUSIONS

The overall performance of AI in predicting PD-L1 expression and EGFR mutations in LC has promising clinical implications.

Non-invasive, fast, and high-performance EGFR gene mutation prediction method based on deep transfer learning and model stacking for patients with Non-Small Cell Lung Cancer

Purpose

To propose an intelligent, non-invasive, highly precise, and rapid method to predict the mutation status of the Epidermal Growth Factor Receptor (EGFR) to accelerate treatment with Tyrosine Kinase Inhibitor (TKI) for patients with untreated adenocarcinoma Non-Small Cell Lung Cancer.

Materials and methods

Real-world data from 521 patients with adenocarcinoma NSCLC who performed a CT scan and underwent surgery or pathological biopsy to determine EGFR gene mutation between January 2021 and July 2022, is collected. Solutions to the problems that prevent the model from achieving very high precision, namely: human errors made during the annotation of the database and the low precision of the output decision of the model, are proposed. Thus, among the 521 analyzed cases, only 40 were selected as patients with EGFR gene mutation and 98 cases with wild-type EGFR.

Results

The proposed model is trained, validated, and tested on 12,040 2D images extracted from the 138 CT scans images where patients were randomly partitioned into training (80 %) and test (20 %) sets. The performance obtained for EGFR gene mutation prediction was 95.22 % for accuracy, 960.2 for F1_score, 95.89 % for precision, 96.92 % for sensitivity, 94.01 % for Cohen kappa, and 98 % for AUC.

Conclusion

An EGFR gene mutation status prediction method, with high-performance thanks to an intelligent prediction model entrained by highly accurate annotated data is proposed. The outcome of this project will facilitate rapid decision-making when applying a TKI as an initial treatment.

EfficientNet-Based System for Detecting EGFR-Mutant Status and Predicting Prognosis of Tyrosine Kinase Inhibitors in Patients with NSCLC

We aimed to develop and validate a deep learning-based system using pre-therapy computed tomography (CT) images to detect epidermal growth factor receptor (EGFR)-mutant status in patients with non-small cell lung cancer (NSCLC) and predict the prognosis of advanced-stage patients with EGFR mutations treated with EGFR tyrosine kinase inhibitors (TKI). This retrospective, multicenter study included 485 patients with NSCLC from four hospitals. Of them, 339 patients from three centers were included in the training dataset to develop an EfficientNetV2-L-based model (EME) for predicting EGFR-mutant status, and the remaining patients were assigned to an independent test dataset. EME semantic features were extracted to construct an EME-prognostic model to stratify the prognosis of EGFR-mutant NSCLC patients receiving EGFR-TKI. A comparison of EME and radiomics was conducted. Additionally, we included patients from The Cancer Genome Atlas lung adenocarcinoma dataset with both CT images and RNA sequencing data to explore the biological associations between EME score and EGFR-related biological processes. EME obtained an area under the curve (AUC) of 0.907 (95% CI 0.840-0.926) on the test dataset, superior to the radiomics model (P = 0.007). The EME and radiomics fusion model showed better (AUC, 0.941) but not significantly increased performance (P = 0.895) compared with EME. In prognostic stratification, the EME-prognostic model achieved the best performance (C-index, 0.711). Moreover, the EME-prognostic score showed strong associations with biological pathways related to EGFR expression and EGFR-TKI efficacy. EME demonstrated a non-invasive and biologically interpretable approach to predict EGFR status, stratify survival prognosis, and correlate biological pathways in patients with NSCLC.

Predicting EGFR Mutation Status in Non-Small Cell Lung Cancer Using Artificial Intelligence: A Systematic Review and Meta-Analysis

RATIONALE AND OBJECTIVES

Recent advancements in artificial intelligence (AI) render a substantial promise for epidermal growth factor receptor (EGFR) mutation status prediction in non-small cell lung cancer (NSCLC). We aimed to evaluate the performance and quality of AI algorithms that use radiomics features in predicting EGFR mutation status in patient with NSCLC.

MATERIALS AND METHODS

We searched PubMed (Medline), EMBASE, Web of Science, and IEEExplore for studies published up to February 28, 2022. Studies utilizing an AI algorithm (either conventional machine learning [cML] and deep learning [DL]) for predicting EGFR mutations in patients with NSLCL were included. We extracted binary diagnostic accuracy data and constructed a bivariate random-effects model to obtain pooled sensitivity, specificity, and 95% confidence interval. This study is registered with PROSPERO, CRD42021278738.

RESULTS

Our search identified 460 studies, of which 42 were included. Thirty-five studies were included in the meta-analysis. The AI algorithms exhibited an overall area under the curve (AUC) value of 0.789 and pooled sensitivity and specificity levels of 72.2% and 73.3%, respectively. The DL algorithms outperformed cML in terms of AUC (0.822 vs. 0.775) and sensitivity (80.1% vs. 71.1%), but had lower specificity (70.0% vs. 73.8%, p-value < 0.001) compared to cML. Subgroup analysis revealed that the use of positron-emission tomography/computed tomography, additional clinical information, deep feature extraction, and manual segmentation can improve diagnostic performance.

CONCLUSION

DL algorithms can serve as a novel method for increasing predictive accuracy and thus have considerable potential for use in predicting EGFR mutation status in patient with NSCLC. We also suggest that guidelines on using AI algorithms in medical image analysis should be developed with a focus on oncologic radiomics.

AI/ML advances in non-small cell lung cancer biomarker discovery

Lung cancer is the leading cause of cancer deaths among both men and women, representing approximately 25% of cancer fatalities each year. The treatment landscape for non-small cell lung cancer (NSCLC) is rapidly evolving due to the progress made in biomarker-driven targeted therapies. While advancements in targeted treatments have improved survival rates for NSCLC patients with actionable biomarkers, long-term survival remains low, with an overall 5-year relative survival rate below 20%. Artificial intelligence/machine learning (AI/ML) algorithms have shown promise in biomarker discovery, yet NSCLC-specific studies capturing the clinical challenges targeted and emerging patterns identified using AI/ML approaches are lacking. Here, we employed a text-mining approach and identified 215 studies that reported potential biomarkers of NSCLC using AI/ML algorithms. We catalogued these studies with respect to BEST (Biomarkers, EndpointS, and other Tools) biomarker sub-types and summarized emerging patterns and trends in AI/ML-driven NSCLC biomarker discovery. We anticipate that our comprehensive review will contribute to the current understanding of AI/ML advances in NSCLC biomarker research and provide an important catalogue that may facilitate clinical adoption of AI/ML-derived biomarkers.

Systematic Review, Meta-Analysis and Radiomics Quality Score Assessment of CT Radiomics-Based Models Predicting Tumor EGFR Mutation Status in Patients with Non-Small-Cell Lung Cancer

Assessment of the quality and current performance of computed tomography (CT) radiomics-based models in predicting epidermal growth factor receptor (EGFR) mutation status in patients with non-small-cell lung carcinoma (NSCLC). Two medical literature databases were systematically searched, and articles presenting original studies on CT radiomics-based models for predicting EGFR mutation status were retrieved. Forest plots and related statistical tests were performed to summarize the model performance and inter-study heterogeneity. The methodological quality of the selected studies was assessed via the Radiomics Quality Score (RQS). The performance of the models was evaluated using the area under the curve (ROC AUC). The range of the Risk RQS across the selected articles varied from 11 to 24, indicating a notable heterogeneity in the quality and methodology of the included studies. The average score was 15.25, which accounted for 42.34% of the maximum possible score. The pooled Area Under the Curve (AUC) value was 0.801, indicating the accuracy of CT radiomics-based models in predicting the EGFR mutation status. CT radiomics-based models show promising results as non-invasive alternatives for predicting EGFR mutation status in NSCLC patients. However, the quality of the studies using CT radiomics-based models varies widely, and further harmonization and prospective validation are needed before the generalization of these models.

Conventional and radiomic features to predict pathology in the preoperative assessment of anterior mediastinal masses

OBJECTIVES

The aim of this study was to differentiate benign from malignant tumors in the anterior mediastinum based on computed tomography (CT) imaging characteristics, which could be useful in preoperative planning. Additionally, our secondary aim was to differentiate thymoma from thymic carcinoma, which could guide the use of neoadjuvant therapy.

MATERIALS AND METHODS

Patients referred for thymectomy were retrospectively selected from our database. Twenty-five conventional characteristics were evaluated by visual analysis, and 101 radiomic features were extracted from each CT. In the step of model training, we applied support vector machines to train classification models. Model performance was assessed using the area under the receiver operating curves (AUC).

RESULTS

Our final study sample comprised 239 patients, 59 (24.7 %) with benign mediastinal lesions and 180 (75.3 %) with malignant thymic tumors. Among the malignant masses, there were 140 (58.6 %) thymomas, 23 (9.6 %) thymic carcinomas, and 17 (7.1 %) non-thymic lesions. For the benign versus malignant differentiation, the model that integrated both conventional and radiomic features achieved the highest diagnostic performance (AUC = 0.715), in comparison to the conventional (AUC = 0.605) and radiomic-only (AUC = 0.678) models. Similarly, regarding thymoma versus thymic carcinoma differentiation, the model that integrated both conventional and radiomic features also achieved the highest diagnostic performance (AUC = 0.810), in comparison to the conventional (AUC = 0.558) and radiomic-only (AUC = 0.774) models.

CONCLUSION

CT-based conventional and radiomic features with machine learning analysis could be useful for predicting pathologic diagnoses of anterior mediastinal masses. The diagnostic performance was moderate for differentiating benign from malignant lesions and good for differentiating thymomas from thymic carcinomas. The best diagnostic performance was achieved when both conventional and radiomic features were integrated in the machine learning algorithms.

Deep learning for predicting epidermal growth factor receptor mutations of non-small cell lung cancer on PET/CT images

Background

Predicting the mutation status of the epidermal growth factor receptor (EGFR) gene based on an integrated positron emission tomography/computed tomography (PET/CT) image of non-small cell lung cancer (NSCLC) is a noninvasive, low-cost method which is valuable for targeted therapy. Although deep learning has been very successful in robotic vision, it is still challenging to predict gene mutations in PET/CT-derived studies because of the small amount of medical data and the different parameters of PET/CT devices.

Methods

We used the advanced EfficientNet-V2 model to predict the EGFR mutation based on fused PET/CT images. First, we extracted 3-dimensional (3D) pulmonary nodules from PET and CT as regions of interest (ROIs). We then fused each single PET and CT image. The network model was used to predict the mutation status of lung nodules by the new data after fusion, and the model was weighted adaptively. The EfficientNet-V2 model used multiple channels to represent nodules comprehensively.

Results

We trained the EfficientNet-V2 model through our PET/CT fusion algorithm using a dataset of 150 patients. The prediction accuracy of EGFR and non-EGFR mutations was 86.25% in the training dataset, and the accuracy rate was 81.92% in the validation set.

Conclusions

Combined with experiments, the demonstrated PET/CT fusion algorithm outperformed radiomics methods in predicting EGFR and non-EGFR mutations in NSCLC.

Deep learning analysis to predict EGFR mutation status in lung adenocarcinoma manifesting as pure ground-glass opacity nodules on CT

BACKGROUND

Epidermal growth factor receptor-tyrosine kinase inhibitors (EGFR-TKIs) showed potency as a non-invasive therapeutic approach in pure ground-glass opacity nodule (pGGN) lung adenocarcinoma. However, optimal methods of extracting information about EGFR mutation from pGGN lung adenocarcinoma images remain uncertain. We aimed to develop, validate, and evaluate the clinical utility of a deep learning model for predicting EGFR mutation status in lung adenocarcinoma manifesting as pGGN on computed tomography (CT).

METHODS

We included 185 resected pGGN lung adenocarcinomas in the primary cohort. The patients were divided into training (n = 125), validation (n = 23), and test sets (n = 37). A preoperative CT-based deep learning model with clinical factors as well as clinical and radiomics models was constructed and applied to the test set. We evaluated the clinical utility of the deep learning model by applying it to 83 GGNs that received EGFR-TKI from an independent cohort (clinical validation set), and treatment response was regarded as the reference standard.

RESULTS

The prediction efficiencies of each model were compared in terms of area under the curve (AUC). Among the 185 pGGN lung adenocarcinomas, 122 (65.9%) were EGFR-mutant and 63 (34.1%) were EGFR-wild type. The AUC of the clinical, radiomics, and deep learning with clinical models to predict EGFR mutations were 0.50, 0.64, and 0.85, respectively, for the test set. The AUC of deep learning with the clinical model in the validation set was 0.72.

CONCLUSIONS

Deep learning approach of CT images combined with clinical factors can predict EGFR mutations in patients with lung adenocarcinomas manifesting as pGGN, and its clinical utility was demonstrated in a real-world sample.

Multiple instance learning for lung pathophysiological findings detection using CT scans

Lung diseases affect the lives of billions of people worldwide, and 4 million people, each year, die prematurely due to this condition. These pathologies are characterized by specific imagiological findings in CT scans. The traditional Computer-Aided Diagnosis (CAD) approaches have been showing promising results to help clinicians; however, CADs normally consider a small part of the medical image for analysis, excluding possible relevant information for clinical evaluation. Multiple Instance Learning (MIL) approach takes into consideration different small pieces that are relevant for the final classification and creates a comprehensive analysis of pathophysiological changes. This study uses MIL-based approaches to identify the presence of lung pathophysiological findings in CT scans for the characterization of lung disease development. This work was focus on the detection of the following: Fibrosis, Emphysema, Satellite Nodules in Primary Lesion Lobe, Nodules in Contralateral Lung and Ground Glass, being Fibrosis and Emphysema the ones with more outstanding results, reaching an Area Under the Curve (AUC) of 0.89 and 0.72, respectively. Additionally, the MIL-based approach was used for EGFR mutation status prediction - the most relevant oncogene on lung cancer, with an AUC of 0.69. The results showed that this comprehensive approach can be a useful tool for lung pathophysiological characterization.

Towards Machine Learning-Aided Lung Cancer Clinical Routines: Approaches and Open Challenges

Advancements in the development of computer-aided decision (CAD) systems for clinical routines provide unquestionable benefits in connecting human medical expertise with machine intelligence, to achieve better quality healthcare. Considering the large number of incidences and mortality numbers associated with lung cancer, there is a need for the most accurate clinical procedures; thus, the possibility of using artificial intelligence (AI) tools for decision support is becoming a closer reality. At any stage of the lung cancer clinical pathway, specific obstacles are identified and "motivate" the application of innovative AI solutions. This work provides a comprehensive review of the most recent research dedicated toward the development of CAD tools using computed tomography images for lung cancer-related tasks. We discuss the major challenges and provide critical perspectives on future directions. Although we focus on lung cancer in this review, we also provide a more clear definition of the path used to integrate AI in healthcare, emphasizing fundamental research points that are crucial for overcoming current barriers.

Three-Dimensional Convolutional Neural Network-Based Prediction of Epidermal Growth Factor Receptor Expression Status in Patients With Non-Small Cell Lung Cancer

Objectives

EGFR testing is a mandatory step before targeted therapy for non-small cell lung cancer patients. Combining some quantifiable features to establish a predictive model of EGFR expression status, break the limitations of tissue biopsy.

Materials and Methods

We retrospectively analyzed 1074 patients of non-small cell lung cancer with complete reports of EGFR gene testing. Then manually segmented VOI, captured the clinicopathological features, analyzed traditional radiology features, and extracted radiomic, and deep learning features. The cases were randomly divided into training and test set. We carried out feature screening; then applied the light GBM algorithm, Resnet-101 algorithm, logistic regression to develop sole models, and fused models to predict EGFR mutation conditions. The efficiency of models was evaluated by ROC and PRC curves.

Results

We successfully established Model_clinical, Model_radiomic, Model_CNN (based on clinical-radiology, radiomic and deep learning features respectively), Model_{radiomic+clinical} (combining clinical-radiology and radiomic features), and Model_{CNN+radiomic+clinical} (combining clinical-radiology, radiomic, and deep learning features). Among the prediction models, Model_{CNN+radiomic+clinical} showed the highest performance, followed by Model_CNN, and then Model_{radiomic+clinical}. All three models were able to accurately predict EGFR mutation with AUC values of 0.751, 0.738, and 0.684, respectively. There was no significant difference in the AUC values between Model_{CNN+radiomic+clinical} and Model_CNN. Further analysis showed that Model_{CNN+radiomic+clinical} effectively improved the efficacy of Model_{radiomic+clinical} and showed better efficacy than Model_CNN. The inclusion of clinical-radiology features did not effectively improve the efficacy of Model_radiomic.

Conclusions

Either deep learning or radiomic signature-based models can provide a fairly accurate non-invasive prediction of EGFR expression status. The model combined both features effectively enhanced the performance of radiomic models and provided marginal enhancement to deep learning models. Collectively, fusion models offer a novel and more reliable way of providing the efficacy of currently developed prediction models, and have far-reaching potential for the optimization of noninvasive EGFR mutation status prediction methods.

AIR-Net: A novel multi-task learning method with auxiliary image reconstruction for predicting EGFR mutation status on CT images of NSCLC patients

Automated and accurate EGFR mutation status prediction using computed tomography (CT) imagery is of great value for tailoring optimal treatments to non-small cell lung cancer (NSCLC) patients. However, existing deep learning based methods usually adopt a single task learning strategy to design and train EGFR mutation status prediction models with limited training data, which may be insufficient to learn distinguishable representations for promoting prediction performance. In this paper, a novel multi-task learning method named AIR-Net is proposed to precisely predict EGFR mutation status on CT images. First, an auxiliary image reconstruction task is effectively integrated with EGFR mutation status prediction, aiming at providing extra supervision at the training phase. Particularly, we adequately employ multi-level information in a shared encoder to generate more comprehensive representations of tumors. Second, a powerful feature consistency loss is further introduced to constrain semantic consistency of original and reconstructed images, which contributes to enhanced image reconstruction and offers more effective regularization to AIR-Net during training. Performance analysis of AIR-Net indicates that auxiliary image reconstruction plays an essential role in identifying EGFR mutation status. Furthermore, extensive experimental results demonstrate that our method achieves favorable performance against other competitive prediction methods. All the results executed in this study suggest that the effectiveness and superiority of AIR-Net in precisely predicting EGFR mutation status of NSCLC.

Systematic Review on the Association of Radiomics with Tumor Biological Endpoints

Radiomics supposes an alternative non-invasive tumor characterization tool, which has experienced increased interest with the advent of more powerful computers and more sophisticated machine learning algorithms. Nonetheless, the incorporation of radiomics in cancer clinical-decision support systems still necessitates a thorough analysis of its relationship with tumor biology. Herein, we present a systematic review focusing on the clinical evidence of radiomics as a surrogate method for tumor molecular profile characterization. An extensive literature review was conducted in PubMed, including papers on radiomics and a selected set of clinically relevant and commonly used tumor molecular markers. We summarized our findings based on different cancer entities, additionally evaluating the effect of different modalities for the prediction of biomarkers at each tumor site. Results suggest the existence of an association between the studied biomarkers and radiomics from different modalities and different tumor sites, even though a larger number of multi-center studies are required to further validate the reported outcomes.

Multi-channel multi-task deep learning for predicting EGFR and KRAS mutations of non-small cell lung cancer on CT images

BACKGROUND

Predicting the mutation statuses of 2 essential pathogenic genes [epidermal growth factor receptor (EGFR) and Kirsten rat sarcoma (KRAS)] in non-small cell lung cancer (NSCLC) based on CT is valuable for targeted therapy because it is a non-invasive and less costly method. Although deep learning technology has realized substantial computer vision achievements, CT imaging being used to predict gene mutations remains challenging due to small dataset limitations.

METHODS

We propose a multi-channel and multi-task deep learning (MMDL) model for the simultaneous prediction of EGFR and KRAS mutation statuses based on CT images. First, we decomposed each 3D lung nodule into 9 views. Then, we used the pre-trained inception-attention-resnet model for each view to learn the features of the nodules. By combining 9 inception-attention-resnet models to predict the types of gene mutations in lung nodules, the models were adaptively weighted, and the proposed MMDL model could be trained end-to-end. The MMDL model utilized multiple channels to characterize the nodule more comprehensively and integrate patient personal information into our learning process.

RESULTS

We trained the proposed MMDL model using a dataset of 363 patients collected by our partner hospital and conducted a multi-center validation on 162 patients in The Cancer Imaging Archive (TCIA) public dataset. The accuracies for the prediction of EGFR and KRAS mutations were, respectively, 79.43% and 72.25% in the training dataset and 75.06% and 69.64% in the validation dataset.

CONCLUSIONS

The experimental results demonstrated that the proposed MMDL model outperformed the latest methods in predicting EGFR and KRAS mutations in NSCLC.

Combining radiomic phenotypes of non-small cell lung cancer with liquid biopsy data may improve prediction of response to EGFR inhibitors

Among non-small cell lung cancer (NSCLC) patients with therapeutically targetable tumor mutations in epidermal growth factor receptor (EGFR), not all patients respond to targeted therapy. Combining circulating-tumor DNA (ctDNA), clinical variables, and radiomic phenotypes may improve prediction of EGFR-targeted therapy outcomes for NSCLC. This single-center retrospective study included 40 EGFR-mutant advanced NSCLC patients treated with EGFR-targeted therapy. ctDNA data included number of mutations and detection of EGFR T790M. Clinical data included age, smoking status, and ECOG performance status. Baseline chest CT scans were analyzed to extract 429 radiomic features from each primary tumor. Unsupervised hierarchical clustering was used to group tumors into phenotypes. Kaplan–Meier (K–M) curves and Cox proportional hazards regression were modeled for progression-free survival (PFS) and overall survival (OS). Likelihood ratio test (LRT) was used to compare fit between models. Among 40 patients (73% women, median age 62 years), consensus clustering identified two radiomic phenotypes. For PFS, the model combining radiomic phenotypes with ctDNA and clinical variables had c-statistic of 0.77 and a better fit (LRT p = 0.01) than the model with clinical and ctDNA variables alone with a c-statistic of 0.73. For OS, adding radiomic phenotypes resulted in c-statistic of 0.83 versus 0.80 when using clinical and ctDNA variables (LRT p = 0.08). Both models showed separation of K–M curves dichotomized by median prognostic score (p < 0.005). Combining radiomic phenotypes, ctDNA, and clinical variables may enhance precision oncology approaches to managing advanced non-small cell lung cancer with EGFR mutations.

CT Radiomics for Distinction of Human Epidermal Growth Factor Receptor 2 Negative Gastric Cancer

RATIONALE AND OBJECTIVES

The purpose of this study was to investigate the role of computed tomography (CT) radiomics for the prediction of the human epidermal growth factor 2 (HER2) status in patients with gastric cancer.

METHODS

One hundred and thirty two consecutive patients with advanced gastric cancer undergoing radical gastrectomy were retrospectively reviewed. All patients received preoperative contrast CT examination, and immunohistochemistry results of their HER2 status were available. All the subjects were randomly divided into a training cohort (n = 90) and a test cohort (n = 42). Arterial phase (AP) and portal phase (PP) contrast CT images were retrieved for tumor segmentation and feature extraction. Receiver operating characteristics (ROC) curves and area under the curve (AUC) were used to evaluate the performance of the radiomics classifiers.

RESULTS

Among the 132 patients, a total of 99 patients were HER2 negative, and the remaining 33 patients were border line or positive. The AP radiomics model could distinguish HER2-negative cases with an AUC of 0.756 (95% confidence interval [CI]: 0.656-0.840) in the training cohort, which was confirmed in the test cohort with AUC of 0.830 (95% CI: 0.678-0.930). The PP radiomics model showed AUCs of 0.715 (95% CI: 0.612-0.804) and 0.718 (95% CI: 0.554-0.849) in the training and test cohort for distinction of negative HER2 cases, respectively.

CONCLUSION

Radiomics models based on standard-of-care CT images hold promise for distinguishing HER2-negative gastric cancer.

Imaging genomics for accurate diagnosis and treatment of tumors: A cutting edge overview

Imaging genomics refers to the establishment of the connection between invasive gene expression features and non-invasive imaging features. Tumor imaging genomics can not only understand the macroscopic phenotype of tumor, but also can deeply analyze the cellular and molecular characteristics of tumor tissue. In recent years, tumor imaging genomics has been a key in the field of medicine. The incidence of cancer in China has increased significantly, which is the main reason of disease death of urban residents. With the rapid development of imaging medicine, depending on imaging genomics, many experts have made remarkable achievements in tumor screening and diagnosis, prognosis evaluation, new treatment targets and understanding of tumor biological mechanism. This review analyzes the relationship between tumor radiology and gene expression, which provides a favorable direction for clinical staging, prognosis evaluation and accurate treatment of tumors.

Artificial intelligence and hybrid imaging: the best match for personalized medicine in oncology

Artificial intelligence (AI) refers to a field of computer science aimed to perform tasks typically requiring human intelligence. Currently, AI is recognized in the broader technology radar within the five key technologies which emerge for their wide-ranging applications and impact in communities, companies, business, and value chain framework alike. However, AI in medical imaging is at an early phase of development, and there are still hurdles to take related to reliability, user confidence, and adoption. The present narrative review aimed to provide an overview on AI-based approaches (distributed learning, statistical learning, computer-aided diagnosis and detection systems, fully automated image analysis tool, natural language processing) in oncological hybrid medical imaging with respect to clinical tasks (detection, contouring and segmentation, prediction of histology and tumor stage, prediction of mutational status and molecular therapies targets, prediction of treatment response, and outcome). Particularly, AI-based approaches have been briefly described according to their purpose and, finally lung cancer-being one of the most extensively malignancy studied by hybrid medical imaging-has been used as illustrative scenario. Finally, we discussed clinical challenges and open issues including ethics, validation strategies, effective data-sharing methods, regulatory hurdles, educational resources, and strategy to facilitate the interaction among different stakeholders. Some of the major changes in medical imaging will come from the application of AI to workflow and protocols, eventually resulting in improved patient management and quality of life. Overall, several time-consuming tasks could be automatized. Machine learning algorithms and neural networks will permit sophisticated analysis resulting not only in major improvements in disease characterization through imaging, but also in the integration of multiple-omics data (i.e., derived from pathology, genomic, proteomics, and demographics) for multi-dimensional disease featuring. Nevertheless, to accelerate the transition of the theory to practice a sustainable development plan considering the multi-dimensional interactions between professionals, technology, industry, markets, policy, culture, and civil society directed by a mindset which will allow talents to thrive is necessary.

Radiomic Detection of EGFR Mutations in NSCLC

Radiomics is defined as the use of automated or semi-automated post-processing and analysis of multiple features derived from imaging exams. Extracted features might generate models able to predict the molecular profile of solid tumors. The aim of this study was to develop a predictive algorithm to define the mutational status of EGFR in treatment-naïve patients with advanced non-small cell lung cancer (NSCLC). CT scans from 109 treatment-naïve patients with NSCLC (21 EGFR-mutant and 88 EGFR-wild type) underwent radiomics analysis to develop a machine learning model able to recognize EGFR-mutant from EGFR-WT patients via CT scans. A "test-retest" approach was used to identify stable radiomics features. The accuracy of the model was tested on an external validation set from another institution and on a dataset from the Cancer Imaging Archive (TCIA). The machine learning model that considered both radiomic and clinical features (gender and smoking status) reached a diagnostic accuracy of 88.1% in our dataset with an AUC at the ROC curve of 0.85, whereas the accuracy values in the datasets from TCIA and the external institution were 76.6% and 83.3%, respectively. Furthermore, 17 distinct radiomics features detected at baseline CT scan were associated with subsequent development of T790M during treatment with an EGFR inhibitor. In conclusion, our machine learning model was able to identify EGFR-mutant patients in multiple validation sets with globally good accuracy, especially after data optimization. More comprehensive training sets might result in further improvement of radiomics-based algorithms. SIGNIFICANCE: These findings demonstrate that data normalization and "test-retest" methods might improve the performance of machine learning models on radiomics images and increase their reliability when used on external validation datasets.

Cancer genotypes prediction and associations analysis from imaging phenotypes: a survey on radiogenomics

In this paper, we present a survey on the progress of radiogenomics research, which predicts cancer genotypes from imaging phenotypes and investigates the associations between them. First, we present an overview of the popular technology modalities for obtaining diagnostic medical images. Second, we summarize recently used methodologies for radiogenomics analysis, including statistical analysis, radiomics and deep learning. And then, we give a survey on the recent research based on several types of cancers. Finally, we discuss these studies and propose possible future research directions. In conclusion, we have identified strong correlations between cancer genotypes and imaging phenotypes. In addition, with the rapid growth of medical data, deep learning models show great application potential for radiogenomics.

Do we need to see to believe?-radiomics for lung nodule classification and lung cancer risk stratification

Despite multiple recent advances, the diagnosis and management of lung cancer remain challenging and it continues to be the deadliest malignancy. In 2011, the National Lung Screening Trial (NLST) reported 20% reduction in lung cancer related mortality using annual low dose chest computed tomography (CT). These results led to the approval and nationwide establishment of lung cancer CT-based lung cancer screening programs. These findings have been further validated by the recently published Nederlands-Leuvens Longkanker Screenings Onderzoek (NELSON) and Multicentric Italian Lung Detection (MILD) trials, the latter showing benefit of screening even beyond the 5 years. However, the implementation of lung cancer screening has been impeded by several challenges, including the differentiation between benign and malignant nodules, the large number of false positive studies and the detection of indolent, potentially clinically insignificant lung cancers (overdiagnosis). Hence, the development of non-invasive strategies to accurately classify and risk stratify screen-detected pulmonary nodules in order to individualize clinical management remains a high priority area of research. Radiomics is a recently coined term which refers to the process of imaging feature extraction and quantitative analysis of clinical diagnostic images to characterize the nodule phenotype beyond what is possible with conventional radiologist assessment. Even though it is still in early phase, several studies have already demonstrated that radiomics approaches are potentially useful for lung nodule classification, risk stratification, individualized management and prediction of overall prognosis. The goal of this review is to summarize the current literature regarding the radiomics of screen-detected lung nodules, highlight potential challenges and discuss its clinical application along with future goals and challenges.

Imaging-Based Prediction of Molecular Therapy Targets in NSCLC by Radiogenomics and AI Approaches: A Systematic Review

The objective of this systematic review was to analyze the current state of the art of imaging-derived biomarkers predictive of genetic alterations and immunotherapy targets in lung cancer. We included original research studies reporting the development and validation of imaging feature-based models. The overall quality, the standard of reporting and the advancements towards clinical practice were assessed. Eighteen out of the 24 selected articles were classified as "high-quality" studies according to the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). The 18 "high-quality papers" adhered to Transparent Reporting of a multivariable prediction model for Individual Prognosis or Diagnosis (TRIPOD) with a mean of 62.9%. The majority of "high-quality" studies (16/18) were classified as phase II. The most commonly used imaging predictors were radiomic features, followed by visual qualitative computed tomography (CT) features, convolutional neural network-based approaches and positron emission tomography (PET) parameters, all used alone or combined with clinicopathologic features. The majority (14/18) were focused on the prediction of epidermal growth factor receptor (EGFR) mutation. Thirty-five imaging-based models were built to predict the EGFR status. The model's performances ranged from weak (n = 5) to acceptable (n = 11), to excellent (n = 18) and outstanding (n = 1) in the validation set. Positive outcomes were also reported for the prediction of ALK rearrangement, ALK/ROS1/RET fusions and programmed cell death ligand 1 (PD-L1) expression. Despite the promising results in terms of predictive performance, image-based models, suffering from methodological bias, require further validation before replacing traditional molecular pathology testing.

Radiomics Signature as a Predictive Factor for EGFR Mutations in Advanced Lung Adenocarcinoma

Purpose: To develop and validate a radiomic signature to identify EGFR mutations in patients with advanced lung adenocarcinoma.

Methods: This study involved 201 patients with advanced lung adenocarcinoma (140 in the training cohort and 61 in the validation cohort). A total of 396 features were extracted from manual segmentation based on enhanced and non-enhance CT imaging after image preprocessing. The Lasso algorithm was used for feature selection, 6 machine learning methods were used to construct radiomics models. Receiver operating characteristic (ROC) curve analysis was applied to evaluate the performance of the radiomic signature between different data and methods. A nomogram was developed using clinical factors and the radiomics signature, then it was analyzed based on its discriminatory ability and calibration. Decision curve analysis (DCA) was implemented to evaluate the clinical utility.

Results: Ten features for contrast data and eleven features for non-contrast data were selected through LASSO algorithm. The performance of the radiomics signature for contrast images was better than that for non-contrast images in all of the 6 different machine learning methods. Finally, the best radiomics signature was built with logistic regression method based on enhanced CT imaging with an area under the curve (AUC) of 0.851 (95% CI, 0.750 to 0.951) in the validation cohort. A nomogram was developed using the radiomics signature and sex with a C-index of 0.908 (95%CI, 0.862 to 0.954) in the training cohort and 0.835 (95% CI, 0.825 to 0.845) in the validation cohort. It showed good discrimination and calibration (Hosmer-Lemeshow test, P = 0.621 for the training cohort and P = 0.605 for the validation cohort).

Conclusion: Radiomics signature can help to distinguish between EGFR positive and wild type advanced lung adenocarcinomas.

CT radiomics and PET radiomics: ready for clinical implementation?

INTRODUCTION

Today, rapid technical and clinical developments result in an increasing number of treatment options for oncological diseases. Thus, decision support systems are needed to offer the right treatment to the right patient. Imaging biomarkers hold great promise in patient-individual treatment guidance. Routinely performed for diagnosis and staging, imaging datasets are expected to hold more information than used in the clinical practice. Radiomics describes the extraction of a large number of meaningful quantitative features from medical images, such as computed tomography (CT) and positron emission tomography (PET). Due to the non-invasive nature and ability to capture 3D image-based heterogeneity, radiomic features are potential surrogate markers of the cancer phenotype. Several radiomic studies are published per day, owing to encouraging results of many radiomics-based patient outcome models. Despite this comparably large number of studies, radiomics is mainly studied in proof of principle concept. Hence, a translation of radiomics from a hot topic research field into an essential clinical decision-making tool is lacking, but of high clinical interest.

EVIDENCE ACQUISITION

Herein, we present a literature review addressing the clinical evidence of CT and PET radiomics. An extensive literature review was conducted in PubMed, including papers on robustness and clinical applications.

EVIDENCE SYNTHESIS

We summarize image-modality related influences on the robustness of radiomic features and provide an overview of clinical evidence reported in the literature. Today, more evidence has been provided for CT imaging, however, PET imaging offers the promise of direct imaging of biological processes and functions. We provide a summary of future research directions, which needs to be addressed in order to successfully introduce radiomics into clinical medicine. In comparison to CT, more focus should be directed towards harmonization of PET acquisition and reconstruction protocols, which is important for transferable modelling.

CONCLUSIONS

Both CT and PET radiomics are promising pre-treatment and intra-treatment biomarkers for outcome prediction. Most studies are performed in retrospective setting, however their validation in prospective data collections is ongoing.

Implementation strategy of a CNN model affects the performance of CT assessment of EGFR mutation status in lung cancer patients

OBJECTIVE

To compare CNN models implemented using different strategies in the CT assessment of EGFR mutation status in patients with lung adenocarcinoma.

METHODS

1,010 consecutive lung adenocarcinoma patients with known EGFR mutation status were randomly divided into a training set (n=810) and a testing set (n=200). CNN models were constructed based on ResNet-101 architecture but implemented using different strategies: dimension filters (2D/3D), input sizes (small/middle/large and their fusion), slicing methods (transverse plane only and arbitrary multi-view planes), and training approaches (from scratch and fine-tuning a pre-trained CNN). The performance of the CNN models was compared using AUC.

RESULTS

The fusion approach yielded consistently better performance than other input sizes, although the effect often did not reach statistical significance. Multi-view slicing was significantly superior to the transverse method when fine-tuning a pre-trained 2D CNN but not a CNN trained from scratch. The 3D CNN was significantly better than the 2D transverse plane method but only marginally better than the multi-view slicing method when trained from scratch. The highest performance (AUC=0.838) was achieved for the fine-tuned 2D CNN model when built using the fusion input size and multi-view slicing method.

CONCLUSION

The assessment of EGFR mutation status in patients is more accurate when CNN models use more spatial information and are fine-tuned by transfer learning. Our finding about implementation strategy of a CNN model could be a guidance to other medical 3D images applications. Compared with other published studies which used medical images to identify EGFR mutation status, our CNN model achieved the best performance in a biggest patient cohort.