The deep learning model combining CT image and clinicopathological information for predicting ALK fusion status and response to ALK-TKI therapy in non-small cell lung cancer patients

Artificial Intelligence in Lung Cancer Imaging: From Data to Therapy

Lung cancer remains a global health challenge, leading to substantial morbidity and mortality. While prevention and early detection strategies have improved, the need for precise diagnosis, prognosis, and treatment remains crucial. In this comprehensive review article, we explore the role of artificial intelligence (AI) in reshaping the management of lung cancer. AI may have different potential applications in lung cancer characterization and outcome prediction. Manual segmentation is a time-consuming task, with high inter-observer variability, that can be replaced by AI-based approaches, including deep learning models such as U-Net, BCDU-Net, and others, to quantify lung nodules and cancers objectively and to extract radiomics features for the characterization of the tissue. AI models have also demonstrated their ability to predict treatment responses, such as immunotherapy and targeted therapy, by integrating radiomic features with clinical data. Additionally, AI-based prognostic models have been developed to identify patients at higher risk and personalize treatment strategies. In conclusion, this review article provides a comprehensive overview of the current state of AI applications in lung cancer management, spanning from segmentation and virtual biopsy to outcome prediction. The evolving role of AI in improving the precision and effectiveness of lung cancer diagnosis and treatment underscores its potential to significantly impact clinical practice and patient outcomes.

AI/ML advances in non-small cell lung cancer biomarker discovery

Lung cancer is the leading cause of cancer deaths among both men and women, representing approximately 25% of cancer fatalities each year. The treatment landscape for non-small cell lung cancer (NSCLC) is rapidly evolving due to the progress made in biomarker-driven targeted therapies. While advancements in targeted treatments have improved survival rates for NSCLC patients with actionable biomarkers, long-term survival remains low, with an overall 5-year relative survival rate below 20%. Artificial intelligence/machine learning (AI/ML) algorithms have shown promise in biomarker discovery, yet NSCLC-specific studies capturing the clinical challenges targeted and emerging patterns identified using AI/ML approaches are lacking. Here, we employed a text-mining approach and identified 215 studies that reported potential biomarkers of NSCLC using AI/ML algorithms. We catalogued these studies with respect to BEST (Biomarkers, EndpointS, and other Tools) biomarker sub-types and summarized emerging patterns and trends in AI/ML-driven NSCLC biomarker discovery. We anticipate that our comprehensive review will contribute to the current understanding of AI/ML advances in NSCLC biomarker research and provide an important catalogue that may facilitate clinical adoption of AI/ML-derived biomarkers.

Development and validation of a deep learning radiomics nomogram for preoperatively differentiating thymic epithelial tumor histologic subtypes

OBJECTIVES

Using contrast-enhanced computed tomography (CECT) and deep learning technology to develop a deep learning radiomics nomogram (DLRN) to preoperative predict risk status of patients with thymic epithelial tumors (TETs).

METHODS

Between October 2008 and May 2020, 257 consecutive patients with surgically and pathologically confirmed TETs were enrolled from three medical centers. We extracted deep learning features from all lesions using a transformer-based convolutional neural network and created a deep learning signature (DLS) using selector operator regression and least absolute shrinkage. The predictive capability of a DLRN incorporating clinical characteristics, subjective CT findings and DLS was evaluated by the area under the curve (AUC) of a receiver operating characteristic curve.

RESULTS

To construct a DLS, 25 deep learning features with non-zero coefficients were selected from 116 low-risk TETs (subtypes A, AB, and B1) and 141 high-risk TETs (subtypes B2, B3, and C). The combination of subjective CT features such as infiltration and DLS demonstrated the best performance in differentiating TETs risk status. The AUCs in the training, internal validation, external validation 1 and 2 cohorts were 0.959 (95% confidence interval [CI]: 0.924-0.993), 0.868 (95% CI: 0.765-0.970), 0.846 (95% CI: 0.750-0.942), and 0.846 (95% CI: 0.735-0.957), respectively. The DeLong test and decision in curve analysis revealed that the DLRN was the most predictive and clinically useful model.

CONCLUSIONS

The DLRN comprised of CECT-derived DLS and subjective CT findings showed a high performance in predicting risk status of patients with TETs.

CLINICAL RELEVANCE STATEMENT

Accurate risk status assessment of thymic epithelial tumors (TETs) may aid in determining whether preoperative neoadjuvant treatment is necessary. A deep learning radiomics nomogram incorporating enhancement CT-based deep learning features, clinical characteristics, and subjective CT findings has the potential to predict the histologic subtypes of TETs, which can facilitate decision-making and personalized therapy in clinical practice.

KEY POINTS

• A non-invasive diagnostic method that can predict the pathological risk status may be useful for pretreatment stratification and prognostic evaluation in TET patients. • DLRN demonstrated superior performance in differentiating the risk status of TETs when compared to the deep learning signature, radiomics signature, or clinical model. • The DeLong test and decision in curve analysis revealed that the DLRN was the most predictive and clinically useful in differentiating the risk status of TETs.

Pretherapy investigations using highly robust visualized biomarkers from CT imaging by multiple machine-learning techniques toward its prognosis prediction for ALK-inhibitor therapy in NSCLC: a feasibility study

PURPOSE

Molecularly targeted therapy has revolutionized the therapeutic landscape and is emerging as the first-line treatment option for ALK-rearranged non-small-cell lung cancer (NSCLC). In this study, the highly informative and robust biomarkers based on pre-treatment CT images and clinicopathologic features will be developed and validated to predict the prognosis for ALK-inhibitor therapy in NSCLC patients.

METHODS

A total of 161 ALK-positive NSCLC patients treated with ALK inhibitors were retrospectively collected as training, validation and test sets from multi-center institutions. Cox proportional hazard regression (CPH) penalized by LASSO and random survival forest (RSF) coupled with recursive feature elimination (RFE) were used for radiomics and clinical features identification and model construction. An overlapping post-processing method was extra added to training process to investigate the stronger biomarker on the whole set.

RESULTS

123 of the collected cases progressed after a median follow-up of 15.5 months (IQR, 8.3-25.3). The T and M staging, pericardial effusion, age and ALK inhibitor-alectinib were determined as significant predictors in the survival analysis. Furthermore, we visualized the finally retained 4 radiomics feature. The RSF models built from overlapping-processed clinical and radiomics features respectively reached the maximum C-index of 0.68 and 0.75,but the combination of them,radioclinical signature, improved the score to 0.78. The model on the validation and external test datasets yielded the C-index of 0.73 and 0.79, with the iAUC of 0.76 and 0.83, the IBS of 0.119 and 0.112.

CONCLUSION

With respect to a simple selection strategy of overlapping optimal radiomics and clinical features from different survival models may promote better progression-free survival(PFS) prediction than conventional survival analysis, which provides a potential method for guiding personalized pre-treatment options of NSCLC.

A new lung cancer detection method based on the chest CT images using Federated Learning and blockchain systems

With an estimated five million fatal cases each year, lung cancer is one of the significant causes of death worldwide. Lung diseases can be diagnosed with a Computed Tomography (CT) scan. The scarcity and trustworthiness of human eyes is the fundamental issue in diagnosing lung cancer patients. The main goal of this study is to detect malignant lung nodules in a CT scan of the lungs and categorize lung cancer according to severity. In this work, cutting-edge Deep Learning (DL) algorithms were used to detect the location of cancerous nodules. Also, the real-life issue is sharing data with hospitals around the world while bearing in mind the organizations' privacy issues. Besides, the main problems for training a global DL model are creating a collaborative model and maintaining privacy. This study presented an approach that takes a modest amount of data from multiple hospitals and uses blockchain-based Federated Learning (FL) to train a global DL model. The data were authenticated using blockchain technology, and FL trained the model internationally while maintaining the organization's anonymity. First, we presented a data normalization approach that addresses the variability of data obtained from various institutions using various CT scanners. Furthermore, using a CapsNets method, we classified lung cancer patients in local mode. Finally, we devised a way to train a global model cooperatively utilizing blockchain technology and FL while maintaining anonymity. We also gathered data from real-life lung cancer patients for testing purposes. The suggested method was trained and tested on the Cancer Imaging Archive (CIA) dataset, Kaggle Data Science Bowl (KDSB), LUNA 16, and the local dataset. Finally, we performed extensive experiments with Python and its well-known libraries, such as Scikit-Learn and TensorFlow, to evaluate the suggested method. The findings showed that the method effectively detects lung cancer patients. The technique delivered 99.69 % accuracy with the smallest possible categorization error.

Artificial Intelligence for Cardiothoracic Imaging: Overview of Current and Emerging Applications

Artificial intelligence algorithms can learn by assimilating information from large datasets in order to decipher complex associations, identify previously undiscovered pathophysiological states, and construct prediction models. There has been tremendous interest and increased incorporation of artificial intelligence into various industries, including healthcare. As a result, there has been an exponential rise in the number of research articles and industry participants producing models intended for a variety of applications in medical imaging, which can be challenging to navigate for radiologists. In thoracic imaging, multiple applications are being evaluated for chest radiography and computed tomography and include applications for lung nodule evaluation and cancer imaging, quantifying diffuse lung disorders, and cardiac imaging, to name a few. This review aims to provide an overview of current clinical AI models, focusing on the most common clinical applications of AI in cardiothoracic imaging.

Predicting gene mutation status via artificial intelligence technologies based on multimodal integration (MMI) to advance precision oncology

Personalized treatment strategies for cancer frequently rely on the detection of genetic alterations which are determined by molecular biology assays. Historically, these processes typically required single-gene sequencing, next-generation sequencing, or visual inspection of histopathology slides by experienced pathologists in a clinical context. In the past decade, advances in artificial intelligence (AI) technologies have demonstrated remarkable potential in assisting physicians with accurate diagnosis of oncology image-recognition tasks. Meanwhile, AI techniques make it possible to integrate multimodal data such as radiology, histology, and genomics, providing critical guidance for the stratification of patients in the context of precision therapy. Given that the mutation detection is unaffordable and time-consuming for a considerable number of patients, predicting gene mutations based on routine clinical radiological scans or whole-slide images of tissue with AI-based methods has become a hot issue in actual clinical practice. In this review, we synthesized the general framework of multimodal integration (MMI) for molecular intelligent diagnostics beyond standard techniques. Then we summarized the emerging applications of AI in the prediction of mutational and molecular profiles of common cancers (lung, brain, breast, and other tumor types) pertaining to radiology and histology imaging. Furthermore, we concluded that there truly exist multiple challenges of AI techniques in the way of its real-world application in the medical field, including data curation, feature fusion, model interpretability, and practice regulations. Despite these challenges, we still prospect the clinical implementation of AI as a highly potential decision-support tool to aid oncologists in future cancer treatment management.

Deep learning magnetic resonance imaging predicts platinum sensitivity in patients with epithelial ovarian cancer

Objective

The aim of the study is to develop and validate a deep learning model to predict the platinum sensitivity of patients with epithelial ovarian cancer (EOC) based on contrast-enhanced magnetic resonance imaging (MRI).

Methods

In this retrospective study, 93 patients with EOC who received platinum-based chemotherapy (≥4 cycles) and debulking surgery at the Sun Yat-sen Memorial Hospital from January 2011 to January 2020 were enrolled and randomly assigned to the training and validation cohorts (2:1). Two different models were built based on either the primary tumor or whole volume of the abdomen as the volume of interest (VOI) within the same cohorts, and then a pre-trained convolutional neural network Med3D (Resnet 10 version) was transferred to automatically extract 1,024 features from two MRI sequences (CE-T1WI and T2WI) of each patient to predict platinum sensitivity. The performance of the two models was compared.

Results

A total of 93 women (mean age, 50.5 years ± 10.5 [standard deviation]) were evaluated (62 in the training cohort and 31 in the validation cohort). The AUCs of the whole abdomen model were 0.97 and 0.98 for the training and validation cohorts, respectively, which was better than the primary tumor model (AUCs of 0.88 and 0.81 in the training and validation cohorts, respectively). In k-fold cross-validation and stratified analysis, the whole abdomen model maintained a stable performance, and the decision function value generated by the model was a prognostic indicator that successfully discriminates high- and low-risk recurrence patients.

Conclusion

The non-manually segmented whole-abdomen deep learning model based on MRI exhibited satisfactory predictive performance for platinum sensitivity and may assist gynecologists in making optimal treatment decisions.

Thoracic Imaging in China: Yesterday, Today, and Tomorrow

Thoracic imaging has been revolutionized through advances in technology and research around the world, and so has China. Thoracic imaging in China has progressed from anatomic observation to quantitative and functional evaluation, from using traditional approaches to using artificial intelligence. This article will review the past, present, and future of thoracic imaging in China, in an attempt to establish new accepted strategies moving forward.

Artificial Intelligence in Lung Cancer Imaging: Unfolding the Future

Lung cancer is one of the malignancies with higher morbidity and mortality. Imaging plays an essential role in each phase of lung cancer management, from detection to assessment of response to treatment. The development of imaging-based artificial intelligence (AI) models has the potential to play a key role in early detection and customized treatment planning. Computer-aided detection of lung nodules in screening programs has revolutionized the early detection of the disease. Moreover, the possibility to use AI approaches to identify patients at risk of developing lung cancer during their life can help a more targeted screening program. The combination of imaging features and clinical and laboratory data through AI models is giving promising results in the prediction of patients’ outcomes, response to specific therapies, and risk for toxic reaction development. In this review, we provide an overview of the main imaging AI-based tools in lung cancer imaging, including automated lesion detection, characterization, segmentation, prediction of outcome, and treatment response to provide radiologists and clinicians with the foundation for these applications in a clinical scenario.

Predicting anaplastic lymphoma kinase rearrangement status in patients with non-small cell lung cancer using a machine learning algorithm that combines clinical features and CT images

PURPOSE

To develop an appropriate machine learning model for predicting anaplastic lymphoma kinase (ALK) rearrangement status in non-small cell lung cancer (NSCLC) patients using computed tomography (CT) images and clinical features.

METHOD AND MATERIALS

This study included 193 patients with NSCLC (154 in the training cohort, 39 in the validation cohort), 68 of whom tested positive for ALK rearrangements and 125 of whom tested negative. From the nonenhanced CT scans, 157 radiomic characteristics were extracted, and 8 clinical features were collected. Five machine learning (ML) models were assessed to find the best classification model for predicting ALK rearrangement status. A radiomic signature was developed using the least absolute shrinkage and selection operator (LASSO) algorithm. The predictive performance of the models based on radiomic features, clinical features, and their combination was assessed by receiver operating characteristic (ROC) curves.

RESULTS

The support vector machine (SVM) model had the highest AUC of 0.914 for classification. The clinical features model had an AUC=0.805 (95% CI 0.731-0.877) and an AUC=0.735 (95% CI 0.566-0.863) in the training and validation cohorts, respectively. The CT image-based ML model had an AUC=0.953 (95% CI 0.913-1.0) in the training cohort and an AUC=0.890 (95% CI 0.778-0.971) in the validation cohort. For predicting ALK rearrangement status, the ML model based on CT images and clinical features performed better than the model based on only clinical information or CT images, with an AUC of 0.965 (95% CI 0.826-0.882) in the primary cohort and an AUC of 0.914 (95% CI 0.804-0.893) in the validation cohort.

CONCLUSION

Our findings revealed that ALK rearrangement status could be accurately predicted using an ML-based classification model based on CT images and clinical data.

Artificial Intelligence-Powered Prediction of ALK Gene Rearrangement in Patients With Non-Small-Cell Lung Cancer

PURPOSE

Several studies reported the possibility of predicting genetic abnormalities in non-small-cell lung cancer by deep learning (DL). However, there are no data of predicting ALK gene rearrangement (ALKr) using DL. We evaluated the ALKr predictability using the DL platform.

MATERIALS AND METHODS

We selected 66 ALKr-positive cases and 142 ALKr-negative cases, which were diagnosed by ALKr immunohistochemical staining in our institution from January 2009 to March 2019. We generated virtual slide of 300 slides (150 ALKr-positive slides and 150 ALKr-negative slides) using NanoZoomer. HALO-AI was used to analyze the whole-slide imaging data, and the DenseNet network was used to build the learning model. Of the 300 slides, we randomly assigned 172 slides to the training cohort and 128 slides to the test cohort to ensure no duplication of cases. In four resolutions (16.0/4.0/1.0/0.25 μm/pix), ALKr prediction models were built in the training cohort and ALKr prediction performance was evaluated in the test cohort. We evaluated the diagnostic probability of ALKr by receiver operating characteristic analysis in each ALKr probability threshold (50%, 60%, 70%, 80%, 90%, and 95%). We expected the area under the curve to be 0.64-0.85 in the model of a previous study. Furthermore, in the test cohort data, an expert pathologist also evaluated the presence of ALKr by hematoxylin and eosin staining on whole-slide imaging.

RESULTS

The maximum area under the curve was 0.73 (50% threshold: 95% CI, 0.65 to 0.82) in the resolution of 1.0 μm/pix. In this resolution, with an ALKr probability of 50% threshold, the sensitivity and specificity were 73% and 73%, respectively. The expert pathologist's sensitivity and specificity in the same test cohort were 13% and 94%.

CONCLUSION

The ALKr prediction by DL was feasible. Further study should be addressed to improve accuracy of ALKr prediction.

Evaluation of clinicopathological features determining treatment response in patients with ALK mutant NSCLC

ALK (anaplastic lymphoma kinase) inhibitors may be used to treat patients with ALK mutant metastatic nonsmall cell cancer (NSCLC). This study aimed to investigate the factors affecting the patients response to treatment with ALK-positive metastatic NSCLC. Data of the patients were investigated retrospectively. Binary regression analysis was performed to evaluate response predictors of treatment. Furthermore, we determined the cut-off value of the ALK-positivity for objective response to the therapy using ROC analysis. A total of 68 patients were included in the research. The median overall survival was observed 39.2 months. The overall response rate was 66.2%. The ratio of ALK positivity (P = .02), gender (P = .04), and the total number of metastatic sites (P = .02) all were detected as predictors of the response to ALK inhibitor in binary regression analysis. ALK inhibitor type (P = .56), primary tumor location (P = .35), pathological subtype (P = .68), de-novo metastatic disease (P = .28), and age (P = .94) were not predictive indicators for response. The cut-off level of ALK positivity was found to be 33% in patients with an objective response. The real-life effectiveness of ALK inhibitors in NSCLC patients with ALK mutations was shown in this research. We determined that having less than 3 metastatic sites, having a high ALK positivity ratio, and being female were all good predictors of ALK inhibitor response.

Artificial intelligence-based prediction of clinical outcome in immunotherapy and targeted therapy of lung cancer

Lung cancer accounts for the main proportion of malignancy-related deaths and most patients are diagnosed at an advanced stage. Immunotherapy and targeted therapy have great advances in application in clinics to treat lung cancer patients, yet the efficacy is unstable. The response rate of these therapies varies among patients. Some biomarkers have been proposed to predict the outcomes of immunotherapy and targeted therapy, including programmed cell death-ligand 1 (PD-L1) expression and oncogene mutations. Nevertheless, the detection tests are invasive, time-consuming, and have high demands on tumor tissue. The predictive performance of conventional biomarkers is also unsatisfactory. Therefore, novel biomarkers are needed to effectively predict the outcomes of immunotherapy and targeted therapy. The application of artificial intelligence (AI) can be a possible solution, as it has several advantages. AI can help identify features that are unable to be used by humans and perform repetitive tasks. By combining AI methods with radiomics, pathology, genomics, transcriptomics, proteomics, and clinical data, the integrated model has shown predictive value in immunotherapy and targeted therapy, which significantly improves the precision treatment of lung cancer patients. Herein, we reviewed the application of AI in predicting the outcomes of immunotherapy and targeted therapy in lung cancer patients, and discussed the challenges and future directions in this field.

External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review

Purpose

To assess generalizability of published deep learning (DL) algorithms for radiologic diagnosis.

Materials and Methods

In this systematic review, the PubMed database was searched for peer-reviewed studies of DL algorithms for image-based radiologic diagnosis that included external validation, published from January 1, 2015, through April 1, 2021. Studies using nonimaging features or incorporating non-DL methods for feature extraction or classification were excluded. Two reviewers independently evaluated studies for inclusion, and any discrepancies were resolved by consensus. Internal and external performance measures and pertinent study characteristics were extracted, and relationships among these data were examined using nonparametric statistics.

Results

Eighty-three studies reporting 86 algorithms were included. The vast majority (70 of 86, 81%) reported at least some decrease in external performance compared with internal performance, with nearly half (42 of 86, 49%) reporting at least a modest decrease (≥0.05 on the unit scale) and nearly a quarter (21 of 86, 24%) reporting a substantial decrease (≥0.10 on the unit scale). No study characteristics were found to be associated with the difference between internal and external performance.

Conclusion

Among published external validation studies of DL algorithms for image-based radiologic diagnosis, the vast majority demonstrated diminished algorithm performance on the external dataset, with some reporting a substantial performance decrease.Keywords: Meta-Analysis, Computer Applications-Detection/Diagnosis, Neural Networks, Computer Applications-General (Informatics), Epidemiology, Technology Assessment, Diagnosis, Informatics Supplemental material is available for this article. © RSNA, 2022.

A CT-based radiomics model to predict subsequent brain metastasis in patients with ALK-rearranged non-small cell lung cancer undergoing crizotinib treatment

Background

Brain metastasis (BM) comprises the most common reason for crizotinib failure in patients with anaplastic lymphoma kinase (ALK)‐rearranged non–small cell lung cancer (NSCLC). We hypothesize that its occurrence could be predicted by a computed tomography (CT)‐based radiomics model, therefore, allowing for selection of enriched patient populations for prevention therapies.

Methods

A total of 75 eligible patients were enrolled from Sun Yat‐sen University Cancer Center between June 2014 and September 2019. The primary endpoint was brain metastasis‐free survival (BMFS), estimated from the initiation of crizotinib to the date of the occurrence of BM. Patients were randomly divided into two cohorts for model training (n = 51) and validation (n = 24), respectively. A radiomics signature was constructed based on features extracted from chest CT before crizotinib treatment. Clinical model was developed using the Cox proportional hazards model. Log‐rank test was performed to describe the difference of BMFS risk.

Results

Patients with low radiomics score had significantly longer BMFS than those with higher, both in the training cohort (p = 0.019) and validation cohort (p = 0.048). The nomogram combining smoking history and the radiomics signature showed good performance for the estimation of BMFS, both in the training (concordance index [C‐index], 0.762; 95% confidence interval [CI], 0.663–0.861) and validation cohort (C‐index, 0.724; 95% CI, 0.601–0.847).

Conclusion

We have developed a CT‐based radiomics model to predict subsequent BM in patients with non‐brain metastatic NSCLC undergoing crizotinib treatment. Selection of an enriched patient population at high BM risk will facilitate the design of clinical trials or strategies to prevent BM.

Artificial intelligence-assisted decision making for prognosis and drug efficacy prediction in lung cancer patients: a narrative review

Objective

In this review, we aim to present frontier studies in patients with lung cancer as it related to artificial intelligence (AI)-assisted decision-making and summarize the latest advances, challenges and future trend in this field.

Background

Despite increasing survival rate in cancer patients over the last decades, lung cancer remains one of the leading causes of death worldwide. The early diagnosis, accurate evaluation and individualized treatment are vital approaches to improve the survival rate of patients with lung cancer. Thus, decision making based on these approaches requires accuracy and efficiency beyond manpower. Recent advances in AI and precision medicine have provided a fertile environment for the development of AI-based models. These models have the potential to assist radiologists and oncologists in detecting lung cancer, predicting prognosis and developing personalized treatment plans for better outcomes of the patients.

Methods

We searched literature from 2000 through July 31^th, 2021 in Medline/PubMed, the Web of Science, the Cochrane Library, ACM Digital Library, INSPEC and EMBASE. Key words such as “artificial intelligence”, “AI”, “deep learning”, “lung cancer”, “NSCLC”, “SCLC” were combined to identify related literatures. These literatures were then selected by two independent authors. Articles chosen by only one author will be examined by another author to determine whether this article was relative and valuable. The selected literatures were read by all authors and discussed to draw reliable conclusions.

Conclusions

AI, especially for those based on deep learning and radiomics, is capable of assisting clinical decision making from many aspects, for its quantitatively interpretation of patients’ information and its potential to deal with the dynamics, individual differences and heterogeneity of lung cancer. Hopefully, remaining problems such as insufficient data and poor interpretability may be solved to put AI-based models into clinical practice.

Deep Learning to Predict EGFR Mutation and PD-L1 Expression Status in Non-Small-Cell Lung Cancer on Computed Tomography Images

OBJECTIVE

The detection of epidermal growth factor receptor (EGFR) mutation and programmed death ligand-1 (PD-L1) expression status is crucial to determine the treatment strategies for patients with non-small-cell lung cancer (NSCLC). Recently, the rapid development of radiomics including but not limited to deep learning techniques has indicated the potential role of medical images in the diagnosis and treatment of diseases.

METHODS

Eligible patients diagnosed/treated at the West China Hospital of Sichuan University from January 2013 to April 2019 were identified retrospectively. The preoperative CT images were obtained, as well as the gene status regarding EGFR mutation and PD-L1 expression. Tumor region of interest (ROI) was delineated manually by experienced respiratory specialists. We used 3D convolutional neural network (CNN) with ROI information as input to construct a classification model and established a prognostic model combining deep learning features and clinical features to stratify survival risk of lung cancer patients.

RESULTS

The whole cohort (N = 1262) was divided into a training set (N = 882, 70%), validation set (N = 125, 10%), and test set (N = 255, 20%). We used a 3D convolutional neural network (CNN) to construct a prediction model, with AUCs of 0.96 (95% CI: 0.94-0.98), 0.80 (95% CI: 0.72-0.88), and 0.73 (95% CI: 0.63-0.83) in the training, validation, and test cohorts, respectively. The combined prognostic model showed a good performance on survival prediction in NSCLC patients (C-index: 0.71).

CONCLUSION

In this study, a noninvasive and effective model was proposed to predict EGFR mutation and PD-L1 expression status as a clinical decision support tool. Additionally, the combination of deep learning features with clinical features demonstrated great stratification capabilities in the prognostic model. Our team would continue to explore the application of imaging markers for treatment selection of lung cancer patients.

A Convolutional Neural Network-Based Intelligent Medical System with Sensors for Assistive Diagnosis and Decision-Making in Non-Small Cell Lung Cancer

In many regions of the world, early diagnosis of non-small cell lung cancer (NSCLC) is a major challenge due to the large population and lack of medical resources, which is difficult toeffectively address via limited physician manpower alone. Therefore, we developed a convolutional neural network (CNN)-based assisted diagnosis and decision-making intelligent medical system with sensors. This system analyzes NSCLC patients' medical records using sensors to assist staging a diagnosis and provides recommended treatment plans to physicians. To address the problem of unbalanced case samples across pathological stages, we used transfer learning and dynamic sampling techniques to reconstruct and iteratively train the model to improve the accuracy of the prediction system. In this paper, all data for training and testing the system were obtained from the medical records of 2,789,675 patients with NSCLC, which were recorded in three hospitals in China over a five-year period. When the number of case samples reached 8000, the system achieved an accuracy rate of 0.84, which is already close to that of the doctors (accuracy: 0.86). The experimental results proved that the system can quickly and accurately analyze patient data and provide decision information support for physicians.

Prediction of EGFR Mutation Status Based on 18F-FDG PET/CT Imaging Using Deep Learning-Based Model in Lung Adenocarcinoma

Objective

The purpose of this study was to develop a deep learning-based system to automatically predict epidermal growth factor receptor (EGFR) mutant lung adenocarcinoma in ¹⁸F-fluorodeoxyglucose (FDG) positron emission tomography/computed tomography (PET/CT).

Methods

Three hundred and one lung adenocarcinoma patients with EGFR mutation status were enrolled in this study. Two deep learning models (SE_CT and SE_PET) were developed with Squeeze-and-Excitation Residual Network (SE-ResNet) module for the prediction of EGFR mutation with CT and PET images, respectively. The deep learning models were trained with a training data set of 198 patients and tested with a testing data set of 103 patients. Stacked generalization was used to integrate the results of SE_CT and SE_PET.

Results

The AUCs of the SE_CT and SE_PET were 0.72 (95% CI, 0.62–0.80) and 0.74 (95% CI, 0.65–0.82) in the testing data set, respectively. After integrating SE_CT and SE_PET with stacked generalization, the AUC was further improved to 0.84 (95% CI, 0.75–0.90), significantly higher than SE_CT (p<0.05).

Conclusion

The stacking model based on ¹⁸F-FDG PET/CT images is capable to predict EGFR mutation status of patients with lung adenocarcinoma automatically and non-invasively. The proposed model in this study showed the potential to help clinicians identify suitable advanced patients with lung adenocarcinoma for EGFR‐targeted therapy.

Combining radiomic phenotypes of non-small cell lung cancer with liquid biopsy data may improve prediction of response to EGFR inhibitors

Among non-small cell lung cancer (NSCLC) patients with therapeutically targetable tumor mutations in epidermal growth factor receptor (EGFR), not all patients respond to targeted therapy. Combining circulating-tumor DNA (ctDNA), clinical variables, and radiomic phenotypes may improve prediction of EGFR-targeted therapy outcomes for NSCLC. This single-center retrospective study included 40 EGFR-mutant advanced NSCLC patients treated with EGFR-targeted therapy. ctDNA data included number of mutations and detection of EGFR T790M. Clinical data included age, smoking status, and ECOG performance status. Baseline chest CT scans were analyzed to extract 429 radiomic features from each primary tumor. Unsupervised hierarchical clustering was used to group tumors into phenotypes. Kaplan–Meier (K–M) curves and Cox proportional hazards regression were modeled for progression-free survival (PFS) and overall survival (OS). Likelihood ratio test (LRT) was used to compare fit between models. Among 40 patients (73% women, median age 62 years), consensus clustering identified two radiomic phenotypes. For PFS, the model combining radiomic phenotypes with ctDNA and clinical variables had c-statistic of 0.77 and a better fit (LRT p = 0.01) than the model with clinical and ctDNA variables alone with a c-statistic of 0.73. For OS, adding radiomic phenotypes resulted in c-statistic of 0.83 versus 0.80 when using clinical and ctDNA variables (LRT p = 0.08). Both models showed separation of K–M curves dichotomized by median prognostic score (p < 0.005). Combining radiomic phenotypes, ctDNA, and clinical variables may enhance precision oncology approaches to managing advanced non-small cell lung cancer with EGFR mutations.