Towards radiologist-level cancer risk assessment in CT lung screening using deep learning

Deep Learning Models for Predicting Malignancy Risk in CT-Detected Pulmonary Nodules: A Systematic Review and Meta-analysis

BACKGROUND

There has been growing interest in using artificial intelligence/deep learning (DL) to help diagnose prevalent diseases earlier. In this study we sought to survey the landscape of externally validated DL-based computer-aided diagnostic (CADx) models, and assess their diagnostic performance for predicting the risk of malignancy in computed tomography (CT)-detected pulmonary nodules.

METHODS

An electronic search was performed in four databases (from inception to 10 August 2023). Studies were eligible if they were peer-reviewed experimental or observational articles comparing the diagnostic performance of externally validated DL-based CADx models with models widely used in clinical practice to predict the risk of malignancy. A bivariate random-effect approach for the meta-analysis on the included studies was used.

RESULTS

Seventeen studies were included, comprising 8553 participants and 9884 nodules. Pooled analyses showed DL-based CADx models were 11.6% more sensitive than physician judgement alone, and 14.5% more than clinical risk models alone. They had a similar pooled specificity to physician judgement alone [0.77 (95% CI 0.68-0.84) v 0.81 (95% CI 0.71-0.88)], and were 7.4% more specific than clinical risk models alone. They had superior pooled areas under the receiver operating curve (AUC), with relative pooled AUCs of 1.03 (95% CI 1.00-1.07) and 1.10 (95% CI 1.07-1.13) versus physician judgement and clinical risk models alone, respectively.

CONCLUSION

DL-based models are already used in clinical practice in certain settings for nodule management. Our results show their diagnostic performance potentially justifies wider, more routine deployment alongside experienced physician readers to help inform multidisciplinary team decision-making.

AI-Driven Models for Diagnosing and Predicting Outcomes in Lung Cancer: A Systematic Review and Meta-Analysis

(1) Background: Lung cancer's high mortality due to late diagnosis highlights a need for early detection strategies. Artificial intelligence (AI) in healthcare, particularly for lung cancer, offers promise by analyzing medical data for early identification and personalized treatment. This systematic review evaluates AI's performance in early lung cancer detection, analyzing its techniques, strengths, limitations, and comparative edge over traditional methods. (2) Methods: This systematic review and meta-analysis followed the PRISMA guidelines rigorously, outlining a comprehensive protocol and employing tailored search strategies across diverse databases. Two reviewers independently screened studies based on predefined criteria, ensuring the selection of high-quality data relevant to AI's role in lung cancer detection. The extraction of key study details and performance metrics, followed by quality assessment, facilitated a robust analysis using R software (Version 4.3.0). The process, depicted via a PRISMA flow diagram, allowed for the meticulous evaluation and synthesis of the findings in this review. (3) Results: From 1024 records, 39 studies met the inclusion criteria, showcasing diverse AI model applications for lung cancer detection, emphasizing varying strengths among the studies. These findings underscore AI's potential for early lung cancer diagnosis but highlight the need for standardization amidst study variations. The results demonstrate promising pooled sensitivity and specificity of 0.87, signifying AI's accuracy in identifying true positives and negatives, despite the observed heterogeneity attributed to diverse study parameters. (4) Conclusions: AI demonstrates promise in early lung cancer detection, showing high accuracy levels in this systematic review. However, study variations underline the need for standardized protocols to fully leverage AI's potential in revolutionizing early diagnosis, ultimately benefiting patients and healthcare professionals. As the field progresses, validated AI models from large-scale perspective studies will greatly benefit clinical practice and patient care in the future.

Application of computer-aided detection for NCCN-based follow-up recommendation in subsolid nodules: Effect on inter-observer agreement

RATIONALE AND OBJECTIVES

Computer-aided detection (CAD) of pulmonary nodules reduces the impact of observer variability, improving the reliability and reproducibility of nodule assessments in clinical practice. Therefore, this study aimed to assess the impact of CAD on inter-observer agreement in the follow-up management of subsolid nodules.

MATERIALS AND METHODS

A dataset comprising 60 subsolid nodule cases was constructed based on the National Cancer Center lung cancer screening data. Five observers independently assessed all low-dose computed tomography scans and assigned follow-up management strategies to each case according to the National Comprehensive Cancer Network (NCCN) guidelines, using both manual measurements and CAD assistance. The linearly weighted Cohen's kappa test was used to measure agreement between paired observers. Agreement among multiple observers was evaluated using the Fleiss kappa statistic.

RESULTS

The agreement of the five observers for NCCN follow-up management categorization was moderate when measured manually, with a Fleiss kappa score of 0.437. Utilizing CAD led to a notable enhancement in agreement, achieving a substantial consensus with a Fleiss kappa value of 0.623. After using CAD, the proportion of major and substantial management discrepancies decreased from 27.5% to 15.8% and 4.8% to 1.5%, respectively (p < 0.01). In 23 lung cancer cases presenting as part-solid nodules, CAD significantly elevates the average sensitivity in detecting lung cancer cases presenting as part-solid nodules (overall sensitivity, 82.6% vs. 92.2%; p < 0.05).

CONCLUSION

The application of CAD significantly improves inter-observer agreement in the follow-up management strategy for subsolid nodules. It also demonstrates the potential to reduce substantial management discrepancies and increase detection sensitivity in lung cancer cases presenting as part-solid nodules.

A new lung cancer detection method based on the chest CT images using Federated Learning and blockchain systems

With an estimated five million fatal cases each year, lung cancer is one of the significant causes of death worldwide. Lung diseases can be diagnosed with a Computed Tomography (CT) scan. The scarcity and trustworthiness of human eyes is the fundamental issue in diagnosing lung cancer patients. The main goal of this study is to detect malignant lung nodules in a CT scan of the lungs and categorize lung cancer according to severity. In this work, cutting-edge Deep Learning (DL) algorithms were used to detect the location of cancerous nodules. Also, the real-life issue is sharing data with hospitals around the world while bearing in mind the organizations' privacy issues. Besides, the main problems for training a global DL model are creating a collaborative model and maintaining privacy. This study presented an approach that takes a modest amount of data from multiple hospitals and uses blockchain-based Federated Learning (FL) to train a global DL model. The data were authenticated using blockchain technology, and FL trained the model internationally while maintaining the organization's anonymity. First, we presented a data normalization approach that addresses the variability of data obtained from various institutions using various CT scanners. Furthermore, using a CapsNets method, we classified lung cancer patients in local mode. Finally, we devised a way to train a global model cooperatively utilizing blockchain technology and FL while maintaining anonymity. We also gathered data from real-life lung cancer patients for testing purposes. The suggested method was trained and tested on the Cancer Imaging Archive (CIA) dataset, Kaggle Data Science Bowl (KDSB), LUNA 16, and the local dataset. Finally, we performed extensive experiments with Python and its well-known libraries, such as Scikit-Learn and TensorFlow, to evaluate the suggested method. The findings showed that the method effectively detects lung cancer patients. The technique delivered 99.69 % accuracy with the smallest possible categorization error.

Recalibration of a Deep Learning Model for Low-Dose Computed Tomographic Images to Inform Lung Cancer Screening Intervals

Importance

Annual low-dose computed tomographic (LDCT) screening reduces lung cancer mortality, but harms could be reduced and cost-effectiveness improved by reusing the LDCT image in conjunction with deep learning or statistical models to identify low-risk individuals for biennial screening.

Objective

To identify low-risk individuals in the National Lung Screening Trial (NLST) and estimate, had they been assigned a biennial screening, how many lung cancers would have been delayed 1 year in diagnosis.

Design, Setting, and Participants

This diagnostic study included participants with a presumed nonmalignant lung nodule in the NLST between January 1, 2002, and December 31, 2004, with follow-up completed on December 31, 2009. Data were analyzed for this study from September 11, 2019, to March 15, 2022.

Exposures

An externally validated deep learning algorithm that predicts malignancy in current lung nodules using LDCT images (Lung Cancer Prediction Convolutional Neural Network [LCP-CNN]; Optellum Ltd) was recalibrated to predict 1-year lung cancer detection by LDCT for presumed nonmalignant nodules. Individuals with presumed nonmalignant lung nodules were hypothetically assigned annual vs biennial screening based on the recalibrated LCP-CNN model, Lung Cancer Risk Assessment Tool (LCRAT + CT [a statistical model combining individual risk factors and LDCT image features]), and the American College of Radiology recommendations for lung nodules, version 1.1 (Lung-RADS).

Main Outcomes and Measures

Primary outcomes included model prediction performance, the absolute risk of a 1-year delay in cancer diagnosis, and the proportion of people without lung cancer assigned a biennial screening interval vs the proportion of cancer diagnoses delayed.

Results

The study included 10 831 LDCT images from patients with presumed nonmalignant lung nodules (58.7% men; mean [SD] age, 61.9 [5.0] years), of whom 195 were diagnosed with lung cancer from the subsequent screen. The recalibrated LCP-CNN had substantially higher area under the curve (0.87) than LCRAT + CT (0.79) or Lung-RADS (0.69) to predict 1-year lung cancer risk (P < .001). If 66% of screens with nodules were assigned to biennial screening, the absolute risk of a 1-year delay in cancer diagnosis would have been lower for recalibrated LCP-CNN (0.28%) than LCRAT + CT (0.60%; P = .001) or Lung-RADS (0.97%; P < .001). To delay only 10% of cancer diagnoses at 1 year, more people would have been safely assigned biennial screening under LCP-CNN than LCRAT + CT (66.4% vs 40.3%; P < .001).

Conclusions and Relevance

In this diagnostic study evaluating models of lung cancer risk, a recalibrated deep learning algorithm was most predictive of 1-year lung cancer risk and had least risk of 1-year delay in cancer diagnosis among people assigned biennial screening. Deep learning algorithms could prioritize people for workup of suspicious nodules and decrease screening intensity for people with low-risk nodules, which may be vital for implementation in health care systems.

Dynamic predictions of postoperative complications from explainable, uncertainty-aware, and multi-task deep neural networks

Accurate prediction of postoperative complications can inform shared decisions regarding prognosis, preoperative risk-reduction, and postoperative resource use. We hypothesized that multi-task deep learning models would outperform conventional machine learning models in predicting postoperative complications, and that integrating high-resolution intraoperative physiological time series would result in more granular and personalized health representations that would improve prognostication compared to preoperative predictions. In a longitudinal cohort study of 56,242 patients undergoing 67,481 inpatient surgical procedures at a university medical center, we compared deep learning models with random forests and XGBoost for predicting nine common postoperative complications using preoperative, intraoperative, and perioperative patient data. Our study indicated several significant results across experimental settings that suggest the utility of deep learning for capturing more precise representations of patient health for augmented surgical decision support. Multi-task learning improved efficiency by reducing computational resources without compromising predictive performance. Integrated gradients interpretability mechanisms identified potentially modifiable risk factors for each complication. Monte Carlo dropout methods provided a quantitative measure of prediction uncertainty that has the potential to enhance clinical trust. Multi-task learning, interpretability mechanisms, and uncertainty metrics demonstrated potential to facilitate effective clinical implementation.

A Comprehensive Survey on the Progress, Process, and Challenges of Lung Cancer Detection and Classification

Lung cancer is the primary reason of cancer deaths worldwide, and the percentage of death rate is increasing step by step. There are chances of recovering from lung cancer by detecting it early. In any case, because the number of radiologists is limited and they have been working overtime, the increase in image data makes it hard for them to evaluate the images accurately. As a result, many researchers have come up with automated ways to predict the growth of cancer cells using medical imaging methods in a quick and accurate way. Previously, a lot of work was done on computer-aided detection (CADe) and computer-aided diagnosis (CADx) in computed tomography (CT) scan, magnetic resonance imaging (MRI), and X-ray with the goal of effective detection and segmentation of pulmonary nodule, as well as classifying nodules as malignant or benign. But still, no complete comprehensive review that includes all aspects of lung cancer has been done. In this paper, every aspect of lung cancer is discussed in detail, including datasets, image preprocessing, segmentation methods, optimal feature extraction and selection methods, evaluation measurement matrices, and classifiers. Finally, the study looks into several lung cancer-related issues with possible solutions.

Lung CAncer SCreening in French women using low-dose CT and Artificial intelligence for DEtection: the CASCADE study protocol

INTRODUCTION

Lung cancer screening (LCS) using low-dose CT has been demonstrated to reduce lung cancer-related mortality in large randomised controlled trials. Moving from trials to practice requires answering practical questions about the level of expertise of CT readers, the need for double reading as in trials and the potential role of artificial intelligence (AI). In addition, most LCS studies have predominantly included male participants with women being under-represented, even though the benefit of screening is greater for them. Thus, this study aims to compare the performance of a single CT reading by general radiologists trained in LCS using AI as a second reader to that of a double reading by expert thoracic radiologists, in a campaign for low-dose CT screening in high-risk women.

METHODS AND ANALYSIS

This observational cohort study will recruit 2400 asymptomatic women aged between 50 and 74 years, current or former smokers with at least a 20 pack-year smoking history, in 4 different French district areas. Assistance with smoking cessation will be offered to current smokers. An initial low-dose CT scan will be performed, with subsequent follow-ups at 1 year and 2 years. The primary objective is to compare CT scan readings by a single LCS-trained, AI-assisted radiologist to that of an expert double reading. The secondary objectives are: to evaluate the performance of AI as a stand-alone reader; the adherence to screening of female participants; the influence on smoking cessation; the psychological consequences of screening; the detection of chronic obstructive pulmonary disease (COPD), coronary artery disease and osteoporosis on low-dose CT scans and the costs incurred by screening.

ETHICS AND DISSEMINATION

Ethics approval was obtained from the Comité de Protection des Personnes Sud-Est 1 (ethics approval number: 2021-A02265-36 with an amendment on 15 July 2022). Trial results will be disseminated at conferences, through relevant patient groups and published in peer-reviewed journals.

TRIAL REGISTRATION NUMBER

NCT05195385.

Artificial intelligence in oncologic imaging

Radiology is integral to cancer care. Compared to molecular assays, imaging has its advantages. Imaging as a noninvasive tool can assess the entirety of tumor unbiased by sampling error and is routinely acquired at multiple time points in oncological practice. Imaging data can be digitally post-processed for quantitative assessment. The ever-increasing application of Artificial intelligence (AI) to clinical imaging is challenging radiology to become a discipline with competence in data science, which plays an important role in modern oncology. Beyond streamlining certain clinical tasks, the power of AI lies in its ability to reveal previously undetected or even imperceptible radiographic patterns that may be difficult to ascertain by the human sensory system. Here, we provide a narrative review of the emerging AI applications relevant to the oncological imaging spectrum and elaborate on emerging paradigms and opportunities. We envision that these technical advances will change radiology in the coming years, leading to the optimization of imaging acquisition and discovery of clinically relevant biomarkers for cancer diagnosis, staging, and treatment monitoring. Together, they pave the road for future clinical translation in precision oncology.

Deep Learning Algorithms for Diagnosis of Lung Cancer: A Systematic Review and Meta-Analysis

We conducted a systematic review and meta-analysis of the diagnostic performance of current deep learning algorithms for the diagnosis of lung cancer. We searched major databases up to June 2022 to include studies that used artificial intelligence to diagnose lung cancer, using the histopathological analysis of true positive cases as a reference. The quality of the included studies was assessed independently by two authors based on the revised Quality Assessment of Diagnostic Accuracy Studies. Six studies were included in the analysis. The pooled sensitivity and specificity were 0.93 (95% CI 0.85−0.98) and 0.68 (95% CI 0.49−0.84), respectively. Despite the significantly high heterogeneity for sensitivity (I2 = 94%, p < 0.01) and specificity (I2 = 99%, p < 0.01), most of it was attributed to the threshold effect. The pooled SROC curve with a bivariate approach yielded an area under the curve (AUC) of 0.90 (95% CI 0.86 to 0.92). The DOR for the studies was 26.7 (95% CI 19.7−36.2) and heterogeneity was 3% (p = 0.40). In this systematic review and meta-analysis, we found that when using the summary point from the SROC, the pooled sensitivity and specificity of DL algorithms for the diagnosis of lung cancer were 93% and 68%, respectively.

Interventions of Advanced Lung Cancer Patient Receiving Chemotherapy by Computed Tomography Image Information Data Analysis-Based Soothing Care Plans

The objective of this study was to investigate the intervention effect of computed tomography (CT) image information data on patients with advanced lung cancer treated with chemotherapy under palliative care program. The research subjects were 60 patients with advanced lung cancer who received palliative care in our hospital from January 1, 2019, to January 1, 2021. All patients were grouped according to the evaluation criteria of solid tumor efficacy, including 28 patients in the remission group and 32 patients in the nonremission group. Texture analysis was performed on the CT images of the two groups of patients. The gray-scale cooccurrence matrix parameters, the maximum diameter of the lesion, and the CT value of the CT images of the two groups of patients before and after palliative care were compared. The results showed that after the palliative care, the combined mean, combined energy, and inverse moment of the three gray cooccurrence matrix parameters of the two groups of patients were decreased, and the combined entropy and contrast were increased. The absolute value of the gray-scale cooccurrence matrix Δ parameter of the patients in the remission group was greater than that in the nonremission group. The Δ combined entropy, Δ contrast, and Δ correlation of the two groups of patients were significantly different, and the difference in Δ contrast was the largest. It suggested that the gray-scale cooccurrence matrix parameter can evaluate the effect of soothing care, and the contrast was the best evaluation parameter. The maximum diameter of the lesions in the remission group before and after palliative care was reduced by 1.23 cm, and the degree of reduction was significantly better. The CT value was reduced by 6.22 HU, and the degree of reduction was significantly higher than that in the nonremission group. There was a significant difference in the data between the two groups (P < 0.05). Therefore, the CT image information data had a better evaluation effect on patients with advanced lung cancer under the palliative care program and can be applied to the clinical evaluation of the palliative care effect, which had good clinical value.

Using Occlusion-Based Saliency Maps to Explain an Artificial Intelligence Tool in Lung Cancer Screening: Agreement Between Radiologists, Labels, and Visual Prompts

Occlusion-based saliency maps (OBSMs) are one of the approaches for interpreting decision-making process of an artificial intelligence (AI) system. This study explores the agreement among text responses from a cohort of radiologists to describe diagnostically relevant areas on low-dose CT (LDCT) images. It also explores if radiologists’ descriptions of cases misclassified by the AI provide a rationale for ruling out the AI’s output. The OBSM indicating the importance of different pixels on the final decision made by an AI were generated for 10 benign cases (3 misclassified by the AI tool as malignant) and 10 malignant cases (2 misclassified by the AI tool as benign). Thirty-six radiologists were asked to use radiological vocabulary, typical to reporting LDCT scans, to describe the mapped regions of interest (ROI). The radiologists’ annotations were then grouped by using a clustering-based technique. Topics were extracted from the annotations and for each ROI, a percentage of annotations containing each topic were found. Radiologists annotated 17 and 24 unique ROIs on benign and malignant cases, respectively. Agreement on the main label (e.g., “vessel,” “nodule”) by radiologists was only seen in only in 12% of all areas (5/41 ROI). Topic analyses identified six descriptors which are commonly associated with a lower malignancy likelihood. Eight common topics related to a higher malignancy likelihood were also determined. Occlusion-based saliency maps were used to explain an AI decision-making process to radiologists, who in turn have provided insight into the level of agreement between the AI’s decision and radiological lexicon.