Development and Cost Analysis of a Lung Nodule Management Strategy Combining Artificial Intelligence and Lung-RADS for Baseline Lung Cancer Screening

Deep Learning Models for Predicting Malignancy Risk in CT-Detected Pulmonary Nodules: A Systematic Review and Meta-analysis

BACKGROUND

There has been growing interest in using artificial intelligence/deep learning (DL) to help diagnose prevalent diseases earlier. In this study we sought to survey the landscape of externally validated DL-based computer-aided diagnostic (CADx) models, and assess their diagnostic performance for predicting the risk of malignancy in computed tomography (CT)-detected pulmonary nodules.

METHODS

An electronic search was performed in four databases (from inception to 10 August 2023). Studies were eligible if they were peer-reviewed experimental or observational articles comparing the diagnostic performance of externally validated DL-based CADx models with models widely used in clinical practice to predict the risk of malignancy. A bivariate random-effect approach for the meta-analysis on the included studies was used.

RESULTS

Seventeen studies were included, comprising 8553 participants and 9884 nodules. Pooled analyses showed DL-based CADx models were 11.6% more sensitive than physician judgement alone, and 14.5% more than clinical risk models alone. They had a similar pooled specificity to physician judgement alone [0.77 (95% CI 0.68-0.84) v 0.81 (95% CI 0.71-0.88)], and were 7.4% more specific than clinical risk models alone. They had superior pooled areas under the receiver operating curve (AUC), with relative pooled AUCs of 1.03 (95% CI 1.00-1.07) and 1.10 (95% CI 1.07-1.13) versus physician judgement and clinical risk models alone, respectively.

CONCLUSION

DL-based models are already used in clinical practice in certain settings for nodule management. Our results show their diagnostic performance potentially justifies wider, more routine deployment alongside experienced physician readers to help inform multidisciplinary team decision-making.

RadioGraphics Update: The 10 Pillars of Lung Cancer Screening-Rationale and Logistics of a Lung Cancer Screening Program

Editor's Note.-RadioGraphics Update articles supplement or update information found in full-length articles previously published in RadioGraphics. These updates, written by at least one author of the previous article, provide a brief synopsis that emphasizes important new information such as technological advances, revised imaging protocols, new clinical guidelines involving imaging, or updated classification schemes.

Diagnostic value of artificial intelligence based on computed tomography (CT) density in benign and malignant pulmonary nodules: a retrospective investigation

Objective

To evaluate the diagnostic value of artificial intelligence (AI) in the detection and management of benign and malignant pulmonary nodules (PNs) using computed tomography (CT) density.

Methods

A retrospective analysis was conducted on the clinical data of 130 individuals diagnosed with PNs based on pathological confirmation. The utilization of AI and physicians has been employed in the diagnostic process of distinguishing benign and malignant PNs. The CT images depicting PNs were integrated into AI-based software. The gold standard for evaluating the accuracy of AI diagnosis software and physician interpretation was the pathological diagnosis.

Results

Out of 226 PNs screened from 130 patients diagnosed by AI and physician reading based on CT, 147 were confirmed by pathology. AI had a sensitivity of 94.69% and radiologists had a sensitivity of 85.40% in identifying PNs. The chi-square analysis indicated that the screening capacity of AI was superior to that of physician reading, with statistical significance (p < 0.05). 195 of the 214 PNs suggested by AI were confirmed pathologically as malignant, and 19 were identified as benign; among the 29 PNs suggested by AI as low risk, 13 were confirmed pathologically as malignant, and 16 were identified as benign. From the physician reading, 193 PNs were identified as malignant, 183 were confirmed malignant by pathology, and 10 appeared benign. Physician reading also identified 30 low-risk PNs, 19 of which were pathologically malignant and 11 benign. The physician readings and AI had kappa values of 0.432 and 0.547, respectively. The physician reading and AI area under curves (AUCs) were 0.814 and 0.798, respectively. Both of the diagnostic techniques had worthy diagnostic value, as indicated by their AUCs of >0.7.

Conclusion

It is anticipated that the use of AI-based CT diagnosis in the detection of PNs would increase the precision in early detection of lung carcinoma, as well as yield more precise evidence for clinical management.

Early experiences of integrating an artificial intelligence-based diagnostic decision support system into radiology settings: a qualitative study

OBJECTIVES

Artificial intelligence (AI)-based clinical decision support systems to aid diagnosis are increasingly being developed and implemented but with limited understanding of how such systems integrate with existing clinical work and organizational practices. We explored the early experiences of stakeholders using an AI-based imaging software tool Veye Lung Nodules (VLN) aiding the detection, classification, and measurement of pulmonary nodules in computed tomography scans of the chest.

MATERIALS AND METHODS

We performed semistructured interviews and observations across early adopter deployment sites with clinicians, strategic decision-makers, suppliers, patients with long-term chest conditions, and academics with expertise in the use of diagnostic AI in radiology settings. We coded the data using the Technology, People, Organizations, and Macroenvironmental factors framework.

RESULTS

We conducted 39 interviews. Clinicians reported VLN to be easy to use with little disruption to the workflow. There were differences in patterns of use between experts and novice users with experts critically evaluating system recommendations and actively compensating for system limitations to achieve more reliable performance. Patients also viewed the tool positively. There were contextual variations in tool performance and use between different hospital sites and different use cases. Implementation challenges included integration with existing information systems, data protection, and perceived issues surrounding wider and sustained adoption, including procurement costs.

DISCUSSION

Tool performance was variable, affected by integration into workflows and divisions of labor and knowledge, as well as technical configuration and infrastructure.

CONCLUSION

The socio-organizational factors affecting performance of diagnostic AI are under-researched and require attention and further research.

Artificial Intelligence and Machine Learning in Lung Cancer Screening

Recent advances in artificial intelligence and machine learning (AI/ML) hold substantial promise to address some of the current challenges in lung cancer screening and improve health equity. This article reviews the status and future directions of AI/ML tools in the lung cancer screening workflow, focusing on determining screening eligibility, radiation dose reduction and image denoising for low-dose chest computed tomography (CT), lung nodule detection, lung nodule classification, and determining optimal screening intervals. AI/ML tools can assess for chronic diseases on CT, which creates opportunities to improve population health through opportunistic screening.

Economic evaluations of artificial intelligence-based healthcare interventions: a systematic literature review of best practices in their conduct and reporting

Objectives: Health economic evaluations (HEEs) help healthcare decision makers understand the value of new technologies. Artificial intelligence (AI) is increasingly being used in healthcare interventions. We sought to review the conduct and reporting of published HEEs for AI-based health interventions. Methods: We conducted a systematic literature review with a 15-month search window (April 2021 to June 2022) on 17th June 2022 to identify HEEs of AI health interventions and update a previous review. Records were identified from 3 databases (Medline, Embase, and Cochrane Central). Two reviewers screened papers against predefined study selection criteria. Data were extracted from included studies using prespecified data extraction tables. Included studies were quality assessed using the National Institute for Health and Care Excellence (NICE) checklist. Results were synthesized narratively. Results: A total of 21 studies were included. The most common type of AI intervention was automated image analysis (9/21, 43%) mainly used for screening or diagnosis in general medicine and oncology. Nearly all were cost-utility (10/21, 48%) or cost-effectiveness analyses (8/21, 38%) that took a healthcare system or payer perspective. Decision-analytic models were used in 16/21 (76%) studies, mostly Markov models and decision trees. Three (3/16, 19%) used a short-term decision tree followed by a longer-term Markov component. Thirteen studies (13/21, 62%) reported the AI intervention to be cost effective or dominant. Limitations tended to result from the input data, authorship conflicts of interest, and a lack of transparent reporting, especially regarding the AI nature of the intervention. Conclusion: Published HEEs of AI-based health interventions are rapidly increasing in number. Despite the potentially innovative nature of AI, most have used traditional methods like Markov models or decision trees. Most attempted to assess the impact on quality of life to present the cost per QALY gained. However, studies have not been comprehensively reported. Specific reporting standards for the economic evaluation of AI interventions would help improve transparency and promote their usefulness for decision making. This is fundamental for reimbursement decisions, which in turn will generate the necessary data to develop flexible models better suited to capturing the potentially dynamic nature of AI interventions.

Invasiveness assessment by artificial intelligence against intraoperative frozen section for pulmonary nodules ≤ 3 cm

PURPOSE

To investigate the performance of an artificial intelligence (AI) algorithm for assessing the malignancy and invasiveness of pulmonary nodules in a multicenter cohort.

METHODS

A previously developed deep learning system based on a 3D convolutional neural network was used to predict tumor malignancy and invasiveness. Dataset of pulmonary nodules no more than 3 cm was integrated with CT images and pathologic information. Receiver operating characteristic curve analysis was used to evaluate the performance of the system.

RESULTS

A total of 466 resected pulmonary nodules were included in this study. The areas under the curves (AUCs) of the deep learning system in the prediction of malignancy as compared with pathological reports were 0.80, 0.80, and 0.75 for all, subcentimeter, and solid nodules, respectively. Additionally, the AUC in the AI-assisted prediction of invasive adenocarcinoma (IA) among subsolid lesions (n = 184) was 0.88. Most malignancies that were misdiagnosed by the AI system as benign diseases with a diameter measuring greater than 1 cm (26/250, 10.4%) presented as solid nodules (19/26, 73.1%) on CT. In an exploratory analysis involving nodules underwent intraoperative pathologic examination, the concordance rate in identifying IA between the AI model and frozen section examination was 0.69, with a sensitivity of 0.50 and specificity of 0.97.

CONCLUSION

The deep learning system can discriminate malignant diseases for pulmonary nodules measuring no more than 3 cm. The AI model has a high positive predictive value for invasive adenocarcinoma with respect to intraoperative frozen section examination, which might help determine the individualized surgical strategy.

The Effects of Artificial Intelligence Assistance on the Radiologists' Assessment of Lung Nodules on CT Scans: A Systematic Review

To reduce the number of missed or misdiagnosed lung nodules on CT scans by radiologists, many Artificial Intelligence (AI) algorithms have been developed. Some algorithms are currently being implemented in clinical practice, but the question is whether radiologists and patients really benefit from the use of these novel tools. This study aimed to review how AI assistance for lung nodule assessment on CT scans affects the performances of radiologists. We searched for studies that evaluated radiologists' performances in the detection or malignancy prediction of lung nodules with and without AI assistance. Concerning detection, radiologists achieved with AI assistance a higher sensitivity and AUC, while the specificity was slightly lower. Concerning malignancy prediction, radiologists achieved with AI assistance generally a higher sensitivity, specificity and AUC. The radiologists' workflows of using the AI assistance were often only described in limited detail in the papers. As recent studies showed improved performances of radiologists with AI assistance, AI assistance for lung nodule assessment holds great promise. To achieve added value of AI tools for lung nodule assessment in clinical practice, more research is required on the clinical validation of AI tools, impact on follow-up recommendations and ways of using AI tools.

A Hybrid Algorithm of ML and XAI to Prevent Breast Cancer: A Strategy to Support Decision Making

Worldwide, the coronavirus has intensified the management problems of health services, significantly harming patients. Some of the most affected processes have been cancer patients' prevention, diagnosis, and treatment. Breast cancer is the most affected, with more than 20 million cases and at least 10 million deaths by 2020. Various studies have been carried out to support the management of this disease globally. This paper presents a decision support strategy for health teams based on machine learning (ML) tools and explainability algorithms (XAI). The main methodological contributions are: first, the evaluation of different ML algorithms that allow classifying patients with and without cancer from the available dataset; and second, an ML methodology mixed with an XAI algorithm, which makes it possible to predict the disease and interpret the variables and how they affect the health of patients. The results show that first, the XGBoost Algorithm has a better predictive capacity, with an accuracy of 0.813 for the train data and 0.81 for the test data; and second, with the SHAP algorithm, it is possible to know the relevant variables and their level of significance in the prediction, and to quantify the impact on the clinical condition of the patients, which will allow health teams to offer early and personalized alerts for each patient.

Important parameters for cost-effective implementation of lung cancer screening

It is now widely accepted that lung cancer screening through low-dose computed tomography (LDCT) results in fewer diagnoses at a late stage, and decreased lung cancer mortality. Whilst reducing deaths from lung cancer is an essential prerequisite, this must be balanced against the considerable economic costs accumulated in screening. Multiple health economic models have shown substantial variation in cost per Quality-Adjusted Life Year (QALY), partly driven by the healthcare costs in the country concerned and partly by other modifiable programme components. Recent modelling using UK costs and a targeted approach suggest that most scenarios are within the willingness to pay threshold for the UK. However, identifying the most clinically and cost-effective programme is a priority to minimise the total financial impact. Programme components that influence cost-effectiveness include the method of selection of the eligible population, the participation rate, the interval between rounds of screening, the method of pulmonary nodule management, and the approach to clinical work up. Future research will clarify if a personalised approach to screening, using baseline and subsequent risk to define screening intervals is more cost-effective. The burden of LDCT screening on the medical infrastructure and workforce has to be quantified and carefully managed during implementation.

Lung cancer screening

Randomised controlled trials, including the National Lung Screening Trial (NLST) and the NELSON trial, have shown reduced mortality with lung cancer screening with low-dose CT compared with chest radiography or no screening. Although research has provided clarity on key issues of lung cancer screening, uncertainty remains about aspects that might be critical to optimise clinical effectiveness and cost-effectiveness. This Review brings together current evidence on lung cancer screening, including an overview of clinical trials, considerations regarding the identification of individuals who benefit from lung cancer screening, management of screen-detected findings, smoking cessation interventions, cost-effectiveness, the role of artificial intelligence and biomarkers, and current challenges, solutions, and opportunities surrounding the implementation of lung cancer screening programmes from an international perspective. Further research into risk models for patient selection, personalised screening intervals, novel biomarkers, integrated cardiovascular disease and chronic obstructive pulmonary disease assessments, smoking cessation interventions, and artificial intelligence for lung nodule detection and risk stratification are key opportunities to increase the efficiency of lung cancer screening and ensure equity of access.

Clinical Impact and Generalizability of a Computer-Assisted Diagnostic Tool to Risk-Stratify Lung Nodules With CT

OBJECTIVE

To evaluate whether an imaging classifier for radiology practice can improve lung nodule classification and follow-up.

METHODS

A machine learning classifier was developed and trained using imaging data from the National Lung Screening Trial (NSLT) to produce a malignancy risk score (malignancy Similarity Index [mSI]) for individual lung nodules. In addition to NLST cohorts, external cohorts were developed from a tertiary referral lung cancer screening program data set and an external nonscreening data set of all nodules detected on CT. Performance of the mSI combined with Lung-RADS was compared with Lung-RADS alone and the Mayo and Brock risk calculators.

RESULTS

We analyzed 963 subjects and 1,331 nodules across these cohorts. The mSI was comparable in accuracy (area under the curve = 0.89) to existing clinical risk models (area under the curve = 0.86-0.88) and independently predictive in the NLST cohort of 704 nodules. When compared with Lung-RADS, the mSI significantly increased sensitivity across all cohorts (25%-117%), with significant increases in specificity in the screening cohorts (17%-33%). When used in conjunction with Lung-RADS, use of mSI would result in earlier diagnoses and reduced follow-up across cohorts, including the potential for early diagnosis in 42% of malignant NLST nodules from prior-year CT scans.

CONCLUSION

A computer-assisted diagnosis software improved risk classification from chest CTs of screening and incidentally detected lung nodules compared with Lung-RADS. mSI added predictive value independent of existing radiological and clinical variables. These results suggest the generalizability and potential clinical impact of a tool that is straightforward to implement in practice.

Artificial Intelligence in Lung Imaging

Recently, interest and advances in artificial intelligence (AI) including deep learning for medical images have surged. As imaging plays a major role in the assessment of pulmonary diseases, various AI algorithms have been developed for chest imaging. Some of these have been approved by governments and are now commercially available in the marketplace. In the field of chest radiology, there are various tasks and purposes that are suitable for AI: initial evaluation/triage of certain diseases, detection and diagnosis, quantitative assessment of disease severity and monitoring, and prediction for decision support. While AI is a powerful technology that can be applied to medical imaging and is expected to improve our current clinical practice, some obstacles must be addressed for the successful implementation of AI in workflows. Understanding and becoming familiar with the current status and potential clinical applications of AI in chest imaging, as well as remaining challenges, would be essential for radiologists and clinicians in the era of AI. This review introduces the potential clinical applications of AI in chest imaging and also discusses the challenges for the implementation of AI in daily clinical practice and future directions in chest imaging.

The Impact of Artificial Intelligence on Health Equity in Oncology: Scoping Review

BACKGROUND

The field of oncology is at the forefront of advances in artificial intelligence (AI) in health care, providing an opportunity to examine the early integration of these technologies in clinical research and patient care. Hope that AI will revolutionize health care delivery and improve clinical outcomes has been accompanied by concerns about the impact of these technologies on health equity.

OBJECTIVE

We aimed to conduct a scoping review of the literature to address the question, "What are the current and potential impacts of AI technologies on health equity in oncology?"

METHODS

Following PRISMA-ScR (Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews) guidelines for scoping reviews, we systematically searched MEDLINE and Embase electronic databases from January 2000 to August 2021 for records engaging with key concepts of AI, health equity, and oncology. We included all English-language articles that engaged with the 3 key concepts. Articles were analyzed qualitatively for themes pertaining to the influence of AI on health equity in oncology.

RESULTS

Of the 14,011 records, 133 (0.95%) identified from our review were included. We identified 3 general themes in the literature: the use of AI to reduce health care disparities (58/133, 43.6%), concerns surrounding AI technologies and bias (16/133, 12.1%), and the use of AI to examine biological and social determinants of health (55/133, 41.4%). A total of 3% (4/133) of articles focused on many of these themes.

CONCLUSIONS

Our scoping review revealed 3 main themes on the impact of AI on health equity in oncology, which relate to AI's ability to help address health disparities, its potential to mitigate or exacerbate bias, and its capability to help elucidate determinants of health. Gaps in the literature included a lack of discussion of ethical challenges with the application of AI technologies in low- and middle-income countries, lack of discussion of problems of bias in AI algorithms, and a lack of justification for the use of AI technologies over traditional statistical methods to address specific research questions in oncology. Our review highlights a need to address these gaps to ensure a more equitable integration of AI in cancer research and clinical practice. The limitations of our study include its exploratory nature, its focus on oncology as opposed to all health care sectors, and its analysis of solely English-language articles.

Mapping intellectual structures and research hotspots in the application of artificial intelligence in cancer: A bibliometric analysis

Background

Artificial intelligence (AI) is more and more widely used in cancer, which is of great help to doctors in diagnosis and treatment. This study aims to summarize the current research hotspots in the Application of Artificial Intelligence in Cancer (AAIC) and to assess the research trends in AAIC.

Methods

Scientific publications for AAIC-related research from 1 January 1998 to 1 July 2022 were obtained from the Web of Science database. The metrics analyses using bibliometrics software included publication, keyword, author, journal, institution, and country. In addition, the blustering analysis on the binary matrix was performed on hot keywords.

Results

The total number of papers in this study is 1592. The last decade of AAIC research has been divided into a slow development phase (2013-2018) and a rapid development phase (2019-2022). An international collaboration centered in the USA is dedicated to the development and application of AAIC. Li J is the most prolific writer in AAIC. Through clustering analysis and high-frequency keyword research, it has been shown that AI plays a significantly important role in the prediction, diagnosis, treatment and prognosis of cancer. Classification, diagnosis, carcinogenesis, risk, and validation are developing topics. Eight hotspot fields of AAIC were also identified.

Conclusion

AAIC can benefit cancer patients in diagnosing cancer, assessing the effectiveness of treatment, making a decision, predicting prognosis and saving costs. Future AAIC research may be dedicated to optimizing AI calculation tools, improving accuracy, and promoting AI.

[Chinese Experts Consensus on Artificial Intelligence Assisted Management for Pulmonary Nodule (2022 Version)]

Low-dose computed tomography (CT) for lung cancer screening has been proven to reduce lung cancer deaths in the screening group compared with the control group. The increasing number of pulmonary nodules being detected by CT scans significantly increase the workload of the radiologists for scan interpretation. Artificial intelligence (AI) has the potential to increase the efficiency of pulmonary nodule discrimination and has been tested in preliminary studies for nodule management. As more and more artificial AI products are commercialized, the consensus statement has been organized in a collaborative effort by Thoracic Surgery Committee, Department of Simulated Medicine, Wu Jieping Medical Foundation to aid clinicians in the application of AI-assisted management for pulmonary nodules.
.