Artificial intelligence model on chest imaging to diagnose COVID-19 and other pneumonias: A systematic review and meta-analysis

An overview of reviews on digital health interventions during COVID- 19 era: insights and lessons for future pandemics

BACKGROUND

The COVID- 19 pandemic has significantly impacted global health, underscoring the crucial role of digital health solutions. The World Health Organization's Classification of Digital Interventions, Services, and Applications in Health (CDISAH) provides a framework for categorizing these technologies. This study aims to analyze the adoption and trends of digital health interventions during the COVID- 19 pandemic, mapping them to the CDISAH framework to identify the most and least utilized interventions and technologies.

METHODS

This overview-of-reviews study was conducted from 1 st January 2020 to 30 th December 2023, focusing on systematic reviews and meta-analyses retrieved from the Cochrane Database of Systematic Reviews, PubMed, Scopus, Web of Science, IEEE Xplore, and ProQuest. Additionally, gray literature was identified through searches on the Google Scholar platform and reviewing the citations and reference lists of the included studies. The findings were qualitatively mapped to the CDISAH framework.

RESULTS

A total of 64 review articles were analyzed. A content analysis of the included studies identified 292 codes related to healthcare providers, 257 codes related to data services, 88 codes related to individuals, and 43 codes related to health management and support personnel. The results revealed that the most frequent interventions were associated with telemedicine and data management subcategories, while gaps were identified in areas such as individual-based data reporting during the pandemic, highlighting the need for individuals to take a more active role in managing their own health in preparation for future crises.

CONCLUSIONS

This study identifies both the strengths and weaknesses of the current digital health landscape. It emphasizes the transformative impact of digital health technologies during the COVID- 19 pandemic and provides a roadmap for future improvements in digital health interventions. By providing a comprehensive overview of digital health during this period, the study underscores the importance of implementing robust digital health strategies within the healthcare system to address existing gaps, leverage strengths, and enhance preparedness and resilience in future public health crises.

Benefits and harms associated with the use of AI-related algorithmic decision-making systems by healthcare professionals: a systematic review

Background

Despite notable advancements in artificial intelligence (AI) that enable complex systems to perform certain tasks more accurately than medical experts, the impact on patient-relevant outcomes remains uncertain. To address this gap, this systematic review assesses the benefits and harms associated with AI-related algorithmic decision-making (ADM) systems used by healthcare professionals, compared to standard care.

Methods

In accordance with the PRISMA guidelines, we included interventional and observational studies published as peer-reviewed full-text articles that met the following criteria: human patients; interventions involving algorithmic decision-making systems, developed with and/or utilizing machine learning (ML); and outcomes describing patient-relevant benefits and harms that directly affect health and quality of life, such as mortality and morbidity. Studies that did not undergo preregistration, lacked a standard-of-care control, or pertained to systems that assist in the execution of actions (e.g., in robotics) were excluded. We searched MEDLINE, EMBASE, IEEE Xplore, and Google Scholar for studies published in the past decade up to 31 March 2024. We assessed risk of bias using Cochrane's RoB 2 and ROBINS-I tools, and reporting transparency with CONSORT-AI and TRIPOD-AI. Two researchers independently managed the processes and resolved conflicts through discussion. This review has been registered with PROSPERO (CRD42023412156) and the study protocol has been published.

Findings

Out of 2,582 records identified after deduplication, 18 randomized controlled trials (RCTs) and one cohort study met the inclusion criteria, covering specialties such as psychiatry, oncology, and internal medicine. Collectively, the studies included a median of 243 patients (IQR 124-828), with a median of 50.5% female participants (range 12.5-79.0, IQR 43.6-53.6) across intervention and control groups. Four studies were classified as having low risk of bias, seven showed some concerns, and another seven were assessed as having high or serious risk of bias. Reporting transparency varied considerably: six studies showed high compliance, four moderate, and five low compliance with CONSORT-AI or TRIPOD-AI. Twelve studies (63%) reported patient-relevant benefits. Of those with low risk of bias, interventions reduced length of stay in hospital and intensive care unit (10.3 vs. 13.0 days, p = 0.042; 6.3 vs. 8.4 days, p = 0.030), in-hospital mortality (9.0% vs. 21.3%, p = 0.018), and depression symptoms in non-complex cases (45.1% vs. 52.3%, p = 0.03). However, harms were frequently underreported, with only eight studies (42%) documenting adverse events. No study reported an increase in adverse events as a result of the interventions.

Interpretation

The current evidence on AI-related ADM systems provides limited insights into patient-relevant outcomes. Our findings underscore the essential need for rigorous evaluations of clinical benefits, reinforced compliance with methodological standards, and balanced consideration of both benefits and harms to ensure meaningful integration into healthcare practice.

Funding

This study did not receive any funding.

Accuracy of machine learning models for pre-diagnosis and diagnosis of pancreatic ductal adenocarcinoma in contrast-CT images: a systematic review and meta-analysis

PURPOSE

To evaluate the diagnostic ability and methodological quality of ML models in detecting Pancreatic Ductal Adenocarcinoma (PDAC) in Contrast CT images.

METHOD

Included studies assessed adults diagnosed with PDAC, confirmed by histopathology. Metrics of tests were interpreted by ML algorithms. Studies provided data on sensitivity and specificity. Studies that did not meet the inclusion criteria, segmentation-focused studies, multiple classifiers or non-diagnostic studies were excluded. PubMed, Cochrane Central Register of Controlled Trials, and Embase were searched without restrictions. Risk of bias was assessed using QUADAS-2, methodological quality was evaluated using Radiomics Quality Score (RQS) and a Checklist for AI in Medical Imaging (CLAIM). Bivariate random-effects models were used for meta-analysis of sensitivity and specificity, I2 values and subgroup analysis used to assess heterogeneity.

RESULTS

Nine studies were included and 12,788 participants were evaluated, of which 3,997 were included in the meta-analysis. AI models based on CT scans showed an accuracy of 88.7% (IC 95%, 87.7%-89.7%), sensitivity of 87.9% (95% CI, 82.9%-91.6%), and specificity of 92.2% (95% CI, 86.8%-95.5%). The average score of six radiomics studies was 17.83 RQS points. Nine ML methods had an average CLAIM score of 30.55 points.

CONCLUSIONS

Our study is the first to quantitatively interpret various independent research, offering insights for clinical application. Despite favorable sensitivity and specificity results, the studies were of low quality, limiting definitive conclusions. Further research is necessary to validate these models before widespread adoption.

Artificial intelligence in predicting recurrence after first-line treatment of liver cancer: a systematic review and meta-analysis

BACKGROUND

The aim of this study was to conduct a systematic review and meta-analysis to comprehensively evaluate the performance and methodological quality of artificial intelligence (AI) in predicting recurrence after single first-line treatment for liver cancer.

METHODS

A rigorous and systematic evaluation was conducted on the AI studies related to recurrence after single first-line treatment for liver cancer, retrieved from the PubMed, Embase, Web of Science, Cochrane Library, and CNKI databases. The area under the curve (AUC), sensitivity (SENC), and specificity (SPEC) of each study were extracted for meta-analysis.

RESULTS

Six percutaneous ablation (PA) studies, 16 surgical resection (SR) studies, and 5 transarterial chemoembolization (TACE) studies were included in the meta-analysis for predicting recurrence after hepatocellular carcinoma (HCC) treatment, respectively. Four SR studies and 2 PA studies were included in the meta-analysis for recurrence after intrahepatic cholangiocarcinoma (ICC) and colorectal cancer liver metastasis (CRLM) treatment. The pooled SENC, SEPC, and AUC of AI in predicting recurrence after primary HCC treatment via PA, SR, and TACE were 0.78, 0.90, and 0.92; 0.81, 0.77, and 0.86; and 0.73, 0.79, and 0.79, respectively. The values for ICC treated with SR and CRLM treated with PA were 0.85, 0.71, 0.86 and 0.69, 0.63,0.74, respectively.

CONCLUSION

This systematic review and meta-analysis demonstrates the comprehensive application value of AI in predicting recurrence after a single first-line treatment of liver cancer, with satisfactory results, indicating the clinical translation potential of AI in predicting recurrence after liver cancer treatment.

Is artificial intelligence for medical professionals serving the patients? : Protocol for a systematic review on patient-relevant benefits and harms of algorithmic decision-making

BACKGROUND

Algorithmic decision-making (ADM) utilises algorithms to collect and process data and develop models to make or support decisions. Advances in artificial intelligence (AI) have led to the development of support systems that can be superior to medical professionals without AI support in certain tasks. However, whether patients can benefit from this remains unclear. The aim of this systematic review is to assess the current evidence on patient-relevant benefits and harms, such as improved survival rates and reduced treatment-related complications, when healthcare professionals use ADM systems (developed using or working with AI) compared to healthcare professionals without AI-related ADM (standard care)-regardless of the clinical issues.

METHODS

Following the PRISMA statement, MEDLINE and PubMed (via PubMed), Embase (via Elsevier) and IEEE Xplore will be searched using English free text terms in title/abstract, Medical Subject Headings (MeSH) terms and Embase Subject Headings (Emtree fields). Additional studies will be identified by contacting authors of included studies and through reference lists of included studies. Grey literature searches will be conducted in Google Scholar. Risk of bias will be assessed by using Cochrane's RoB 2 for randomised trials and ROBINS-I for non-randomised trials. Transparent reporting of the included studies will be assessed using the CONSORT-AI extension statement. Two researchers will screen, assess and extract from the studies independently, with a third in case of conflicts that cannot be resolved by discussion.

DISCUSSION

It is expected that there will be a substantial shortage of suitable studies that compare healthcare professionals with and without ADM systems concerning patient-relevant endpoints. This can be attributed to the prioritisation of technical quality criteria and, in some cases, clinical parameters over patient-relevant endpoints in the development of study designs. Furthermore, it is anticipated that a significant portion of the identified studies will exhibit relatively poor methodological quality and provide only limited generalisable results.

SYSTEMATIC REVIEW REGISTRATION

This study is registered within PROSPERO (CRD42023412156).

A systematic review of deep learning-based spinal bone lesion detection in medical images

Spinal bone lesions encompass a wide array of pathologies, spanning from benign abnormalities to aggressive malignancies, such as diffusely localized metastases. Early detection and accurate differentiation of the underlying diseases is crucial for every patient's clinical treatment and outcome, with radiological imaging being a core element in the diagnostic pathway. Across numerous pathologies and imaging techniques, deep learning (DL) models are progressively considered a valuable resource in the clinical setting. This review describes not only the diagnostic performance of these models and the differing approaches in the field of spinal bone malignancy recognition, but also the lack of standardized methodology and reporting that we believe is currently hampering this newly founded area of research. In line with their established and reliable role in lesion detection, this publication focuses on both computed tomography and magnetic resonance imaging, as well as various derivative modalities (i.e. SPECT). After conducting a systematic literature search and subsequent analysis for applicability and quality using a modified QUADAS-2 scoring system, we confirmed that most of the 14 identified studies were plagued by major limitations, such as insufficient reporting of model statistics and data acquisition, a lacking external validation dataset, and potentially biased annotation. Although we experienced these limitations, we nonetheless conclude that the potential of these methods shines through in the presented results. These findings underline the need for more stringent quality controls in DL studies, as well as model development to afford increased insight and progress in this promising novel field.

Development and testing of a deep learning algorithm to detect lung consolidation among children with pneumonia using hand-held ultrasound

BACKGROUND AND OBJECTIVES

Severe pneumonia is the leading cause of death among young children worldwide, disproportionately impacting children who lack access to advanced diagnostic imaging. Here our objectives were to develop and test the accuracy of an artificial intelligence algorithm for detecting features of pulmonary consolidation on point-of-care lung ultrasounds among hospitalized children.

METHODS

This was a prospective, multicenter center study conducted at academic Emergency Department and Pediatric inpatient or intensive care units between 2018-2020. Pediatric participants from 18 months to 17 years old with suspicion of lower respiratory tract infection were enrolled. Bedside lung ultrasounds were performed using a Philips handheld Lumify C5-2 transducer and standardized protocol to collect video loops from twelve lung zones, and lung features at both the video and frame levels annotated. Data from both affected and unaffected lung fields were split at the participant level into training, tuning, and holdout sets used to train, tune hyperparameters, and test an algorithm for detection of consolidation features. Data collected from adults with lower respiratory tract disease were added to enrich the training set. Algorithm performance at the video level to detect consolidation on lung ultrasound was determined using reference standard diagnosis of positive or negative pneumonia derived from clinical data.

RESULTS

Data from 107 pediatric participants yielded 117 unique exams and contributed 604 positive and 589 negative videos for consolidation that were utilized for the algorithm development process. Overall accuracy for the model for identification and localization of consolidation was 88.5%, with sensitivity 88%, specificity 89%, positive predictive value 89%, and negative predictive value 87%.

CONCLUSIONS

Our algorithm demonstrated high accuracy for identification of consolidation features on pediatric chest ultrasound in children with pneumonia. Automated diagnostic support on an ultraportable point-of-care device has important implications for global health, particularly in austere settings.

Deep Learning for Pneumonia Detection in Chest X-ray Images: A Comprehensive Survey

This paper addresses the significant problem of identifying the relevant background and contextual literature related to deep learning (DL) as an evolving technology in order to provide a comprehensive analysis of the application of DL to the specific problem of pneumonia detection via chest X-ray (CXR) imaging, which is the most common and cost-effective imaging technique available worldwide for pneumonia diagnosis. This paper in particular addresses the key period associated with COVID-19, 2020-2023, to explain, analyze, and systematically evaluate the limitations of approaches and determine their relative levels of effectiveness. The context in which DL is applied as both an aid to and an automated substitute for existing expert radiography professionals, who often have limited availability, is elaborated in detail. The rationale for the undertaken research is provided, along with a justification of the resources adopted and their relevance. This explanatory text and the subsequent analyses are intended to provide sufficient detail of the problem being addressed, existing solutions, and the limitations of these, ranging in detail from the specific to the more general. Indeed, our analysis and evaluation agree with the generally held view that the use of transformers, specifically, vision transformers (ViTs), is the most promising technique for obtaining further effective results in the area of pneumonia detection using CXR images. However, ViTs require extensive further research to address several limitations, specifically the following: biased CXR datasets, data and code availability, the ease with which a model can be explained, systematic methods of accurate model comparison, the notion of class imbalance in CXR datasets, and the possibility of adversarial attacks, the latter of which remains an area of fundamental research.

Evolving and Novel Applications of Artificial Intelligence in Thoracic Imaging

The advent of artificial intelligence (AI) is revolutionizing medicine, particularly radiology. With the development of newer models, AI applications are demonstrating improved performance and versatile utility in the clinical setting. Thoracic imaging is an area of profound interest, given the prevalence of chest imaging and the significant health implications of thoracic diseases. This review aims to highlight the promising applications of AI within thoracic imaging. It examines the role of AI, including its contributions to improving diagnostic evaluation and interpretation, enhancing workflow, and aiding in invasive procedures. Next, it further highlights the current challenges and limitations faced by AI, such as the necessity of 'big data', ethical and legal considerations, and bias in representation. Lastly, it explores the potential directions for the application of AI in thoracic radiology.

Preoperative magnetic resonance imaging-radiomics in cervical cancer: a systematic review and meta-analysis

Background

The purpose of this systematic review and meta-analysis is to evaluate the potential significance of radiomics, derived from preoperative magnetic resonance imaging (MRI), in detecting deep stromal invasion (DOI), lymphatic vascular space invasion (LVSI) and lymph node metastasis (LNM) in cervical cancer (CC).

Methods

A rigorous and systematic evaluation was conducted on radiomics studies pertaining to CC, published in the PubMed database prior to March 2024. The area under the curve (AUC), sensitivity, and specificity of each study were separately extracted to evaluate the performance of preoperative MRI radiomics in predicting DOI, LVSI, and LNM of CC.

Results

A total of 4, 7, and 12 studies were included in the meta-analysis of DOI, LVSI, and LNM, respectively. The overall AUC, sensitivity, and specificity of preoperative MRI models in predicting DOI, LVSI, and LNM were 0.90, 0.83 (95% confidence interval [CI], 0.75-0.89) and 0.83 (95% CI, 0.74-0.90); 0.85, 0.80 (95% CI, 0.73-0.86) and 0.75 (95% CI, 0.66-0.82); 0.86, 0.79 (95% CI, 0.74-0.83) and 0.80 (95% CI, 0.77-0.83), respectively.

Conclusion

MRI radiomics has demonstrated considerable potential in predicting DOI, LVSI, and LNM in CC, positioning it as a valuable tool for preoperative precision evaluation in CC patients.

The Role of Artificial Intelligence in Combatting Respiratory Tract Infections

Respiratory tract infections (RTIs) such as pneumonia, bronchitis, and COVID-19 are significant global health concerns due to their high morbidity and mortality rates. The advent of artificial intelligence (AI) offers innovative solutions across various aspects of RTI management, including diagnosis, prediction, treatment, and prevention. AI algorithms enhance diagnostic accuracy by analyzing extensive data from electronic health records and imaging studies, often surpassing human radiologists in identifying diseases such as pneumonia. For instance, AI-based image recognition tools have demonstrated remarkable precision in detecting pneumonia from chest X-rays. Additionally, AI models can predict disease outbreaks and optimize public health responses, as exemplified during the COVID-19 pandemic where AI predicted infection hotspots and evaluated the effectiveness of containment measures. In personalized medicine, AI tailors treatments based on individual patient profiles, thereby improving therapeutic outcomes and accelerating drug discovery. Wearable AI devices facilitate early detection and prevention of RTIs through continuous health monitoring. Despite its transformative potential, AI implementation in healthcare faces challenges, including data privacy, algorithm transparency, and ethical concerns. Addressing these issues necessitates collaboration among technologists, healthcare providers, and policymakers to ensure responsible and equitable integration of AI technologies. This editorial underscores the transformative potential of AI in managing RTIs and calls for robust frameworks to harness AI's benefits while safeguarding patient rights.

Validated machine learning tools to distinguish immune checkpoint inhibitor, radiotherapy, COVID-19 and other infective pneumonitis

BACKGROUND

Pneumonitis is a well-described, potentially disabling, or fatal adverse effect associated with both immune checkpoint inhibitors (ICI) and thoracic radiotherapy. Accurate differentiation between checkpoint inhibitor pneumonitis (CIP) radiation pneumonitis (RP), and infective pneumonitis (IP) is crucial for swift, appropriate, and tailored management to achieve optimal patient outcomes. However, correct diagnosis is often challenging, owing to overlapping clinical presentations and radiological patterns.

METHODS

In this multi-centre study of 455 patients, we used machine learning with radiomic features extracted from chest CT imaging to develop and validate five models to distinguish CIP and RP from COVID-19, non-COVID-19 infective pneumonitis, and each other. Model performance was compared to that of two radiologists.

RESULTS

Models to distinguish RP from COVID-19, CIP from COVID-19 and CIP from non-COVID-19 IP out-performed radiologists (test set AUCs of 0.92 vs 0.8 and 0.8; 0.68 vs 0.43 and 0.4; 0.71 vs 0.55 and 0.63 respectively). Models to distinguish RP from non-COVID-19 IP and CIP from RP were not superior to radiologists but demonstrated modest performance, with test set AUCs of 0.81 and 0.8 respectively. The CIP vs RP model performed less well on patients with prior exposure to both ICI and radiotherapy (AUC 0.54), though the radiologists also had difficulty distinguishing this test cohort (AUC values 0.6 and 0.6).

CONCLUSION

Our results demonstrate the potential utility of such tools as a second or concurrent reader to support oncologists, radiologists, and chest physicians in cases of diagnostic uncertainty. Further research is required for patients with exposure to both ICI and thoracic radiotherapy.

The Impact of Artificial Intelligence on Microbial Diagnosis

Traditional microbial diagnostic methods face many obstacles such as sample handling, culture difficulties, misidentification, and delays in determining susceptibility. The advent of artificial intelligence (AI) has markedly transformed microbial diagnostics with rapid and precise analyses. Nonetheless, ethical considerations accompany AI adoption, necessitating measures to uphold patient privacy, mitigate biases, and ensure data integrity. This review examines conventional diagnostic hurdles, stressing the significance of standardized procedures in sample processing. It underscores AI's significant impact, particularly through machine learning (ML), in microbial diagnostics. Recent progressions in AI, particularly ML methodologies, are explored, showcasing their influence on microbial categorization, comprehension of microorganism interactions, and augmentation of microscopy capabilities. This review furnishes a comprehensive evaluation of AI's utility in microbial diagnostics, addressing both advantages and challenges. A few case studies including SARS-CoV-2, malaria, and mycobacteria serve to illustrate AI's potential for swift and precise diagnosis. Utilization of convolutional neural networks (CNNs) in digital pathology, automated bacterial classification, and colony counting further underscores AI's versatility. Additionally, AI improves antimicrobial susceptibility assessment and contributes to disease surveillance, outbreak forecasting, and real-time monitoring. Despite a few limitations, integration of AI in diagnostic microbiology presents robust solutions, user-friendly algorithms, and comprehensive training, promising paradigm-shifting advancements in healthcare.

Machine learning-based computer-aided simple triage (CAST) for COVID-19 pneumonia as compared with triage by board-certified chest radiologists

PURPOSE

Several reporting systems have been proposed for providing standardized language and diagnostic categories aiming for expressing the likelihood that lung abnormalities on CT images represent COVID-19. We developed a machine learning (ML)-based CT texture analysis software for simple triage based on the RSNA Expert Consensus Statement system. The purpose of this study was to conduct a multi-center and multi-reader study to determine the capability of ML-based computer-aided simple triage (CAST) software based on RSNA expert consensus statements for diagnosis of COVID-19 pneumonia.

METHODS

For this multi-center study, 174 cases who had undergone CT and polymerase chain reaction (PCR) tests for COVID-19 were retrospectively included. Their CT data were then assessed by CAST and consensus from three board-certified chest radiologists, after which all cases were classified as either positive or negative. Diagnostic performance was then compared by McNemar's test. To determine radiological finding evaluation capability of CAST, three other board-certified chest radiologists assessed CAST results for radiological findings into five criteria. Finally, accuracies of all radiological evaluations were compared by McNemar's test.

RESULTS

A comparison of diagnosis for COVID-19 pneumonia based on RT-PCR results for cases with COVID-19 pneumonia findings on CT showed no significant difference of diagnostic performance between ML-based CAST software and consensus evaluation (p > 0.05). Comparison of agreement on accuracy for all radiological finding evaluations showed that emphysema evaluation accuracy for investigator A (AC = 91.7%) was significantly lower than that for investigators B (100%, p = 0.0009) and C (100%, p = 0.0009).

CONCLUSION

This multi-center study shows COVID-19 pneumonia triage by CAST can be considered at least as valid as that by chest expert radiologists and may be capable for playing as useful a complementary role for management of suspected COVID-19 pneumonia patients as well as the RT-PCR test in routine clinical practice.

Clinical applications of artificial intelligence in identification and management of bacterial infection: Systematic review and meta-analysis

Pneumonia is declared a global emergency public health crisis in children less than five age and the geriatric population. Recent advancements in deep learning models could be utilized effectively for the timely and early diagnosis of pneumonia in immune-compromised patients to avoid complications. This systematic review and meta-analysis utilized PRISMA guidelines for the selection of ten articles included in this study. The literature search was done through electronic databases including PubMed, Scopus, and Google Scholar from 1st January 2016 till 1 July 2023. Overall studies included a total of 126,610 images and 1706 patients in this meta-analysis. At a 95% confidence interval, for pooled sensitivity was 0.90 (0.85-0.94) and I2 statistics 90.20 (88.56 - 91.92). The pooled specificity for deep learning models' diagnostic accuracy was 0.89 (0.86---0.92) and I2 statistics 92.72 (91.50 - 94.83). I2 statistics showed low heterogeneity across studies highlighting consistent and reliable estimates, and instilling confidence in these findings for researchers and healthcare practitioners. The study highlighted the recent deep learning models single or in combination with high accuracy, sensitivity, and specificity to ensure reliable use for bacterial pneumonia identification and differentiate from other viral, fungal pneumonia in children and adults through chest x-rays and radiographs.

Diagnostic performance of deep learning models versus radiologists in COVID-19 pneumonia: A systematic review and meta-analysis

PURPOSE

Although several studies have compared the performance of deep learning (DL) models and radiologists for the diagnosis of COVID-19 pneumonia on CT of the chest, these results have not been collectively evaluated. We performed a meta-analysis of original articles comparing the performance of DL models versus radiologists in detecting COVID-19 pneumonia.

METHODS

A systematic search was conducted on the three main medical literature databases, Scopus, Web of Science, and PubMed, for articles published as of February 1st, 2023. We included original scientific articles that compared DL models trained to detect COVID-19 pneumonia on CT to radiologists. Meta-analysis was performed to determine DL versus radiologist performance in terms of model sensitivity and specificity, taking into account inter and intra-study heterogeneity.

RESULTS

Twenty-two articles met the inclusion criteria. Based on the meta-analytic calculations, DL models had significantly higher pooled sensitivity (0.933 vs. 0.829, p < 0.001) compared to radiologists with similar pooled specificity (0.905 vs. 0.897, p = 0.746). In the differentiation of COVID-19 versus community-acquired pneumonia, the DL models had significantly higher sensitivity compared to radiologists (0.915 vs. 0.836, p = 0.001).

CONCLUSIONS

DL models have high performance for screening of COVID-19 pneumonia on chest CT, offering the possibility of these models for augmenting radiologists in clinical practice.

Harnessing of Artificial Intelligence for the Diagnosis and Prevention of Hospital-Acquired Infections: A Systematic Review

Healthcare-associated infections (HAIs) are the most common adverse events in healthcare and constitute a major global public health concern. Surveillance represents the foundation for the effective prevention and control of HAIs, yet conventional surveillance is costly and labor intensive. Artificial intelligence (AI) and machine learning (ML) have the potential to support the development of HAI surveillance algorithms for the understanding of HAI risk factors, the improvement of patient risk stratification as well as the prediction and timely detection and prevention of infections. AI-supported systems have so far been explored for clinical laboratory testing and imaging diagnosis, antimicrobial resistance profiling, antibiotic discovery and prediction-based clinical decision support tools in terms of HAIs. This review aims to provide a comprehensive summary of the current literature on AI applications in the field of HAIs and discuss the future potentials of this emerging technology in infection practice. Following the PRISMA guidelines, this study examined the articles in databases including PubMed and Scopus until November 2023, which were screened based on the inclusion and exclusion criteria, resulting in 162 included articles. By elucidating the advancements in the field, we aim to highlight the potential applications of AI in the field, report related issues and shortcomings and discuss the future directions.

Exploring the Methodological Approaches of Studies on Radiographic Databases Used in Cariology to Feed Artificial Intelligence: A Systematic Review

INTRODUCTION

A growing number of studies on diagnostic imaging show superior efficiency and accuracy of computer-aided diagnostic systems compared to those of certified dentists. This methodological systematic review aimed to evaluate the different methodological approaches used by studies focusing on machine learning and deep learning that have used radiographic databases to classify, detect, and segment dental caries.

METHODS

The protocol was registered in PROSPERO before data collection (CRD42022348097). Literature research was performed in MEDLINE, Embase, IEEE Xplore, and Web of Science until December 2022, without language restrictions. Studies and surveys using a dental radiographic database for the classification, detection, or segmentation of carious lesions were sought. Records deemed eligible were retrieved and further assessed for inclusion by two reviewers who resolved any discrepancies through consensus. A third reviewer was consulted when any disagreements or discrepancies persisted between the two reviewers. After data extraction, the same reviewers assessed the methodological quality using the CLAIM and QUADAS-AI checklists.

RESULTS

After screening 325 articles, 35 studies were eligible and included. The bitewing was the most commonly used radiograph (n = 17) at the time when detection (n = 15) was the most explored computer vision task. The sample sizes used ranged from 95 to 38,437, while the augmented training set ranged from 300 to 315,786. Convolutional neural network was the most commonly used model. The mean completeness of CLAIM items was 49% (SD ± 34%). The applicability of the CLAIM checklist items revealed several weaknesses in the methodology of the selected studies: most of the studies were monocentric, and only 9% of them used an external test set when evaluating the model's performance. The QUADAS-AI tool revealed that only 43% of the studies included in this systematic review were at low risk of bias concerning the standard reference domain.

CONCLUSION

This review demonstrates that the overall scientific quality of studies conducted to feed artificial intelligence algorithms is low. Some improvement in the design and validation of studies can be made with the development of a standardized guideline for the reproducibility and generalizability of results and, thus, their clinical applications.

Blazing the trail for innovative tuberculosis diagnostics

The COVID-19 pandemic brought diagnostics into the spotlight in an unprecedented way not only for case management but also for population health, surveillance, and monitoring. The industry saw notable levels of investment and accelerated research which sparked a wave of innovation. Simple non-invasive sampling methods such as nasal swabs have become widely used in settings ranging from tertiary hospitals to the community. Self-testing has also been adopted as standard practice using not only conventional lateral flow tests but novel and affordable point-of-care molecular diagnostics. The use of new technologies, including artificial intelligence-based diagnostics, have rapidly expanded in the clinical setting. The capacity for next-generation sequencing and acceptance of digital health has significantly increased. However, 4 years after the pandemic started, the market for SARS-CoV-2 tests is saturated, and developers may benefit from leveraging their innovations for other diseases; tuberculosis (TB) is a worthwhile portfolio expansion for diagnostics developers given the extremely high disease burden, supportive environment from not-for-profit initiatives and governments, and the urgent need to overcome the long-standing dearth of innovation in the TB diagnostics field. In exchange, the current challenges in TB detection may be resolved by adopting enhanced swab-based molecular methods, instrument-based, higher sensitivity antigen detection technologies, and/or artificial intelligence-based digital health technologies developed for COVID-19. The aim of this article is to review how such innovative approaches for COVID-19 diagnosis can be applied to TB to have a comparable impact.

Machine and deep learning methods for clinical outcome prediction based on physiological data of COVID-19 patients: a scoping review

INTRODUCTION

Since the beginning of the COVID-19 pandemic, numerous machine and deep learning (MDL) methods have been proposed in the literature to analyze patient physiological data. The objective of this review is to summarize various aspects of these methods and assess their practical utility for predicting various clinical outcomes.

METHODS

We searched PubMed, Scopus, and Cochrane Library, screened and selected the studies matching the inclusion criteria. The clinical analysis focused on the characteristics of the patient cohorts in the studies included in this review, the specific tasks in the context of the COVID-19 pandemic that machine and deep learning methods were used for, and their practical limitations. The technical analysis focused on the details of specific MDL methods and their performance.

RESULTS

Analysis of the 48 selected studies revealed that the majority (∼54 %) of them examined the application of MDL methods for the prediction of survival/mortality-related patient outcomes, while a smaller fraction (∼13 %) of studies also examined applications to the prediction of patients' physiological outcomes and hospital resource utilization. 21 % of the studies examined the application of MDL methods to multiple clinical tasks. Machine and deep learning methods have been shown to be effective at predicting several outcomes of COVID-19 patients, such as disease severity, complications, intensive care unit (ICU) transfer, and mortality. MDL methods also achieved high accuracy in predicting the required number of ICU beds and ventilators.

CONCLUSION

Machine and deep learning methods have been shown to be valuable tools for predicting disease severity, organ dysfunction and failure, patient outcomes, and hospital resource utilization during the COVID-19 pandemic. The discovered knowledge and our conclusions and recommendations can also be useful to healthcare professionals and artificial intelligence researchers in managing future pandemics.

New trend in artificial intelligence-based assistive technology for thoracic imaging

Although there is no solid agreement for artificial intelligence (AI), it refers to a computer system with intelligence similar to that of humans. Deep learning appeared in 2006, and more than 10 years have passed since the third AI boom was triggered by improvements in computing power, algorithm development, and the use of big data. In recent years, the application and development of AI technology in the medical field have intensified internationally. There is no doubt that AI will be used in clinical practice to assist in diagnostic imaging in the future. In qualitative diagnosis, it is desirable to develop an explainable AI that at least represents the basis of the diagnostic process. However, it must be kept in mind that AI is a physician-assistant system, and the final decision should be made by the physician while understanding the limitations of AI. The aim of this article is to review the application of AI technology in diagnostic imaging from PubMed database while particularly focusing on diagnostic imaging in thorax such as lesion detection and qualitative diagnosis in order to help radiologists and clinicians to become more familiar with AI in thorax.

Quantitative Evaluation of COVID-19 Pneumonia CT Using AI Analysis-Feasibility and Differentiation from Other Common Pneumonia Forms

PURPOSE: To implement the technical feasibility of an AI-based software prototype optimized for the detection of COVID-19 pneumonia in CT datasets of the lung and the differentiation between other etiologies of pneumonia. METHODS: This single-center retrospective case-control-study consecutively yielded 144 patients (58 female, mean age 57.72 ± 18.25 y) with CT datasets of the lung. Subgroups including confirmed bacterial (n = 24, 16.6%), viral (n = 52, 36.1%), or fungal (n = 25, 16.6%) pneumonia and (n = 43, 30.7%) patients without detected pneumonia (comparison group) were evaluated using the AI-based Pneumonia Analysis prototype. Scoring (extent, etiology) was compared to reader assessment. RESULTS: The software achieved an optimal sensitivity of 80.8% with a specificity of 50% for the detection of COVID-19; however, the human radiologist achieved optimal sensitivity of 80.8% and a specificity of 97.2%. The mean postprocessing time was 7.61 ± 4.22 min. The use of a contrast agent did not influence the results of the software (p = 0.81). The mean evaluated COVID-19 probability is 0.80 ± 0.36 significantly higher in COVID-19 patients than in patients with fungal pneumonia (p < 0.05) and bacterial pneumonia (p < 0.001). The mean percentage of opacity (PO) and percentage of high opacity (PHO ≥ -200 HU) were significantly higher in COVID-19 patients than in healthy patients. However, the total mean HU in COVID-19 patients was -679.57 ± 112.72, which is significantly higher than in the healthy control group (p < 0.001). CONCLUSION: The detection and quantification of pneumonia beyond the primarily trained COVID-19 datasets is possible and shows comparable results for COVID-19 pneumonia to an experienced reader. The advantages are the fast, automated segmentation and quantification of the pneumonia foci.

Added value of chest CT in a machine learning-based prediction model to rule out COVID-19 before inpatient admission: A retrospective university network study

PURPOSE

During the coronavirus disease 2019 (COVID-19) pandemic, hospitals still face the challenge of timely identification of infected individuals before inpatient admission. An artificial intelligence approach based on an established clinical network may improve prospective pandemic preparedness.

METHOD

Supervised machine learning was used to construct diagnostic models to predict COVID-19. A pooled database was retrospectively generated from 4437 participant data that were collected between January 2017 and October 2020 at 12 German centers that belong to the radiological cooperative network of the COVID-19 (RACOON) consortium. A total of 692 (15.6 %) participants were COVID-19 positive according to the reference of the reverse transcription-polymerase chain reaction test. The diagnostic models included chest CT features (model R), clinical examination and laboratory test features (model CL), or all three feature categories (model RCL). Performance outcomes included accuracy, sensitivity, specificity, negative and positive predictive value, and area under the receiver operating curve (AUC).

RESULTS

Performance of predictive models improved significantly by adding chest CT features to clinical evaluation and laboratory test features. Without (model CL) and with inclusion of chest CT (model RCL), sensitivity was 0.82 and 0.89 (p < 0.0001), specificity was 0.84 and 0.89 (p < 0.0001), negative predictive value was 0.96 and 0.97 (p < 0.0001), AUC was 0.92 and 0.95 (p < 0.0001), and proportion of false negative classifications was 2.6 % and 1.7 % (p < 0.0001), respectively.

CONCLUSIONS

Addition of chest CT features to machine learning-based predictive models improves the effectiveness in ruling out COVID-19 before inpatient admission to regular wards.

Institutional Strategies to Maintain and Grow Imaging Research During the COVID-19 Pandemic

Understanding imaging research experiences, challenges, and strategies for academic radiology departments during and after COVID-19 is critical to prepare for future disruptive events. We summarize key insights and programmatic initiatives at major academic hospitals across the world, based on literature review and meetings of the Radiological Society of North America Vice Chairs of Research (RSNA VCR) group. Through expert discussion and case studies, we provide suggested guidelines to maintain and grow radiology research in the postpandemic era.