Artificial Intelligence Applied to Chest X-ray for Differential Diagnosis of COVID-19 Pneumonia

Artificial Intelligence Applied to Chest X-ray: A Reliable Tool to Assess the Differential Diagnosis of Lung Pneumonia in the Emergency Department

BACKGROUND

Considering the large number of patients with pulmonary symptoms admitted to the emergency department daily, it is essential to diagnose them correctly. It is necessary to quickly solve the differential diagnosis between COVID-19 and typical bacterial pneumonia to address them with the best management possible. In this setting, an artificial intelligence (AI) system can help radiologists detect pneumonia more quickly.

METHODS

We aimed to test the diagnostic performance of an AI system in detecting COVID-19 pneumonia and typical bacterial pneumonia in patients who underwent a chest X-ray (CXR) and were admitted to the emergency department. The final dataset was composed of three sub-datasets: the first included all patients positive for COVID-19 pneumonia (n = 1140, namely "COVID-19+"), the second one included all patients with typical bacterial pneumonia (n = 500, "pneumonia+"), and the third one was composed of healthy subjects (n = 1000). Two radiologists were blinded to demographic, clinical, and laboratory data. The developed AI system was used to evaluate all CXRs randomly and was asked to classify them into three classes. Cohen's κ was used for interrater reliability analysis. The AI system's diagnostic accuracy was evaluated using a confusion matrix, and 95%CIs were reported as appropriate.

RESULTS

The interrater reliability analysis between the most experienced radiologist and the AI system reported an almost perfect agreement for COVID-19+ (κ = 0.822) and pneumonia+ (κ = 0.913). We found 96% sensitivity (95% CIs = 94.9-96.9) and 79.8% specificity (76.4-82.9) for the radiologist and 94.7% sensitivity (93.4-95.8) and 80.2% specificity (76.9-83.2) for the AI system in the detection of COVID-19+. Moreover, we found 97.9% sensitivity (98-99.3) and 88% specificity (83.5-91.7) for the radiologist and 97.5% sensitivity (96.5-98.3) and 83.9% specificity (79-87.9) for the AI system in the detection of pneumonia+ patients. Finally, the AI system reached an accuracy of 93.8%, with a misclassification rate of 6.2% and weighted-F1 of 93.8% in detecting COVID+, pneumonia+, and healthy subjects.

CONCLUSIONS

The AI system demonstrated excellent diagnostic performance in identifying COVID-19 and typical bacterial pneumonia in CXRs acquired in the emergency setting.

Ten Issues for Updating in Community-Acquired Pneumonia: An Expert Review

Community-acquired pneumonia represents the third-highest cause of mortality in industrialized countries and the first due to infection. Although guidelines for the approach to this infection model are widely implemented in international health schemes, information continually emerges that generates controversy or requires updating its management. This paper reviews the most important issues in the approach to this process, such as an aetiologic update using new molecular platforms or imaging techniques, including the diagnostic stewardship in different clinical settings. It also reviews both the Intensive Care Unit admission criteria and those of clinical stability to discharge. An update in antibiotic, in oxygen, or steroidal therapy is presented. It also analyzes the management out-of-hospital in CAP requiring hospitalization, the main factors for readmission, and an approach to therapeutic failure or rescue. Finally, the main strategies for prevention and vaccination in both immunocompetent and immunocompromised hosts are reviewed.

How do patients perceive the AI-radiologists interaction? Results of a survey on 2119 responders

PURPOSE

In this study we investigate how patients perceive the interaction between artificial intelligence (AI) and radiologists by designing a survey.

METHOD

We created a survey focused on the application of Artificial Intelligence in radiology which consisted of 20 questions distributed in three sections:Only completed questionnaires were considered for analysis.

RESULTS

2119 subjects completed the survey. Among them, 1216 respondents were over 60 years old, showing interest in AI even though they were not digital natives. Although >45% of the respondents reported a high level of education, only 3% said they were AI experts. 87% of respondents favored using AI to support diagnosis but would like to be informed. Only 10% would consult another specialist if their doctor used AI support. Most respondents (76%) said they would not feel comfortable if the diagnosis was made by the AI alone, highlighting the importance of the physician's role in the emotional management of the patient. Finally, 36% of respondents were willing to discuss the topic further in a focus group.

CONCLUSION

Patients' perception of the use of AI in radiology was positive, although still strictly linked to the supervision of the radiologist. Respondents showed interest and willingness to learn more about AI in the medical field, confirming how patients' confidence in AI technology and its acceptance is central to its widespread use in clinical practice.

A new classification method for diagnosing COVID-19 pneumonia based on joint CNN features of chest X-ray images and parallel pyramid MLP-mixer module

During the past three years, the coronavirus disease 2019 (COVID-19) has swept the world. The rapid and accurate recognition of covid-19 pneumonia are ,therefore, of great importance. To handle this problem, we propose a new pipeline of deep learning framework for diagnosing COVID-19 pneumonia via chest X-ray images from normal, COVID-19, and other pneumonia patients. In detail, the self-trained YOLO-v4 network was first used to locate and segment the thoracic region, and the output images were scaled to the same size. Subsequently, the pre-trained convolutional neural network was adopted to extract the features of X-ray images from 13 convolutional layers, which were fused with the original image to form a 14-dimensional image matrix. It was then put into three parallel pyramid multi-layer perceptron (MLP)-Mixer modules for comprehensive feature extraction through spatial fusion and channel fusion based on different scales so as to grasp more extensive feature correlation. Finally, by combining all image features from the 14-channel output, the classification task was achieved using two fully connected layers as well as Softmax classifier for classification. Extensive simulations based on a total of 4099 chest X-ray images were conducted to verify the effectiveness of the proposed method. Experimental results indicated that our proposed method can achieve the best performance in almost all cases, which is good for auxiliary diagnosis of COVID-19 and has great clinical application potential.

Inter- and Intra-Observer Agreement When Using a Diagnostic Labeling Scheme for Annotating Findings on Chest X-rays-An Early Step in the Development of a Deep Learning-Based Decision Support System

Consistent annotation of data is a prerequisite for the successful training and testing of artificial intelligence-based decision support systems in radiology. This can be obtained by standardizing terminology when annotating diagnostic images. The purpose of this study was to evaluate the annotation consistency among radiologists when using a novel diagnostic labeling scheme for chest X-rays. Six radiologists with experience ranging from one to sixteen years, annotated a set of 100 fully anonymized chest X-rays. The blinded radiologists annotated on two separate occasions. Statistical analyses were done using Randolph's kappa and PABAK, and the proportions of specific agreements were calculated. Fair-to-excellent agreement was found for all labels among the annotators (Randolph's Kappa, 0.40-0.99). The PABAK ranged from 0.12 to 1 for the two-reader inter-rater agreement and 0.26 to 1 for the intra-rater agreement. Descriptive and broad labels achieved the highest proportion of positive agreement in both the inter- and intra-reader analyses. Annotating findings with specific, interpretive labels were found to be difficult for less experienced radiologists. Annotating images with descriptive labels may increase agreement between radiologists with different experience levels compared to annotation with interpretive labels.

Low-cost thermal imaging with machine learning for non-invasive diagnosis and therapeutic monitoring of pneumonia

Rapid screening and early treatment of lung infection are essential for effective control of many epidemics such as Coronavirus Disease 2019 (COVID-19). Recent studies have demonstrated the potential correlation between lung infection and the change of back skin temperature distribution. Based on these findings, we propose to use low-cost, portable and rapid thermal imaging in combination with image-processing algorithms and machine learning analysis for non-invasive and safe detection of pneumonia. The proposed method was tested in 69 subjects (30 normal adults, 11 cases of fever without pneumonia, 19 cases of general pneumonia and 9 cases of COVID-19) where both RGB and thermal images were acquired from the back of each subject. The acquired images were processed automatically in order to extract multiple location and shape features that distinguish normal subjects from pneumonia patients at a high accuracy of 93 % . Furthermore, daily assessment of two pneumonia patients by the proposed method accurately predicted the clinical outcomes, coincident with those of laboratory tests. Our pilot study demonstrated the technical feasibility of portable and intelligent thermal imaging for screening and therapeutic assessment of pneumonia. The method can be potentially implemented in under-resourced regions for more effective control of respiratory epidemics.

The role of artificial intelligence in plain chest radiographs interpretation during the Covid-19 pandemic

Artificial intelligence (AI) plays a crucial role in the future development of all healthcare sectors ranging from clinical assistance of physicians by providing accurate diagnosis, prognosis and treatment to the development of vaccinations and aiding in the combat against the Covid-19 global pandemic. AI has an important role in diagnostic radiology where the algorithms can be trained by large datasets to accurately provide a timely diagnosis of the radiological images given. This has led to the development of several AI algorithms that can be used in regions of scarcity of radiologists during the current pandemic by simply denoting the presence or absence of Covid-19 pneumonia in PCR positive patients on plain chest radiographs as well as in helping to levitate the over-burdened radiology departments by accelerating the time for report delivery. Plain chest radiography is the most common radiological study in the emergency department setting and is readily available, fast and a cheap method that can be used in triaging patients as well as being portable in the medical wards and can be used as the initial radiological examination in Covid-19 positive patients to detect pneumonic changes. Numerous studies have been done comparing several AI algorithms to that of experienced thoracic radiologists in plain chest radiograph reports measuring accuracy of each in Covid-19 patients. The majority of studies have reported performance equal or higher to that of the well-experienced thoracic radiologist in predicting the presence or absence of Covid-19 pneumonic changes in the provided chest radiographs.

Application of Table Tennis Ball Trajectory and Rotation-Oriented Prediction Algorithm Using Artificial Intelligence

The present work aims to accelerate sports development in China and promote technological innovation in the artificial intelligence (AI) field. After analyzing the application and development of AI, it is introduced into sports and applied to table tennis competitions and training. The principle of the trajectory prediction of the table tennis ball (TTB) based on AI is briefly introduced. It is found that the difficulty of predicting TTB trajectories lies in rotation measurement. Accordingly, the rotation and trajectory of TTB are predicted using some AI algorithms. Specifically, a TTB detection algorithm is designed based on the Feature Fusion Network (FFN). For feature exaction, the cross-layer connection network is used to strengthen the learning ability of convolutional neural networks (CNNs) and streamline network parameters to improve the network detection response. The experimental results demonstrate that the trained CNN can reach a detection accuracy of over 98%, with a detection response within 5.3 ms, meeting the requirements of the robot vision system of the table tennis robot. By comparison, the traditional Color Segmentation Algorithm has advantages in detection response, with unsatisfactory detection accuracy, especially against TTB's color changes. Thus, the algorithm reported here can immediately hit the ball with high accuracy. The research content provides a reference for applying AI to TTB trajectory and rotation prediction and has significant value in popularizing table tennis.

External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review

Purpose

To assess generalizability of published deep learning (DL) algorithms for radiologic diagnosis.

Materials and Methods

In this systematic review, the PubMed database was searched for peer-reviewed studies of DL algorithms for image-based radiologic diagnosis that included external validation, published from January 1, 2015, through April 1, 2021. Studies using nonimaging features or incorporating non-DL methods for feature extraction or classification were excluded. Two reviewers independently evaluated studies for inclusion, and any discrepancies were resolved by consensus. Internal and external performance measures and pertinent study characteristics were extracted, and relationships among these data were examined using nonparametric statistics.

Results

Eighty-three studies reporting 86 algorithms were included. The vast majority (70 of 86, 81%) reported at least some decrease in external performance compared with internal performance, with nearly half (42 of 86, 49%) reporting at least a modest decrease (≥0.05 on the unit scale) and nearly a quarter (21 of 86, 24%) reporting a substantial decrease (≥0.10 on the unit scale). No study characteristics were found to be associated with the difference between internal and external performance.

Conclusion

Among published external validation studies of DL algorithms for image-based radiologic diagnosis, the vast majority demonstrated diminished algorithm performance on the external dataset, with some reporting a substantial performance decrease.Keywords: Meta-Analysis, Computer Applications-Detection/Diagnosis, Neural Networks, Computer Applications-General (Informatics), Epidemiology, Technology Assessment, Diagnosis, Informatics Supplemental material is available for this article. © RSNA, 2022.

Evaluating Deep Neural Network Architectures with Transfer Learning for Pneumonitis Diagnosis

Pneumonitis is an infectious disease that causes the inflammation of the air sac. It can be life-threatening to the very young and elderly. Detection of pneumonitis from X-ray images is a significant challenge. Early detection and assistance with diagnosis can be crucial. Recent developments in the field of deep learning have significantly improved their performance in medical image analysis. The superior predictive performance of the deep learning methods makes them ideal for pneumonitis classification from chest X-ray images. However, training deep learning models can be cumbersome and resource-intensive. Reusing knowledge representations of public models trained on large-scale datasets through transfer learning can help alleviate these challenges. In this paper, we compare various image classification models based on transfer learning with well-known deep learning architectures. The Kaggle chest X-ray dataset was used to evaluate and compare our models. We apply basic data augmentation and fine-tune our feed-forward classification head on the models pretrained on the ImageNet dataset. We observed that the DenseNet201 model outperforms other models with an AUROC score of 0.966 and a recall score of 0.99. We also visualize the class activation maps from the DenseNet201 model to interpret the patterns recognized by the model for prediction.