Pre-trained convolutional neural networks as feature extractors for tuberculosis detection

Diagnostic Performance of Artificial Intelligence-Based Methods for Tuberculosis Detection: Systematic Review

BACKGROUND

Tuberculosis (TB) remains a significant health concern, contributing to the highest mortality among infectious diseases worldwide. However, none of the various TB diagnostic tools introduced is deemed sufficient on its own for the diagnostic pathway, so various artificial intelligence (AI)-based methods have been developed to address this issue.

OBJECTIVE

We aimed to provide a comprehensive evaluation of AI-based algorithms for TB detection across various data modalities.

METHODS

Following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analysis) 2020 guidelines, we conducted a systematic review to synthesize current knowledge on this topic. Our search across 3 major databases (Scopus, PubMed, Association for Computing Machinery [ACM] Digital Library) yielded 1146 records, of which we included 152 (13.3%) studies in our analysis. QUADAS-2 (Quality Assessment of Diagnostic Accuracy Studies version 2) was performed for the risk-of-bias assessment of all included studies.

RESULTS

Radiographic biomarkers (n=129, 84.9%) and deep learning (DL; n=122, 80.3%) approaches were predominantly used, with convolutional neural networks (CNNs) using Visual Geometry Group (VGG)-16 (n=37, 24.3%), ResNet-50 (n=33, 21.7%), and DenseNet-121 (n=19, 12.5%) architectures being the most common DL approach. The majority of studies focused on model development (n=143, 94.1%) and used a single modality approach (n=141, 92.8%). AI methods demonstrated good performance in all studies: mean accuracy=91.93% (SD 8.10%, 95% CI 90.52%-93.33%; median 93.59%, IQR 88.33%-98.32%), mean area under the curve (AUC)=93.48% (SD 7.51%, 95% CI 91.90%-95.06%; median 95.28%, IQR 91%-99%), mean sensitivity=92.77% (SD 7.48%, 95% CI 91.38%-94.15%; median 94.05% IQR 89%-98.87%), and mean specificity=92.39% (SD 9.4%, 95% CI 90.30%-94.49%; median 95.38%, IQR 89.42%-99.19%). AI performance across different biomarker types showed mean accuracies of 92.45% (SD 7.83%), 89.03% (SD 8.49%), and 84.21% (SD 0%); mean AUCs of 94.47% (SD 7.32%), 88.45% (SD 8.33%), and 88.61% (SD 5.9%); mean sensitivities of 93.8% (SD 6.27%), 88.41% (SD 10.24%), and 93% (SD 0%); and mean specificities of 94.2% (SD 6.63%), 85.89% (SD 14.66%), and 95% (SD 0%) for radiographic, molecular/biochemical, and physiological types, respectively. AI performance across various reference standards showed mean accuracies of 91.44% (SD 7.3%), 93.16% (SD 6.44%), and 88.98% (SD 9.77%); mean AUCs of 90.95% (SD 7.58%), 94.89% (SD 5.18%), and 92.61% (SD 6.01%); mean sensitivities of 91.76% (SD 7.02%), 93.73% (SD 6.67%), and 91.34% (SD 7.71%); and mean specificities of 86.56% (SD 12.8%), 93.69% (SD 8.45%), and 92.7% (SD 6.54%) for bacteriological, human reader, and combined reference standards, respectively. The transfer learning (TL) approach showed increasing popularity (n=89, 58.6%). Notably, only 1 (0.7%) study conducted domain-shift analysis for TB detection.

CONCLUSIONS

Findings from this review underscore the considerable promise of AI-based methods in the realm of TB detection. Future research endeavors should prioritize conducting domain-shift analyses to better simulate real-world scenarios in TB detection.

TRIAL REGISTRATION

PROSPERO CRD42023453611; https://www.crd.york.ac.uk/PROSPERO/view/CRD42023453611.

Medical image classification by incorporating clinical variables and learned features

Medical image classification plays an important role in medical imaging. In this work, we present a novel approach to enhance deep learning models in medical image classification by incorporating clinical variables without overwhelming the information. Unlike most existing deep neural network models that only consider single-pixel information, our method captures a more comprehensive view. Our method contains two main steps and is effective in tackling the extra challenge raised by the scarcity of medical data. Firstly, we employ a pre-trained deep neural network served as a feature extractor to capture meaningful image features. Then, an exquisite discriminant analysis is applied to reduce the dimensionality of these features, ensuring that the low number of features remains optimized for the classification task and striking a balance with the clinical variables information. We also develop a way of obtaining class activation maps for our approach in visualizing models' focus on specific regions within the low-dimensional feature space. Thorough experimental results demonstrate improvements of our proposed method over state-of-the-art methods for tuberculosis and dermatology issues for example. Furthermore, a comprehensive comparison with a popular dimensionality reduction technique (principal component analysis) is also conducted.

Machine learning based tuberculosis (ML-TB) health predictor model: early TB health disease prediction with ML models for prevention in developing countries

Background

Tuberculosis (TB) remains one of the top infectious killers in the world and a prominent fatal disease in developing countries. This study proposes a prototypical solution to early prevention of TB based on its primary symptoms, signs, and risk factors, implemented by means of machine learning (ML) predictive algorithms. Further novelty of the study lies in the uniqueness of patient dataset collected from three top-ranked hospitals of Sindh, Pakistan, via a self-administered survey patient-records that comprises a set of questions asked by the doctors treating TB patients in real-time. A total of 1,200 survey patient-records were evenly distributed among all three hospitals, viz. ICT Kotri, LUMHS Jamshoro, and Civil Hospital Hyderabad.

Methods

To develop the required prototypes, the research made use of five distinct benchmark ML algorithms: decision tree (DT), Gaussian naive Bayes (GNB), logistic regression classifier (LRC), adaptive boosting (AdaBoost), and neural network (NN), whose performance was evaluated by considering various performance metrics, i.e., accuracy, precision, recall, F1 score, and confusion matrix.

Results

The experimental results, graphically visualized and systematically discoursed, demonstrate that early detection of TB classifiers, including DT, GNB, LRC, AdaBoost, and NN, attained accuracy rates of 92.11%, 89.04%, 90.35%, 93.42%, and 92.98%, respectively. These results indicate effective diagnosis of TB disease by each implemented ML algorithm.

Development and Multicenter, Multiprotocol Validation of Neural Network for Aberrant Right Subclavian Artery Detection

PURPOSE

This study aimed to develop and validate a convolutional neural network (CNN) that automatically detects an aberrant right subclavian artery (ARSA) on preoperative computed tomography (CT) for thyroid cancer evaluation.

MATERIALS AND METHODS

A total of 556 CT with ARSA and 312 CT with normal aortic arch from one institution were used as the training set for model development. A deep learning model for the classification of patch images for ARSA was developed using two-dimension CNN from EfficientNet. The diagnostic performance of our model was evaluated using external test sets (112 and 126 CT) from two institutions. The performance of the model was compared with that of radiologists for detecting ARSA using an independent dataset of 1683 consecutive neck CT.

RESULTS

The performance of the model was achieved using two external datasets with an area under the curve of 0.97 and 0.99, and accuracy of 97% and 99%, respectively. In the temporal validation set, which included a total of 20 patients with ARSA and 1663 patients without ARSA, radiologists overlooked 13 ARSA cases. In contrast, the CNN model successfully detected all the 20 patients with ARSA.

CONCLUSION

We developed a CNN-based deep learning model that detects ARSA using CT. Our model showed high performance in the multicenter validation.

A systematic literature analysis of multi-organ cancer diagnosis using deep learning techniques

Cancer is becoming the most toxic ailment identified among individuals worldwide. The mortality rate has been increasing rapidly every year, which causes progression in the various diagnostic technologies to handle this illness. The manual procedure for segmentation and classification with a large set of data modalities can be a challenging task. Therefore, a crucial requirement is to significantly develop the computer-assisted diagnostic system intended for the initial cancer identification. This article offers a systematic review of Deep Learning approaches using various image modalities to detect multi-organ cancers from 2012 to 2023. It emphasizes the detection of five supreme predominant tumors, i.e., breast, brain, lung, skin, and liver. Extensive review has been carried out by collecting research and conference articles and book chapters from reputed international databases, i.e., Springer Link, IEEE Xplore, Science Direct, PubMed, and Wiley that fulfill the criteria for quality evaluation. This systematic review summarizes the overview of convolutional neural network model architectures and datasets used for identifying and classifying the diverse categories of cancer. This study accomplishes an inclusive idea of ensemble deep learning models that have achieved better evaluation results for classifying the different images into cancer or healthy cases. This paper will provide a broad understanding to the research scientists within the domain of medical imaging procedures of which deep learning technique perform best over which type of dataset, extraction of features, different confrontations, and their anticipated solutions for the complex problems. Lastly, some challenges and issues which control the health emergency have been discussed.

A deep learning radiomics model based on CT images for predicting the biological activity of hepatic cystic echinococcosis

Introduction: Hepatic cystic echinococcosis (HCE) is a widely seen parasitic infection. Biological activity is crucial for treatment planning. This work aims to explore the potential applications of a deep learning radiomics (DLR) model, based on CT images, in predicting the biological activity grading of hepatic cystic echinococcosis. Methods: A retrospective analysis of 160 patients with hepatic echinococcosis was performed (127 and 33 in training and validation sets). Volume of interests (VOIs) were drawn, and radiomics features and deep neural network features were extracted. Feature selection was performed on the training set, and radiomics score (Rad Score) and deep learning score (Deep Score) were calculated. Seven diagnostics models (based on logistic regression algorithm) for the biological activity grading were constructed using the selected radiomics features and two deep model features respectively. All models were evaluated using the receiver operating characteristic curve, and the area under the curve (AUC) was calculated. A nomogram was constructed using the combined model, and its calibration, discriminatory ability, and clinical utility were assessed. Results: 12, 6 and 10 optimal radiomics features, deep learning features were selected from two deep learning network (DLN) features, respectively. For biological activity grading of hepatic cystic echinococcosis, the combined model demonstrated strong diagnostic performance, with an AUC value of 0.888 (95% CI: 0.837-0.936) in the training set and 0.876 (0.761-0.964) in the validation set. The clinical decision analysis curve indicated promising results, while the calibration curve revealed that the nomogram's prediction result was highly compatible with the actual result. Conclusion: The DLR model can be used for predicting the biological activity grading of hepatic echinococcosis.

Adapted generative latent diffusion models for accurate pathological analysis in chest X-ray images

Respiratory diseases have a significant global impact, and assessing these conditions is crucial for improving patient outcomes. Chest X-ray is widely used for diagnosis, but expert evaluation can be challenging. Automatic computer-aided diagnosis methods can provide support for clinicians in these tasks. Deep learning has emerged as a set of algorithms with exceptional potential in such tasks. However, these algorithms require a vast amount of data, often scarce in medical imaging domains. In this work, a new data augmentation methodology based on adapted generative latent diffusion models is proposed to improve the performance of an automatic pathological screening in two high-impact scenarios: tuberculosis and lung nodules. The methodology is evaluated using three publicly available datasets, representative of real-world settings. An ablation study obtained the highest-performing image generation model configuration regarding the number of training steps. The results demonstrate that the novel set of generated images can improve the performance of the screening of these two highly relevant pathologies, obtaining an accuracy of 97.09%, 92.14% in each dataset of tuberculosis screening, respectively, and 82.19% in lung nodules. The proposal notably improves on previous image generation methods for data augmentation, highlighting the importance of the contribution in these critical public health challenges.

Encrypted Network Traffic Analysis and Classification Utilizing Machine Learning

Encryption is a fundamental security measure to safeguard data during transmission to ensure confidentiality while at the same time posing a great challenge for traditional packet and traffic inspection. In response to the proliferation of diverse network traffic patterns from Internet-of-Things devices, websites, and mobile applications, understanding and classifying encrypted traffic are crucial for network administrators, cybersecurity professionals, and policy enforcement entities. This paper presents a comprehensive survey of recent advancements in machine-learning-driven encrypted traffic analysis and classification. The primary goals of our survey are two-fold: First, we present the overall procedure and provide a detailed explanation of utilizing machine learning in analyzing and classifying encrypted network traffic. Second, we review state-of-the-art techniques and methodologies in traffic analysis. Our aim is to provide insights into current practices and future directions in encrypted traffic analysis and classification, especially machine-learning-based analysis.

Revisiting Computer-Aided Tuberculosis Diagnosis

Tuberculosis (TB) is a major global health threat, causing millions of deaths annually. Although early diagnosis and treatment can greatly improve the chances of survival, it remains a major challenge, especially in developing countries. Recently, computer-aided tuberculosis diagnosis (CTD) using deep learning has shown promise, but progress is hindered by limited training data. To address this, we establish a large-scale dataset, namely the Tuberculosis X-ray (TBX11 K) dataset, which contains 11 200 chest X-ray (CXR) images with corresponding bounding box annotations for TB areas. This dataset enables the training of sophisticated detectors for high-quality CTD. Furthermore, we propose a strong baseline, SymFormer, for simultaneous CXR image classification and TB infection area detection. SymFormer incorporates Symmetric Search Attention (SymAttention) to tackle the bilateral symmetry property of CXR images for learning discriminative features. Since CXR images may not strictly adhere to the bilateral symmetry property, we also propose Symmetric Positional Encoding (SPE) to facilitate SymAttention through feature recalibration. To promote future research on CTD, we build a benchmark by introducing evaluation metrics, evaluating baseline models reformed from existing detectors, and running an online challenge. Experiments show that SymFormer achieves state-of-the-art performance on the TBX11 K dataset.

Diagnosis of Mycobacterium tuberculosis using palladium-platinum bimetallic nanoparticles combined with paper-based analytical devices

In this study, we demonstrate that palladium-platinum bimetallic nanoparticles (Pd@Pt NPs) as the nanozyme, combined with a multi-layer paper-based analytical device and DNA hybridization, can successfully detect Mycobacterium tuberculosis. This nanozyme has peroxidase-like properties, which can increase the oxidation rate of the substrate. Compared with horseradish peroxidase, which is widely used in traditional detection, the Michaelis constants of Pd@Pt NPs are fourteen and seventeen times lower than those for 3,3',5,5'-tetramethylbenzidine and H2O2, respectively. To verify the catalytic efficiency of Pd@Pt NPs, this study will execute molecular diagnosis of Mycobacterium tuberculosis. We chose the IS6110 fragment as the target DNA and divided the complementary sequences into the capture DNA and reporter DNA. They were modified on paper and Pd@Pt NPs, respectively, to detect Mycobacterium tuberculosis on a paper-based analytical device. With the above-mentioned method, we can detect target DNA within 15 minutes with a linear range between 0.75 and 10 nM, and a detection limit of 0.216 nM. These results demonstrate that the proposed platform (a DNA-nanozyme integrated paper-based analytical device, dnPAD) can provide sensitive and on-site infection prognosis in areas with insufficient medical resources.

Survival Analysis for Multimode Ablation Using Self-Adapted Deep Learning Network Based on Multisource Features

Novel multimode thermal therapy by freezing before radio-frequency heating has achieved a desirable therapeutic effect in liver cancer. Compared with surgical resection, ablation treatment has a relatively high risk of tumor recurrence. To monitor tumor progression after ablation, we developed a novel survival analysis framework for survival prediction and efficacy assessment. We extracted preoperative and postoperative MRI radiomics features and vision transformer-based deep learning features. We also combined the immune features extracted from peripheral blood immune responses using flow cytometry and routine blood tests before and after treatment. We selected features using random survival forest and improved the deep Cox mixture (DCM) for survival analysis. To properly accommodate multitype input features, we proposed a self-adapted fully connected layer for locally and globally representing features. We evaluated the method using our clinical dataset. Of note, the immune features rank the highest feature importance and contribute significantly to the prediction accuracy. The results showed a promising C$^{\mathit{td}}$-index of 0.885 $\pm$ 0.040 and an integrated Brier score of 0.041 $\pm$ 0.014, which outperformed state-of-the-art method combinations of survival prediction. For each patient, individual survival probability was accurately predicted over time, which provided clinicians with trustable prognosis suggestions.

Exploring the Impact of Artificial Intelligence on Global Health and Enhancing Healthcare in Developing Nations

BACKGROUND

Artificial intelligence (AI), which combines computer science with extensive datasets, seeks to mimic human-like intelligence. Subsets of AI are being applied in almost all fields of medicine and surgery.

AIM

This review focuses on the applications of AI in healthcare settings in developing countries, designed to underscore its significance by comprehensively outlining the advancements made thus far, the shortcomings encountered in AI applications, the present status of AI integration, persistent challenges, and innovative strategies to surmount them.

METHODOLOGY

Articles from PubMed, Google Scholar, and Cochrane were searched from 2000 to 2023 with keywords including AI and healthcare, focusing on multiple medical specialties.

RESULTS

The increasing role of AI in diagnosis, prognosis prediction, and patient management, as well as hospital management and community healthcare, has made the overall healthcare system more efficient, especially in the high patient load setups and resource-limited areas of developing countries where patient care is often compromised. However, challenges, including low adoption rates and the absence of standardized guidelines, high installation and maintenance costs of equipment, poor transportation and connectivvity issues hinder AI's full use in healthcare.

CONCLUSION

Despite these challenges, AI holds a promising future in healthcare. Adequate knowledge and expertise of healthcare professionals for the use of AI technology in healthcare is imperative in developing nations.

Early diagnosis and meta-agnostic model visualization of tuberculosis based on radiography images

Despite being treatable and preventable, tuberculosis (TB) affected one-fourth of the world population in 2019, and it took the lives of 1.4 million people in 2019. It affected 1.2 million children around the world in the same year. As it is an infectious bacterial disease, the early diagnosis of TB prevents further transmission and increases the survival rate of the affected person. One of the standard diagnosis methods is the sputum culture test. Diagnosing and rapid sputum test results usually take one to eight weeks in 24 h. Using posterior-anterior chest radiographs (CXR) facilitates a rapid and more cost-effective early diagnosis of tuberculosis. Due to intraclass variations and interclass similarities in the images, TB prognosis from CXR is difficult. We proposed an early TB diagnosis system (tbXpert) based on deep learning methods. Deep Fused Linear Triangulation (FLT) is considered for CXR images to reconcile intraclass variation and interclass similarities. To improve the robustness of the prognosis approach, deep information must be obtained from the minimal radiation and uneven quality CXR images. The advanced FLT method accurately visualizes the infected region in the CXR without segmentation. Deep fused images are trained by the Deep learning network (DLN) with residual connections. The largest standard database, comprised of 3500 TB CXR images and 3500 normal CXR images, is utilized for training and validating the recommended model. Specificity, sensitivity, Accuracy, and AUC are estimated to determine the performance of the proposed systems. The proposed system demonstrates a maximum testing accuracy of 99.2%, a sensitivity of 98.9%, a specificity of 99.6%, a precision of 99.6%, and an AUC of 99.4%, all of which are pretty high when compared to current state-of-the-art deep learning approaches for the prognosis of tuberculosis. To lessen the radiologist's time, effort, and reliance on the level of competence of the specialist, the suggested system named tbXpert can be deployed as a computer-aided diagnosis technique for tuberculosis.

Parallel CNN-ELM: A multiclass classification of chest X-ray images to identify seventeen lung diseases including COVID-19

Numerous epidemic lung diseases such as COVID-19, tuberculosis (TB), and pneumonia have spread over the world, killing millions of people. Medical specialists have experienced challenges in correctly identifying these diseases due to their subtle differences in Chest X-ray images (CXR). To assist the medical experts, this study proposed a computer-aided lung illness identification method based on the CXR images. For the first time, 17 different forms of lung disorders were considered and the study was divided into six trials with each containing two, two, three, four, fourteen, and seventeen different forms of lung disorders. The proposed framework combined robust feature extraction capabilities of a lightweight parallel convolutional neural network (CNN) with the classification abilities of the extreme learning machine algorithm named CNN-ELM. An optimistic accuracy of 90.92% and an area under the curve (AUC) of 96.93% was achieved when 17 classes were classified side by side. It also accurately identified COVID-19 and TB with 99.37% and 99.98% accuracy, respectively, in 0.996 microseconds for a single image. Additionally, the current results also demonstrated that the framework could outperform the existing state-of-the-art (SOTA) models. On top of that, a secondary conclusion drawn from this study was that the prospective framework retained its effectiveness over a range of real-world environments, including balanced-unbalanced or large-small datasets, large multiclass or simple binary class, and high- or low-resolution images. A prototype Android App was also developed to establish the potential of the framework in real-life implementation.

Prediction of Five-Year Survival Rate for Rectal Cancer Using Markov Models of Convolutional Features of RhoB Expression on Tissue Microarray

The ability to predict survival in cancer is clinically important because the finding can help patients and physicians make optimal treatment decisions. Artificial intelligence in the context of deep learning has been increasingly realized by the informatics-oriented medical community as a powerful machine-learning technology for cancer research, diagnosis, prediction, and treatment. This paper presents the combination of deep learning, data coding, and probabilistic modeling for predicting five-year survival in a cohort of patients with rectal cancer using images of RhoB expression on biopsies. Using about one-third of the patients' data for testing, the proposed approach achieved 90% prediction accuracy, which is much higher than the direct use of the best pretrained convolutional neural network (70%) and the best coupling of a pretrained model and support vector machines (70%).

Detection of various lung diseases including COVID-19 using extreme learning machine algorithm based on the features extracted from a lightweight CNN architecture

Around the world, several lung diseases such as pneumonia, cardiomegaly, and tuberculosis (TB) contribute to severe illness, hospitalization or even death, particularly for elderly and medically vulnerable patients. In the last few decades, several new types of lung-related diseases have taken the lives of millions of people, and COVID-19 has taken almost 6.27 million lives. To fight against lung diseases, timely and correct diagnosis with appropriate treatment is crucial in the current COVID-19 pandemic. In this study, an intelligent recognition system for seven lung diseases has been proposed based on machine learning (ML) techniques to aid the medical experts. Chest X-ray (CXR) images of lung diseases were collected from several publicly available databases. A lightweight convolutional neural network (CNN) has been used to extract characteristic features from the raw pixel values of the CXR images. The best feature subset has been identified using the Pearson Correlation Coefficient (PCC). Finally, the extreme learning machine (ELM) has been used to perform the classification task to assist faster learning and reduced computational complexity. The proposed CNN-PCC-ELM model achieved an accuracy of 96.22% with an Area Under Curve (AUC) of 99.48% for eight class classification. The outcomes from the proposed model demonstrated better performance than the existing state-of-the-art (SOTA) models in the case of COVID-19, pneumonia, and tuberculosis detection in both binary and multiclass classifications. For eight class classification, the proposed model achieved precision, recall and fi-score and ROC are 100%, 99%, 100% and 99.99% respectively for COVID-19 detection demonstrating its robustness. Therefore, the proposed model has overshadowed the existing pioneering models to accurately differentiate COVID-19 from the other lung diseases that can assist the medical physicians in treating the patient effectively.

Characterization of attentional event-related potential from REM sleep behavior disorder patients based on explainable machine learning

BACKGROUND AND OBJECTIVE

Idiopathic rapid eye movement sleep behavior disorder (iRBD) is a prodromal stage of neurodegeneration and is associated with cortical dysfunction. The purpose of this study was to investigate the spatiotemporal characteristics of cortical activities underlying impaired visuospatial attention in iRBD patients using an explainable machine-learning approach.

METHODS

An algorithm based on a convolutional neural network (CNN) was devised to discriminate cortical current source activities of iRBD patients due to single-trial event-related potentials (ERPs), from those of normal controls. The ERPs from 16 iRBD patients and 19 age- and sex-matched normal controls were recorded while the subjects were performing visuospatial attentional task, and converted to two-dimensional images representing current source densities on flattened cortical surface. The CNN classifier was trained based on overall data, and then, a transfer learning approach was applied for the fine-tuning to each patient.

RESULTS

The trained classifier yielded high classification accuracy. The critical features for the classification were determined by layer-wise relevance propagation, so that the spatiotemporal characteristics of cortical activities that were most relevant to cognitive impairment in iRBD were revealed.

CONCLUSIONS

These results suggest that the recognized dysfunction in visuospatial attention of iRBD patients originates from neural activity impairment in relevant cortical regions and may contribute to the development of useful iRBD biomarkers based on neural activity.

Computer-Aided detection of tuberculosis from X-ray images using CNN and PatternNet classifier

BACKGROUND

Tuberculosis (TB) is a highly infectious disease that mainly affects the human lungs. The gold standard for TB diagnosis is Xpert Mycobacterium tuberculosis/ resistance to rifampicin (MTB/RIF) testing. X-ray, a relatively inexpensive and widely used imaging modality, can be employed as an alternative for early diagnosis of the disease. Computer-aided techniques can be used to assist radiologists in interpreting X-ray images, which can improve the ease and accuracy of diagnosis.

OBJECTIVE

To develop a computer-aided technique for the diagnosis of TB from X-ray images using deep learning techniques.

METHODS

This research paper presents a novel approach for TB diagnosis from X-ray using deep learning methods. The proposed method uses an ensemble of two pre-trained neural networks, namely EfficientnetB0 and Densenet201, for feature extraction. The features extracted using two CNNs are expected to generate more accurate and representative features than a single CNN. A custom-built artificial neural network (ANN) called PatternNet with two hidden layers is utilized to classify the extracted features.

RESULTS

The effectiveness of the proposed method was assessed on two publicly accessible datasets, namely the Montgomery and Shenzhen datasets. The Montgomery dataset comprises 138 X-ray images, while the Shenzhen dataset has 662 X-ray images. The method was further evaluated after combining both datasets. The method performed exceptionally well on all three datasets, achieving high Area Under the Curve (AUC) scores of 0.9978, 0.9836, and 0.9914, respectively, using a 10-fold cross-validation technique.

CONCLUSION

The experiments performed in this study prove the effectiveness of features extracted using EfficientnetB0 and Densenet201 in combination with PatternNet classifier in the diagnosis of tuberculosis from X-ray images.

Point-of-care test for tuberculosis: a boon in diagnosis

Rapid diagnosis of tuberculosis (TB) is an effective measure to eradicate this infectious disease worldwide. Traditional methods for screening TB patients do not provide an immediate diagnosis and thus delay treatment. There is an urgent need for the early detection of TB through point-of-care tests (POCTs). Several POCTs are widely available at primary healthcare facilities that assist in TB screening. In addition to the currently used POCTs, advancements in technology have led to the discovery of newer methods that provide accurate and fast information independent of access to laboratory facilities. In the present article, the authors tried to include and describe the potential POCTs for screening TB in patients. Several molecular diagnostic tests, such as nucleic acid amplification tests, including GeneXpert and TB-loop-mediated isothermal amplification, are currently being used as POCTs. Besides these methods, the pathogenic component of Mycobacterium tuberculosis can also be utilized as a biomarker for screening purposes through immunological assays. Similarly, the host immune response to infection has also been utilized as a marker for the diagnosis of TB. These novel biomarkers might include Mtb85, interferon-γ inducible protein-10, volatile organic compounds, acute-phase proteins, etc. Radiological tests have also been observed as POCTs in the TB screening POCT panel. Various POCTs are performed on samples other than sputum, which further eases the screening process. These POCTs should not require large-scale manpower and infrastructure. Hence, POCT should be able to identify patients with M. tuberculosis infection at the primary healthcare level only. There are several other advanced techniques that have been proposed as future POCTs and have been discussed in the present article.

Review on chest pathogies detection systems using deep learning techniques

Chest radiography is the standard and most affordable way to diagnose, analyze, and examine different thoracic and chest diseases. Typically, the radiograph is examined by an expert radiologist or physician to decide about a particular anomaly, if exists. Moreover, computer-aided methods are used to assist radiologists and make the analysis process accurate, fast, and more automated. A tremendous improvement in automatic chest pathologies detection and analysis can be observed with the emergence of deep learning. The survey aims to review, technically evaluate, and synthesize the different computer-aided chest pathologies detection systems. The state-of-the-art of single and multi-pathologies detection systems, which are published in the last five years, are thoroughly discussed. The taxonomy of image acquisition, dataset preprocessing, feature extraction, and deep learning models are presented. The mathematical concepts related to feature extraction model architectures are discussed. Moreover, the different articles are compared based on their contributions, datasets, methods used, and the results achieved. The article ends with the main findings, current trends, challenges, and future recommendations.

A hybrid deep learning approach for COVID-19 detection based on genomic image processing techniques

The coronavirus disease 2019 (COVID-19) pandemic has been spreading quickly, threatening the public health system. Consequently, positive COVID-19 cases must be rapidly detected and treated. Automatic detection systems are essential for controlling the COVID-19 pandemic. Molecular techniques and medical imaging scans are among the most effective approaches for detecting COVID-19. Although these approaches are crucial for controlling the COVID-19 pandemic, they have certain limitations. This study proposes an effective hybrid approach based on genomic image processing (GIP) techniques to rapidly detect COVID-19 while avoiding the limitations of traditional detection techniques, using whole and partial genome sequences of human coronavirus (HCoV) diseases. In this work, the GIP techniques convert the genome sequences of HCoVs into genomic grayscale images using a genomic image mapping technique known as the frequency chaos game representation. Then, the pre-trained convolution neural network, AlexNet, is used to extract deep features from these images using the last convolution (conv5) and second fully-connected (fc7) layers. The most significant features were obtained by removing the redundant ones using the ReliefF and least absolute shrinkage and selection operator (LASSO) algorithms. These features are then passed to two classifiers: decision trees and k-nearest neighbors (KNN). Results showed that extracting deep features from the fc7 layer, selecting the most significant features using the LASSO algorithm, and executing the classification process using the KNN classifier is the best hybrid approach. The proposed hybrid deep learning approach detected COVID-19, among other HCoV diseases, with 99.71% accuracy, 99.78% specificity, and 99.62% sensitivity.

A comprehensive survey of deep learning research on medical image analysis with focus on transfer learning

This survey aims to identify commonly used methods, datasets, future trends, knowledge gaps, constraints, and limitations in the field to provide an overview of current solutions used in medical image analysis in parallel with the rapid developments in transfer learning (TL). Unlike previous studies, this survey grouped the last five years of current studies for the period between January 2017 and February 2021 according to different anatomical regions and detailed the modality, medical task, TL method, source data, target data, and public or private datasets used in medical imaging. Also, it provides readers with detailed information on technical challenges, opportunities, and future research trends. In this way, an overview of recent developments is provided to help researchers to select the most effective and efficient methods and access widely used and publicly available medical datasets, research gaps, and limitations of the available literature.

A deep learning architecture for multi-class lung diseases classification using chest X-ray (CXR) images

In 2019, the world experienced the rapid outbreak of the Covid-19 pandemic creating an alarming situation worldwide. The virus targets the respiratory system causing pneumonia with other symptoms such as fatigue, dry cough, and fever which can be mistakenly diagnosed as pneumonia, lung cancer, or TB. Thus, the early diagnosis of COVID-19 is critical since the disease can provoke patients’ mortality. Chest X-ray (CXR) is commonly employed in healthcare sector where both quick and precise diagnosis can be supplied. Deep learning algorithms have proved extraordinary capabilities in terms of lung diseases detection and classification. They facilitate and expedite the diagnosis process and save time for the medical practitioners. In this paper, a deep learning (DL) architecture for multi-class classification of Pneumonia, Lung Cancer, tuberculosis (TB), Lung Opacity, and most recently COVID-19 is proposed. Tremendous CXR images of 3615 COVID-19, 6012 Lung opacity, 5870 Pneumonia, 20,000 lung cancer, 1400 tuberculosis, and 10,192 normal images were resized, normalized, and randomly split to fit the DL requirements. In terms of classification, we utilized a pre-trained model, VGG19 followed by three blocks of convolutional neural network (CNN) as a feature extraction and fully connected network at the classification stage. The experimental results revealed that our proposed VGG19 + CNN outperformed other existing work with 96.48 % accuracy, 93.75 % recall, 97.56 % precision, 95.62 % F1 score, and 99.82 % area under the curve (AUC). The proposed model delivered superior performance allowing healthcare practitioners to diagnose and treat patients more quickly and efficiently.

Grading of gliomas using transfer learning on MRI images

OBJECTIVE

Despite the critical role of Magnetic Resonance Imaging (MRI) in the diagnosis of brain tumours, there are still many pitfalls in the exact grading of them, in particular, gliomas. In this regard, it was aimed to examine the potential of Transfer Learning (TL) and Machine Learning (ML) algorithms in the accurate grading of gliomas on MRI images.

MATERIALS AND METHODS

Dataset has included four types of axial MRI images of glioma brain tumours with grades I-IV: T1-weighted, T2-weighted, FLAIR, and T1-weighted Contrast-Enhanced (T1-CE). Images were resized, normalized, and randomly split into training, validation, and test sets. ImageNet pre-trained Convolutional Neural Networks (CNNs) were utilized for feature extraction and classification, using Adam and SGD optimizers. Logistic Regression (LR) and Support Vector Machine (SVM) methods were also implemented for classification instead of Fully Connected (FC) layers taking advantage of features extracted by each CNN.

RESULTS

Evaluation metrics were computed to find the model with the best performance, and the highest overall accuracy of 99.38% was achieved for the model containing an SVM classifier and features extracted by pre-trained VGG-16.

DISCUSSION

It was demonstrated that developing Computer-aided Diagnosis (CAD) systems using pre-trained CNNs and classification algorithms is a functional approach to automatically specify the grade of glioma brain tumours in MRI images. Using these models is an excellent alternative to invasive methods and helps doctors diagnose more accurately before treatment.

Sputum smears quality inspection using an ensemble feature extraction approach

The diagnosis of tuberculosis (TB) is extremely important. Sputum smear microscopy is thought to be the best method available in terms of accessibility and ease of use in resource-constrained countries. In this paper, research was conducted to evaluate the effectiveness of tuberculosis diagnosis by examining, among other things, the underlying causes of sputum smear quality for Ethiopian states such as Tigray, Amahira, and Oromia. However, because it is done manually, it has its limitations. This study proposes a model for sputum smear quality inspection using an ensemble feature extraction approach. The dataset used was recorded and labeled by experts in a regional lab in Bahir Dar, near Felege Hiwot Hospital after being collected from Gabi Hospital, Felege Hiwot Hospital, Adit Clinic and Gondar Hospital, as well as Kidanemihret Clinic in Gondar. We used a controlled environment to reduce environmental influences and eliminate variation. All the data was collected using a smartphone (the standard 15) with a jpg file extension and a pixel resolution of 1,728 × 3,840. Prior to feature extraction, bicubic resizing, and ROI extraction using thresholding was performed. In addition, sequential Gaussian and Gabor filters were used for noise reduction, augmentation, and CLAHE was used for enhancement. For feature extraction, GLCM from the gray label and CNN from the color image were both chosen. Ultimately, when CNN, SVM, and KNN classifiers were used to test both CNN and GLCM features, KNN outperformed them all with scores of 87, 93, and 94% for GLCM, CNN, and a hybrid of CNN and GLCM, respectively. CNN with GLCM outperformed other methods by 0.7 and 0.1% for GLCM and CNN feature extractors using the same classifier, respectively. In addition, the KNN classifier with the combination of CNN and GLCM as feature extractors performed better than existing methods by 1.48%.

A Review of Recent Advances in Deep Learning Models for Chest Disease Detection Using Radiography

Chest X-ray radiography (CXR) is among the most frequently used medical imaging modalities. It has a preeminent value in the detection of multiple life-threatening diseases. Radiologists can visually inspect CXR images for the presence of diseases. Most thoracic diseases have very similar patterns, which makes diagnosis prone to human error and leads to misdiagnosis. Computer-aided detection (CAD) of lung diseases in CXR images is among the popular topics in medical imaging research. Machine learning (ML) and deep learning (DL) provided techniques to make this task more efficient and faster. Numerous experiments in the diagnosis of various diseases proved the potential of these techniques. In comparison to previous reviews our study describes in detail several publicly available CXR datasets for different diseases. It presents an overview of recent deep learning models using CXR images to detect chest diseases such as VGG, ResNet, DenseNet, Inception, EfficientNet, RetinaNet, and ensemble learning methods that combine multiple models. It summarizes the techniques used for CXR image preprocessing (enhancement, segmentation, bone suppression, and data-augmentation) to improve image quality and address data imbalance issues, as well as the use of DL models to speed-up the diagnosis process. This review also discusses the challenges present in the published literature and highlights the importance of interpretability and explainability to better understand the DL models' detections. In addition, it outlines a direction for researchers to help develop more effective models for early and automatic detection of chest diseases.

Lung Diseases Detection Using Various Deep Learning Algorithms

The primary objective of this proposed framework work is to detect and classify various lung diseases such as pneumonia, tuberculosis, and lung cancer from standard X-ray images and Computerized Tomography (CT) scan images with the help of volume datasets. We implemented three deep learning models namely Sequential, Functional & Transfer models and trained them on open-source training datasets. To augment the patient's treatment, deep learning techniques are promising and successful domains that extend the machine learning domain where CNNs are trained to extract features and offers great potential from datasets of images in biomedical application. Our primary aim is to validate our models as a new direction to address the problem on the datasets and then to compare their performance with other existing models. Our models were able to reach higher levels of accuracy for possible solutions and provide effectiveness to humankind for faster detection of diseases and serve as best performing models. The conventional networks have poor performance for tilted, rotated, and other abnormal orientation and have poor learning framework. The results demonstrated that the proposed framework with a sequential model outperforms other existing methods in terms of an F1 score of 98.55%, accuracy of 98.43%, recall of 96.33% for pneumonia and for tuberculosis F1 score of 97.99%, accuracy of 99.4%, and recall of 98.88%. In addition, the functional model for cancer outperformed with an accuracy of 99.9% and specificity of 99.89% and paves way to less number of trained parameters, leading to less computational overhead and less expensive than existing pretrained models. In our work, we implemented a state-of-the art CNN with various models to classify lung diseases accurately.

Classification of IHC Images of NATs With ResNet-FRP-LSTM for Predicting Survival Rates of Rectal Cancer Patients

BACKGROUND

Over a decade, tissues dissected adjacent to primary tumors have been considered "normal" or healthy samples (NATs). However, NATs have recently been discovered to be distinct from both tumorous and normal tissues. The ability to predict the survival rate of cancer patients using NATs can open a new door to selecting optimal treatments for cancer and discovering biomarkers.

METHODS

This paper introduces an artificial intelligence (AI) approach that uses NATs for predicting the 5-year survival of pre-operative radiotherapy patients with rectal cancer. The new approach combines pre-trained deep learning, nonlinear dynamics, and long short-term memory to classify immunohistochemical images of RhoB protein expression on NATs.

RESULTS

Ten-fold cross-validation results show 88% accuracy of prediction obtained from the new approach, which is also higher than those provided from baseline methods.

CONCLUSION

Preliminary results not only add objective evidence to recent findings of NATs' molecular characteristics using state-of-the-art AI methods, but also contribute to the discovery of RhoB expression on NATs in rectal-cancer patients.

CLINICAL IMPACT

The ability to predict the survival rate of cancer patients is extremely important for clinical decision-making. The proposed AI tool is promising for assisting oncologists in their treatments of rectal cancer patients.

Druggable protein prediction using a multi-canal deep convolutional neural network based on autocovariance method

Drug targets must be identified and positioned correctly to research and manufacture new drugs. In this study, rather than using traditional methods for drug expansion, the drug target is determined using machine learning. Machine learning has generated significant interest and desire in recent years and extensive research due to its low cost and speed of operation. As a result, it is critical to develop an intelligent classification system for drug proteins. This study proposes two distinct models for the prediction of druggable protein classes based on the deep learning method. The translation of drug-protein sequences is based on six physicochemical properties of amino acids. Following the application of the autocovariance method, converted sequences are used as fixed-length input vectors in deep stacked sparse auto-encoders (DSSAEs) network. The coded protein sequences are also considered and utilized as a six-channel input vector for the deep convolutional neural network model. The experimental results contributing to the deep convolution model are more efficient than previous studies for classifying druggable proteins. The proposed approach achieved a sensitivity of 96.92%, a specificity of 99.51%, and an accuracy of 98.29%.

Ensemble Technique Coupled with Deep Transfer Learning Framework for Automatic Detection of Tuberculosis from Chest X-ray Radiographs

Tuberculosis (TB) is an infectious disease affecting humans' lungs and is currently ranked the 13th leading cause of death globally. Due to advancements in technology and the availability of medical datasets, automatic analysis and classification of chest X-rays (CXRs) into TB and non-TB can be a reliable alternative for early TB screening. We propose an automatic TB detection system using advanced deep learning (DL) models. A substantial part of a CXR image is dark, with no relevant information for diagnosis and potentially confusing DL models. In this work, the U-Net model extracts the region of interest from CXRs and the segmented images are fed to the DL models for feature extraction. Eight different convolutional neural networks (CNN) models are employed in our experiments, and their classification performance is compared based on three publicly available CXR datasets. The U-Net model achieves segmentation accuracy of 98.58%, intersection over union (IoU) of 93.10, and a Dice coefficient score of 96.50. Our proposed stacked ensemble algorithm performed better by achieving accuracy, sensitivity, and specificity values of 98.38%, 98.89%, and 98.70%, respectively. Experimental results confirm that segmented lung CXR images with ensemble learning produce a better result than un-segmented lung CXR images.

Advances in Deep Learning for Tuberculosis Screening using Chest X-rays: The Last 5 Years Review

There has been an explosive growth in research over the last decade exploring machine learning techniques for analyzing chest X-ray (CXR) images for screening cardiopulmonary abnormalities. In particular, we have observed a strong interest in screening for tuberculosis (TB). This interest has coincided with the spectacular advances in deep learning (DL) that is primarily based on convolutional neural networks (CNNs). These advances have resulted in significant research contributions in DL techniques for TB screening using CXR images. We review the research studies published over the last five years (2016-2021). We identify data collections, methodical contributions, and highlight promising methods and challenges. Further, we discuss and compare studies and identify those that offer extension beyond binary decisions for TB, such as region-of-interest localization. In total, we systematically review 54 peer-reviewed research articles and perform meta-analysis.

AI-Assisted Tuberculosis Detection and Classification from Chest X-Rays Using a Deep Learning Normalization-Free Network Model

Tuberculosis (TB) is an airborne disease caused by Mycobacterium tuberculosis. It is imperative to detect cases of TB as early as possible because if left untreated, there is a 70% chance of a patient dying within 10 years. The necessity for supplementary tools has increased in mid to low-income countries due to the rise of automation in healthcare sectors. The already limited resources are being heavily allocated towards controlling other dangerous diseases. Modern digital radiography (DR) machines, used for screening chest X-rays of potential TB victims are very practical. Coupled with computer-aided detection (CAD) with the aid of artificial intelligence, radiologists working in this field can really help potential patients. In this study, progressive resizing is introduced for training models to perform automatic inference of TB using chest X-ray images. ImageNet fine-tuned Normalization-Free Networks (NFNets) are trained for classification and the Score-Cam algorithm is utilized to highlight the regions in the chest X-Rays for detailed inference on the diagnosis. The proposed method is engineered to provide accurate diagnostics for both binary and multiclass classification. The models trained with this method have achieved 96.91% accuracy, 99.38% AUC, 91.81% sensitivity, and 98.42% specificity on a multiclass classification dataset. Moreover, models have also achieved top-1 inference metrics of 96% accuracy and 98% AUC for binary classification. The results obtained demonstrate that the proposed method can be used as a secondary decision tool in a clinical setting for assisting radiologists.

Review and Updates on the Diagnosis of Tuberculosis

Diagnosis of tuberculosis, and especially the diagnosis of extrapulmonary tuberculosis, still faces challenges in clinical practice. There are several reasons for this. Methods based on the detection of Mycobacterium tuberculosis (Mtb) are insufficiently sensitive, methods based on the detection of Mtb-specific immune responses cannot always differentiate active disease from latent infection, and some of the serological markers of infection with Mtb are insufficiently specific to differentiate tuberculosis from other inflammatory diseases. New tools based on technologies such as flow cytometry, mass spectrometry, high-throughput sequencing, and artificial intelligence have the potential to solve this dilemma. The aim of this review was to provide an updated overview of current efforts to optimize classical diagnostic methods, as well as new molecular and other methodologies, for accurate diagnosis of patients with Mtb infection.

Early Diagnosis of Tuberculosis Using Deep Learning Approach for IOT Based Healthcare Applications

In the modern world, Tuberculosis (TB) is regarded as a serious health issue with a high rate of mortality. TB can be cured completely by early diagnosis. For achieving this, one tool utilized is CXR (Chest X-rays) which is used to screen active TB. An enhanced deep learning (DL) model is implemented for automatic Tuberculosis detection. This work undergoes the phases like preprocessing, segmentation, feature extraction, and optimized classification. Initially, the CXR image is preprocessed and segmented using AFCM (Adaptive Fuzzy C means) clustering. Then, feature extraction and several features are extracted. Finally, these features are given to the DL classifier Deep Belief Network (DBN). To improve the classification accuracy and to optimize the DBN, a metaheuristic optimization Adaptive Monarch butterfly optimization (AMBO) algorithm is used. Here, the Deep Belief Network with Adaptive Monarch butterfly optimization (DBN-AMBO) is used for enhancing the accuracy, reducing the error function, and optimizing weighting parameters. The overall implementation is carried out on the Python platform. The overall performance evaluations of the DBN-AMBO were carried out on MC and SC datasets and compared over the other approaches on the basis of certain metrics.

Computed tomography-based deep-learning prediction of lymph node metastasis risk in locally advanced gastric cancer

Purpose

Preoperative evaluation of lymph node metastasis (LNM) is the basis of personalized treatment of locally advanced gastric cancer (LAGC). We aim to develop and evaluate CT-based model using deep learning features to preoperatively predict LNM in LAGC.

Methods

A combined size of 523 patients who had pathologically confirmed LAGC were retrospectively collected between August 2012 and July 2019 from our hospital. Five pre-trained convolutional neural networks were exploited to extract deep learning features from pretreatment CT images. And the support vector machine (SVM) was employed as the classifier. We assessed the performance using the area under the receiver operating characteristics curve (AUC) and selected an optimal model, which was compared with a radiomics model developed from the training cohort. A clinical model was built with clinical factors only for baseline comparison.

Results

The optimal model with features extracted from ResNet yielded better performance with AUC of 0.796 [95% confidence interval (95% CI), 0.715-0.865] and accuracy of 75.2% (95% CI, 67.2%-81.5%) in the testing cohort, compared with 0.704 (0.625-0.783) and 61.8% (54.5%-69.9%) for the radiomics model. The predictive performance of all the radiological models were significantly better than the clinical model.

Conclusion

The novel and noninvasive deep learning approach could provide efficient and accurate prediction of lymph node metastasis in LAGC, and benefit clinical decision making of therapeutic strategy.

A multichannel EfficientNet deep learning-based stacking ensemble approach for lung disease detection using chest X-ray images

This paper proposes a multichannel deep learning approach for lung disease detection using chest X-rays. The multichannel models used in this work are EfficientNetB0, EfficientNetB1, and EfficientNetB2 pretrained models. The features from EfficientNet models are fused together. Next, the fused features are passed into more than one non-linear fully connected layer. Finally, the features passed into a stacked ensemble learning classifier for lung disease detection. The stacked ensemble learning classifier contains random forest and SVM in the first stage and logistic regression in the second stage for lung disease detection. The performance of the proposed method is studied in detail for more than one lung disease such as pneumonia, Tuberculosis (TB), and COVID-19. The performances of the proposed method for lung disease detection using chest X-rays compared with similar methods with the aim to show that the method is robust and has the capability to achieve better performances. In all the experiments on lung disease, the proposed method showed better performance and outperformed similar lung disease existing methods. This indicates that the proposed method is robust and generalizable on unseen chest X-rays data samples. To ensure that the features learnt by the proposed method is optimal, t-SNE feature visualization was shown on all three lung disease models. Overall, the proposed method has shown 98% detection accuracy for pediatric pneumonia lung disease, 99% detection accuracy for TB lung disease, and 98% detection accuracy for COVID-19 lung disease. The proposed method can be used as a tool for point-of-care diagnosis by healthcare radiologists.Journal instruction requires a city for affiliations; however, this is missing in affiliation 3. Please verify if the provided city is correct and amend if necessary.correct.

Transformer-Based Deep-Learning Algorithm for Discriminating Demyelinating Diseases of the Central Nervous System With Neuroimaging

Background

Differential diagnosis of demyelinating diseases of the central nervous system is a challenging task that is prone to errors and inconsistent reading, requiring expertise and additional examination approaches. Advancements in deep-learning-based image interpretations allow for prompt and automated analyses of conventional magnetic resonance imaging (MRI), which can be utilized in classifying multi-sequence MRI, and thus may help in subsequent treatment referral.

Methods

Imaging and clinical data from 290 patients diagnosed with demyelinating diseases from August 2013 to October 2021 were included for analysis, including 67 patients with multiple sclerosis (MS), 162 patients with aquaporin 4 antibody-positive (AQP4+) neuromyelitis optica spectrum disorder (NMOSD), and 61 patients with myelin oligodendrocyte glycoprotein antibody-associated disease (MOGAD). Considering the heterogeneous nature of lesion size and distribution in demyelinating diseases, multi-modal MRI of brain and/or spinal cord were utilized to build the deep-learning model. This novel transformer-based deep-learning model architecture was designed to be versatile in handling with multiple image sequences (coronal T2-weighted and sagittal T2-fluid attenuation inversion recovery) and scanning locations (brain and spinal cord) for differentiating among MS, NMOSD, and MOGAD. Model performances were evaluated using the area under the receiver operating curve (AUC) and the confusion matrices measurements. The classification accuracy between the fusion model and the neuroradiological raters was also compared.

Results

The fusion model that was trained with combined brain and spinal cord MRI achieved an overall improved performance, with the AUC of 0.933 (95%CI: 0.848, 0.991), 0.942 (95%CI: 0.879, 0.987) and 0.803 (95%CI: 0.629, 0.949) for MS, AQP4+ NMOSD, and MOGAD, respectively. This exceeded the performance using the brain or spinal cord MRI alone for the identification of the AQP4+ NMOSD (AUC of 0.940, brain only and 0.689, spinal cord only) and MOGAD (0.782, brain only and 0.714, spinal cord only). In the multi-category classification, the fusion model had an accuracy of 81.4%, which was significantly higher compared to rater 1 (64.4%, p=0.04<0.05) and comparable to rater 2 (74.6%, p=0.388).

Conclusion

The proposed novel transformer-based model showed desirable performance in the differentiation of MS, AQP4+ NMOSD, and MOGAD on brain and spinal cord MRI, which is comparable to that of neuroradiologists. Our model is thus applicable for interpretating conventional MRI in the differential diagnosis of demyelinating diseases with overlapping lesions.

Reliable Sarcoidosis Detection Using Chest X-rays with EfficientNets and Stain-Normalization Techniques

Sarcoidosis is frequently misdiagnosed as tuberculosis (TB) and consequently mistreated due to inherent limitations in radiological presentations. Clinically, to distinguish sarcoidosis from TB, physicians usually employ biopsy tissue diagnosis and blood tests; this approach is painful for patients, time-consuming, expensive, and relies on techniques prone to human error. This study proposes a computer-aided diagnosis method to address these issues. This method examines seven EfficientNet designs that were fine-tuned and compared for their abilities to categorize X-ray images into three categories: normal, TB-infected, and sarcoidosis-infected. Furthermore, the effects of stain normalization on performance were investigated using Reinhard's and Macenko's conventional stain normalization procedures. This procedure aids in improving diagnostic efficiency and accuracy while cutting diagnostic costs. A database of 231 sarcoidosis-infected, 563 TB-infected, and 1010 normal chest X-ray images was created using public databases and information from several national hospitals. The EfficientNet-B4 model attained accuracy, sensitivity, and precision rates of 98.56%, 98.36%, and 98.67%, respectively, when the training X-ray images were normalized by the Reinhard stain approach, and 97.21%, 96.9%, and 97.11%, respectively, when normalized by Macenko's approach. Results demonstrate that Reinhard stain normalization can improve the performance of EfficientNet -B4 X-ray image classification. The proposed framework for identifying pulmonary sarcoidosis may prove valuable in clinical use.

Deep learning radiomics based on contrast enhanced computed tomography predicts microvascular invasion and survival outcome in early stage hepatocellular carcinoma

OBJECTIVE

To evaluate the performance of a deep learning (DL)-based radiomics strategy on contrast-enhanced computed tomography (CT) to predict microvascular invasion (MVI) status and clinical outcomes, recurrence-free survival (RFS) and overall survival (OS) in patients with early stage hepatocellular carcinoma (HCC) receiving surgical resection.

METHODS

All 283 eligible patients were included retrospectively between January 2008 and December 2015, and assigned into the training cohort (n = 198) and the testing cohort (n = 85). We extracted radiomics features via handcrafted radiomics analysis manually and DL analysis of pretrained convolutional neural networks via transfer learning automatically. Support vector machine was adopted as the classifier. A clinical-radiological model for MVI status integrated significant clinical features and the radiological signature generated from the radiological model with the optimal area under the receiver operating characteristics curve (AUC) in the testing cohort. Otherwise, DL-based prognostic models were constructed in prediction of recurrence and mortality via Cox proportional hazard analysis.

RESULTS

The clinical-radiological model for MVI represented an AUC of 0.909, accuracy of 96.47%, sensitivity of 90.91%, specificity of 97.30%, positive predictive value of 83.33%, and negative predictive value of 98.63% in the testing cohort. The clinical-radiological models for identification of RFS and OS outperformed prediction performance of the clinical model or the DL signature alone. The DL-based integrated model for prognostication showed great predictive value with significant classification and discrimination abilities after validation.

CONCLUSIONS

The integrated DL-based radiomics models achieved accurate preoperative prediction of MVI status, and might facilitate predicting tumor recurrence and mortality in order to optimize clinical decisions for patients with early stage HCC.

TB-Net: A Tailored, Self-Attention Deep Convolutional Neural Network Design for Detection of Tuberculosis Cases From Chest X-Ray Images

Tuberculosis (TB) remains a global health problem, and is the leading cause of death from an infectious disease. A crucial step in the treatment of tuberculosis is screening high risk populations and the early detection of the disease, with chest x-ray (CXR) imaging being the most widely-used imaging modality. As such, there has been significant recent interest in artificial intelligence-based TB screening solutions for use in resource-limited scenarios where there is a lack of trained healthcare workers with expertise in CXR interpretation. Motivated by this pressing need and the recent recommendation by the World Health Organization (WHO) for the use of computer-aided diagnosis of TB in place of a human reader, we introduce TB-Net, a self-attention deep convolutional neural network tailored for TB case screening. We used CXR data from a multi-national patient cohort to train and test our models. A machine-driven design exploration approach leveraging generative synthesis was used to build a highly customized deep neural network architecture with attention condensers. We conducted an explainability-driven performance validation process to validate TB-Net's decision-making behavior. Experiments on CXR data from a multi-national patient cohort showed that the proposed TB-Net is able to achieve accuracy/sensitivity/specificity of 99.86/100.0/99.71%. Radiologist validation was conducted on select cases by two board-certified radiologists with over 10 and 19 years of experience, respectively, and showed consistency between radiologist interpretation and critical factors leveraged by TB-Net for TB case detection for the case where radiologists identified anomalies. The proposed TB-Net not only achieves high tuberculosis case detection performance in terms of sensitivity and specificity, but also leverages clinically relevant critical factors in its decision making process. While not a production-ready solution, we hope that the open-source release of TB-Net as part of the COVID-Net initiative will support researchers, clinicians, and citizen data scientists in advancing this field in the fight against this global public health crisis.

Novel computer aided diagnostic models on multimodality medical images to differentiate well differentiated liposarcomas from lipomas approached by deep learning methods

BACKGROUND

Deep learning methods have great potential to predict tumor characterization, such as histological diagnosis and genetic aberration. The objective of this study was to evaluate and validate the predictive performance of multimodality imaging-derived models using computer-aided diagnostic (CAD) methods for prediction of MDM2 gene amplification to identify well-differentiated liposarcoma (WDLPS) and lipoma.

MATERIALS AND METHODS

All 127 patients from two institutions were included with 89 patients in one institution for model training and 38 patients in the other institution for external validation between January 2012 and December 2018. For each modality, handcrafted radiomics analysis with manual segmentation was applied to extract 851 features for each modality, and six pretrained convolutional neural networks (CNNs) extracted 512-2048 deep learning features automatically. Extracted imaging-based features were selected via univariate filter selection methods and the recursive feature elimination algorithm, which were then classified by support vector machine for model construction. Integrated with two significant clinical variables, age and LDH level, a clinical-radiological model was constructed for identification WDLPS and lipoma. All differentiation models were evaluated using the area under the receiver operating characteristics curve (AUC) and their 95% confidence interval (CI).

RESULTS

The multimodality model on deep learning features extracted from ResNet50 algorithm (RN-DL model) performed great differentiation performance with an AUC of 0.995 (95% CI 0.987-1.000) for the training cohort, and an AUC of 0.950 (95% CI 0.886-1.000), accuracy of 92.11%, sensitivity of 95.00% (95% CI 73.06-99.74%), specificity of 88.89% (95% CI 63.93-98.05%) in external validation. The integrated clinical-radiological model represented an AUC of 0.996 (95% CI 0.989-1.000) for the training cohort, and an AUC of 0.942 (95% CI 0.867-1.000), accuracy of 86.84%, sensitivity of 95.00% (95% CI 73.06-99.74%), and specificity of 77.78% (95% CI 51.92-92.63%) in external validation.

CONCLUSIONS

Imaging-based multimodality models represent effective discrimination abilities between WDLPS and lipoma via CAD methods, and might be a practicable approach in assistance of treatment decision.

Computed tomography-based deep-learning prediction of induction chemotherapy treatment response in locally advanced nasopharyngeal carcinoma

BACKGROUND

Deep learning methods have great potential to predict treatment response. The objective of this study was to evaluate and validate the predictive performance of the computed tomography (CT)-based model using deep learning features for identification of responders and nonresponders to induction chemotherapy (IC) in nasopharyngeal carcinoma (NPC).

MATERIALS AND METHODS

All eligible patients were included retrospectively between January 2012 and December 2018, and assigned to the training (n = 208) or the testing cohort (n = 89). We extracted deep learning features of six pretrained convolutional neural networks (CNNs) via transfer learning method, and handcrafted radiomics features manually. Support vector machine (SVM) was adopted as the classifier. All predictive models were evaluated using the area under the receiver operating characteristics curve (AUC), by which an optimal model was selected. We also built clinical and clinical-radiological models for comparison.

RESULTS

The model with features extracted from ResNet50 (RN-SVM) had optimal performance among all models with features extracted from pretrained CNNs with an AUC of 0.811, accuracy of 68.54%, sensitivity of 61.54%, specificity of 87.50%, positive predictive value (PPV) of 93.02%, and negative predictive value (NPV) of 45.65% in the testing cohort. The handcrafted radiomics model was slightly inferior to the RN-SVM model with an AUC of 0.663 and accuracy of 60.67% in the testing cohort. All the imaging-derived models had better predictive performance than the clinical model.

CONCLUSION

The noninvasive deep learning method could provide efficient prediction of treatment response to IC in locally advanced NPC and might be a practicable approach in therapeutic strategy decision-making.

Enhanced lung image segmentation using deep learning

With the advances in technology, assistive medical systems are emerging with rapid growth and helping healthcare professionals. The proactive diagnosis of diseases with artificial intelligence (AI) and its aligned technologies has been an exciting research area in the last decade. Doctors usually detect tuberculosis (TB) by checking the lungs' X-rays. Classification using deep learning algorithms is successfully able to achieve accuracy almost similar to a doctor in detecting TB. It is found that the probability of detecting TB increases if classification algorithms are implemented on segmented lungs instead of the whole X-ray. The paper's novelty lies in detailed analysis and discussion of U-Net +  + results and implementation of U-Net +  + in lung segmentation using X-ray. A thorough comparison of U-Net +  + with three other benchmark segmentation architectures and segmentation in diagnosing TB or other pulmonary lung diseases is also made in this paper. To the best of our knowledge, no prior research tried to implement U-Net +  + for lung segmentation. Most of the papers did not even use segmentation before classification, which causes data leakage. Very few used segmentations before classification, but they only used U-Net, which U-Net +  + can easily replace because accuracy and mean_iou of U-Net +  + are greater than U-Net accuracy and mean_iou , discussed in results, which can minimize data leakage. The authors achieved more than 98% lung segmentation accuracy and mean_iou 0.95 using U-Net +  + , and the efficacy of such comparative analysis is validated.

Remote Sensing Scene Type Classification using Multi Trial Vector based Differential Evolution Algorithm and Multi Support Vector Machine Classifier

In recent decades, remote sensing scene type classification becomes a challenging task in remote sensing applications. In this paper, a new model is proposed for multi-class scene type classification in remote sensing images. Firstly, the aerial images are collected from the Aerial Image Dataset (AID), University of California Merced (UC Merced) and REmote Sensing Image Scene Classification 45 (RESISC45) datasets. Next, AlexNet, GoogLeNet, ResNet 18, and Visual Geometric Group (VGG) 19 models are used for extracting feature vectors from the collected aerial images. After feature extraction, the Multi-Trial vector based Differential Evolution (MTDE) algorithm is proposed to choose active feature vectors for better classification and to reduce system complexity and time consumption. The selected active features are fed to the Multi Support Vector Machine (MSVM) for final scene type classification. The simulation results showed that the proposed MTDE-MSVM model obtained high classification accuracy of 99.41%, 99.59% and 99.74% on RESISC45, AID and UC Merced datasets.

Ensemble of EfficientNets for the Diagnosis of Tuberculosis

Tuberculosis (TB) remains a life-threatening disease and is one of the leading causes of mortality in developing regions due to poverty and inadequate medical resources. Tuberculosis is medicable, but it necessitates early diagnosis through reliable screening techniques. Chest X-ray is a recommended screening procedure for identifying pulmonary abnormalities. Still, this recommendation is not enough without experienced radiologists to interpret the screening results, which forms part of the problems in rural communities. Consequently, various computer-aided diagnostic systems have been developed for the automatic detection of tuberculosis. However, their sensitivity and accuracy are still significant challenges that require constant improvement due to the severity of the disease. Hence, this study explores the application of a leading state-of-the-art convolutional neural network (EfficientNets) model for the classification of tuberculosis. Precisely, five variants of EfficientNets were fine-tuned and implemented on two prominent and publicly available chest X-ray datasets (Montgomery and Shenzhen). The experiments performed show that EfficientNet-B4 achieved the best accuracy of 92.33% and 94.35% on both datasets. These results were then improved through Ensemble learning and reached 97.44%. The performance recorded in this study portrays the efficiency of fine-tuning EfficientNets on medical imaging classification through Ensemble.

A computer-aided diagnosis system for the classification of COVID-19 and non-COVID-19 pneumonia on chest X-ray images by integrating CNN with sparse autoencoder and feed forward neural network

Several infectious diseases have affected the lives of many people and have caused great dilemmas all over the world. COVID-19 was declared a pandemic caused by a newly discovered virus named Severe Acute Respiratory Syndrome Coronavirus 2 (SARS-CoV-2) by the World Health Organisation in 2019. RT-PCR is considered the golden standard for COVID-19 detection. Due to the limited RT-PCR resources, early diagnosis of the disease has become a challenge. Radiographic images such as Ultrasound, CT scans, X-rays can be used for the detection of the deathly disease. Developing deep learning models using radiographic images for detecting COVID-19 can assist in countering the outbreak of the virus. This paper presents a computer-aided detection model utilizing chest X-ray images for combating the pandemic. Several pre-trained networks and their combinations have been used for developing the model. The method uses features extracted from pre-trained networks along with Sparse autoencoder for dimensionality reduction and a Feed Forward Neural Network (FFNN) for the detection of COVID-19. Two publicly available chest X-ray image datasets, consisting of 504 COVID-19 images and 542 non-COVID-19 images, have been combined to train the model. The method was able to achieve an accuracy of 0.9578 and an AUC of 0.9821, using the combination of InceptionResnetV2 and Xception. Experiments have proved that the accuracy of the model improves with the usage of sparse autoencoder as the dimensionality reduction technique.