Explainable Artificial Intelligence for COVID-19 Diagnosis Through Blood Test Variables

Intelligent diagnosis of Kawasaki disease from real-world data using interpretable machine learning models

OBJECTIVE

This study aimed to leverage real-world electronic medical record data to develop interpretable machine learning models for diagnosis of Kawasaki disease while also exploring and prioritizing the significant risk factors.

METHODS

A comprehensive study was conducted on 4087 pediatric patients at the Children's Hospital of Chongqing, China. The study collected demographic data, physical examination results, and laboratory findings. Statistical analyses were performed using IBM SPSS Statistics, Version 26.0. The optimal feature subset was used to develop intelligent diagnostic prediction models based on the Light Gradient Boosting Machine, Explainable Boosting Machine (EBM), Gradient Boosting Classifier (GBC), Fast Interpretable Greedy-Tree Sums, Decision Tree, AdaBoost Classifier, and Logistic Regression. Model performance was evaluated in three dimensions: discriminative ability via receiver operating characteristic curves, calibration accuracy using calibration curves, and interpretability through SHAP (SHapley Additive exPlanations) and LIME (Local Interpretable Model-Agnostic Explanations).

RESULTS

In this study, Kawasaki disease was diagnosed in 2971 participants. Analysis was conducted on 31 indicators, including red blood cell distribution width and erythrocyte sedimentation rate. The EBM model demonstrated superior performance relative to other models, with an area under the curve of 0.97, second only to the GBC model. Furthermore, the EBM model exhibited the highest calibration accuracy and maintained its interpretability without relying on external analytical tools such as SHAP and LIME, thus reducing interpretation biases. Platelet distribution width, total protein, and erythrocyte sedimentation rate were identified by the model as significant predictors for the diagnosis of Kawasaki disease.

CONCLUSION

This study used diverse machine learning models for early diagnosis of Kawasaki disease. The findings demonstrated that interpretable models such as EBM outperformed traditional machine learning models in terms of both interpretability and performance. Ensuring consistency between predictive models and clinical evidence is crucial for the successful integration of artificial intelligence into real-world clinical practice.

Trusting AI made decisions in healthcare by making them explainable

OBJECTIVES

In solving the trust issues surrounding machine learning algorithms whose reasoning cannot be understood, advancements can be made toward the integration of machine learning algorithms into mHealth applications. The aim of this paper is to provide a transparency layer to black-box machine learning algorithms and empower mHealth applications to maximize their efficiency.

METHODS

Using a machine learning testing framework, we present the process of knowledge transfer between a white-box model and a black-box model and the evaluation process to validate the success of the knowledge transfer.

RESULTS

The presentation layer of the final output of the base white-box model and the knowledge-infused white-box model shows clear differences in reasoning. The correlation between the base black-box model and the new knowledge-infused model is very high, indicating that the knowledge transfer was successful.

CONCLUSION

There is a clear need for transparency in digital health and health in general. Adding solutions to the toolbox of explainable artificial intelligence is one way to gradually decrease the obscurity of black-box models.

Towards Improved XAI-Based Epidemiological Research into the Next Potential Pandemic

By applying AI techniques to a variety of pandemic-relevant data, artificial intelligence (AI) has substantially supported the control of the spread of the SARS-CoV-2 virus. Along with this, epidemiological machine learning studies of SARS-CoV-2 have been frequently published. While these models can be perceived as precise and policy-relevant to guide governments towards optimal containment policies, their black box nature can hamper building trust and relying confidently on the prescriptions proposed. This paper focuses on interpretable AI-based epidemiological models in the context of the recent SARS-CoV-2 pandemic. We systematically review existing studies, which jointly incorporate AI, SARS-CoV-2 epidemiology, and explainable AI approaches (XAI). First, we propose a conceptual framework by synthesizing the main methodological features of the existing AI pipelines of SARS-CoV-2. Upon the proposed conceptual framework and by analyzing the selected epidemiological studies, we reflect on current research gaps in epidemiological AI toolboxes and how to fill these gaps to generate enhanced policy support in the next potential pandemic.

Application of boosted trees to the prognosis prediction of COVID-19

Background and Aims

The precise prediction of COVID-19 prognosis remains a clinical challenge. In this regard, early identification of severe cases facilitates the triage and management of COVID-19 cases. The present paper aims to explore the prognosis of COVID-19 patients based on routine laboratory tests taken when patients are admitted.

Methods

A data set including 1455 COVID-19 patients (727 male, 728 female) and their routine laboratory tests conducted upon hospital admission, age, Intensive Care Unit (ICU) admission, and outcome were gathered. The data set was randomly split into the train (75% of the data) and test data set (25% of the data). The explainable boosting machine (EBM) and extreme gradient boosting (XGBoost) were used for predicting the mortality and ICU admission of COVID-19 cases. Also, feature importance was extracted using EBM and XGBoost.

Results

The EBM and XGBoost achieved 86.38% and 88.56% accuracy in the test data set, respectively. In addition, EBM and XGBoost predicted the ICU admission with an accuracy of 89.37%, and 79.29% in the test data set for COVID-19 patients, respectively. Also, obtained models indicated that aspartate transaminase (AST), lymphocyte, blood urea nitrogen (BUN), and age are the most significant predictors of COVID-19 mortality. Furthermore, the lymphocyte count, AST, and BUN level were the most significant ICU admission predictors of COVID-19 patients.

Conclusions

The current study indicated that both EBM and XGBoost could predict the ICU admission and mortality of COVID-19 cases based on routine hematological and clinical chemistry evaluation at the time of admission. Also, based on the results, AST, lymphocyte count, and BUN levels could be used as early predictors of COVID-19 prognosis.

Reconstructing the cytokine view for the multi-view prediction of COVID-19 mortality

BACKGROUND

Coronavirus disease 2019 (COVID-19) is a rapidly developing and sometimes lethal pulmonary disease. Accurately predicting COVID-19 mortality will facilitate optimal patient treatment and medical resource deployment, but the clinical practice still needs to address it. Both complete blood counts and cytokine levels were observed to be modified by COVID-19 infection. This study aimed to use inexpensive and easily accessible complete blood counts to build an accurate COVID-19 mortality prediction model. The cytokine fluctuations reflect the inflammatory storm induced by COVID-19, but their levels are not as commonly accessible as complete blood counts. Therefore, this study explored the possibility of predicting cytokine levels based on complete blood counts.

METHODS

We used complete blood counts to predict cytokine levels. The predictive model includes an autoencoder, principal component analysis, and linear regression models. We used classifiers such as support vector machine and feature selection models such as adaptive boost to predict the mortality of COVID-19 patients.

RESULTS

Complete blood counts and original cytokine levels reached the COVID-19 mortality classification area under the curve (AUC) values of 0.9678 and 0.9111, respectively, and the cytokine levels predicted by the feature set alone reached the classification AUC value of 0.9844. The predicted cytokine levels were more significantly associated with COVID-19 mortality than the original values.

CONCLUSIONS

Integrating the predicted cytokine levels and complete blood counts improved a COVID-19 mortality prediction model using complete blood counts only. Both the cytokine level prediction models and the COVID-19 mortality prediction models are publicly available at http://www.healthinformaticslab.org/supp/resources.php .

Rapid Triage of Children with Suspected COVID-19 Using Laboratory-Based Machine-Learning Algorithms

In order to limit the spread of the novel betacoronavirus (SARS-CoV-2), it is necessary to detect positive cases as soon as possible and isolate them. For this purpose, machine-learning algorithms, as a field of artificial intelligence, have been recognized as a promising tool. The aim of this study was to assess the utility of the most common machine-learning algorithms in the rapid triage of children with suspected COVID-19 using easily accessible and inexpensive laboratory parameters. A cross-sectional study was conducted on 566 children treated for respiratory diseases: 280 children with PCR-confirmed SARS-CoV-2 infection and 286 children with respiratory symptoms who were SARS-CoV-2 PCR-negative (control group). Six machine-learning algorithms, based on the blood laboratory data, were tested: random forest, support vector machine, linear discriminant analysis, artificial neural network, k-nearest neighbors, and decision tree. The training set was validated through stratified cross-validation, while the performance of each algorithm was confirmed by an independent test set. Random forest and support vector machine models demonstrated the highest accuracy of 85% and 82.1%, respectively. The models demonstrated better sensitivity than specificity and better negative predictive value than positive predictive value. The F1 score was higher for the random forest than for the support vector machine model, 85.2% and 82.3%, respectively. This study might have significant clinical applications, helping healthcare providers identify children with COVID-19 in the early stage, prior to PCR and/or antigen testing. Additionally, machine-learning algorithms could improve overall testing efficiency with no extra costs for the healthcare facility.

A Decision Support System for Diagnosis of COVID-19 from Non-COVID-19 Influenza-like Illness Using Explainable Artificial Intelligence

The coronavirus pandemic emerged in early 2020 and turned out to be deadly, killing a vast number of people all around the world. Fortunately, vaccines have been discovered, and they seem effectual in controlling the severe prognosis induced by the virus. The reverse transcription-polymerase chain reaction (RT-PCR) test is the current golden standard for diagnosing different infectious diseases, including COVID-19; however, it is not always accurate. Therefore, it is extremely crucial to find an alternative diagnosis method which can support the results of the standard RT-PCR test. Hence, a decision support system has been proposed in this study that uses machine learning and deep learning techniques to predict the COVID-19 diagnosis of a patient using clinical, demographic and blood markers. The patient data used in this research were collected from two Manipal hospitals in India and a custom-made, stacked, multi-level ensemble classifier has been used to predict the COVID-19 diagnosis. Deep learning techniques such as deep neural networks (DNN) and one-dimensional convolutional networks (1D-CNN) have also been utilized. Further, explainable artificial techniques (XAI) such as Shapley additive values (SHAP), ELI5, local interpretable model explainer (LIME), and QLattice have been used to make the models more precise and understandable. Among all of the algorithms, the multi-level stacked model obtained an excellent accuracy of 96%. The precision, recall, f1-score and AUC obtained were 94%, 95%, 94% and 98% respectively. The models can be used as a decision support system for the initial screening of coronavirus patients and can also help ease the existing burden on medical infrastructure.

Explainable AI for clinical and remote health applications: a survey on tabular and time series data

Nowadays Artificial Intelligence (AI) has become a fundamental component of healthcare applications, both clinical and remote, but the best performing AI systems are often too complex to be self-explaining. Explainable AI (XAI) techniques are defined to unveil the reasoning behind the system’s predictions and decisions, and they become even more critical when dealing with sensitive and personal health data. It is worth noting that XAI has not gathered the same attention across different research areas and data types, especially in healthcare. In particular, many clinical and remote health applications are based on tabular and time series data, respectively, and XAI is not commonly analysed on these data types, while computer vision and Natural Language Processing (NLP) are the reference applications. To provide an overview of XAI methods that are most suitable for tabular and time series data in the healthcare domain, this paper provides a review of the literature in the last 5 years, illustrating the type of generated explanations and the efforts provided to evaluate their relevance and quality. Specifically, we identify clinical validation, consistency assessment, objective and standardised quality evaluation, and human-centered quality assessment as key features to ensure effective explanations for the end users. Finally, we highlight the main research challenges in the field as well as the limitations of existing XAI methods.

Predictive models for COVID-19 detection using routine blood tests and machine learning

The problem of accurate, fast, and inexpensive COVID-19 tests has been urgent till now. Standard COVID-19 tests need high-cost reagents and specialized laboratories with high safety requirements, are time-consuming. Data of routine blood tests as a base of SARS-CoV-2 invasion detection allows using the most practical medicine facilities. But blood tests give general information about a patient's state, which is not directly associated with COVID-19. COVID-19-specific features should be selected from the list of standard blood characteristics, and decision-making software based on appropriate clinical data should be created. This review describes the abilities to develop predictive models for COVID-19 detection using routine blood tests and machine learning.