1
|
Sikora A, Keats K, Murphy DJ, Devlin JW, Smith SE, Murray B, Buckley MS, Rowe S, Coppiano L, Kamaleswaran R. A common data model for the standardization of intensive care unit medication features. JAMIA Open 2024; 7:ooae033. [PMID: 38699649 PMCID: PMC11064096 DOI: 10.1093/jamiaopen/ooae033] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2023] [Revised: 02/12/2024] [Accepted: 04/09/2024] [Indexed: 05/05/2024] Open
Abstract
Objective Common data models provide a standard means of describing data for artificial intelligence (AI) applications, but this process has never been undertaken for medications used in the intensive care unit (ICU). We sought to develop a common data model (CDM) for ICU medications to standardize the medication features needed to support future ICU AI efforts. Materials and Methods A 9-member, multi-professional team of ICU clinicians and AI experts conducted a 5-round modified Delphi process employing conference calls, web-based communication, and electronic surveys to define the most important medication features for AI efforts. Candidate ICU medication features were generated through group discussion and then independently scored by each team member based on relevance to ICU clinical decision-making and feasibility for collection and coding. A key consideration was to ensure the final ontology both distinguished unique medications and met Findable, Accessible, Interoperable, and Reusable (FAIR) guiding principles. Results Using a list of 889 ICU medications, the team initially generated 106 different medication features, and 71 were ranked as being core features for the CDM. Through this process, 106 medication features were assigned to 2 key feature domains: drug product-related (n = 43) and clinical practice-related (n = 63). Each feature included a standardized definition and suggested response values housed in the electronic data library. This CDM for ICU medications is available online. Conclusion The CDM for ICU medications represents an important first step for the research community focused on exploring how AI can improve patient outcomes and will require ongoing engagement and refinement.
Collapse
Affiliation(s)
- Andrea Sikora
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Augusta, GA 30912, United States
| | - Kelli Keats
- Department of Pharmacy, Augusta University Medical Center, Augusta, GA 30912, United States
| | - David J Murphy
- Division of Pulmonary, Allergy, Critical Care and Sleep Medicine, Emory University, Atlanta, GA 30322, United States
| | - John W Devlin
- Northeastern University School of Pharmacy, Boston, MA 02115, United States
- Division of Pulmonary and Critical Care Medicine, Brigham and Women’s Hospital, Boston, MA 02115, United States
| | - Susan E Smith
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Athens, GA 30601, United States
| | - Brian Murray
- Department of Pharmacy, University of North Carolina Medical Center, Chapel Hill, NC 27514, United States
| | - Mitchell S Buckley
- Department of Pharmacy, Banner University Medical Center Phoenix, Phoenix, AZ 85032, United States
| | - Sandra Rowe
- Department of Pharmacy, Oregon Health and Science University, Portland, OR 97239, United States
| | - Lindsey Coppiano
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30322, United States
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30322, United States
| | - Rishikesan Kamaleswaran
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30322, United States
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA 30322, United States
| |
Collapse
|
2
|
Lin S, Yang M, Liu C, Wang Z, Long X. A pretrain-finetune approach for improving model generalizability in outcome prediction of acute respiratory distress syndrome patients. Int J Med Inform 2024; 186:105397. [PMID: 38507979 DOI: 10.1016/j.ijmedinf.2024.105397] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Revised: 12/20/2023] [Accepted: 02/25/2024] [Indexed: 03/22/2024]
Abstract
BACKGROUND Early prediction of acute respiratory distress syndrome (ARDS) of critically ill patients in intensive care units (ICUs) has been intensively studied in the past years. Yet a prediction model trained on data from one hospital might not be well generalized to other hospitals. It is therefore essential to develop an accurate and generalizable ARDS prediction model adaptive to different hospital or medical centers. METHODS We analyzed electronic medical records of 200,859 and 50,920 hospitalized patients within 24 h after being diagnosed with ARDS from the Philips eICU Institute (eICU-CRD) and the Medical Information Mart for Intensive Care (MIMIC-IV) dataset, respectively. Patients were sorted into three groups, including rapid death, long stay, and recovery, based on their condition or outcome between 24 and 72 h after ARDS diagnosis. To improve prediction performance and generalizability, a "pretrain-finetune" approach was applied, where we pretrained models on the eICU-CRD dataset and performed model finetuning using only a part (35%) of the MIMIC-IV dataset, and then tested the finetuned models on the remaining data from the MIMIC-IV dataset. Well-known machine-learning algorithms, including logistic regression, random forest, extreme gradient boosting, and multilayer perceptron neural networks, were employed to predict ARDS outcomes. Prediction performance was evaluated using the area under the receiver-operating characteristic curve (AUC). RESULTS Results show that, in general, multilayer perceptron neural networks outperformed the other models. The use of pretrain-finetune yielded improved performance in predicting ARDS outcomes achieving a micro-AUC of 0.870 for the MIMIC-IV dataset, an improvement of 0.046 over the pretrain model. CONCLUSIONS The proposed pretrain-finetune approach can effectively improve model generalizability from one to another dataset in ARDS prediction.
Collapse
Affiliation(s)
- Songlu Lin
- Instrument Science and Electrical Engineering, Jilin University, Changchun, China; Biomedical Diagnostics Lab, Department of Electrical Engineering, Eindhoven University of Technology, the Netherlands
| | - Meicheng Yang
- Biomedical Diagnostics Lab, Department of Electrical Engineering, Eindhoven University of Technology, the Netherlands; State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Chengyu Liu
- State Key Laboratory of Digital Medical Engineering, School of Instrument Science and Engineering, Southeast University, Nanjing, China
| | - Zhihong Wang
- Instrument Science and Electrical Engineering, Jilin University, Changchun, China
| | - Xi Long
- Biomedical Diagnostics Lab, Department of Electrical Engineering, Eindhoven University of Technology, the Netherlands
| |
Collapse
|
3
|
Yang P, Sjoding MW. Acute Respiratory Distress Syndrome: Definition, Diagnosis, and Routine Management. Crit Care Clin 2024; 40:309-327. [PMID: 38432698 DOI: 10.1016/j.ccc.2023.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2024]
Abstract
Acute respiratory distress syndrome (ARDS) is an acute inflammatory lung injury characterized by severe hypoxemic respiratory failure, bilateral opacities on chest imaging, and low lung compliance. ARDS is a heterogeneous syndrome that is the common end point of a wide variety of predisposing conditions, with complex pathophysiology and underlying mechanisms. Routine management of ARDS is centered on lung-protective ventilation strategies such as low tidal volume ventilation and targeting low airway pressures to avoid exacerbation of lung injury, as well as a conservative fluid management strategy.
Collapse
Affiliation(s)
- Philip Yang
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Emory University, 6335 Hospital Parkway, Physicians Plaza Suite 310, Johns Creek, GA 30097, USA.
| | - Michael W Sjoding
- Division of Pulmonary and Critical Care Medicine, University of Michigan, 2800 Plymouth Road, NCRC, Building 16, G027W, Ann Arbor, MI 48109, USA
| |
Collapse
|
4
|
Jiang Z, Liu L, Du L, Lv S, Liang F, Luo Y, Wang C, Shen Q. Machine learning for the early prediction of acute respiratory distress syndrome (ARDS) in patients with sepsis in the ICU based on clinical data. Heliyon 2024; 10:e28143. [PMID: 38533071 PMCID: PMC10963609 DOI: 10.1016/j.heliyon.2024.e28143] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2023] [Revised: 02/28/2024] [Accepted: 03/12/2024] [Indexed: 03/28/2024] Open
Abstract
Background Acute respiratory distress syndrome (ARDS) is a fatal outcome of severe sepsis. Machine learning models are helpful for accurately predicting ARDS in patients with sepsis at an early stage. Objective We aim to develop a machine-learning model for predicting ARDS in patients with sepsis in the intensive care unit (ICU). Methods The initial clinical data of patients with sepsis admitted to the hospital (including population characteristics, clinical diagnosis, complications, and laboratory tests) were used to predict ARDS, and screen out the crucial variables. After comparing eight different algorithms, namely, XG boost, logistic regression, light GBM, random forest, GaussianNB, complement NB, support vector machine (SVM), and K nearest neighbors (KNN), rebuilding a prediction model with the best one. When remodeling with the best algorithm, 10% was randomly selected to test, and the remaining was trained for cross-validation. Using the area under the curve (AUC), sensitivity, accuracy, specificity, positive and negative predictive value, F1 score, kappa value, and clinical decision curve to evaluate the model's performance. Eventually, the application in the model illustrated by the SHAP package. Results Ten critical features were screened utilizing the lasso method, namely, PaO2/PAO2, A-aDO2, PO2(T), CRP, gender, PO2, RDW, MCH, SG, and chlorine. The prior ranking of variables demonstrated that PaO2/PAO2 was the most significant variable. Among the eight algorithms, the performance of the Gaussian NB algorithm was significantly better than that of the others. After remodeling with the best algorithm, the AUC in the training and validation sets were 0.777 and 0.770, respectively, and the algorithm performed well in the test set (AUC = 0.781, accuracy = 78.6%, sensitivity = 82.4%, F1 score = 0.824). A comparison of the overlap factors with those of previous models revealed that the model we developed performs better. Conclusion Sepsis-associated ARDS can be accurately predicted early via a machine learning model based on existing clinical data. These findings are helpful for accurate identification and improvement of the prognosis in patients with sepsis-associated ARDS.
Collapse
Affiliation(s)
- Zhenzhen Jiang
- Department of Blood Transfusion, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Leping Liu
- Department of Pediatrics, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Lin Du
- Department of Blood Transfusion, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Shanshan Lv
- Department of Blood Transfusion, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Fang Liang
- Department of Hematology and Critical Care Medicine, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Yanwei Luo
- Department of Blood Transfusion, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Chunjiang Wang
- Department of Pharmacy, The Third Xiangya Hospital, Central South University, Changsha, China
| | - Qin Shen
- Department of Radiology, The Second Xiangya Hospital, Central South University, Changsha, China
| |
Collapse
|
5
|
Arora M, Davis CM, Mondal A, Gowda NR, Foster DG, Kamaleswaran R. Optimizing the Synergistic Potential of Pseudo-Labels from Radiology Notes and Annotated Ground Truth in Identifying Pulmonary Opacities on Chest Radiographs for Early Detection of Acute Respiratory Distress Syndrome. AMIA Annu Symp Proc 2024; 2023:270-279. [PMID: 38222424 PMCID: PMC10785907] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Subscribe] [Scholar Register] [Indexed: 01/16/2024]
Abstract
Acute Respiratory Distress Syndrome (ARDS) is a life-threatening lung injury, hallmarks of which are bilateral radiographic opacities. Studies have shown that early recognition of ARDS could reduce severity and lethal clinical sequela. A Convolutional Neural Network (CNN) model that can identify bilateral pulmonary opacities on chest x-ray (CXR) images can aid early ARDS recognition. Obtaining large datasets with ground truth labels to train CNNs is challenging, as medical image annotation requires clinical expertise and meticulous consideration. In this work, we implement a natural language processing pipeline that extracts pseudo-labels CXR images by parsing radiology notes for abnormal findings. We obtain ground-truth annotations from clinicians for the presence of pulmonary opacities for a subset of these images. A knowledge distillation-based teacher-student training framework is implemented to leverage the larger dataset with noisy pseudo-labels. Our results show an AUC of 0.93 (95%CI 0.92-0.94) for the prediction of bilateral opacities on chest radiographs.
Collapse
Affiliation(s)
- Mehak Arora
- Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA
| | - Carolyn M Davis
- Department of Surgery, Emory University School of Medicine, Atlanta, GA
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA
| | - Angana Mondal
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA
| | - Niraj R Gowda
- Division of Pulmonary, Critical Care, Allergy and Sleep Medicine, Emory University School of Medicine, Atlanta, GA
| | | | - Rishikesan Kamaleswaran
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA
| |
Collapse
|
6
|
Wei T, Peng S, Li X, Li J, Gu M, Li X. Critical evaluation of established risk prediction models for acute respiratory distress syndrome in adult patients: A systematic review and meta-analysis. J Evid Based Med 2023; 16:465-476. [PMID: 38058055 DOI: 10.1111/jebm.12565] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Accepted: 11/22/2023] [Indexed: 12/08/2023]
Abstract
AIM To assess the performance of validated prediction models for acute respiratory distress syndrome (ARDS) by systematic review and meta-analysis. METHODS Eight databases (Medline, CINAHL, Embase, The Cochrane Library, CNKI, WanFang Data, Sinomed, and VIP) were searched up to March 26, 2023. Studies developed and validated a prediction model for ARDS in adult patients were included. Items on study design, incidence, derivation methods, predictors, discrimination, and calibration were collected. The risk of bias was assessed by the Prediction model Risk of Bias Assessment Tool. Models with a reported area under the curve of the receiver operating characteristic (AUC) metric were analyzed. RESULTS A total of 25 studies were retrieved, including 48 unique prediction models. Discrimination was reported in all studies, with AUC ranging from 0.701 to 0.95. Emerged AUC value of the logistic regression model was 0.837 (95% CI: 0.814 to 0.859). Besides, the value in the ICU group was 0.856 (95% CI: 0.812 to 0.899), the acute pancreatitis group was 0.863 (95% CI: 0.844 to 0.882), and the postoperation group was 0.835 (95% CI: 0.808 to 0.861). In total, 24 of the included studies had a high risk of bias, which was mostly due to the improper methods in predictor screening (13/24), model calibration assessment (9/24), and dichotomization of continuous predictors (6/24). CONCLUSIONS This study shows that most prediction models for ARDS are at high risk of bias, and the discrimination ability of the model is excellent. Adherence to standardized guidelines for model development is necessary to derive a prediction model of value to clinicians.
Collapse
Affiliation(s)
- Tao Wei
- Anesthesiology Department, Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| | - Siyi Peng
- The Early Clinical Trial Center in The Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| | - Xuying Li
- Department of Nursing, Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| | - Jinhua Li
- Department of Nursing, Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| | - Mengdan Gu
- Anesthesiology Department, Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| | - Xiaoling Li
- Anesthesiology Department, Affiliated Cancer Hospital of Xiangya School of Medicine, Central South University/Hunan Cancer Hospital, Changsha, China
| |
Collapse
|
7
|
Sikora A, Jeong H, Yu M, Chen X, Murray B, Kamaleswaran R. Cluster analysis driven by unsupervised latent feature learning of medications to identify novel pharmacophenotypes of critically ill patients. Sci Rep 2023; 13:15562. [PMID: 37730817 PMCID: PMC10511715 DOI: 10.1038/s41598-023-42657-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2022] [Accepted: 09/13/2023] [Indexed: 09/22/2023] Open
Abstract
Unsupervised clustering of intensive care unit (ICU) medications may identify unique medication clusters (i.e., pharmacophenotypes) in critically ill adults. We performed an unsupervised analysis with Restricted Boltzmann Machine of 991 medications profiles of patients managed in the ICU to explore pharmacophenotypes that correlated with ICU complications (e.g., mechanical ventilation) and patient-centered outcomes (e.g., length of stay, mortality). Six unique pharmacophenotypes were observed, with unique medication profiles and clinically relevant differences in ICU complications and patient-centered outcomes. While pharmacophenotypes 2 and 4 had no statistically significant difference in ICU length of stay, duration of mechanical ventilation, or duration of vasopressor use, their mortality differed significantly (9.0% vs. 21.9%, p < 0.0001). Pharmacophenotype 4 had a mortality rate of 21.9%, compared with the rest of the pharmacophenotypes ranging from 2.5 to 9%. Phenotyping approaches have shown promise in classifying the heterogenous syndromes of critical illness to predict treatment response and guide clinical decision support systems but have never included comprehensive medication information. This first-ever machine learning approach revealed differences among empirically-derived subgroups of ICU patients that are not typically revealed by traditional classifiers. Identification of pharmacophenotypes may enable enhanced decision making to optimize treatment decisions.
Collapse
Affiliation(s)
- Andrea Sikora
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Augusta, GA, USA.
| | | | - Mengyun Yu
- Department of Statistics, University of Georgia Franklin College of Arts and Sciences, Athens, USA
| | - Xianyan Chen
- Department of Statistics, University of Georgia Franklin College of Arts and Sciences, Athens, USA
| | - Brian Murray
- Department of Pharmacy, University of North Carolina Medical Center, Chapel Hill, NC, USA
| | - Rishikesan Kamaleswaran
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA, USA
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA, USA
| |
Collapse
|
8
|
Lentzen M, Linden T, Veeranki S, Madan S, Kramer D, Leodolter W, Frohlich H. A Transformer-Based Model Trained on Large Scale Claims Data for Prediction of Severe COVID-19 Disease Progression. IEEE J Biomed Health Inform 2023; 27:4548-4558. [PMID: 37347632 DOI: 10.1109/jbhi.2023.3288768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/24/2023]
Abstract
In situations like the COVID-19 pandemic, healthcare systems are under enormous pressure as they can rapidly collapse under the burden of the crisis. Machine learning (ML) based risk models could lift the burden by identifying patients with a high risk of severe disease progression. Electronic Health Records (EHRs) provide crucial sources of information to develop these models because they rely on routinely collected healthcare data. However, EHR data is challenging for training ML models because it contains irregularly timestamped diagnosis, prescription, and procedure codes. For such data, transformer-based models are promising. We extended the previously published Med-BERT model by including age, sex, medications, quantitative clinical measures, and state information. After pre-training on approximately 988 million EHRs from 3.5 million patients, we developed models to predict Acute Respiratory Manifestations (ARM) risk using the medical history of 80,211 COVID-19 patients. Compared to Random Forests, XGBoost, and RETAIN, our transformer-based models more accurately forecast the risk of developing ARM after COVID-19 infection. We used Integrated Gradients and Bayesian networks to understand the link between the essential features of our model. Finally, we evaluated adapting our model to Austrian in-patient data. Our study highlights the promise of predictive transformer-based models for precision medicine.
Collapse
|
9
|
Arora M, Davis CM, Gowda NR, Foster DG, Mondal A, Coopersmith CM, Kamaleswaran R. Uncertainty-Aware Convolutional Neural Network for Identifying Bilateral Opacities on Chest X-rays: A Tool to Aid Diagnosis of Acute Respiratory Distress Syndrome. Bioengineering (Basel) 2023; 10:946. [PMID: 37627831 PMCID: PMC10451804 DOI: 10.3390/bioengineering10080946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/26/2023] [Accepted: 08/03/2023] [Indexed: 08/27/2023] Open
Abstract
Acute Respiratory Distress Syndrome (ARDS) is a severe lung injury with high mortality, primarily characterized by bilateral pulmonary opacities on chest radiographs and hypoxemia. In this work, we trained a convolutional neural network (CNN) model that can reliably identify bilateral opacities on routine chest X-ray images of critically ill patients. We propose this model as a tool to generate predictive alerts for possible ARDS cases, enabling early diagnosis. Our team created a unique dataset of 7800 single-view chest-X-ray images labeled for the presence of bilateral or unilateral pulmonary opacities, or 'equivocal' images, by three blinded clinicians. We used a novel training technique that enables the CNN to explicitly predict the 'equivocal' class using an uncertainty-aware label smoothing loss. We achieved an Area under the Receiver Operating Characteristic Curve (AUROC) of 0.82 (95% CI: 0.80, 0.85), a precision of 0.75 (95% CI: 0.73, 0.78), and a sensitivity of 0.76 (95% CI: 0.73, 0.78) on the internal test set while achieving an (AUROC) of 0.84 (95% CI: 0.81, 0.86), a precision of 0.73 (95% CI: 0.63, 0.69), and a sensitivity of 0.73 (95% CI: 0.70, 0.75) on an external validation set. Further, our results show that this approach improves the model calibration and diagnostic odds ratio of the hypothesized alert tool, making it ideal for clinical decision support systems.
Collapse
Affiliation(s)
- Mehak Arora
- Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30332, USA;
| | - Carolyn M. Davis
- Department of Surgery, Emory University School of Medicine, Atlanta, GA 30332, USA; (C.M.D.); (D.G.F.); (C.M.C.)
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA 30332, USA
| | - Niraj R. Gowda
- Division of Pulmonary, Critical Care, Allergy and Sleep Medicine, Emory University School of Medicine, Atlanta, GA 30332, USA;
| | - Dennis G. Foster
- Department of Surgery, Emory University School of Medicine, Atlanta, GA 30332, USA; (C.M.D.); (D.G.F.); (C.M.C.)
| | - Angana Mondal
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30332, USA;
| | - Craig M. Coopersmith
- Department of Surgery, Emory University School of Medicine, Atlanta, GA 30332, USA; (C.M.D.); (D.G.F.); (C.M.C.)
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA 30332, USA
| | - Rishikesan Kamaleswaran
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30332, USA;
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA 30332, USA
| |
Collapse
|
10
|
Sikora A, Rafiei A, Rad MG, Keats K, Smith SE, Devlin JW, Murphy DJ, Murray B, Kamaleswaran R. Pharmacophenotype identification of intensive care unit medications using unsupervised cluster analysis of the ICURx common data model. Crit Care 2023; 27:167. [PMID: 37131200 PMCID: PMC10155304 DOI: 10.1186/s13054-023-04437-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Accepted: 04/10/2023] [Indexed: 05/04/2023] Open
Abstract
BACKGROUND Identifying patterns within ICU medication regimens may help artificial intelligence algorithms to better predict patient outcomes; however, machine learning methods incorporating medications require further development, including standardized terminology. The Common Data Model for Intensive Care Unit (ICU) Medications (CDM-ICURx) may provide important infrastructure to clinicians and researchers to support artificial intelligence analysis of medication-related outcomes and healthcare costs. Using an unsupervised cluster analysis approach in combination with this common data model, the objective of this evaluation was to identify novel patterns of medication clusters (termed 'pharmacophenotypes') correlated with ICU adverse events (e.g., fluid overload) and patient-centered outcomes (e.g., mortality). METHODS This was a retrospective, observational cohort study of 991 critically ill adults. To identify pharmacophenotypes, unsupervised machine learning analysis with automated feature learning using restricted Boltzmann machine and hierarchical clustering was performed on the medication administration records of each patient during the first 24 h of their ICU stay. Hierarchical agglomerative clustering was applied to identify unique patient clusters. Distributions of medications across pharmacophenotypes were described, and differences among patient clusters were compared using signed rank tests and Fisher's exact tests, as appropriate. RESULTS A total of 30,550 medication orders for the 991 patients were analyzed; five unique patient clusters and six unique pharmacophenotypes were identified. For patient outcomes, compared to patients in Clusters 1 and 3, patients in Cluster 5 had a significantly shorter duration of mechanical ventilation and ICU length of stay (p < 0.05); for medications, Cluster 5 had a higher distribution of Pharmacophenotype 1 and a smaller distribution of Pharmacophenotype 2, compared to Clusters 1 and 3. For outcomes, patients in Cluster 2, despite having the highest severity of illness and greatest medication regimen complexity, had the lowest overall mortality; for medications, Cluster 2 also had a comparably higher distribution of Pharmacophenotype 6. CONCLUSION The results of this evaluation suggest that patterns among patient clusters and medication regimens may be observed using empiric methods of unsupervised machine learning in combination with a common data model. These results have potential because while phenotyping approaches have been used to classify heterogenous syndromes in critical illness to better define treatment response, the entire medication administration record has not been incorporated in those analyses. Applying knowledge of these patterns at the bedside requires further algorithm development and clinical application but may have the future potential to be leveraged in guiding medication-related decision making to improve treatment outcomes.
Collapse
Affiliation(s)
- Andrea Sikora
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Augusta, GA USA
| | - Alireza Rafiei
- Department of Computer Science and Informatics, Emory University, Atlanta, GA USA
| | - Milad Ghiasi Rad
- Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA USA
| | - Kelli Keats
- Department of Pharmacy, Augusta University Medical Center, Augusta, GA USA
| | - Susan E. Smith
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Augusta, GA USA
| | - John W. Devlin
- Northeastern University School of Pharmacy, Boston, MA USA
- Brigham and Women’s Hospital, Division of Pulmonary and Critical Care Medicine, Boston, MA USA
| | - David J. Murphy
- Division of Pulmonary, Allergy, Critical Care and Sleep Medicine, Emory University, Atlanta, GA USA
| | - Brian Murray
- Department of Pharmacy, University of North Carolina Medical Center, Chapel Hill, NC USA
| | - Rishikesan Kamaleswaran
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA USA
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA USA
| | - MRC-ICU Investigator Team
- Department of Clinical and Administrative Pharmacy, University of Georgia College of Pharmacy, Augusta, GA USA
- Department of Computer Science and Informatics, Emory University, Atlanta, GA USA
- Department of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA USA
- Department of Pharmacy, Augusta University Medical Center, Augusta, GA USA
- Northeastern University School of Pharmacy, Boston, MA USA
- Brigham and Women’s Hospital, Division of Pulmonary and Critical Care Medicine, Boston, MA USA
- Division of Pulmonary, Allergy, Critical Care and Sleep Medicine, Emory University, Atlanta, GA USA
- Department of Pharmacy, University of North Carolina Medical Center, Chapel Hill, NC USA
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA USA
- Department of Biomedical Engineering, Georgia Institute of Technology, Atlanta, GA USA
| |
Collapse
|
11
|
Baik SM, Kim KT, Lee H, Lee JH. Machine learning algorithm for early-stage prediction of severe morbidity in COVID-19 pneumonia patients based on bio-signals. BMC Pulm Med 2023; 23:121. [PMID: 37059983 PMCID: PMC10103026 DOI: 10.1186/s12890-023-02421-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2022] [Accepted: 04/03/2023] [Indexed: 04/16/2023] Open
Abstract
BACKGROUND Paralysis of medical systems has emerged as a major problem not only in Korea but also globally because of the COVID-19 pandemic. Therefore, early identification and treatment of COVID-19 are crucial. This study aims to develop a machine-learning algorithm based on bio-signals that predicts the infection three days in advance before it progresses from mild to severe, which may necessitate high-flow oxygen therapy or mechanical ventilation. METHODS The study included 2758 hospitalized patients with mild severity COVID-19 between July 2020 and October 2021. Bio-signals, clinical information, and laboratory findings were retrospectively collected from the electronic medical records of patients. Machine learning methods included random forest, random forest ranger, gradient boosting machine, and support vector machine (SVM). RESULTS SVM showed the best performance in terms of accuracy, kappa, sensitivity, detection rate, balanced accuracy, and run-time; the area under the receiver operating characteristic curve was also quite high at 0.96. Body temperature and SpO2 three and four days before discharge or exacerbation were ranked high among SVM features. CONCLUSIONS The proposed algorithm can predict the exacerbation of severity three days in advance in patients with mild COVID-19. This prediction can help effectively manage the reallocation of appropriate medical resources in clinical settings. Therefore, this algorithm can facilitate adequate oxygen therapy and mechanical ventilator preparation, thereby improving patient prognosis, increasing the efficiency of medical systems, and mitigating the damage caused by a global pandemic.
Collapse
Affiliation(s)
- Seung Min Baik
- Department of Critical Care Medicine, Ewha Womans University Mokdong Hospital, Ewha Womans University College of Medicine, Seoul, Republic of Korea
- Department of Surgery, Ewha Womans University Mokdong Hospital, Ewha Womans University College of Medicine, Seoul, Republic of Korea
- Department of Surgery, Korea University College of Medicine, Seoul, Republic of Korea
| | | | - Haneol Lee
- Department of Artificial Intelligence, Ulsan National Institute of Science and Technology, Ulsan, Republic of Korea
| | - Jung Hwa Lee
- Department of Critical Care Medicine, Ewha Womans University Mokdong Hospital, Ewha Womans University College of Medicine, Seoul, Republic of Korea.
- Department of Neurology, Ewha Womans University Mokdong Hospital, Ewha Womans University College of Medicine, Seoul, Republic of Korea.
| |
Collapse
|
12
|
Gadrey SM, Mohanty P, Haughey SP, Jacobsen BA, Dubester KJ, Webb KM, Kowalski RL, Dreicer JJ, Andris RT, Clark MT, Moore CC, Holder A, Kamaleswaran R, Ratcliffe SJ, Moorman JR. Overt and Occult Hypoxemia in Patients Hospitalized With COVID-19. Crit Care Explor 2023; 5:e0825. [PMID: 36699241 DOI: 10.1097/CCE.0000000000000825] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/22/2023] Open
Abstract
Progressive hypoxemia is the predominant mode of deterioration in COVID-19. Among hypoxemia measures, the ratio of the Pao2 to the Fio2 (P/F ratio) has optimal construct validity but poor availability because it requires arterial blood sampling. Pulse oximetry reports oxygenation continuously (ratio of the Spo2 to the Fio2 [S/F ratio]), but it is affected by skin color and occult hypoxemia can occur in Black patients. Oxygen dissociation curves allow noninvasive estimation of P/F ratios (ePFRs) but remain unproven. OBJECTIVES Measure overt and occult hypoxemia using ePFR. DESIGN SETTING AND PARTICIPANTS We retrospectively studied COVID-19 hospital encounters (n = 5,319) at two academic centers (University of Virginia [UVA] and Emory University). MAIN OUTCOMES AND MEASURES We measured primary outcomes (death or ICU transfer within 24 hr), ePFR, conventional hypoxemia measures, baseline predictors (age, sex, race, comorbidity), and acute predictors (National Early Warning Score [NEWS] and Sequential Organ Failure Assessment [SOFA]). We updated predictors every 15 minutes. We assessed predictive validity using adjusted odds ratios (AORs) and area under the receiver operating characteristic curves (AUROCs). We quantified disparities (Black vs non-Black) in empirical cumulative distributions using the Kolmogorov-Smirnov (K-S) two-sample test. RESULTS Overt hypoxemia (low ePFR) predicted bad outcomes (AOR for a 100-point ePFR drop: 2.7 [UVA]; 1.7 [Emory]; p < 0.01) with better discrimination (AUROC: 0.76 [UVA]; 0.71 [Emory]) than NEWS (0.70 [both sites]) or SOFA (0.68 [UVA]; 0.65 [Emory]) and similar to S/F ratio (0.76 [UVA]; 0.70 [Emory]). We found racial differences consistent with occult hypoxemia. Black patients had better apparent oxygenation (K-S distance: 0.17 [both sites]; p < 0.01) but, for comparable ePFRs, worse outcomes than other patients (AOR: 2.2 [UVA]; 1.2 [Emory]; p < 0.01). CONCLUSIONS AND RELEVANCE The ePFR was a valid measure of overt hypoxemia. In COVID-19, it may outperform multi-organ dysfunction models. By accounting for biased oximetry as well as clinicians' real-time responses to it (supplemental oxygen adjustment), ePFRs may reveal racial disparities attributable to occult hypoxemia.
Collapse
|
13
|
Tsai YT, Ku HC, Maithreepala SD, Tsai YJ, Chen LF, Ko NY, Konara Mudiyanselage SP. Higher Risk of Acute Respiratory Distress Syndrome and Risk Factors among Patients with COVID-19: A Systematic Review, Meta-Analysis and Meta-Regression. Int J Environ Res Public Health 2022; 19:15125. [PMID: 36429842 PMCID: PMC9690625 DOI: 10.3390/ijerph192215125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/07/2022] [Revised: 11/12/2022] [Accepted: 11/15/2022] [Indexed: 06/16/2023]
Abstract
OBJECTIVE To estimate the global risk and risk factors associated with acute respiratory distress syndrome (ARDS) among patients with COVID-19: Design: A systematic review, meta-analysis and meta-regression. SETTING AND PARTICIPANTS Hospitals or nursing homes and patients with acute respiratory distress syndrome after COVID-19. METHODS The literature review was systematically conducted on Embase, MEDLINE, CINAHL, and Web of Science, in addition to manual searches and reference list checking from 1 January 2019 to 2 March 2022. The search terms included coronavirus, acute respiratory syndrome, acute respiratory distress syndrome and observational studies. Three reviewers independently appraised the quality of the studies and extracted the relevant data using the Joanna Briggs Institute abstraction form and critical appraisal tools. A study protocol was registered in PROSPERO (CRD42022311957). Eligible studies were meta-analyzed and underwent meta-regression. RESULTS A total of 12 studies were included, with 148,080 participants. The risk ratio (RR) of ARDS was 23%. Risk factors were age ≥ 41-64 years old (RR = 15.3%, 95% CI =0.14-2.92, p = 0.03); fever (RR = 10.3%, 95% CI = 0.03-2.03, p = 0.04); multilobe involvement of the chest (RR = 33.5%, 95% CI = 0.35-6.36, p = 0.02); lymphopenia (RR = 25.9%, 95% CI = 1.11-4.08, p = 0.01); mechanical ventilation with oxygen therapy (RR = 31.7%, 95% CI = 1.10-5.25, p = 0.002); European region (RR = 16.3%, 95% CI = 0.09-3.17, p = 0.03); sample size ≤ 500 (RR = 18.0%, 95% CI = 0.70-2.89, p = 0.001). CONCLUSIONS AND IMPLICATIONS One in four patients experienced ARDS after having COVID-19. The age group 41-64 years old and the European region were high-risk groups. These findings can be used by policymakers to allocate resources for respiratory care facilities and can also provide scientific evidence in the design of protocols to manage COVID-19 worldwide.
Collapse
Affiliation(s)
- Yi-Tseng Tsai
- Department of Nursing, An-Nan Hospital, China Medical University, Tainan 709, Taiwan
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
| | - Han-Chang Ku
- Department of Nursing, An-Nan Hospital, China Medical University, Tainan 709, Taiwan
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
| | - Sujeewa Dilhani Maithreepala
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
- Department of Nursing, Faculty of Allied Health Sciences, University of Peradeniya, Peradeniya 20400, Sri Lanka
| | - Yi-Jing Tsai
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
| | - Li-Fan Chen
- Department of Nursing, An-Nan Hospital, China Medical University, Tainan 709, Taiwan
| | - Nai-Ying Ko
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
- Department of Nursing, National Cheng Kung University Hospital, College of Medicine, Tainan 704, Taiwan
| | - Sriyani Padmalatha Konara Mudiyanselage
- Department of Nursing, College of Medicine, National Cheng Kung University, 1 University Road, Tainan 70101, Taiwan
- Operation Theatre Department, The National Hospital of Sri Lanka, Colombo 00700, Sri Lanka
| |
Collapse
|
14
|
De Freitas VM, Chiloff DM, Bosso GG, Teixeira JOP, Hernandes ICDG, Padilha MDP, Moura GC, De Andrade LGM, Mancuso F, Finamor FE, Serodio AMDB, Arakaki JSO, Sartori MGF, Ferreira PRA, Rangel ÉB. A Machine Learning Model for Predicting Hospitalization in Patients with Respiratory Symptoms during the COVID-19 Pandemic. J Clin Med 2022; 11:jcm11154574. [PMID: 35956189 PMCID: PMC9369854 DOI: 10.3390/jcm11154574] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2022] [Revised: 07/30/2022] [Accepted: 08/01/2022] [Indexed: 12/28/2022] Open
Abstract
A machine learning approach is a useful tool for risk-stratifying patients with respiratory symptoms during the COVID-19 pandemic, as it is still evolving. We aimed to verify the predictive capacity of a gradient boosting decision trees (XGboost) algorithm to select the most important predictors including clinical and demographic parameters in patients who sought medical support due to respiratory signs and symptoms (RAPID RISK COVID-19). A total of 7336 patients were enrolled in the study, including 6596 patients that did not require hospitalization and 740 that required hospitalization. We identified that patients with respiratory signs and symptoms, in particular, lower oxyhemoglobin saturation by pulse oximetry (SpO2) and higher respiratory rate, fever, higher heart rate, and lower levels of blood pressure, associated with age, male sex, and the underlying conditions of diabetes mellitus and hypertension, required hospitalization more often. The predictive model yielded a ROC curve with an area under the curve (AUC) of 0.9181 (95% CI, 0.9001 to 0.9361). In conclusion, our model had a high discriminatory value which enabled the identification of a clinical and demographic profile predictive, preventive, and personalized of COVID-19 severity symptoms.
Collapse
Affiliation(s)
- Victor Muniz De Freitas
- Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Daniela Mendes Chiloff
- Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Giulia Gabriella Bosso
- Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | | | | | - Maira do Patrocínio Padilha
- Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Giovanna Corrêa Moura
- Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | | | - Frederico Mancuso
- Discipline of Emergency Medicine, Department of Medicine, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Francisco Estivallet Finamor
- Discipline of Emergency Medicine, Department of Medicine, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Aluísio Marçal de Barros Serodio
- Sector of Bioethics, Department of Surgery, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Jaquelina Sonoe Ota Arakaki
- Pneumology Division, Department of Medicine, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Marair Gracio Ferreira Sartori
- Department of Obstetrics, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Paulo Roberto Abrão Ferreira
- Infectious Disease Division, Department of Medicine, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
| | - Érika Bevilaqua Rangel
- Nephrology Division, Department of Medicine, Paulista School of Medicine, Hospital São Paulo, Federal University of São Paulo, São Paulo 04038-901, Brazil
- Correspondence:
| |
Collapse
|
15
|
Gadrey SM, Mohanty P, Haughey SP, Jacobsen BA, Dubester KJ, Webb KM, Kowalski RL, Dreicer JJ, Andris RT, Clark MT, Moore CC, Holder A, Kamaleswaran R, Ratcliffe SJ, Moorman JR. Overt and occult hypoxemia in patients hospitalized with novel coronavirus disease 2019. medRxiv 2022:2022.06.14.22276166. [PMID: 35734082 PMCID: PMC9216725 DOI: 10.1101/2022.06.14.22276166] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Background Progressive hypoxemia is the predominant mode of deterioration in COVID-19. Among hypoxemia measures, the ratio of the partial pressure of arterial oxygen to the fraction of inspired oxygen (P/F ratio) has optimal construct validity but poor availability because it requires arterial blood sampling. Pulse oximetry reports oxygenation continuously, but occult hypoxemia can occur in Black patients because the technique is affected by skin color. Oxygen dissociation curves allow non-invasive estimation of P/F ratios (ePFR) but this approach remains unproven. Research Question Can ePFRs measure overt and occult hypoxemia? Study Design and methods We retrospectively studied COVID-19 hospital encounters (n=5319) at two academic centers (University of Virginia [UVA] and Emory University). We measured primary outcomes (death or ICU transfer within 24 hours), ePFR, conventional hypoxemia measures, baseline predictors (age, sex, race, comorbidity), and acute predictors (National Early Warning Score (NEWS) and Sepsis-3). We updated predictors every 15 minutes. We assessed predictive validity using adjusted odds ratios (AOR) and area under receiver operating characteristics curves (AUROC). We quantified disparities (Black vs non-Black) in empirical cumulative distributions using the Kolmogorov-Smirnov (K-S) two-sample test. Results Overt hypoxemia (low ePFR) predicted bad outcomes (AOR for a 100-point ePFR drop: 2.7 [UVA]; 1.7 [Emory]; p<0.01) with better discrimination (AUROC: 0.76 [UVA]; 0.71 [Emory]) than NEWS (AUROC: 0.70 [UVA]; 0.70 [Emory]) or Sepsis-3 (AUROC: 0.68 [UVA]; 0.65 [Emory]). We found racial differences consistent with occult hypoxemia. Black patients had better apparent oxygenation (K-S distance: 0.17 [both sites]; p<0.01) but, for comparable ePFRs, worse outcomes than other patients (AOR: 2.2 [UVA]; 1.2 [Emory], p<0.01). Interpretation The ePFR was a valid measure of overt hypoxemia. In COVID-19, it may outperform multi-organ dysfunction models like NEWS and Sepsis-3. By accounting for biased oximetry as well as clinicians’ real-time responses to it (supplemental oxygen adjustment), ePFRs may enable statistical modelling of racial disparities in outcomes attributable to occult hypoxemia.
Collapse
Affiliation(s)
- Shrirang M Gadrey
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Piyus Mohanty
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Sean P Haughey
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Beck A Jacobsen
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Kira J Dubester
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Katherine M Webb
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Rebecca L Kowalski
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Jessica J Dreicer
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Robert T Andris
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Matthew T Clark
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Christopher C Moore
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Andre Holder
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Rishi Kamaleswaran
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - Sarah J Ratcliffe
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| | - J Randall Moorman
- University of Virginia School of Medicine, Charlottesville; and Emory University, Atlanta, USA
| |
Collapse
|
16
|
Baik S, Lee M, Hong K, Park D. Development of Machine-Learning Model to Predict COVID-19 Mortality: Application of Ensemble Model and Regarding Feature Impacts. Diagnostics (Basel) 2022; 12:1464. [PMID: 35741274 PMCID: PMC9221552 DOI: 10.3390/diagnostics12061464] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 06/13/2022] [Accepted: 06/13/2022] [Indexed: 11/16/2022] Open
Abstract
This study was designed to develop machine-learning models to predict COVID-19 mortality and identify its key features based on clinical characteristics and laboratory tests. For this, deep-learning (DL) and machine-learning (ML) models were developed using receiver operating characteristic (ROC) area under the curve (AUC) and F1 score optimization of 87 parameters. Of the two, the DL model exhibited better performance (AUC 0.8721, accuracy 0.84, and F1 score 0.76). However, we also blended DL with ML, and the ensemble model performed the best (AUC 0.8811, accuracy 0.85, and F1 score 0.77). The DL model is generally unable to extract feature importance; however, we succeeded by using the Shapley Additive exPlanations method for each model. This study demonstrated both the applicability of DL and ML models for classifying COVID-19 mortality using hospital-structured data and that the ensemble model had the best predictive ability.
Collapse
|
17
|
Hanley C, Giacomini C, Brennan A, McNicholas B, Laffey JG. Insights Regarding the Berlin Definition of ARDS from Prospective Observational Studies. Semin Respir Crit Care Med 2022; 43:379-389. [PMID: 35679873 DOI: 10.1055/s-0042-1744306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
The definition of acute respiratory distress syndrome (ARDS), has evolved since it was first described in 1967 by Ashbaugh and Petty to the current "Berlin" definition of ARDS developed in 2012 by an expert panel, that provided clarification on the definition of "acute," and on the cardiac failure criteria. It expanded the definition to include patients receiving non-invasive ventilation, and removed the term "acute lung injury" and added a requirement of patients to be receiving a minimum 5 cmH2O expiratory pressure.Since 2012, a series of observational cohort studies have generated insights into the utility and robustness of this definition. This review will examine novel insights into the epidemiology of ARDS, failures in ARDS diagnosis, the role of lung imaging in ARDS, the novel ARDS cohort that is not invasively ventilated, lung compliance profiles in patients with ARDS, sex differences that exist in ARDS management and outcomes, the progression of ARDS following initial diagnosis, and the clinical profile and outcomes of confirmed versus resolved ARDS. Furthermore, we will discuss studies that challenge the utility of distinguishing ARDS from other causes of acute hypoxemic respiratory failure (AHRF) and identify issues that may need to be addressed in a revised definition.
Collapse
Affiliation(s)
- Ciara Hanley
- Department of Anaesthesia and Intensive Care medicine, Galway University Hospitals, Saolta University Hospital Group, Galway, Ireland
| | - Camilla Giacomini
- Department of Anaesthesia and Intensive Care medicine, Galway University Hospitals, Saolta University Hospital Group, Galway, Ireland
| | - Aoife Brennan
- Department of Anaesthesia and Intensive Care medicine, Galway University Hospitals, Saolta University Hospital Group, Galway, Ireland.,School of Medicine, National University of Ireland, Galway, Ireland
| | - Bairbre McNicholas
- Department of Anaesthesia and Intensive Care medicine, Galway University Hospitals, Saolta University Hospital Group, Galway, Ireland.,School of Medicine, National University of Ireland, Galway, Ireland
| | - John G Laffey
- Department of Anaesthesia and Intensive Care medicine, Galway University Hospitals, Saolta University Hospital Group, Galway, Ireland.,School of Medicine, National University of Ireland, Galway, Ireland.,Regenerative Medicine Institute, National University of Ireland, Galway, Ireland
| |
Collapse
|
18
|
Arora M, Zambrzycki SC, Levy JM, Esper A, Frediani JK, Quave CL, Fernández FM, Kamaleswaran R. Machine Learning Approaches to Identify Discriminative Signatures of Volatile Organic Compounds (VOCs) from Bacteria and Fungi Using SPME-DART-MS. Metabolites 2022; 12:metabo12030232. [PMID: 35323675 PMCID: PMC8953436 DOI: 10.3390/metabo12030232] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2022] [Revised: 03/03/2022] [Accepted: 03/04/2022] [Indexed: 12/24/2022] Open
Abstract
Point-of-care screening tools are essential to expedite patient care and decrease reliance on slow diagnostic tools (e.g., microbial cultures) to identify pathogens and their associated antibiotic resistance. Analysis of volatile organic compounds (VOC) emitted from biological media has seen increased attention in recent years as a potential non-invasive diagnostic procedure. This work explores the use of solid phase micro-extraction (SPME) and ambient plasma ionization mass spectrometry (MS) to rapidly acquire VOC signatures of bacteria and fungi. The MS spectrum of each pathogen goes through a preprocessing and feature extraction pipeline. Various supervised and unsupervised machine learning (ML) classification algorithms are trained and evaluated on the extracted feature set. These are able to classify the type of pathogen as bacteria or fungi with high accuracy, while marked progress is also made in identifying specific strains of bacteria. This study presents a new approach for the identification of pathogens from VOC signatures collected using SPME and ambient ionization MS by training classifiers on just a few samples of data. This ambient plasma ionization and ML approach is robust, rapid, precise, and can potentially be used as a non-invasive clinical diagnostic tool for point-of-care applications.
Collapse
Affiliation(s)
- Mehak Arora
- School of Electrical and Computer Engineering, Georgia Institute of Technology, Atlanta, GA 30332, USA
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30332, USA;
- Correspondence: ; Tel.: +1-(470)-815-1555
| | - Stephen C. Zambrzycki
- School of Chemistry and Biochemistry, Georgia Institute of Technology, Atlanta, GA 30332, USA; (S.C.Z.); (F.M.F.)
| | - Joshua M. Levy
- Department of Otolaryngology—Head and Neck Surgery, Emory University School of Medicine, Atlanta, GA 30332, USA;
| | - Annette Esper
- Division of Pulmonary, Allergy, Critical Care, and Sleep Medicine, Emory University School of Medicine, Atlanta, GA 30332, USA;
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA 30332, USA
| | - Jennifer K. Frediani
- Nell Hodgson Woodruff School of Nursing, Emory University, Atlanta, GA 30332, USA;
| | - Cassandra L. Quave
- Department of Dermatology, Emory University School of Medicine, Atlanta, GA 30332, USA;
- Center for the Study of Human Health, Emory College of Arts and Sciences, Atlanta, GA 30332, USA
| | - Facundo M. Fernández
- School of Chemistry and Biochemistry, Georgia Institute of Technology, Atlanta, GA 30332, USA; (S.C.Z.); (F.M.F.)
| | - Rishikesan Kamaleswaran
- Department of Biomedical Informatics, Emory University School of Medicine, Atlanta, GA 30332, USA;
- Emory Critical Care Center, Emory University School of Medicine, Atlanta, GA 30332, USA
- Department of Emergency Medicine, Emory University School of Medicine, Atlanta, GA 30332, USA
| |
Collapse
|
19
|
Lam C, Thapa R, Maharjan J, Rahmani K, Tso CF, Singh NP, Casie Chetty S, Mao Q. Multi-Task Learning with Recurrent Neural Networks for ARDS Prediction using only EHR Data: Model Development and Validation Study (Preprint). JMIR Med Inform 2022; 10:e36202. [PMID: 35704370 PMCID: PMC9244659 DOI: 10.2196/36202] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/06/2022] [Revised: 04/07/2022] [Accepted: 05/02/2022] [Indexed: 11/24/2022] Open
Abstract
Background Acute respiratory distress syndrome (ARDS) is a condition that is often considered to have broad and subjective diagnostic criteria and is associated with significant mortality and morbidity. Early and accurate prediction of ARDS and related conditions such as hypoxemia and sepsis could allow timely administration of therapies, leading to improved patient outcomes. Objective The aim of this study is to perform an exploration of how multilabel classification in the clinical setting can take advantage of the underlying dependencies between ARDS and related conditions to improve early prediction of ARDS in patients. Methods The electronic health record data set included 40,703 patient encounters from 7 hospitals from April 20, 2018, to March 17, 2021. A recurrent neural network (RNN) was trained using data from 5 hospitals, and external validation was conducted on data from 2 hospitals. In addition to ARDS, 12 target labels for related conditions such as sepsis, hypoxemia, and COVID-19 were used to train the model to classify a total of 13 outputs. As a comparator, XGBoost models were developed for each of the 13 target labels. Model performance was assessed using the area under the receiver operating characteristic curve. Heat maps to visualize attention scores were generated to provide interpretability to the neural networks. Finally, cluster analysis was performed to identify potential phenotypic subgroups of patients with ARDS. Results The single RNN model trained to classify 13 outputs outperformed the individual XGBoost models for ARDS prediction, achieving an area under the receiver operating characteristic curve of 0.842 on the external test sets. Models trained on an increasing number of tasks resulted in improved performance. Earlier prediction of ARDS nearly doubled the rate of in-hospital survival. Cluster analysis revealed distinct ARDS subgroups, some of which had similar mortality rates but different clinical presentations. Conclusions The RNN model presented in this paper can be used as an early warning system to stratify patients who are at risk of developing one of the multiple risk outcomes, hence providing practitioners with the means to take early action.
Collapse
Affiliation(s)
- Carson Lam
- Dascena, Inc, Houston, TX, United States
| | | | | | | | | | | | | | | |
Collapse
|
20
|
Pai KC, Chao WC, Huang YL, Sheu RK, Chen LC, Wang MS, Lin SH, Yu YY, Wu CL, Chan MC. Artificial intelligence–aided diagnosis model for acute respiratory distress syndrome combining clinical data and chest radiographs. Digit Health 2022; 8:20552076221120317. [PMID: 35990108 PMCID: PMC9386858 DOI: 10.1177/20552076221120317] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2022] [Accepted: 07/29/2022] [Indexed: 11/28/2022] Open
Abstract
Objective The aim of this study was to develop an artificial intelligence–based model to detect the presence of acute respiratory distress syndrome (ARDS) using clinical data and chest X-ray (CXR) data. Method The transfer learning method was used to train a convolutional neural network (CNN) model with an external image dataset to extract the image features. Then, the last layer of the model was fine-tuned to determine the probability of ARDS. The clinical data were trained using three machine learning algorithms—eXtreme Gradient Boosting (XGB), random forest (RF), and logistic regression (LR)—to estimate the probability of ARDS. Finally, ensemble-weighted methods were proposed that combined the image model and the clinical data model to estimate the probability of ARDS. An analysis of the importance of clinical features was performed to explore the most important features in detecting ARDS. A gradient-weighted class activation mapping (Grad-CAM) model was used to explain what our CNN sees and understands when making a decision. Results The proposed ensemble-weighted methods improved the performances of the ARDS classifiers (XGB + CNN, area under the curve [AUC] = 0.916; RF + CNN, AUC = 0.920; LR + CNN, AUC = 0.920; XGB + RF + LR + CNN, AUC = 0.925). In addition, the ML model using clinical data to present the top 15 important features to identify the risk factors of ARDS. Conclusion This study developed combined machine learning models with clinical data and CXR images to detect ARDS. According to the results of the Shapley Additive exPlanations values and the Grad-CAM techniques, an explicable ARDS diagnosis model is suitable for a real-life scenario.
Collapse
Affiliation(s)
- Kai-Chih Pai
- College of Engineering, Tunghai University, Taichung, Taiwan
| | - Wen-Cheng Chao
- Department of Critical Care Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
- College of Medicine, National Chung Hsing University, Taichung, Taiwan
- Department of Automatic Control Engineering, Feng Chia University, Taichung, Taiwan
| | - Yu-Len Huang
- Department of Computer Science, Tunghai University, Taichung, Taiwan
| | - Ruey-Kai Sheu
- Department of Computer Science, Tunghai University, Taichung, Taiwan
| | - Lun-Chi Chen
- College of Engineering, Tunghai University, Taichung, Taiwan
| | - Min-Shian Wang
- Artificial Intelligence Studio, Taichung Veterans General Hospital, Taichung, Taiwan
| | - Shau-Hung Lin
- DDS-THU Artificial Intelligence Center, Tunghai University, Taichung, Taiwan
| | - Yu-Yi Yu
- Division of Critical Care and Respiratory Therapy, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
- Institute of Emergency and Critical Care Medicine, National Yang Ming Chiao Tung University, Taipei, Taiwan
| | - Chieh-Liang Wu
- Department of Critical Care Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
- College of Medicine, National Chung Hsing University, Taichung, Taiwan
- Department of Automatic Control Engineering, Feng Chia University, Taichung, Taiwan
| | - Ming-Cheng Chan
- College of Medicine, National Chung Hsing University, Taichung, Taiwan
- Division of Critical Care and Respiratory Therapy, Department of Internal Medicine, Taichung Veterans General Hospital, Taichung, Taiwan
| |
Collapse
|
21
|
Ghosheh GO, Alamad B, Yang KW, Syed F, Hayat N, Iqbal I, Al Kindi F, Al Junaibi S, Al Safi M, Ali R, Zaher W, Al Harbi M, Shamout FE. Clinical prediction system of complications among patients with COVID-19: A development and validation retrospective multicentre study during first wave of the pandemic. Intelligence-Based Medicine 2022; 6:100065. [PMID: 35721825 PMCID: PMC9188985 DOI: 10.1016/j.ibmed.2022.100065] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/08/2022] [Revised: 04/21/2022] [Accepted: 06/01/2022] [Indexed: 12/15/2022]
Abstract
Clinical evidence suggests that some patients diagnosed with coronavirus disease 2019 (COVID-19) experience a variety of complications associated with significant morbidity, especially in severe cases during the initial spread of the pandemic. To support early interventions, we propose a machine learning system that predicts the risk of developing multiple complications. We processed data collected from 3,352 patient encounters admitted to 18 facilities between April 1 and April 30, 2020, in Abu Dhabi (AD), United Arab Emirates. Using data collected during the first 24 h of admission, we trained machine learning models to predict the risk of developing any of three complications after 24 h of admission. The complications include Secondary Bacterial Infection (SBI), Acute Kidney Injury (AKI), and Acute Respiratory Distress Syndrome (ARDS). The hospitals were grouped based on geographical proximity to assess the proposed system's learning generalizability, AD Middle region and AD Western & Eastern regions, A and B, respectively. The overall system includes a data filtering criterion, hyperparameter tuning, and model selection. In test set A, consisting of 587 patient encounters (mean age: 45.5), the system achieved a good area under the receiver operating curve (AUROC) for the prediction of SBI (0.902 AUROC), AKI (0.906 AUROC), and ARDS (0.854 AUROC). Similarly, in test set B, consisting of 225 patient encounters (mean age: 42.7), the system performed well for the prediction of SBI (0.859 AUROC), AKI (0.891 AUROC), and ARDS (0.827 AUROC). The performance results and feature importance analysis highlight the system's generalizability and interpretability. The findings illustrate how machine learning models can achieve a strong performance even when using a limited set of routine input variables. Since our proposed system is data-driven, we believe it can be easily repurposed for different outcomes considering the changes in COVID-19 variants over time.
Collapse
|
22
|
Bonnesen B, Jensen JUS, Jeschke KN, Mathioudakis AG, Corlateanu A, Hansen EF, Weinreich UM, Hilberg O, Sivapalan P. Management of COVID-19-Associated Acute Respiratory Failure with Alternatives to Invasive Mechanical Ventilation: High-Flow Oxygen, Continuous Positive Airway Pressure, and Noninvasive Ventilation. Diagnostics (Basel) 2021. [DOI: doi.org/10.3390/diagnostics11122259] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022] Open
Abstract
Patients admitted to hospital with coronavirus disease 2019 (COVID-19) may develop acute respiratory failure (ARF) with compromised gas exchange. These patients require oxygen and possibly ventilatory support, which can be delivered via different devices. Initially, oxygen therapy will often be administered through a conventional binasal oxygen catheter or air-entrainment mask. However, when higher rates of oxygen flow are needed, patients are often stepped up to high-flow nasal cannula oxygen therapy (HFNC), continuous positive airway pressure (CPAP), bilevel positive airway pressure (BiPAP), or invasive mechanical ventilation (IMV). BiPAP, CPAP, and HFNC may be beneficial alternatives to IMV for COVID-19-associated ARF. Current evidence suggests that when nasal catheter oxygen therapy is insufficient for adequate oxygenation of patients with COVID-19-associated ARF, CPAP should be provided for prolonged periods. Subsequent escalation to IMV may be implemented if necessary.
Collapse
|
23
|
Bonnesen B, Jensen JUS, Jeschke KN, Mathioudakis AG, Corlateanu A, Hansen EF, Weinreich UM, Hilberg O, Sivapalan P. Management of COVID-19-Associated Acute Respiratory Failure with Alternatives to Invasive Mechanical Ventilation: High-Flow Oxygen, Continuous Positive Airway Pressure, and Noninvasive Ventilation. Diagnostics (Basel) 2021; 11:diagnostics11122259. [PMID: 34943496 PMCID: PMC8700515 DOI: 10.3390/diagnostics11122259] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 11/28/2021] [Accepted: 12/01/2021] [Indexed: 02/05/2023] Open
Abstract
Patients admitted to hospital with coronavirus disease 2019 (COVID-19) may develop acute respiratory failure (ARF) with compromised gas exchange. These patients require oxygen and possibly ventilatory support, which can be delivered via different devices. Initially, oxygen therapy will often be administered through a conventional binasal oxygen catheter or air-entrainment mask. However, when higher rates of oxygen flow are needed, patients are often stepped up to high-flow nasal cannula oxygen therapy (HFNC), continuous positive airway pressure (CPAP), bilevel positive airway pressure (BiPAP), or invasive mechanical ventilation (IMV). BiPAP, CPAP, and HFNC may be beneficial alternatives to IMV for COVID-19-associated ARF. Current evidence suggests that when nasal catheter oxygen therapy is insufficient for adequate oxygenation of patients with COVID-19-associated ARF, CPAP should be provided for prolonged periods. Subsequent escalation to IMV may be implemented if necessary.
Collapse
Affiliation(s)
- Barbara Bonnesen
- Department of Medicine, Section of Respiratory Medicine, Herlev and Gentofte Hospital, University of Copenhagen, 2200 Copenhagen, Denmark; (B.B.); (J.-U.S.J.)
| | - Jens-Ulrik Stæhr Jensen
- Department of Medicine, Section of Respiratory Medicine, Herlev and Gentofte Hospital, University of Copenhagen, 2200 Copenhagen, Denmark; (B.B.); (J.-U.S.J.)
- Department of Clinical Medicine, Faculty of Health Sciences, University of Copenhagen, 2200 Copenhagen, Denmark
| | - Klaus Nielsen Jeschke
- Department of Respiratory Medicine, Copenhagen University Hospital-Hvidovre, 2650 Hvidovre, Denmark; (K.N.J.); (E.F.H.)
| | - Alexander G. Mathioudakis
- Division of Infection, Immunity and Respiratory Medicine, School of Biological Sciences, The University of Manchester, Manchester Academic Health Science Centre, Manchester M23 9LT, UK;
- North West Lung Centre, Wythenshawe Hospital, Manchester University NHS Foundation Trust, Manchester M23 9LT, UK
| | - Alexandru Corlateanu
- Department of Respiratory Medicine, State University of Medicine and Pharmacy “Nicolae Testemitanu”, 2004 Chisinau, Moldova;
| | - Ejvind Frausing Hansen
- Department of Respiratory Medicine, Copenhagen University Hospital-Hvidovre, 2650 Hvidovre, Denmark; (K.N.J.); (E.F.H.)
| | - Ulla Møller Weinreich
- Department of Respiratory Medicine, Aalborg University Hospital, University of Aalborg, 9100 Aalborg, Denmark;
- The Clinical Institute, Aalborg University, 9220 Aalborg, Denmark
| | - Ole Hilberg
- Department of Medicine, Little Belt Hospital, 7100 Vejle, Denmark;
- Department of Regional Health Research, University of Southern Denmark, 5000 Odense, Denmark
| | - Pradeesh Sivapalan
- Department of Medicine, Section of Respiratory Medicine, Herlev and Gentofte Hospital, University of Copenhagen, 2200 Copenhagen, Denmark; (B.B.); (J.-U.S.J.)
- Correspondence: ; Tel.: +45-298-806-01
| |
Collapse
|