1
|
Parsimonious Waveform-derived Features consisting of Pulse Arrival Time and Heart Rate Variability Predicts the Onset of Septic Shock. Biomed Signal Process Control 2024; 92:105974. [PMID: 38559667 PMCID: PMC10977921 DOI: 10.1016/j.bspc.2024.105974] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Sepsis is a major public health emergency and one of the leading causes of morbidity and mortality in critically ill patients. For each hour treatment is delayed, shock-related mortality increases, so early diagnosis and intervention is of utmost importance. However, earlier recognition of shock requires active monitoring, which may be delayed due to subclinical manifestations of the disease at the early phase of onset. Machine learning systems can increase timely detection of shock onset by exploiting complex interactions among continuous physiological waveforms. We use a dataset consisting of high-resolution physiological waveforms from intensive care unit (ICU) of a tertiary hospital system. We investigate the use of mean arterial blood pressure (MAP), pulse arrival time (PAT), heart rate variability (HRV), and heart rate (HR) for the early prediction of shock onset. Using only five minutes of the aforementioned vital signals from 239 ICU patients, our developed models can accurately predict septic shock onset 6 to 36 hours prior to clinical recognition with area under the receiver operating characteristic (AUROC) of 0.84 and 0.8 respectively. This work lays foundations for a robust, efficient, accurate and early prediction of septic shock onset which may help clinicians in their decision-making processes. This study introduces machine learning models that provide fast and accurate predictions of septic shock onset times up to 36 hours in advance. BP, PAT and HR dynamics can independently predict septic shock onset with a look-back period of only 5 mins.
Collapse
|
2
|
Corticosteroid sensitivity detection in sepsis patients using a personalized data mining approach: A clinical investigation. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 245:108017. [PMID: 38241801 DOI: 10.1016/j.cmpb.2024.108017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/12/2023] [Revised: 10/29/2023] [Accepted: 01/09/2024] [Indexed: 01/21/2024]
Abstract
BACKGROUND AND OBJECTIVE Sepsis is a life-threatening disease with high mortality, incidence, and morbidity. Corticosteroids (CS) are a recommended treatment for sepsis, but some patients respond negatively to CS therapy. Early prediction of corticosteroid responsiveness can help intervene and reduce mortality. In this study, we aim to develop a data mining methodology for predicting CS responsiveness of septic patients. METHODS We used data from a randomized controlled trial called APROCCHSS, which recruited 1241 septis patients to study the effectiveness of corticotherapy. We conducted a thorough study of multiple machine learning models to select the most efficient prediction model, called "signature". We evaluated the performance of the signature using precision, sensitivity, and specificity values. RESULTS We found that Logistic Regression was the best model with an AUC of 72%. We conducted further experiments to examine the impact of additional features and the model's generalizability to different groups of patients. We also performed a statistical analysis to analyze the effect of the treatment at the individual level and on the population as a whole. CONCLUSIONS Our data mining methodology can accurately predict cortico-sensitivity or resistance in septis patients. The signature has been deployed into the Assistance Publique - Hôpitaux de Paris (APHP) information system as a web service, taking patient information as input and providing a prediction of cortico-sensitivity or resistance. Early prediction of corticosteroid responsiveness can help clinicians intervene promptly and improve patient outcomes.
Collapse
|
3
|
Machine Learning-Based Early Prediction of Sepsis Using Electronic Health Records: A Systematic Review. J Clin Med 2023; 12:5658. [PMID: 37685724 PMCID: PMC10488449 DOI: 10.3390/jcm12175658] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Revised: 08/13/2023] [Accepted: 08/23/2023] [Indexed: 09/10/2023] Open
Abstract
BACKGROUND Sepsis, a life-threatening infection-induced inflammatory condition, has significant global health impacts. Timely detection is crucial for improving patient outcomes as sepsis can rapidly progress to severe forms. The application of machine learning (ML) and deep learning (DL) to predict sepsis using electronic health records (EHRs) has gained considerable attention for timely intervention. METHODS PubMed, IEEE Xplore, Google Scholar, and Scopus were searched for relevant studies. All studies that used ML/DL to detect or early-predict the onset of sepsis in the adult population using EHRs were considered. Data were extracted and analyzed from all studies that met the criteria and were also evaluated for their quality. RESULTS This systematic review examined 1942 articles, selecting 42 studies while adhering to strict criteria. The chosen studies were predominantly retrospective (n = 38) and spanned diverse geographic settings, with a focus on the United States. Different datasets, sepsis definitions, and prevalence rates were employed, necessitating data augmentation. Heterogeneous parameter utilization, diverse model distribution, and varying quality assessments were observed. Longitudinal data enabled early sepsis prediction, and quality criteria fulfillment varied, with inconsistent funding-article quality correlation. CONCLUSIONS This systematic review underscores the significance of ML/DL methods for sepsis detection and early prediction through EHR data.
Collapse
|
4
|
Uncertainty-Aware Convolutional Neural Network for Identifying Bilateral Opacities on Chest X-rays: A Tool to Aid Diagnosis of Acute Respiratory Distress Syndrome. Bioengineering (Basel) 2023; 10:946. [PMID: 37627831 PMCID: PMC10451804 DOI: 10.3390/bioengineering10080946] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/26/2023] [Accepted: 08/03/2023] [Indexed: 08/27/2023] Open
Abstract
Acute Respiratory Distress Syndrome (ARDS) is a severe lung injury with high mortality, primarily characterized by bilateral pulmonary opacities on chest radiographs and hypoxemia. In this work, we trained a convolutional neural network (CNN) model that can reliably identify bilateral opacities on routine chest X-ray images of critically ill patients. We propose this model as a tool to generate predictive alerts for possible ARDS cases, enabling early diagnosis. Our team created a unique dataset of 7800 single-view chest-X-ray images labeled for the presence of bilateral or unilateral pulmonary opacities, or 'equivocal' images, by three blinded clinicians. We used a novel training technique that enables the CNN to explicitly predict the 'equivocal' class using an uncertainty-aware label smoothing loss. We achieved an Area under the Receiver Operating Characteristic Curve (AUROC) of 0.82 (95% CI: 0.80, 0.85), a precision of 0.75 (95% CI: 0.73, 0.78), and a sensitivity of 0.76 (95% CI: 0.73, 0.78) on the internal test set while achieving an (AUROC) of 0.84 (95% CI: 0.81, 0.86), a precision of 0.73 (95% CI: 0.63, 0.69), and a sensitivity of 0.73 (95% CI: 0.70, 0.75) on an external validation set. Further, our results show that this approach improves the model calibration and diagnostic odds ratio of the hypothesized alert tool, making it ideal for clinical decision support systems.
Collapse
|
5
|
Dissecting contributions of individual systemic inflammatory response syndrome criteria from a prospective algorithm to the prediction and diagnosis of sepsis in a polytrauma cohort. Front Med (Lausanne) 2023; 10:1227031. [PMID: 37583420 PMCID: PMC10424878 DOI: 10.3389/fmed.2023.1227031] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2023] [Accepted: 07/17/2023] [Indexed: 08/17/2023] Open
Abstract
Background Sepsis is the leading cause of death in intensive care units (ICUs), and its timely detection and treatment improve clinical outcome and survival. Systemic inflammatory response syndrome (SIRS) refers to the concurrent fulfillment of at least two out of the following four clinical criteria: tachycardia, tachypnea, abnormal body temperature, and abnormal leukocyte count. While SIRS was controversially abandoned from the current sepsis definition, a dynamic SIRS representation still has potential for sepsis prediction and diagnosis. Objective We retrospectively elucidate the individual contributions of the SIRS criteria in a polytrauma cohort from the post-surgical ICU of University Medical Center Mannheim (Germany). Methods We used a dynamic and prospective SIRS algorithm tailored to the ICU setting by accounting for catecholamine therapy and mechanical ventilation. Two clinically relevant tasks are considered: (i) sepsis prediction using the first 24 h after admission to our ICU, and (ii) sepsis diagnosis using the last 24 h before sepsis onset and a time point of comparable ICU treatment duration for controls, respectively. We determine the importance of individual SIRS criteria by systematically varying criteria weights when summarizing the SIRS algorithm output with SIRS descriptors and assessing the classification performance of the resulting logistic regression models using a specifically developed ranking score. Results Our models perform better for the diagnosis than the prediction task (maximum AUROC 0.816 vs. 0.693). Risk models containing only the SIRS level average mostly show reasonable performance across criteria weights, with prediction and diagnosis AUROCs ranging from 0.455 (weight on leukocyte criterion only) to 0.693 and 0.619 to 0.800, respectively. For sepsis prediction, temperature and tachypnea are the most important SIRS criteria, whereas the leukocytes criterion is least important and potentially even counterproductive. For sepsis diagnosis, all SIRS criteria are relevant, with the temperature criterion being most influential. Conclusion SIRS is relevant for sepsis prediction and diagnosis in polytrauma, and no criterion should a priori be omitted. Hence, the original expert-defined SIRS criteria are valid, capturing important sepsis risk determinants. Our prospective SIRS algorithm provides dynamic determination of SIRS criteria and descriptors, allowing their integration in sepsis risk models also in other settings.
Collapse
|
6
|
Deep Learning-Based Recurrent Delirium Prediction in Critically Ill Patients. Crit Care Med 2023; 51:492-502. [PMID: 36790184 DOI: 10.1097/ccm.0000000000005789] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/16/2023]
Abstract
OBJECTIVES To predict impending delirium in ICU patients using recurrent deep learning. DESIGN Retrospective cohort study. SETTING Fifteen medical-surgical ICUs across Alberta, Canada, between January 1, 2014, and January 24, 2020. PATIENTS Forty-three thousand five hundred ten ICU admissions from 38,426 patients. INTERVENTIONS None. MEASUREMENTS AND MAIN RESULTS We used ICU and administrative health data to train deep learning models to predict delirium episodes in the next two 12-hour periods (0-12 and 12-24 hr), starting at 24 hours after ICU admission, and to generate new predictions every 12 hours. We used a comprehensive set of 3,643 features, capturing patient history, early ICU admission information (first 24 hr), and the temporal dynamics of various clinical variables throughout the ICU admission. Our deep learning architecture consisted of a feature embedding, a recurrent, and a prediction module. Our best model based on gated recurrent units yielded a sensitivity of 0.810, a specificity of 0.848, a precision (positive predictive value) of 0.704, and an area under the receiver operating characteristic curve (AUROC) of 0.909 in the hold-out test set for the 0-12-hour prediction horizon. For the 12-24-hour prediction horizon, the same model achieved a sensitivity of 0.791, a specificity of 0.807, a precision of 0.637, and an AUROC of 0.895 in the test set. CONCLUSIONS Our delirium prediction model achieved strong performance by applying deep learning to a dataset that is at least one order of magnitude larger than those used in previous studies. Another novel aspect of our study is the temporal nature of our features and predictions. Our model enables accurate prediction of impending delirium in the ICU, which can potentially lead to early intervention, more efficient allocation of ICU resources, and improved patient outcomes.
Collapse
|
7
|
Performance of bedside tools for predicting infection-related mortality and administrative data for sepsis surveillance: An observational cohort study. PLoS One 2023; 18:e0280228. [PMID: 36862700 PMCID: PMC9980760 DOI: 10.1371/journal.pone.0280228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2021] [Accepted: 12/23/2022] [Indexed: 03/03/2023] Open
Abstract
BACKGROUND Measuring sepsis incidence and associated mortality at scale using administrative data is hampered by variation in diagnostic coding. This study aimed first to compare how well bedside severity scores predict 30-day mortality in hospitalised patients with infection, then to assess the ability of combinations of administrative data items to identify patients with sepsis. METHODS This retrospective case note review examined 958 adult hospital admissions between October 2015 and March 2016. Admissions with blood culture sampling were matched 1:1 to admissions without a blood culture. Case note review data were linked to discharge coding and mortality. For patients with infection the performance characteristics of Sequential Organ Failure Assessment (SOFA), National Early Warning System (NEWS), quick SOFA (qSOFA), and Systemic Inflammatory Response Syndrome (SIRS) were calculated for predicting 30-day mortality. Next, the performance characteristics of administrative data (blood cultures and discharge codes) for identifying patients with sepsis, defined as SOFA ≥2 because of infection, were calculated. RESULTS Infection was documented in 630 (65.8%) admissions and 347 (55.1%) patients with infection had sepsis. NEWS (Area Under the Receiver Operating Characteristic, AUROC 0.78 95%CI 0.72-0.83) and SOFA (AUROC 0.77, 95%CI 0.72-0.83), performed similarly well for prediction of 30-day mortality. Having an infection and/or sepsis International Classification of Diseases, Tenth Revision (ICD-10) code (AUROC 0.68, 95%CI 0.64-0.71) performed as well in identifying patients with sepsis as having at least one of: an infection code; sepsis code, or; blood culture (AUROC 0.68, 95%CI 0.65-0.71), Sepsis codes (AUROC 0.53, 95%CI 0.49-0.57) and positive blood cultures (AUROC 0.52, 95%CI 0.49-0.56) performed least well. CONCLUSIONS SOFA and NEWS best predicted 30-day mortality in patients with infection. Sepsis ICD-10 codes lack sensitivity. For health systems without suitable electronic health records, blood culture sampling has potential utility as a clinical component of a proxy marker for sepsis surveillance.
Collapse
|
8
|
OnAI-Comp: An Online AI Experts Competing Framework for Early Sepsis Detection. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2022; 19:3595-3603. [PMID: 34699366 PMCID: PMC10975783 DOI: 10.1109/tcbb.2021.3122405] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Sepsis is a major public concern due to its high mortality, morbidity, and financial cost. There are many existing works of early sepsis prediction using different machine learning models to mitigate the outcomes brought by sepsis. In the practical scenario, the dataset grows dynamically as new patients visit the hospital. Most existing models, being "offline" models and having used retrospective observational data, cannot be updated and improved dynamically using the new observational data. Incorporating the new data to improve the offline models requires retraining the model, which is very computationally expensive. To solve the challenge mentioned above, we propose an Online Artificial Intelligence Experts Competing Framework (OnAI-Comp) for early sepsis detection using an online learning algorithm called Multi-armed Bandit. We selected several machine learning models as the artificial intelligence experts and used average regret to evaluate the performance of our model. The experimental analysis demonstrated that our model would converge to the optimal strategy in the long run. Meanwhile, our model can provide clinically interpretable predictions using existing local interpretable model-agnostic explanation technologies, which can aid clinicians in making decisions and might improve the probability of survival.
Collapse
|
9
|
Machine learning models for predicting in-hospital mortality in patient with sepsis: Analysis of vital sign dynamics. Front Med (Lausanne) 2022; 9:964667. [PMID: 36341257 PMCID: PMC9631306 DOI: 10.3389/fmed.2022.964667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Accepted: 09/23/2022] [Indexed: 11/18/2022] Open
Abstract
Purpose To build machine learning models for predicting the risk of in-hospital death in patients with sepsis within 48 h, using only dynamic changes in the patient's vital signs. Methods This retrospective observational cohort study enrolled septic patients from five emergency departments (ED) in Taiwan. We adopted seven variables, i.e., age, sex, systolic blood pressure, diastolic blood pressure, heart rate, respiratory rate, and body temperature. Results Among all 353,253 visits, after excluding 159,607 visits (45%), the study group consisted of 193,646 ED visits. With a leading time of 6 h, the convolutional neural networks (CNNs), long short-term memory (LSTM), and random forest (RF) had accuracy rates of 0.905, 0.817, and 0.835, respectively, and the area under the receiver operating characteristic curve (AUC) was 0.840, 0.761, and 0.770, respectively. With a leading time of 48 h, the CNN, LSTM, and RF achieved accuracy rates of 0.828, 0759, and 0.805, respectively, and an AUC of 0.811, 0.734, and 0.776, respectively. Conclusion By analyzing dynamic vital sign data, machine learning models can predict mortality in septic patients within 6 to 48 h of admission. The performance of the testing models is more accurate if the lead time is closer to the event.
Collapse
|
10
|
Optimizing the First Response to Sepsis: An Electronic Health Record-Based Markov Decision Process Model. DECISION ANALYSIS 2022. [DOI: 10.1287/deca.2022.0455] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
Abstract
Sepsis is considered a medical emergency where delays in initial treatment are associated with increased morbidity and mortality, yet there is no gold standard for identifying sepsis onset and thus treatment timing. We leverage electronic health record (EHR) data with clinical expertise to develop a continuous-time Markov decision process (MDP) optimal stopping model that identifies the optimal first intervention action (anti-infective, fluid, or wait). To study the impact of initial treatment of patients at risk for developing sepsis, we define the delayed treatment population who received delayed treatment upon admission or during hospitalization and serves as an approximation of the natural history of sepsis. We apply the optimal first treatment policy to sample patient visits from the nondelayed treatment population. This analysis indicates the average risk of death could be reduced by approximately 2.2%, the average time until treatment could be reduced by 106 minutes, and the average severity of the treatment state could be reduced by 15.5% compared with the treatment they received in the hospital. We study the properties of the optimal policy to define an easily interpretable initial treatment heuristic that considers a patient’s organ dysfunction, location, and septic shock status. This generalizable framework can inform personalized treatment of patients at risk for sepsis.
Collapse
|
11
|
Machine Learning Models for Early Prediction of Sepsis on Large Healthcare Datasets. ELECTRONICS 2022. [DOI: 10.3390/electronics11091507] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Sepsis is a highly lethal syndrome with heterogeneous clinical manifestation that can be hard to identify and treat. Early diagnosis and appropriate treatment are critical to reduce mortality and promote survival in suspected cases and improve the outcomes. Several screening prediction systems have been proposed for evaluating the early detection of patient deterioration, but the efficacy is still limited at individual level. The increasing amount and the versatility of healthcare data suggest implementing machine learning techniques to develop models for predicting sepsis. This work presents an experimental study of some machine-learning-based models for sepsis prediction considering vital signs, laboratory test results, and demographics using Medical Information Mart for Intensive Care III (MIMIC-III) (v1.4), a publicly available dataset. The experimental results demonstrate an overall higher performance of machine learning models over the commonly used Sequential Organ Failure Assessment (SOFA) and Quick SOFA (qSOFA) scoring systems at the time of sepsis onset.
Collapse
|
12
|
Admission vital signs as predictors of COVID-19 mortality: a retrospective cross-sectional study. BMC Emerg Med 2022; 22:68. [PMID: 35488200 PMCID: PMC9051839 DOI: 10.1186/s12873-022-00631-7] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2021] [Accepted: 04/18/2022] [Indexed: 11/10/2022] Open
Abstract
Background COVID-19 remains a major healthcare concern. Vital signs are routinely measured on admission and may provide an early, cost-effective indicator of outcome – more so in developing countries where such data is scarce. We sought to describe the association between six routinely measured admission vital signs and COVID-19 mortality, and secondarily to derive potential applications for resource-limited settings. Methods Retrospective analysis of consecutive patients admitted to King Edward VIII Hospital, South Africa, with COVID-19 during June–September 2020 was undertaken. The sample was subdivided into survivors and non-survivors and comparisons made in terms of demographics and admission vital signs. Univariate and multivariate analysis of predictor variables identified associations with in-hospital mortality, with the resulting multivariate regression model evaluated for its predictive ability with receiver operating characteristic (ROC) curve analysis. Results The 236 participants enrolled comprised 153(77.54%) survivors and 53(22.46%) non-survivors. Most participants were Black African(87.71%) and female(59.75%) with a mean age of 53.08(16.96) years. The non-survivor group demonstrated a significantly lower median/mean for admission oxygen saturation (%) [87(78–95) vs. 96(90–98)] and diastolic BP (mmHg) [70.79(14.66) vs. 76.3(12.07)], and higher median for admission respiratory rate (breaths/minute) [24(20–28) vs. 20(20–23)] and glucose (mmol/l) [10.2(6.95–16.25) vs. 7.4(5.5–9.8)]. Age, oxygen saturation, respiratory rate, glucose and diastolic BP were found to be significantly associated with mortality on univariate analysis. A log rank test revealed significantly lower survival rates in patients with an admission oxygen saturation < 90% compared with ≥90% (p = 0.001). Multivariate logistic regression revealed a significant relationship between age and oxygen saturation with in-hospital mortality (OR 1.047; 95% CI 1.016–1.080; p = 0.003 and OR 0.922; 95% CI 0.880–0.965; p = 0.001 respectively). A ROC curve analysis generated an area under the curve (AUC) of 0.778 (p < 0.001) when evaluating the predictive ability of oxygen saturation, respiratory rate, glucose and diastolic BP for in-hospital death. This improved to an AUC of 0.832 (p < 0.001) with the inclusion of age. Conclusion A multivariate regression model comprising admission oxygen saturation, respiratory rate, glucose and diastolic BP (with/without age) demonstrated promising predictive capacity, and may provide a cost-effective means for early prognostication of patients admitted with COVID-19 in resource-limited settings. Supplementary Information The online version contains supplementary material available at 10.1186/s12873-022-00631-7.
Collapse
|
13
|
Enhancing sepsis management through machine learning techniques: A review. Med Intensiva 2022; 46:140-156. [PMID: 35221003 DOI: 10.1016/j.medine.2020.04.015] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Accepted: 04/05/2020] [Indexed: 06/14/2023]
Abstract
Sepsis is a major public health problem and a leading cause of death in the world, where delay in the beginning of treatment, along with clinical guidelines non-adherence have been proved to be associated with higher mortality. Machine Learning is increasingly being adopted in developing innovative Clinical Decision Support Systems in many areas of medicine, showing a great potential for automatic prediction of diverse patient conditions, as well as assistance in clinical decision making. In this context, this work conducts a narrative review to provide an overview of how specific Machine Learning techniques can be used to improve sepsis management, discussing the main tasks addressed, the most popular methods and techniques, as well as the obtained results, in terms of both intelligent system accuracy and clinical outcomes improvement.
Collapse
|
14
|
Evaluating machine learning models for sepsis prediction: A systematic review of methodologies. iScience 2022; 25:103651. [PMID: 35028534 PMCID: PMC8741489 DOI: 10.1016/j.isci.2021.103651] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2021] [Revised: 11/16/2021] [Accepted: 12/15/2021] [Indexed: 12/29/2022] Open
Abstract
Studies for sepsis prediction using machine learning are developing rapidly in medical science recently. In this review, we propose a set of new evaluation criteria and reporting standards to assess 21 qualified machine learning models for quality analysis based on PRISMA. Our assessment shows that (1.) the definition of sepsis is not consistent among the studies; (2.) data sources and data preprocessing methods, machine learning models, feature engineering, and inclusion types vary widely among the studies; (3.) the closer to the onset of sepsis, the higher the value of AUROC is; (4.) the improvement in AUROC is primarily due to using machine learning as a feature engineering tool; (5.) deep neural networks coupled with Sepsis-3 diagnostic criteria tend to yield better results on the time series data collected from patients with sepsis. The new evaluation criteria and reporting standards will facilitate the development of improved machine learning models for clinical applications. New evaluation/reporting standard for sepsis prediction machine learning models Major limitations in the current models for sepsis prediction have been identified We strongly suggest using machine learning as a feature engineering tool Recommending multilayer neural networks and Sepsis 3.0 for yield better result
Collapse
|
15
|
Improving Prediction Models’ Propriety in Intensive-Care Unit, by Enforcing an Advance Notice Period. Artif Intell Med 2022. [DOI: 10.1007/978-3-031-09342-5_16] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/17/2022]
|
16
|
Altered Heart Rate Variability Early in ICU Admission Differentiates Critically Ill Coronavirus Disease 2019 and All-Cause Sepsis Patients. Crit Care Explor 2021; 3:e0570. [PMID: 34984336 PMCID: PMC8718227 DOI: 10.1097/cce.0000000000000570] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
IMPORTANCE Altered heart rate variability has been associated with autonomic dysfunction in a number of disease profiles, in this work we elucidate differences in the biomarker among patients with all-cause sepsis and coronavirus disease 2019. OBJECTIVES To measure heart rate variability metrics in critically ill coronavirus disease 2019 patients with comparison to all-cause critically ill sepsis patients. DESIGN SETTING AND PARTICIPANTS Retrospective analysis of coronavirus disease 2019 patients admitted to an ICU for at least 24 hours at any of Emory Healthcare ICUs between March 2020 and April 2020 up to 5 days of ICU stay. The comparison group was a cohort of all-cause sepsis patients prior to coronavirus disease 2019 pandemic. MAIN OUTCOMES AND MEASURES Continuous waveforms were captured from the patient monitor. The electrocardiogram was then analyzed for each patient over a 300 seconds observational window that was shifted by 30 seconds in each iteration from admission till discharge. A total of 23 heart rate variability metrics were extracted in each iteration. We use the Kruskal-Wallis and Steel-Dwass tests (p < 0.05) for statistical analysis and interpretations of heart rate variability multiple measures. RESULTS A total of 141 critically ill coronavirus disease 2019 patients met inclusion criteria, who were compared with 208 patients with all-cause sepsis. Three nonlinear markers, including the ratio of standard deviation derived from the Poincaré plot, sample entropy, and approximate entropy and four linear features, including mode of beat-to-beat interval, acceleration capacity, deceleration capacity, and the proportion of consecutive RR intervals that differ by more than 50 ms, were all statistically significant (p < 0.05) between the coronavirus disease 2019 and all-cause sepsis cohorts. The three nonlinear features and acceleration capacity, deceleration capacity, and beat-to-beat interval (mode) were statistically significant (p < 0.05) when comparing pairwise analysis among the combinations of survivors and nonsurvivors between the coronavirus disease 2019 and sepsis cohorts. Temporal analysis of the main markers showed low variability across the 5 days of analysis compared with sepsis patients. CONCLUSIONS AND RELEVANCE In this descriptive statistical study, heart rate variability measures were found to be statistically different across critically ill patients infected with severe acute respiratory syndrome coronavirus 2 and distinct from bacterial sepsis.
Collapse
|
17
|
The Framing of machine learning risk prediction models illustrated by evaluation of sepsis in general wards. NPJ Digit Med 2021; 4:158. [PMID: 34782696 PMCID: PMC8593052 DOI: 10.1038/s41746-021-00529-x] [Citation(s) in RCA: 12] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2021] [Accepted: 10/19/2021] [Indexed: 11/09/2022] Open
Abstract
Problem framing is critical to developing risk prediction models because all subsequent development work and evaluation takes place within the context of how a problem has been framed and explicit documentation of framing choices makes it easier to compare evaluation metrics between published studies. In this work, we introduce the basic concepts of framing, including prediction windows, observation windows, window shifts and event-triggers for a prediction that strongly affects the risk of clinician fatigue caused by false positives. Building on this, we apply four different framing structures to the same generic dataset, using a sepsis risk prediction model as an example, and evaluate how framing affects model performance and learning. Our results show that an apparently good model with strong evaluation results in both discrimination and calibration is not necessarily clinically usable. Therefore, it is important to assess the results of objective evaluations within the context of more subjective evaluations of how a model is framed.
Collapse
|
18
|
The impact of recency and adequacy of historical information on sepsis predictions using machine learning. Sci Rep 2021; 11:20869. [PMID: 34675275 PMCID: PMC8531301 DOI: 10.1038/s41598-021-00220-x] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2021] [Accepted: 10/07/2021] [Indexed: 12/11/2022] Open
Abstract
Sepsis is a major public and global health concern. Every hour of delay in detecting sepsis significantly increases the risk of death, highlighting the importance of accurately predicting sepsis in a timely manner. A growing body of literature has examined developing new or improving the existing machine learning (ML) approaches for timely and accurate predictions of sepsis. This study contributes to this literature by providing clear insights regarding the role of the recency and adequacy of historical information in predicting sepsis using ML. To this end, we implemented a deep learning model using a bidirectional long short-term memory (BiLSTM) algorithm and compared it with six other ML algorithms based on numerous combinations of the prediction horizons (to capture information recency) and observation windows (to capture information adequacy) using different measures of predictive performance. Our results indicated that the BiLSTM algorithm outperforms all other ML algorithms and provides a great separability of the predicted risk of sepsis among septic versus non-septic patients. Moreover, decreasing the prediction horizon (in favor of information recency) always boosts the predictive performance; however, the impact of expanding the observation window (in favor of information adequacy) depends on the prediction horizon and the purpose of prediction. More specifically, when the prediction is responsive to the positive label (i.e., Sepsis), increasing historical data improves the predictive performance when the prediction horizon is short-moderate.
Collapse
|
19
|
Accurate diagnosis of sepsis using a neural network: Pilot study using routine clinical variables. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2021; 210:106366. [PMID: 34500141 DOI: 10.1016/j.cmpb.2021.106366] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 08/17/2021] [Indexed: 06/13/2023]
Abstract
BACKGROUND AND OBJECTIVES Sepsis is a severe infection that increases mortality risk and is one if the main causes of death in intensive care units. Accurate detection is key to successful interventions, but diagnosis of sepsis is complicated because the initial signs and symptoms are not specific. Biomarkers that have been proposed have low specificity and sensitivity, are expensive, and not available in every hospital. In this study, we propose the use of artificial intelligence in the form of a neural network to diagnose sepsis using only common laboratory tests and vital signs that are routine and widely available. METHODS A retrospective, cross sectional cohort of 113 patients from an intensive care unit, each with 48 routinely evaluated vital signs and biochemical parameters was used to train, validate and test a neural network with 48 inputs, 10 neurons in a single hidden layer and one output. The sensitivity and specificity of the neural network as a point sampled diagnostic test was calculated. RESULTS All but one case were correctly diagnosed by the neural network, with 91% sensitivity and 100% specificity in the validation data set, and 100% sensitivity and specificity in the test data set. CONCLUSIONS The designed neural network system can identify patients with sepsis, with minimal resources using standard laboratory tests widely available in most health care facilities. This should reduce the burden on the medical staff of a difficult diagnosis and should improve outcomes for patients with sepsis.
Collapse
|
20
|
Artificial Intelligence May Predict Early Sepsis After Liver Transplantation. Front Physiol 2021; 12:692667. [PMID: 34552499 PMCID: PMC8450439 DOI: 10.3389/fphys.2021.692667] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/08/2021] [Accepted: 07/29/2021] [Indexed: 12/14/2022] Open
Abstract
Background: Sepsis, post-liver transplantation, is a frequent challenge that impacts patient outcomes. We aimed to develop an artificial intelligence method to predict the onset of post-operative sepsis earlier. Methods: This pilot study aimed to identify "physiomarkers" in continuous minute-by-minute physiologic data streams, such as heart rate, respiratory rate, oxygen saturation (SpO2), and blood pressure, to predict the onset of sepsis. The model was derived from a cohort of 5,748 transplant and non-transplant patients across intensive care units (ICUs) over 36 months, with 92 post-liver transplant patients who developed sepsis. Results: Using an alert timestamp generated with the Third International Consensus Definition of Sepsis (Sepsis-3) definition as a reference point, we studied up to 24 h of continuous physiologic data prior to the event, totaling to 8.35 million data points. One hundred fifty-five features were generated using signal processing and statistical methods. Feature selection identified 52 highly ranked features, many of which included blood pressures. An eXtreme Gradient Boost (XGB) classifier was then trained on the ranked features by 5-fold cross validation on all patients (n = 5,748). We identified that the average sensitivity, specificity, positive predictive value (PPV), and area under the receiver-operator curve (AUC) of the model after 100 iterations was 0.94 ± 0.02, 0.9 ± 0.02, 0.89 ± 0.01, respectively, and 0.97 ± 0.01 for predicting sepsis 12 h before meeting criteria. Conclusion: The data suggest that machine learning/deep learning can be applied to continuous streaming data in the transplant ICU to monitor patients and possibly predict sepsis.
Collapse
|
21
|
Generalization in Clinical Prediction Models: The Blessing and Curse of Measurement Indicator Variables. Crit Care Explor 2021; 3:e0453. [PMID: 34235453 PMCID: PMC8238368 DOI: 10.1097/cce.0000000000000453] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
Supplemental Digital Content is available in the text. OBJECTIVE: Specific factors affecting generalizability of clinical prediction models are poorly understood. Our main objective was to investigate how measurement indicator variables affect external validity in clinical prediction models for predicting onset of vasopressor therapy. DESIGN: We fit logistic regressions on retrospective cohorts to predict vasopressor onset using two classes of variables: seemingly objective clinical variables (vital signs and laboratory measurements) and more subjective variables denoting recency of measurements. SETTING: Three cohorts from two tertiary-care academic hospitals in geographically distinct regions, spanning general inpatient and critical care settings. PATIENTS: Each cohort consisted of adult patients (age greater than or equal to 18 yr at time of hospitalization), with lengths of stay between 6 and 600 hours, and who did not receive vasopressors in the first 6 hours of hospitalization or ICU admission. Models were developed on each of the three derivation cohorts and validated internally on the derivation cohort and externally on the other two cohorts. INTERVENTIONS: None. MEASUREMENTS AND MAIN RESULTS: The prevalence of vasopressors was 0.9% in the general inpatient cohort and 12.4% and 11.5% in the two critical care cohorts. Models utilizing both classes of variables performed the best in-sample, with C-statistics for predicting vasopressor onset in 4 hours of 0.862 (95% CI, 0.844–0.879), 0.822 (95% CI, 0.793–0.852), and 0.889 (95% CI, 0.880–0.898). Models solely using the subjective variables denoting measurement recency had poor external validity. However, these practice-driven variables helped adjust for differences between the two hospitals and led to more generalizable models using clinical variables. CONCLUSIONS: We developed and externally validated models for predicting the onset of vasopressors. We found that practice-specific features denoting measurement recency improved local performance and also led to more generalizable models if they are adjusted for during model development but discarded at validation. The role of practice-specific features such as measurement indicators in clinical prediction modeling should be carefully considered if the goal is to develop generalizable models.
Collapse
|
22
|
Early Prediction of Sepsis in the ICU Using Machine Learning: A Systematic Review. Front Med (Lausanne) 2021; 8:607952. [PMID: 34124082 PMCID: PMC8193357 DOI: 10.3389/fmed.2021.607952] [Citation(s) in RCA: 37] [Impact Index Per Article: 12.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/18/2020] [Accepted: 03/04/2021] [Indexed: 12/12/2022] Open
Abstract
Background: Sepsis is among the leading causes of death in intensive care units (ICUs) worldwide and its recognition, particularly in the early stages of the disease, remains a medical challenge. The advent of an affluence of available digital health data has created a setting in which machine learning can be used for digital biomarker discovery, with the ultimate goal to advance the early recognition of sepsis. Objective: To systematically review and evaluate studies employing machine learning for the prediction of sepsis in the ICU. Data Sources: Using Embase, Google Scholar, PubMed/Medline, Scopus, and Web of Science, we systematically searched the existing literature for machine learning-driven sepsis onset prediction for patients in the ICU. Study Eligibility Criteria: All peer-reviewed articles using machine learning for the prediction of sepsis onset in adult ICU patients were included. Studies focusing on patient populations outside the ICU were excluded. Study Appraisal and Synthesis Methods: A systematic review was performed according to the PRISMA guidelines. Moreover, a quality assessment of all eligible studies was performed. Results: Out of 974 identified articles, 22 and 21 met the criteria to be included in the systematic review and quality assessment, respectively. A multitude of machine learning algorithms were applied to refine the early prediction of sepsis. The quality of the studies ranged from "poor" (satisfying ≤ 40% of the quality criteria) to "very good" (satisfying ≥ 90% of the quality criteria). The majority of the studies (n = 19, 86.4%) employed an offline training scenario combined with a horizon evaluation, while two studies implemented an online scenario (n = 2, 9.1%). The massive inter-study heterogeneity in terms of model development, sepsis definition, prediction time windows, and outcomes precluded a meta-analysis. Last, only two studies provided publicly accessible source code and data sources fostering reproducibility. Limitations: Articles were only eligible for inclusion when employing machine learning algorithms for the prediction of sepsis onset in the ICU. This restriction led to the exclusion of studies focusing on the prediction of septic shock, sepsis-related mortality, and patient populations outside the ICU. Conclusions and Key Findings: A growing number of studies employs machine learning to optimize the early prediction of sepsis through digital biomarker discovery. This review, however, highlights several shortcomings of the current approaches, including low comparability and reproducibility. Finally, we gather recommendations how these challenges can be addressed before deploying these models in prospective analyses. Systematic Review Registration Number: CRD42020200133.
Collapse
|
23
|
Preventing sepsis; how can artificial intelligence inform the clinical decision-making process? A systematic review. Int J Med Inform 2021; 150:104457. [PMID: 33878596 DOI: 10.1016/j.ijmedinf.2021.104457] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2020] [Revised: 03/12/2021] [Accepted: 04/06/2021] [Indexed: 12/13/2022]
Abstract
BACKGROUND AND OBJECTIVES Sepsis is a life-threatening condition that is associated with increased mortality. Artificial intelligence tools can inform clinical decision making by flagging patients at risk of developing infection and subsequent sepsis. This systematic review aims to identify the optimal set of predictors used to train machine learning algorithms to predict the likelihood of an infection and subsequent sepsis. METHODS This systematic review was registered in PROSPERO database (CRD42020158685). We conducted a systematic literature review across 3 large databases: Medline, Cumulative Index of Nursing and Allied Health Literature, and Embase. Quantitative primary research studies that focused on sepsis prediction associated with bacterial infection in adults in all care settings were eligible for inclusion. RESULTS Seventeen articles met our inclusion criteria. We identified 194 predictors that were used to train machine learning algorithms, with 13 predictors used on average across all included studies. The most prevalent predictors included age, gender, smoking, alcohol intake, heart rate, blood pressure, lactate level, cardiovascular disease, endocrine disease, cancer, chronic kidney disease (eGFR<60 mL/min), white blood cell count, liver dysfunction, surgical approach (open or minimally invasive), and pre-operative haematocrit < 30 %. All included studies used artificial intelligence techniques, with average sensitivity 75.7 ± 17.88, and average specificity 63.08 ± 22.01. CONCLUSION The type of predictors influenced the predictive power and predictive timeframe of the developed machine learning algorithm. Predicting the likelihood of sepsis through artificial intelligence can help concentrate finite resources to those patients who are most at risk. Future studies should focus on developing more sensitive and specific algorithms.
Collapse
|
24
|
Machine Learning Identifies Complicated Sepsis Course and Subsequent Mortality Based on 20 Genes in Peripheral Blood Immune Cells at 24 H Post-ICU Admission. Front Immunol 2021; 12:592303. [PMID: 33692779 PMCID: PMC7937924 DOI: 10.3389/fimmu.2021.592303] [Citation(s) in RCA: 28] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2020] [Accepted: 01/28/2021] [Indexed: 01/08/2023] Open
Abstract
A complicated clinical course for critically ill patients admitted to the intensive care unit (ICU) usually includes multiorgan dysfunction and subsequent death. Owing to the heterogeneity, complexity, and unpredictability of the disease progression, ICU patient care is challenging. Identifying the predictors of complicated courses and subsequent mortality at the early stages of the disease and recognizing the trajectory of the disease from the vast array of longitudinal quantitative clinical data is difficult. Therefore, we attempted to perform a meta-analysis of previously published gene expression datasets to identify novel early biomarkers and train the artificial intelligence systems to recognize the disease trajectories and subsequent clinical outcomes. Using the gene expression profile of peripheral blood cells obtained within 24 h of pediatric ICU (PICU) admission and numerous clinical data from 228 septic patients from pediatric ICU, we identified 20 differentially expressed genes predictive of complicated course outcomes and developed a new machine learning model. After 5-fold cross-validation with 10 iterations, the overall mean area under the curve reached 0.82. Using a subset of the same set of genes, we further achieved an overall area under the curve of 0.72, 0.96, 0.83, and 0.82, respectively, on four independent external validation sets. This model was highly effective in identifying the clinical trajectories of the patients and mortality. Artificial intelligence systems identified eight out of twenty novel genetic markers (SDC4, CLEC5A, TCN1, MS4A3, HCAR3, OLAH, PLCB1, and NLRP1) that help predict sepsis severity or mortality. While these genes have been previously associated with sepsis mortality, in this work, we show that these genes are also implicated in complex disease courses, even among survivors. The discovery of eight novel genetic biomarkers related to the overactive innate immune system, including neutrophil function, and a new predictive machine learning method provides options to effectively recognize sepsis trajectories, modify real-time treatment options, improve prognosis, and patient survival.
Collapse
|
25
|
HeMA: A hierarchically enriched machine learning approach for managing false alarms in real time: A sepsis prediction case study. Comput Biol Med 2021; 131:104255. [PMID: 33639353 DOI: 10.1016/j.compbiomed.2021.104255] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2020] [Revised: 02/01/2021] [Accepted: 02/03/2021] [Indexed: 01/09/2023]
Abstract
Early detection of sepsis can be life-saving. Machine learning models have shown great promise in early sepsis prediction when applied to patient physiological data in real-time. However, these existing models often under-perform in terms of positive predictive value, an important metric in clinical settings. This is especially the case when the models are applied to data with less than 50% sepsis prevalence, reflective of the incidence rate of sepsis on the floor or in the ICU. In this study, we develop HeMA, a hierarchically enriched machine learning approach for managing false alarms in real time, and conduct a case study for early sepsis prediction. Specifically, we develop a two-stage framework, where a first stage machine learning model is paired with statistical tests, particularly Kolmogorov-Smirnov tests, in the second stage, to predict whether a patient would develop sepsis. Compared with machine learning models alone, the framework results in an increase in specificity and positive predictive value, without compromising F1 score. In particular, the framework shows improved performance when applied to data with 50% and 25% sepsis prevalence, collected from a large hospital system in the US, resulting in up to 18% and 7% increase in specificity and positive predictive value, respectively. Despite the significant improvements observed, and although F1 score is not negatively affected, because of the up to 6% decrease in sensitivity, further improvements and pilot studies may be necessary before deploying the framework in a clinical setting. Finally, external validation conducted using a publicly available dataset produces similar results, validating that the proposed framework is generalizable.
Collapse
|
26
|
Early Detection of Sepsis With Machine Learning Techniques: A Brief Clinical Perspective. Front Med (Lausanne) 2021; 8:617486. [PMID: 33644097 PMCID: PMC7906970 DOI: 10.3389/fmed.2021.617486] [Citation(s) in RCA: 25] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2020] [Accepted: 01/19/2021] [Indexed: 12/15/2022] Open
Abstract
Sepsis is a major cause of death worldwide. Over the past years, prediction of clinically relevant events through machine learning models has gained particular attention. In the present perspective, we provide a brief, clinician-oriented vision on the following relevant aspects concerning the use of machine learning predictive models for the early detection of sepsis in the daily practice: (i) the controversy of sepsis definition and its influence on the development of prediction models; (ii) the choice and availability of input features; (iii) the measure of the model performance, the output, and their usefulness in the clinical practice. The increasing involvement of artificial intelligence and machine learning in health care cannot be disregarded, despite important pitfalls that should be always carefully taken into consideration. In the long run, a rigorous multidisciplinary approach to enrich our understanding in the application of machine learning techniques for the early recognition of sepsis may show potential to augment medical decision-making when facing this heterogeneous and complex syndrome.
Collapse
|
27
|
SSP: Early prediction of sepsis using fully connected LSTM-CNN model. Comput Biol Med 2020; 128:104110. [PMID: 33227577 DOI: 10.1016/j.compbiomed.2020.104110] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/29/2020] [Revised: 11/05/2020] [Accepted: 11/05/2020] [Indexed: 01/31/2023]
Abstract
BACKGROUND Sepsis is a life-threatening condition that occurs due to the body's reaction to infections, and it is a leading cause of morbidity and mortality in hospitals. Early prediction of sepsis onset facilitates early interventions that promote the survival of suspected patients. However, reliable and intelligent systems for predicting sepsis are scarce. METHODS This paper presents a novel technique called Smart Sepsis Predictor (SSP) to predict sepsis onset in patients admitted to an intensive care unit (ICU). SSP is a deep neural network architecture that encompasses long short-term memory (LSTM), convolutional, and fully connected layers to achieve early prediction of sepsis. SSP can work in two modes; Mode 1 uses demographic data and vital signs, and Mode 2 uses laboratory test results in addition to demographic data and vital signs. To evaluate SSP, we have used the 2019 PhysioNet/CinC Challenge dataset, which includes the records of 40,366 patients admitted to the ICU. RESULTS To compare SSP with existing state-of-the-art methods, we have measured the accuracy of the SSP in 4-, 8-, and 12-h prediction windows using publicly available data. Our results show that the SSP performance in Mode 1 and Mode 2 is much higher than existing methods, achieving an area under the receiver operating characteristic curve (AUROC) of 0.89 and 0.92, 0.88 and 0.87, and 0.86 and 0.84 for 4 h, 8 h, and 12 h before sepsis onset, respectively. CONCLUSIONS Using ICU data, sepsis onset can be predicted up to 12 h in advance. Our findings offer an early solution for mitigating the risk of sepsis onset.
Collapse
|
28
|
Dynamic tracking of microvascular hemoglobin content for continuous perfusion monitoring in the intensive care unit: pilot feasibility study. J Clin Monit Comput 2020; 35:1453-1465. [PMID: 33104968 PMCID: PMC7586414 DOI: 10.1007/s10877-020-00611-x] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2020] [Accepted: 10/20/2020] [Indexed: 12/25/2022]
Abstract
Purpose: There is a need for bedside methods to monitor oxygen delivery in the microcirculation. Near-infrared spectroscopy commonly measures tissue oxygen saturation, but does not reflect the time-dependent variability of microvascular hemoglobin content (MHC) that attempts to match oxygen supply with demand. The objective of this study is to determine the feasibility of MHC monitoring in critically ill patients using high-resolution near-infrared spectroscopy to assess perfusion in the peripheral microcirculation. Methods: Prospective observational cohort of 36 patients admitted within 48 h at a tertiary intensive care unit. Perfusion was measured on the quadriceps, biceps, and/or deltoid, using the temporal change in optical density at the isosbestic wavelength of hemoglobin (798 nm). Continuous wavelet transform was applied to the hemoglobin signal to delineate frequency ranges corresponding to physiological oscillations in the cardiovascular system. Results: 31/36 patients had adequate signal quality for analysis, most commonly affected by motion artifacts. MHC signal demonstrates inter-subject heterogeneity in the cohort, indicated by different patterns of variability and frequency composition. Signal characteristics were concordant between muscle groups in the same patient, and correlated with systemic hemoglobin levels and oxygen saturation. Signal power was lower for patients receiving vasopressors, but not correlated with mean arterial pressure. Mechanical ventilation directly impacts MHC in peripheral tissue. Conclusion: MHC can be measured continuously in the ICU with high-resolution near-infrared spectroscopy, and reflects the dynamic variability of hemoglobin distribution in the microcirculation. Results suggest this novel hemodynamic metric should be further evaluated for diagnosing microvascular dysfunction and monitoring peripheral perfusion.
Collapse
|
29
|
Machine learning predicts mortality in septic patients using only routinely available ABG variables: a multi-centre evaluation. Int J Med Inform 2020; 145:104312. [PMID: 33126059 DOI: 10.1016/j.ijmedinf.2020.104312] [Citation(s) in RCA: 23] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2020] [Revised: 09/26/2020] [Accepted: 10/20/2020] [Indexed: 12/13/2022]
Abstract
PURPOSE To evaluate the application of machine learning methods, specifically Deep Neural Networks (DNN) models for intensive care (ICU) mortality prediction. The aim was to predict mortality within 96 hours after admission to mirror the clinical situation of patient evaluation after an ICU trial, which consists of 24-48 hours of ICU treatment and then "re-triage". The input variables were deliberately restricted to ABG values to maximise real-world practicability. METHODS We retrospectively evaluated septic patients in the multi-centre eICU dataset as well as single centre MIMIC-III dataset. Included were all patients alive after 48 hours with available data on ABG (n = 3979 and n = 9655 ICU stays for the multi-centre and single centre respectively). The primary endpoint was 96 -h-mortality. RESULTS The model was developed using long short-term memory (LSTM), a type of DNN designed to learn temporal dependencies between variables. Input variables were all ABG values within the first 48 hours. The SOFA score (AUC of 0.72) was moderately predictive. Logistic regression showed good performance (AUC of 0.82). The best performance was achieved by the LSTM-based model with AUC of 0.88 in the multi-centre study and AUC of 0.85 in the single centre study. CONCLUSIONS An LSTM-based model could help physicians with the "re-triage" and the decision to restrict treatment in patients with a poor prognosis.
Collapse
|
30
|
Abstract
BACKGROUND Digitalization and artificial intelligence have an important impact on the way microbiology laboratories will work in the near future. Opportunities and challenges lie ahead to digitalize the microbiological workflows. Making efficient use of big data, machine learning, and artificial intelligence in clinical microbiology requires a profound understanding of data handling aspects. OBJECTIVE This review article summarizes the most important concepts of digital microbiology. The article gives microbiologists, clinicians and data scientists a viewpoint and practical examples along the diagnostic process. SOURCES We used peer-reviewed literature identified by a PubMed search for digitalization, machine learning, artificial intelligence and microbiology. CONTENT We describe the opportunities and challenges of digitalization in microbiological diagnostic processes with various examples. We also provide in this context key aspects of data structure and interoperability, as well as legal aspects. Finally, we outline the way for applications in a modern microbiology laboratory. IMPLICATIONS We predict that digitalization and the usage of machine learning will have a profound impact on the daily routine of laboratory staff. Along the analytical process, the most important steps should be identified, where digital technologies can be applied and provide a benefit. The education of all staff involved should be adapted to prepare for the advances in digital microbiology.
Collapse
|
31
|
Utilizing time series data embedded in electronic health records to develop continuous mortality risk prediction models using hidden Markov models: A sepsis case study. Stat Methods Med Res 2020; 29:3409-3423. [PMID: 32552573 DOI: 10.1177/0962280220929045] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Continuous mortality risk monitoring is instrumental to manage a patient's care and to efficiently utilize the limited hospital resources. Due to incompleteness and irregularities of electronic health records (EHR), developing continuous mortality risk prediction using EHR data is a challenge. In this study, we propose a framework to continuously monitor mortality risk, and apply it to the real-world EHR data. The proposed method employs hidden Markov models (temporal technique) that take account of both the previous state of patient's health and the current value of clinical signs. Following the Sepsis-3 definition, we selected 3898 encounters of patients with suspected infection to compare the performance of temporal and non-temporal methods (Decision Tree (DT), Logistic Regression (LR), Naive Bayes (NB), Random Forest (RF), and Support Vector Machine (SVM)). The area under receiver operating characteristics (AUROC) curve, sensitivity, specificity and G-mean were used as performance measures. On the selected data, the AUROC of the proposed temporal framework (0.87) is 9-12% greater than the nontemporal methods (DT: 0.78, NB: 0.79, SVM: 0.79, LR: 0.80 and RF: 0.80). The results also show that our model (G-mean=0.78) provides a better balance between sensitivity and specificity compared to clinically acceptable bed-side criteria (G-mean=0.71). The proposed framework leverages the longitudinal data available in EHR and performs better than the non-temporal methods. The proposed method facilitates information related to the time of change of the patient's health that may help practitioners to plan early and develop effective treatment strategies.
Collapse
|
32
|
Abstract
Clinicians face challenges in the timely diagnosis and management of pediatric sepsis. Pediatric heart rate has been incorporated into early warning systems and studied as a predictor for critical illness. We aim to review: (I) the role of heart rate in pediatric warning systems and (II) the role of heart rate variability (HRV) in adult and neonatal sepsis, with a focus on its potential applications in pediatrics. We conducted a literature search for papers published up to December 2019 on the utility of heart rate and HRV analysis in the diagnosis and management of sepsis, using four medical databases: PubMed, Google Scholar, EMBASE and Web of Science. This review demonstrates that the clinical utility of pediatric heart rate in predicting clinical deterioration is limited by the lack of consensus among warning systems, consensus-based guidelines, and evidence-based studies as to what constitutes abnormal heart rate in the pediatric age group. Current studies demonstrate that abnormal heart rate itself does not adequately discriminate children with sepsis from those without. HRV analysis provides a quick and non-invasive method of assessment and can provide more information than traditional heart rate. HRV analysis has the potential to add value in identification and prognostication of adult and neonatal sepsis. With further studies to explore its role, HRV analysis has the potential to add to current tools in the diagnosis and prognosis of pediatric sepsis.
Collapse
|
33
|
Enhancing sepsis management through machine learning techniques: A review. Med Intensiva 2020; 46:S0210-5691(20)30102-9. [PMID: 32482370 DOI: 10.1016/j.medin.2020.04.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/29/2019] [Revised: 03/27/2020] [Accepted: 04/05/2020] [Indexed: 12/11/2022]
Abstract
Sepsis is a major public health problem and a leading cause of death in the world, where delay in the beginning of treatment, along with clinical guidelines non-adherence have been proved to be associated with higher mortality. Machine Learning is increasingly being adopted in developing innovative Clinical Decision Support Systems in many areas of medicine, showing a great potential for automatic prediction of diverse patient conditions, as well as assistance in clinical decision making. In this context, this work conducts a narrative review to provide an overview of how specific Machine Learning techniques can be used to improve sepsis management, discussing the main tasks addressed, the most popular methods and techniques, as well as the obtained results, in terms of both intelligent system accuracy and clinical outcomes improvement.
Collapse
|
34
|
Using Machine Learning to Predict Early Onset Acute Organ Failure in Critically Ill Intensive Care Unit Patients With Sickle Cell Disease: Retrospective Study. J Med Internet Res 2020; 22:e14693. [PMID: 32401216 PMCID: PMC7254279 DOI: 10.2196/14693] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/13/2019] [Revised: 08/18/2019] [Accepted: 01/28/2020] [Indexed: 12/22/2022] Open
Abstract
Background Sickle cell disease (SCD) is a genetic disorder of the red blood cells, resulting in multiple acute and chronic complications, including pain episodes, stroke, and kidney disease. Patients with SCD develop chronic organ dysfunction, which may progress to organ failure during disease exacerbations. Early detection of acute physiological deterioration leading to organ failure is not always attainable. Machine learning techniques that allow for prediction of organ failure may enable early identification and treatment and potentially reduce mortality. Objective The aim of this study was to test the hypothesis that machine learning physiomarkers can predict the development of organ dysfunction in a sample of adult patients with SCD admitted to intensive care units (ICUs). Methods We applied diverse machine learning methods, statistical methods, and data visualization techniques to develop classification models to distinguish SCD from controls. Results We studied 63 sequential SCD patients admitted to ICUs with 163 patient encounters (mean age 30.7 years, SD 9.8 years). A subset of these patient encounters, 22.7% (37/163), met the sequential organ failure assessment criteria. The other 126 SCD patient encounters served as controls. A set of signal processing features (such as fast Fourier transform, energy, and continuous wavelet transform) derived from heart rate, blood pressure, and respiratory rate was identified to distinguish patients with SCD who developed acute physiological deterioration leading to organ failure from patients with SCD who did not meet the criteria. A multilayer perceptron model accurately predicted organ failure up to 6 hours before onset, with an average sensitivity and specificity of 96% and 98%, respectively. Conclusions This retrospective study demonstrated the viability of using machine learning to predict acute organ failure among hospitalized adults with SCD. The discovery of salient physiomarkers through machine learning techniques has the potential to further accelerate the development and implementation of innovative care delivery protocols and strategies for medically vulnerable patients.
Collapse
|
35
|
Machine learning for the prediction of sepsis: a systematic review and meta-analysis of diagnostic test accuracy. Intensive Care Med 2020; 46:383-400. [PMID: 31965266 PMCID: PMC7067741 DOI: 10.1007/s00134-019-05872-y] [Citation(s) in RCA: 247] [Impact Index Per Article: 61.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2019] [Accepted: 11/16/2019] [Indexed: 12/19/2022]
Abstract
PURPOSE Early clinical recognition of sepsis can be challenging. With the advancement of machine learning, promising real-time models to predict sepsis have emerged. We assessed their performance by carrying out a systematic review and meta-analysis. METHODS A systematic search was performed in PubMed, Embase.com and Scopus. Studies targeting sepsis, severe sepsis or septic shock in any hospital setting were eligible for inclusion. The index test was any supervised machine learning model for real-time prediction of these conditions. Quality of evidence was assessed using the Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology, with a tailored Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) checklist to evaluate risk of bias. Models with a reported area under the curve of the receiver operating characteristic (AUROC) metric were meta-analyzed to identify strongest contributors to model performance. RESULTS After screening, a total of 28 papers were eligible for synthesis, from which 130 models were extracted. The majority of papers were developed in the intensive care unit (ICU, n = 15; 54%), followed by hospital wards (n = 7; 25%), the emergency department (ED, n = 4; 14%) and all of these settings (n = 2; 7%). For the prediction of sepsis, diagnostic test accuracy assessed by the AUROC ranged from 0.68-0.99 in the ICU, to 0.96-0.98 in-hospital and 0.87 to 0.97 in the ED. Varying sepsis definitions limit pooling of the performance across studies. Only three papers clinically implemented models with mixed results. In the multivariate analysis, temperature, lab values, and model type contributed most to model performance. CONCLUSION This systematic review and meta-analysis show that on retrospective data, individual machine learning models can accurately predict sepsis onset ahead of time. Although they present alternatives to traditional scoring systems, between-study heterogeneity limits the assessment of pooled results. Systematic reporting and clinical implementation studies are needed to bridge the gap between bytes and bedside.
Collapse
|
36
|
Abstract
Big data (BD) in pediatric medication safety research provides many opportunities to improve the safety and health of children. The number of pediatric medication and device trials has increased in part because of the past 20 years of US legislation requiring and incentivizing study of the effects of medical products in children (Food and Drug Administration Modernization Act of 1997, Pediatric Rule in 1998, Best Pharmaceuticals for Children Act of 2002, and Pediatric Research Equity Act of 2003). There are some limitations of traditional approaches to studying medication safety in children. Randomized clinical trials within the regulatory context may not enroll patients who are representative of the general pediatric population, provide the power to detect rare safety signals, or provide long-term safety data. BD sources may have these capabilities. In recent years, medical records have become digitized, and cell phones and personal devices have proliferated. In this process, the field of biomedical science has progressively used BD from those records coupled with other data sources, both digital and traditional. Additionally, large distributed databases that include pediatric-specific outcome variables are available. A workshop entitled "Advancing the Development of Pediatric Therapeutics: Application of 'Big Data' to Pediatric Safety Studies" held September 18 to 19, 2017, in Silver Spring, Maryland, formed the basis of many of the ideas outlined in this article, which are intended to identify key examples, critical issues, and future directions in this early phase of an anticipated dramatic change in the availability and use of BD.
Collapse
|
37
|
Clinical applications of artificial intelligence in sepsis: A narrative review. Comput Biol Med 2019; 115:103488. [PMID: 31634699 DOI: 10.1016/j.compbiomed.2019.103488] [Citation(s) in RCA: 50] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2019] [Revised: 09/25/2019] [Accepted: 10/05/2019] [Indexed: 12/27/2022]
Abstract
Many studies have been published on a variety of clinical applications of artificial intelligence (AI) for sepsis, while there is no overview of the literature. The aim of this review is to give an overview of the literature and thereby identify knowledge gaps and prioritize areas with high priority for further research. A literature search was conducted in PubMed from inception to February 2019. Search terms related to AI were combined with terms regarding sepsis. Articles were included when they reported an area under the receiver operator characteristics curve (AUROC) as outcome measure. Fifteen articles on diagnosis of sepsis with AI models were included. The best performing model reached an AUROC of 0.97. There were also seven articles on prognosis, predicting mortality over time with an AUROC of up to 0.895. Finally, there were three articles on assistance of treatment of sepsis, where the use of AI was associated with the lowest mortality rates. Of the articles, twenty-two were judged to be at high risk of bias or had major concerns regarding applicability. This was mostly because predictor variables in these models, such as blood pressure, were also part of the definition of sepsis, which led to overestimation of the performance. We conclude that AI models have great potential for improving early identification of patients who may benefit from administration of antibiotics. Current AI prediction models to diagnose sepsis are at major risks of bias when the diagnosis criteria are part of the predictor variables in the model. Furthermore, generalizability of these models is poor due to overfitting and a lack of standardized protocols for the construction and validation of the models. Until these problems have been resolved, a large gap remains between the creation of an AI algorithm and its implementation in clinical practice.
Collapse
|
38
|
Differential gene expression analysis reveals novel genes and pathways in pediatric septic shock patients. Sci Rep 2019; 9:11270. [PMID: 31375728 PMCID: PMC6677896 DOI: 10.1038/s41598-019-47703-6] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/04/2019] [Accepted: 07/12/2019] [Indexed: 12/20/2022] Open
Abstract
Septic shock is a devastating health condition caused by uncontrolled sepsis. Advancements in high-throughput sequencing techniques have increased the number of potential genetic biomarkers under review. Multiple genetic markers and functional pathways play a part in development and progression of pediatric septic shock. We identified 53 differentially expressed pediatric septic shock biomarkers using gene expression data sampled from 181 patients admitted to the pediatric intensive care unit within the first 24 hours of their admission. The gene expression signatures showed discriminatory power between pediatric septic shock survivors and nonsurvivor types. Using functional enrichment analysis of differentially expressed genes, we validated the known genes and pathways in septic shock and identified the unexplored septic shock-related genes and functional groups. Differential gene expression analysis revealed the genes involved in the immune response, chemokine-mediated signaling, neutrophil chemotaxis, and chemokine activity and distinguished the septic shock survivor from non-survivor. The identification of the septic shock gene biomarkers may facilitate in septic shock diagnosis, treatment, and prognosis.
Collapse
|
39
|
Computational Health Engineering Applied to Model Infectious Diseases and Antimicrobial Resistance Spread. APPLIED SCIENCES-BASEL 2019. [DOI: 10.3390/app9122486] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
Infectious diseases are the primary cause of mortality worldwide. The dangers of infectious disease are compounded with antimicrobial resistance, which remains the greatest concern for human health. Although novel approaches are under investigation, the World Health Organization predicts that by 2050, septicaemia caused by antimicrobial resistant bacteria could result in 10 million deaths per year. One of the main challenges in medical microbiology is to develop novel experimental approaches, which enable a better understanding of bacterial infections and antimicrobial resistance. After the introduction of whole genome sequencing, there was a great improvement in bacterial detection and identification, which also enabled the characterization of virulence factors and antimicrobial resistance genes. Today, the use of in silico experiments jointly with computational and machine learning offer an in depth understanding of systems biology, allowing us to use this knowledge for the prevention, prediction, and control of infectious disease. Herein, the aim of this review is to discuss the latest advances in human health engineering and their applicability in the control of infectious diseases. An in-depth knowledge of host–pathogen–protein interactions, combined with a better understanding of a host’s immune response and bacterial fitness, are key determinants for halting infectious diseases and antimicrobial resistance dissemination.
Collapse
|
40
|
Improving Prediction Performance Using Hierarchical Analysis of Real-Time Data: A Sepsis Case Study. IEEE J Biomed Health Inform 2019; 23:978-986. [PMID: 30676988 DOI: 10.1109/jbhi.2019.2894570] [Citation(s) in RCA: 22] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
This paper presents a novel method for hierarchical analysis of machine learning algorithms to improve predictions of at risk patients, thus further enabling prompt therapy. Specifically, we develop a multi-layer machine learning approach to analyze continuous, high-frequency data. We illustrate the capabilities of this approach for early identification of patients at risk of sepsis, a potentially life-threatening complication of an infection, using high-frequency (minute-by-minute) physiological data collected from bedside monitors. In our analysis of a cohort of 586 patients, the model obtained from analyzing the output of a previously developed sepsis prediction model resulted in improved outcomes. Specifically, the original model failed to predict 11.76 ± 4.26% of sepsis patients earlier than Systemic Inflammatory Response Syndrome (SIRS) criteria, commonly used to identify patients at risk for rapid physiological deterioration resulting from sepsis. In contrast, the multi-layer model only failed to predict 3.21 ± 3.11% of sepsis patients earlier than SIRS. In addition, sepsis patients were predicted on average 204.87 ± 7.90 minutes earlier than SIRS criteria using the multi-layer model, which can potentially help reduce mortality and morbidity if implemented in the ICU.
Collapse
|