1
|
Zhang J, Jin Z, Tang B, Huang X, Wang Z, Chen Q, He J. Enhancing Trauma Care: A Machine Learning Approach with XGBoost for Predicting Urgent Hemorrhage Interventions Using NTDB Data. Bioengineering (Basel) 2024; 11:768. [PMID: 39199726 PMCID: PMC11352089 DOI: 10.3390/bioengineering11080768] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2024] [Revised: 07/21/2024] [Accepted: 07/25/2024] [Indexed: 09/01/2024] Open
Abstract
OBJECTIVE Trauma is a leading cause of death worldwide, with many incidents resulting in hemorrhage before the patient reaches the hospital. Despite advances in trauma care, the majority of deaths occur within the first three hours of hospital admission, offering a very limited window for effective intervention. Unfortunately, a significant increase in mortality from hemorrhagic trauma is primarily due to delays in hemorrhage control. Therefore, we propose a machine learning model to predict the need for urgent hemorrhage intervention. METHODS This study developed and validated an XGBoost-based machine learning model using data from the National Trauma Data Bank (NTDB) from 2017 to 2019. It focuses on demographic and clinical data from the initial hours following trauma for model training and validation, aiming to predict whether trauma patients require urgent hemorrhage intervention. RESULTS The XGBoost model demonstrated superior performance across multiple datasets, achieving an AUROC of 0.872 on the training set, 0.869 on the internal validation set, and 0.875 on the external validation set. The model also showed high sensitivity (77.8% on the external validation set) and specificity (82.1% on the external validation set), with an accuracy exceeding 81% across all datasets, highlighting its high reliability for clinical applications. CONCLUSIONS Our study shows that the XGBoost model effectively predicts urgent hemorrhage interventions using data from the National Trauma Data Bank (NTDB). It outperforms other machine learning algorithms in accuracy and robustness across various datasets. These results highlight machine learning's potential to improve emergency responses and decision-making in trauma care.
Collapse
Affiliation(s)
- Jin Zhang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Zhichao Jin
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Bihan Tang
- Department of Health Management, Naval Medical University, Shanghai 200433, China;
| | - Xiangtong Huang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Zongyu Wang
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Qi Chen
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| | - Jia He
- School of Health Sciences and Engineering, University of Shanghai for Science and Technology, Shanghai 200000, China; (J.Z.); (X.H.); (Z.W.)
- Department of Health Statistics, Naval Medical University, Shanghai 200433, China;
| |
Collapse
|
2
|
Zhang T, Zhu L, Wang X, Zhang X, Wang Z, Xu S, Jiao W. Machine learning models to predict systemic inflammatory response syndrome after percutaneous nephrolithotomy. BMC Urol 2024; 24:140. [PMID: 38972999 PMCID: PMC11229268 DOI: 10.1186/s12894-024-01529-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2023] [Accepted: 07/01/2024] [Indexed: 07/09/2024] Open
Abstract
OBJECTIVE The objective of this study was to develop and evaluate the performance of machine learning models for predicting the possibility of systemic inflammatory response syndrome (SIRS) following percutaneous nephrolithotomy (PCNL). METHODS We retrospectively reviewed the clinical data of 337 patients who received PCNL between May 2020 and June 2022. In our study, 80% of the data were used as the training set, and the remaining data were used as the testing set. Separate prediction models based on the six machine learning algorithms were created using the training set. The predictive performance of each machine learning model was determined by the area under the receiver operating characteristic curve (AUC), accuracy, sensitivity and specificity using the testing set. We used coefficients to interpret the contribution of each variable to the predictive performance. RESULTS Among the six machine learning algorithms, the support vector machine (SVM) delivered the best performance with accuracy of 0.868, AUC of 0.942 (95% CI 0.890-0.994) in the testing set. Further analysis using the SVM model showed that prealbumin contributed the most to the prediction of the outcome, followed by preoperative urine culture, systemic immune-inflammation (SII), neutrophil to lymphocyte ratio (NLR), staghorn stones, fibrinogen, operation time, preoperative urine white blood cell (WBC), preoperative urea nitrogen, hydronephrosis, stone burden, sex and preoperative lymphocyte count. CONCLUSION Machine learning-based prediction models can accurately predict the possibility of SIRS after PCNL in advance by learning patient clinical data, and should be used to guide surgeons in clinical decision-making.
Collapse
Affiliation(s)
- Tianwei Zhang
- Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Ling Zhu
- Shandong Key Laboratory of Digital Medicine and Computer Assisted Surgery, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Xinning Wang
- Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Xiaofei Zhang
- Department of Education and Training, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Zijie Wang
- Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Shang Xu
- Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China
| | - Wei Jiao
- Department of Urology, The Affiliated Hospital of Qingdao University, Qingdao, China.
| |
Collapse
|
3
|
Shang X, Zhang C, Kong R, Zhao C, Wang H. Construction of a Diagnostic Model for Small Cell Lung Cancer Combining Metabolomics and Integrated Machine Learning. Oncologist 2024; 29:e392-e401. [PMID: 37706531 PMCID: PMC10911920 DOI: 10.1093/oncolo/oyad261] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2022] [Accepted: 08/09/2023] [Indexed: 09/15/2023] Open
Abstract
BACKGROUND To date, no study has systematically explored the potential role of serum metabolites and lipids in the diagnosis of small cell lung cancer (SCLC). Therefore, we aimed to conduct a case-cohort study that included 191 cases of SCLC, 91 patients with lung adenocarcinoma, 82 patients with squamous cell carcinoma, and 97 healthy controls. METHODS Metabolomics and lipidomics were applied to analyze different metabolites and lipids in the serum of these patients. The SCLC diagnosis model (d-model) was constructed using an integrated machine learning technology and a training cohort (n = 323) and was validated in a testing cohort (n=138). RESULTS Eight metabolites, including 1-mristoyl-sn-glycero-3-phosphocholine, 16b-hydroxyestradiol, 3-phosphoserine, cholesteryl sulfate, D-lyxose, dioctyl phthalate, DL-lactate and Leu-Phe, were successfully selected to distinguish SCLC from controls. The d-model was constructed based on these 8 metabolites and showed improved diagnostic performance for SCLC, with the area under curve (AUC) of 0.933 in the training cohort and 0.922 in the testing cohort. Importantly, the d-model still had an excellent diagnostic performance after adjusting the stage and related clinical variables and, combined with the progastrin-releasing peptide (ProGRP), showed the best diagnostic performance with 0.975 of AUC for limited-stage patients. CONCLUSION This study is the first to analyze the difference between metabolomics and lipidomics and to construct a d-model to detect SCLC using integrated machine learning. This study may be of great significance for the screening and early diagnosis of SCLC patients.
Collapse
Affiliation(s)
- Xiaoling Shang
- Department of Clinical Laboratory, Shandong Cancer Hospital and Institute, Shandong University, Jinan, People’s Republic of China
| | - Chenyue Zhang
- Department of Integrated Therapy, Fudan University Shanghai Cancer Center, Shanghai Medical College, Shanghai, People’s Republic of China
| | - Ronghua Kong
- Department of Breast Surgery, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, People’s Republic of China
| | - Chenglong Zhao
- Department of Pathology, The First Affiliated Hospital of Shandong First Medical University and Shandong Provincial Qianfoshan Hospital, Jinan, Shandong, People’s Republic of China
| | - Haiyong Wang
- Department of Internal Medicine-Oncology, Shandong Cancer Hospital and Institute, Shandong First Medical University and Shandong Academy of Medical Sciences, Jinan, People’s Republic of China
| |
Collapse
|
4
|
Arina P, Kaczorek MR, Hofmaenner DA, Pisciotta W, Refinetti P, Singer M, Mazomenos EB, Whittle J. Prediction of Complications and Prognostication in Perioperative Medicine: A Systematic Review and PROBAST Assessment of Machine Learning Tools. Anesthesiology 2024; 140:85-101. [PMID: 37944114 PMCID: PMC11146190 DOI: 10.1097/aln.0000000000004764] [Citation(s) in RCA: 15] [Impact Index Per Article: 15.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Indexed: 11/12/2023]
Abstract
BACKGROUND The utilization of artificial intelligence and machine learning as diagnostic and predictive tools in perioperative medicine holds great promise. Indeed, many studies have been performed in recent years to explore the potential. The purpose of this systematic review is to assess the current state of machine learning in perioperative medicine, its utility in prediction of complications and prognostication, and limitations related to bias and validation. METHODS A multidisciplinary team of clinicians and engineers conducted a systematic review using the Preferred Reporting Items for Systematic Review and Meta-Analysis (PRISMA) protocol. Multiple databases were searched, including Scopus, Cumulative Index to Nursing and Allied Health Literature (CINAHL), the Cochrane Library, PubMed, Medline, Embase, and Web of Science. The systematic review focused on study design, type of machine learning model used, validation techniques applied, and reported model performance on prediction of complications and prognostication. This review further classified outcomes and machine learning applications using an ad hoc classification system. The Prediction model Risk Of Bias Assessment Tool (PROBAST) was used to assess risk of bias and applicability of the studies. RESULTS A total of 103 studies were identified. The models reported in the literature were primarily based on single-center validations (75%), with only 13% being externally validated across multiple centers. Most of the mortality models demonstrated a limited ability to discriminate and classify effectively. The PROBAST assessment indicated a high risk of systematic errors in predicted outcomes and artificial intelligence or machine learning applications. CONCLUSIONS The findings indicate that the development of this field is still in its early stages. This systematic review indicates that application of machine learning in perioperative medicine is still at an early stage. While many studies suggest potential utility, several key challenges must be first overcome before their introduction into clinical practice. EDITOR’S PERSPECTIVE
Collapse
Affiliation(s)
- Pietro Arina
- Bloomsbury Institute of Intensive Care Medicine and Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| | - Maciej R. Kaczorek
- Wellcome/EPSRC Centre of Interventional and Surgical Sciences and Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - Daniel A. Hofmaenner
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom; and Institute of Intensive Care Medicine, University Hospital Zurich, Zurich, Switzerland
| | - Walter Pisciotta
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom
| | - Patricia Refinetti
- Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| | - Mervyn Singer
- Bloomsbury Institute of Intensive Care Medicine, University College London, London, United Kingdom
| | - Evangelos B. Mazomenos
- Wellcome/EPSRC Centre of Interventional and Surgical Sciences and Department of Medical Physics and Biomedical Engineering, University College London, London, United Kingdom
| | - John Whittle
- Human Physiology and Performance Laboratory, Centre for Perioperative Medicine, Department of Targeted Intervention, University College London, London, United Kingdom
| |
Collapse
|
5
|
Rodriguez J, Schulz S, Voss A, Herrera S, Benito S, Giraldo BF. Baroreflex activity through the analysis of the cardio-respiratory variability influence over blood pressure in cardiomyopathy patients. Front Physiol 2023; 14:1184293. [PMID: 37637149 PMCID: PMC10456872 DOI: 10.3389/fphys.2023.1184293] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2023] [Accepted: 06/01/2023] [Indexed: 08/29/2023] Open
Abstract
A large portion of the elderly population are affected by cardiovascular diseases. Early prognosis of cardiomyopathies remains a challenge. The aim of this study was to classify cardiomyopathy patients by their etiology based on significant indexes extracted from the characterization of the baroreflex mechanism in function of the influence of the cardio-respiratory activity over the blood pressure. Forty-one cardiomyopathy patients (CMP) classified as ischemic (ICM-24 patients) and dilated (DCM-17 patients) were considered. In addition, thirty-nine control (CON) subjects were used as reference. The beat-to-beat (BBI) time series, from the electrocardiographic (ECG) signal, the systolic (SBP), and diastolic (DBP) time series, from the blood pressure signal (BP), and the respiratory time (TT), from the respiratory flow (RF) signal, were extracted. The three-dimensional representation of the cardiorespiratory and vascular activities was characterized geometrically, by fitting a polygon that contains 95% of data, and by statistical descriptive indices. DCM patients presented specific patterns in the respiratory response to decreasing blood pressure activity. ICM patients presented more stable cardiorespiratory activity in comparison with DCM patients. In general, CMP shown limited ability to regulate changes in blood pressure. In addition, patients also shown a limited ability of their cardiac and respiratory systems response to regulate incremental changes of the vascular variability and a lower heart rate variability. The best classifiers were used to build support vector machine models. The optimal model to classify ICM versus DCM patients achieved 92.7% accuracy, 94.1% sensitivity, and 91.7% specificity. When comparing CMP patients and CON subjects, the best model achieved 86.2% accuracy, 82.9% sensitivity, and 89.7% specificity. When comparing ICM patients and CON subjects, the best model achieved 88.9% accuracy, 87.5% sensitivity, and 89.7% specificity. When comparing DCM patients and CON subjects, the best model achieved 87.5% accuracy, 76.5% sensitivity, and 92.3% specificity. In conclusion, this study introduced a new method for the classification of patients by their etiology based on new indices from the analysis of the baroreflex mechanism.
Collapse
Affiliation(s)
- Javier Rodriguez
- Automatic Control Department (ESAII), Barcelona East School of Engineering (EEBE), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
- Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology, Barcelona, Spain
| | - Steffen Schulz
- Institute of Innovative Health Technologies, Jena, Germany
| | - Andreas Voss
- Institute of Innovative Health Technologies, Jena, Germany
| | | | | | - Beatriz F. Giraldo
- Automatic Control Department (ESAII), Barcelona East School of Engineering (EEBE), Universitat Politècnica de Catalunya (UPC), Barcelona, Spain
- Institute for Bioengineering of Catalonia (IBEC), The Barcelona Institute of Science and Technology, Barcelona, Spain
- CIBER de Bioengenieria, Biomateriales y Nanomedicina (CIBER-BBN), Barcelona, Spain
| |
Collapse
|
6
|
Hassan AM, Rajesh A, Asaad M, Jonas NA, Coert JH, Mehrara BJ, Butler CE. A Surgeon's Guide to Artificial Intelligence-Driven Predictive Models. Am Surg 2023; 89:11-19. [PMID: 35588764 PMCID: PMC9674797 DOI: 10.1177/00031348221103648] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
Artificial intelligence (AI) focuses on processing and interpreting complex information as well as identifying relationships and patterns among complex data. Artificial intelligence- and machine learning (ML)-driven predictions have shown promising potential in influencing real-time decisions and improving surgical outcomes by facilitating screening, diagnosis, risk assessment, preoperative planning, and shared decision-making. Fundamental understanding of the algorithms, as well as their development and interpretation, is essential for the evolution of AI in surgery. In this article, we provide surgeons with a fundamental understanding of AI-driven predictive models through an overview of common ML and deep learning algorithms, model development, performance metrics and interpretation. This would serve as a basis for understanding ML-based research, while fostering new ideas and innovations for furthering the reach of this emerging discipline.
Collapse
Affiliation(s)
- Abbas M. Hassan
- Department of Plastic & Reconstructive Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| | - Aashish Rajesh
- Department of Surgery, University of Texas Health Science Center, San Antonio, TX, USA
| | - Malke Asaad
- Department of Plastic Surgery, University of Pittsburgh Medical Center, Pittsburgh, PA, USA
| | - Nelson A. Jonas
- Department of Plastic & Reconstructive Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - J. Henk Coert
- Department of Plastic and Reconstructive Surgery, University Medical Center Utrecht, Utrecht, Netherlands
| | - Babak J. Mehrara
- Department of Plastic & Reconstructive Surgery, Memorial Sloan Kettering Cancer Center, New York, NY
| | - Charles E. Butler
- Department of Plastic & Reconstructive Surgery, The University of Texas MD Anderson Cancer Center, Houston, TX, USA
| |
Collapse
|